2024-03-28T21:37:20.130 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-28T21:37:20.130 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059 --owner scheduled_teuthology@teuthology --verbose --name teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} -- /home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059/orig.config.yaml 2024-03-28T21:37:20.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:37:20.258 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: ceph-qa@ceph.com first_in_suite: false job_id: '7627059' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 323d23dc228bbcb7f16f188fdc9c0dcb801844be ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 323d23dc228bbcb7f16f188fdc9c0dcb801844be kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 55f5138942aa4866e49329c9103468889cec3f73 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7214 sha1: 323d23dc228bbcb7f16f188fdc9c0dcb801844be sleep_before_teardown: 0 subset: 39/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 55f5138942aa4866e49329c9103468889cec3f73 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNyOn+XjEEeviiRfh8n2NmY+aed5azVsvfvaq3kTllg3aA9QgGG2vUXMxHMAGJOgP1qq2fzaLhDYXpFLDGi22ZE= smithi165.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPK0PWKqju/yAHgFV04dllBlqvQvg+g5UAX7WuVR1JQ61iINE4wq0MbSs4qy2l8xIk/fXIda2zvHNEWJxHU/dWQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-27_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-28T21:37:20.259 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa; will attempt to use it 2024-03-28T21:37:20.259 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks 2024-03-28T21:37:20.259 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-28T21:37:20.261 INFO:teuthology.task.internal:Checking packages... 2024-03-28T21:37:20.287 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '323d23dc228bbcb7f16f188fdc9c0dcb801844be' 2024-03-28T21:37:20.287 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-28T21:37:20.287 INFO:teuthology.packaging:ref: None 2024-03-28T21:37:20.287 INFO:teuthology.packaging:tag: None 2024-03-28T21:37:20.287 INFO:teuthology.packaging:branch: squid 2024-03-28T21:37:20.287 INFO:teuthology.packaging:sha1: 323d23dc228bbcb7f16f188fdc9c0dcb801844be 2024-03-28T21:37:20.287 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-03-28T21:37:20.463 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1959.g8da23624 2024-03-28T21:37:20.464 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-28T21:37:20.473 INFO:teuthology.task.internal:no buildpackages task found 2024-03-28T21:37:20.474 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-28T21:37:20.490 INFO:teuthology.task.internal:Saving configuration 2024-03-28T21:37:20.507 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-28T21:37:20.517 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-28T21:37:20.534 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-28 21:32:12.138608', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNyOn+XjEEeviiRfh8n2NmY+aed5azVsvfvaq3kTllg3aA9QgGG2vUXMxHMAGJOgP1qq2fzaLhDYXpFLDGi22ZE='} 2024-03-28T21:37:20.551 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi165.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-28 21:32:12.137257', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPK0PWKqju/yAHgFV04dllBlqvQvg+g5UAX7WuVR1JQ61iINE4wq0MbSs4qy2l8xIk/fXIda2zvHNEWJxHU/dWQ='} 2024-03-28T21:37:20.551 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-28T21:37:20.562 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-28T21:37:20.562 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-28T21:37:20.562 INFO:teuthology.run_tasks:Running task console_log... 2024-03-28T21:37:20.627 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fee68b2f0d0>, signals=[15]) 2024-03-28T21:37:20.628 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-28T21:37:20.638 INFO:teuthology.task.internal:Opening connections... 2024-03-28T21:37:20.638 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-03-28T21:37:20.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T21:37:20.732 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi165.front.sepia.ceph.com 2024-03-28T21:37:20.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T21:37:20.824 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-28T21:37:20.833 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-03-28T21:37:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-03-28T21:37:20.850 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-03-28T21:37:20.908 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-03-28T21:37:20.908 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-03-28T21:37:20.908 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-03-28T21:37:20.908 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-03-28T21:37:20.908 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-03-28T21:37:20.908 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-03-28T21:37:20.908 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-28T21:37:20.908 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-03-28T21:37:20.909 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-03-28T21:37:20.909 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-28T21:37:20.909 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-03-28T21:37:20.909 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-28T21:37:20.909 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-28T21:37:20.909 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-28T21:37:20.909 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-03-28T21:37:21.003 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2024-03-28T21:37:21.021 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2024-03-28T21:37:21.021 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-03-28T21:37:21.078 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-03-28T21:37:21.079 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9" 2024-03-28T21:37:21.079 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-03-28T21:37:21.079 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-03-28T21:37:21.079 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9" 2024-03-28T21:37:21.079 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9" 2024-03-28T21:37:21.079 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-28T21:37:21.079 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-03-28T21:37:21.079 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon" 2024-03-28T21:37:21.079 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-28T21:37:21.079 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-03-28T21:37:21.079 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-28T21:37:21.079 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-28T21:37:21.079 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-28T21:37:21.080 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-03-28T21:37:21.097 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-28T21:37:21.111 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-28T21:37:21.125 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-28T21:37:21.125 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-03-28T21:37:21.128 DEBUG:teuthology.orchestra.run.smithi165:> test '!' -e /home/ubuntu/cephtest 2024-03-28T21:37:21.144 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-28T21:37:21.155 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-28T21:37:21.156 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-03-28T21:37:21.185 DEBUG:teuthology.orchestra.run.smithi165:> test -z $(ls -A /var/lib/ceph) 2024-03-28T21:37:21.296 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-28T21:37:21.344 INFO:teuthology.run_tasks:Running task kernel... 2024-03-28T21:37:21.361 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-03-28T21:37:21.361 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-03-28T21:37:21.361 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-03-28T21:37:21.361 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-28T21:37:21.362 DEBUG:teuthology.orchestra.run.smithi165:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-28T21:37:21.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T21:37:21.379 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-28T21:37:21.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T21:37:21.383 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-28T21:37:21.670 DEBUG:teuthology.task.kernel:sha1 for client.1 is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T21:37:21.670 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-28T21:37:21.670 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-03-28T21:37:21.677 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T21:37:21.677 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-28T21:37:21.677 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-03-28T21:37:21.687 INFO:teuthology.orchestra.run.smithi165.stdout:5.14.0-361.el9.x86_64 2024-03-28T21:37:21.688 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T21:37:21.688 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-28T21:37:21.688 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum upgrade -y linux-firmware 2024-03-28T21:37:21.694 INFO:teuthology.orchestra.run.smithi153.stdout:5.14.0-361.el9.x86_64 2024-03-28T21:37:21.694 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T21:37:21.694 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-28T21:37:21.695 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum upgrade -y linux-firmware 2024-03-28T21:37:24.082 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-9 - AppStream 9.5 MB/s | 6.7 MB 00:00 2024-03-28T21:37:24.505 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - AppStream 5.8 MB/s | 6.7 MB 00:01 2024-03-28T21:37:25.524 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2024-03-28T21:37:26.080 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2024-03-28T21:37:27.107 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.0 MB 00:01 2024-03-28T21:37:30.211 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.0 MB 00:03 2024-03-28T21:37:44.747 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:16 2024-03-28T21:37:48.905 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.1 MB 00:00 2024-03-28T21:37:50.373 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 16 kB 00:00 2024-03-28T21:37:52.215 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-03-28T21:37:53.559 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 868 kB/s | 19 MB 00:22 2024-03-28T21:37:57.140 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-03-28T21:37:58.076 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 6.1 MB 00:01 2024-03-28T21:37:59.585 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-03-28T21:37:59.598 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-03-28T21:37:59.598 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-03-28T21:37:59.598 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-03-28T21:37:59.598 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrading: 2024-03-28T21:37:59.598 INFO:teuthology.orchestra.run.smithi165.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-28T21:37:59.598 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:37:59.598 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-03-28T21:37:59.598 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-03-28T21:37:59.598 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrade 1 Package 2024-03-28T21:37:59.598 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:37:59.598 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 375 M 2024-03-28T21:37:59.598 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-03-28T21:37:59.652 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-03-28T21:38:02.740 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 7.0 MB/s | 21 MB 00:02 2024-03-28T21:38:07.728 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-03-28T21:38:10.016 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-03-28T21:38:10.027 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-03-28T21:38:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-03-28T21:38:10.027 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-03-28T21:38:10.027 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-03-28T21:38:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-28T21:38:10.027 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:38:10.027 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-03-28T21:38:10.027 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-03-28T21:38:10.028 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 1 Package 2024-03-28T21:38:10.028 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:38:10.028 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 375 M 2024-03-28T21:38:10.028 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-03-28T21:38:11.681 INFO:teuthology.orchestra.run.smithi165.stdout:linux-firmware-20240219-143.el9.noarch.rpm 31 MB/s | 375 MB 00:12 2024-03-28T21:38:11.682 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-03-28T21:38:11.682 INFO:teuthology.orchestra.run.smithi165.stdout:Total 31 MB/s | 375 MB 00:12 2024-03-28T21:38:11.683 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-03-28T21:38:11.784 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-03-28T21:38:11.784 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-03-28T21:38:14.265 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-03-28T21:38:14.265 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-03-28T21:38:20.744 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-03-28T21:38:21.056 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-28T21:38:21.147 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T21:38:22.357 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T21:38:22.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-28T21:38:22.494 INFO:teuthology.orchestra.run.smithi153.stdout:linux-firmware-20240219-143.el9.noarch.rpm 30 MB/s | 375 MB 00:12 2024-03-28T21:38:22.495 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-03-28T21:38:22.496 INFO:teuthology.orchestra.run.smithi153.stdout:Total 30 MB/s | 375 MB 00:12 2024-03-28T21:38:22.496 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-03-28T21:38:22.599 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-03-28T21:38:22.600 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-03-28T21:38:22.765 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T21:38:22.766 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:38:22.766 INFO:teuthology.orchestra.run.smithi165.stdout:Upgraded: 2024-03-28T21:38:22.766 INFO:teuthology.orchestra.run.smithi165.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-28T21:38:22.766 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:38:22.766 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-03-28T21:38:23.053 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.1... 2024-03-28T21:38:23.054 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T21:38:23.211 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-28T21:38:23.211 DEBUG:teuthology.orchestra.run.smithi165:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-28T21:38:23.214 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi165.front.sepia.ceph.com to complete... 2024-03-28T21:38:25.098 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-03-28T21:38:25.099 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-03-28T21:38:31.391 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-03-28T21:38:31.635 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-28T21:38:31.718 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T21:38:32.919 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T21:38:32.919 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-28T21:38:33.338 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T21:38:33.338 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:38:33.338 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-03-28T21:38:33.338 INFO:teuthology.orchestra.run.smithi153.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-28T21:38:33.339 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:38:33.339 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-03-28T21:38:33.610 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.0... 2024-03-28T21:38:33.610 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T21:38:33.753 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-28T21:38:33.753 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-28T21:38:33.756 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi153.front.sepia.ceph.com to complete... 2024-03-28T21:39:02.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28 21:39:02 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-28T21:39:02.872 INFO:teuthology.orchestra.run.smithi153.stderr:FINISHED --2024-03-28 21:39:02-- 2024-03-28T21:39:02.872 INFO:teuthology.orchestra.run.smithi153.stderr:Total wall clock time: 29s 2024-03-28T21:39:02.872 INFO:teuthology.orchestra.run.smithi153.stderr:Downloaded: 1 files, 321M in 29s (11.1 MB/s) 2024-03-28T21:39:02.875 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.0... 2024-03-28T21:39:02.876 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-28T21:39:04.817 INFO:teuthology.orchestra.run.smithi153.stdout:Verifying... ######################################## 2024-03-28T21:39:04.878 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing... ######################################## 2024-03-28T21:39:04.957 INFO:teuthology.orchestra.run.smithi153.stdout:Updating / installing... 2024-03-28T21:39:12.490 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-28T21:39:25.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28 21:39:25 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-28T21:39:25.783 INFO:teuthology.orchestra.run.smithi165.stderr:FINISHED --2024-03-28 21:39:25-- 2024-03-28T21:39:25.783 INFO:teuthology.orchestra.run.smithi165.stderr:Total wall clock time: 1m 3s 2024-03-28T21:39:25.783 INFO:teuthology.orchestra.run.smithi165.stderr:Downloaded: 1 files, 321M in 1m 2s (5.18 MB/s) 2024-03-28T21:39:25.786 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.1... 2024-03-28T21:39:25.789 DEBUG:teuthology.orchestra.run.smithi165:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-28T21:39:26.176 INFO:teuthology.orchestra.run.smithi153.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-28T21:39:27.723 INFO:teuthology.orchestra.run.smithi165.stdout:Verifying... ######################################## 2024-03-28T21:39:27.789 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing... ######################################## 2024-03-28T21:39:27.869 INFO:teuthology.orchestra.run.smithi165.stdout:Updating / installing... 2024-03-28T21:39:35.445 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-28T21:39:48.659 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-28T21:39:48.660 DEBUG:teuthology.orchestra.run.smithi153:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-28T21:39:48.728 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-28T21:39:48.728 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-28T21:39:48.728 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-28T21:39:48.728 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-28T21:39:48.728 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-28T21:39:48.728 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-28T21:39:48.728 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-28T21:39:48.728 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-28T21:39:48.728 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-28T21:39:48.728 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-28T21:39:48.728 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-28T21:39:48.728 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-28T21:39:48.728 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-28T21:39:48.728 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-28T21:39:48.729 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-28T21:39:48.730 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-28T21:39:48.731 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-28T21:39:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-28T21:39:48.733 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-28T21:39:48.734 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-28T21:39:48.735 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-28T21:39:48.736 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-28T21:39:48.737 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-28T21:39:48.738 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-28T21:39:48.739 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-28T21:39:48.740 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-28T21:39:48.741 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-28T21:39:48.742 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-28T21:39:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-28T21:39:48.744 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-28T21:39:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-28T21:39:48.746 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-28T21:39:48.746 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-28T21:39:48.746 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-28T21:39:48.746 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-28T21:39:48.746 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-28T21:39:48.746 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-28T21:39:48.746 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-28T21:39:48.746 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-28T21:39:48.746 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-28T21:39:48.746 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-28T21:39:48.746 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-28T21:39:48.746 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-28T21:39:48.746 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-28T21:39:48.746 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-28T21:39:48.747 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-28T21:39:48.748 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-28T21:39:48.749 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-28T21:39:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-28T21:39:48.751 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-28T21:39:48.752 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-28T21:39:48.753 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-28T21:39:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-28T21:39:48.755 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-28T21:39:48.756 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-28T21:39:48.757 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-28T21:39:48.758 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-28T21:39:48.759 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-28T21:39:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-28T21:39:48.761 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-28T21:39:48.762 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-28T21:39:48.763 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-28T21:39:48.764 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-28T21:39:48.765 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-28T21:39:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-28T21:39:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-28T21:39:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-28T21:39:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-28T21:39:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-28T21:39:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-28T21:39:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-28T21:39:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-28T21:39:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-28T21:39:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-28T21:39:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-28T21:39:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-28T21:39:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-28T21:39:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-28T21:39:48.767 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-28T21:39:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-28T21:39:48.769 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-28T21:39:48.770 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-28T21:39:48.770 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-28T21:39:48.770 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-28T21:39:48.770 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-28T21:39:48.770 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-28T21:39:48.770 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-28T21:39:48.770 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-28T21:39:48.770 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-28T21:39:48.770 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-28T21:39:48.770 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-28T21:39:48.770 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-28T21:39:48.770 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-28T21:39:48.770 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-28T21:39:48.770 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-28T21:39:48.771 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-28T21:39:48.772 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-28T21:39:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-28T21:39:48.774 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-28T21:39:48.774 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-28T21:39:48.774 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-28T21:39:48.774 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-28T21:39:48.774 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-28T21:39:48.774 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-28T21:39:48.774 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-28T21:39:48.774 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-28T21:39:48.774 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-28T21:39:48.774 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-28T21:39:48.774 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-28T21:39:48.774 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-28T21:39:48.774 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-28T21:39:48.774 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-28T21:39:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-28T21:39:48.776 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-28T21:39:48.776 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-28T21:39:48.776 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-28T21:39:48.776 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-28T21:39:48.776 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-28T21:39:48.776 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-28T21:39:48.776 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-28T21:39:48.776 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-28T21:39:48.776 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-28T21:39:48.776 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-28T21:39:48.776 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-28T21:39:48.776 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-28T21:39:48.776 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-28T21:39:48.777 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-28T21:39:48.778 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-28T21:39:48.778 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-28T21:39:48.778 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-28T21:39:48.778 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-28T21:39:48.778 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-28T21:39:48.778 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-28T21:39:48.778 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-28T21:39:48.778 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-28T21:39:48.778 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-28T21:39:48.778 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-28T21:39:48.778 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-28T21:39:48.778 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-28T21:39:48.778 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-28T21:39:48.778 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-28T21:39:48.779 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-28T21:39:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-28T21:39:48.781 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-28T21:39:48.782 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-28T21:39:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-28T21:39:48.784 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-28T21:39:48.785 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-28T21:39:48.786 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-28T21:39:48.787 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-28T21:39:48.788 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-28T21:39:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-28T21:39:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-28T21:39:48.791 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-28T21:39:48.791 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-28T21:39:48.791 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-28T21:39:48.791 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-28T21:39:48.791 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-28T21:39:48.791 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-28T21:39:48.791 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-28T21:39:48.791 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-28T21:39:48.791 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-28T21:39:48.791 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-28T21:39:48.791 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-28T21:39:48.791 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-28T21:39:48.791 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-28T21:39:48.791 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-28T21:39:48.792 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-28T21:39:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-28T21:39:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-28T21:39:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-28T21:39:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-28T21:39:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-28T21:39:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-28T21:39:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-28T21:39:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-28T21:39:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-28T21:39:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-28T21:39:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-28T21:39:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-28T21:39:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-28T21:39:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-28T21:39:48.794 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-28T21:39:48.795 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-28T21:39:48.796 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-28T21:39:48.797 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-28T21:39:48.798 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-28T21:39:48.799 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-28T21:39:48.800 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-28T21:39:48.801 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-28T21:39:48.802 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-28T21:39:48.803 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-28T21:39:48.804 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-28T21:39:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-28T21:39:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-28T21:39:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-28T21:39:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-28T21:39:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-28T21:39:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-28T21:39:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-28T21:39:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-28T21:39:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-28T21:39:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-28T21:39:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-28T21:39:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-28T21:39:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-28T21:39:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-28T21:39:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-28T21:39:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-28T21:39:48.808 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-28T21:39:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-28T21:39:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-28T21:39:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-28T21:39:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-28T21:39:48.813 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-28T21:39:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-28T21:39:48.815 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-28T21:39:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-28T21:39:48.817 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-28T21:39:48.818 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-28T21:39:48.819 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-28T21:39:48.820 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-28T21:39:48.821 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-28T21:39:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-28T21:39:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-28T21:39:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-28T21:39:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-28T21:39:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-28T21:39:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-28T21:39:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-28T21:39:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-28T21:39:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-28T21:39:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-28T21:39:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-28T21:39:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-28T21:39:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-28T21:39:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-28T21:39:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-28T21:39:48.824 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-28T21:39:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-28T21:39:48.826 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-28T21:39:48.826 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-28T21:39:48.826 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-28T21:39:48.826 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-28T21:39:48.826 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-28T21:39:48.826 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-28T21:39:48.826 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-28T21:39:48.826 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-28T21:39:48.826 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-28T21:39:48.826 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-28T21:39:48.826 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-28T21:39:48.826 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-28T21:39:48.826 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-28T21:39:48.826 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-28T21:39:48.827 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-28T21:39:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-28T21:39:48.829 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-28T21:39:48.830 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-28T21:39:48.830 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-28T21:39:48.830 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-28T21:39:48.830 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-28T21:39:48.830 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-28T21:39:48.830 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-28T21:39:48.830 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-28T21:39:48.830 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-28T21:39:48.830 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-28T21:39:48.830 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-28T21:39:48.830 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-28T21:39:48.830 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-28T21:39:48.830 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-28T21:39:48.830 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-28T21:39:48.831 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-28T21:39:48.832 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-28T21:39:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-28T21:39:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-28T21:39:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-28T21:39:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-28T21:39:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-28T21:39:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-28T21:39:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-28T21:39:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-28T21:39:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-28T21:39:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-28T21:39:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-28T21:39:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-28T21:39:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-28T21:39:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-28T21:39:48.834 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-28T21:39:48.834 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-28T21:39:48.834 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-28T21:39:48.834 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-28T21:39:48.834 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-28T21:39:48.834 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-28T21:39:48.834 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-28T21:39:48.834 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-28T21:39:48.834 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-28T21:39:48.834 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-28T21:39:48.834 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-28T21:39:48.834 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-28T21:39:48.834 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-28T21:39:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-28T21:39:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-28T21:39:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-28T21:39:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-28T21:39:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-28T21:39:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-28T21:39:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-28T21:39:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-28T21:39:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-28T21:39:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-28T21:39:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-28T21:39:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-28T21:39:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-28T21:39:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-28T21:39:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-28T21:39:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-28T21:39:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-28T21:39:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-28T21:39:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-28T21:39:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-28T21:39:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-28T21:39:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-28T21:39:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-28T21:39:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-28T21:39:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-28T21:39:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-28T21:39:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-28T21:39:48.836 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-28T21:39:48.837 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-28T21:39:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-28T21:39:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-28T21:39:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-28T21:39:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-28T21:39:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-28T21:39:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-28T21:39:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-28T21:39:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-28T21:39:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-28T21:39:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-28T21:39:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-28T21:39:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-28T21:39:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-28T21:39:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-28T21:39:48.839 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-28T21:39:48.840 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-28T21:39:48.841 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-28T21:39:48.842 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-28T21:39:48.842 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-28T21:39:48.842 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-28T21:39:48.842 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-28T21:39:48.842 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-28T21:39:48.842 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-28T21:39:48.842 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-28T21:39:48.842 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-28T21:39:48.842 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-28T21:39:48.842 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-28T21:39:48.842 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-28T21:39:48.842 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-28T21:39:48.842 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-28T21:39:48.842 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-28T21:39:48.843 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-28T21:39:48.844 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-28T21:39:48.845 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-28T21:39:48.846 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-28T21:39:48.846 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-28T21:39:48.846 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-28T21:39:48.846 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-28T21:39:48.846 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-28T21:39:48.846 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-28T21:39:48.846 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-28T21:39:48.846 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-28T21:39:48.846 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-28T21:39:48.846 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-28T21:39:48.846 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-28T21:39:48.846 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-28T21:39:48.846 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-28T21:39:48.846 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-28T21:39:48.847 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-28T21:39:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-28T21:39:48.849 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-28T21:39:48.849 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-28T21:39:48.849 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-28T21:39:48.849 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-28T21:39:48.849 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-28T21:39:48.849 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-28T21:39:48.849 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-28T21:39:48.849 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-28T21:39:48.849 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-28T21:39:48.849 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-28T21:39:48.849 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-28T21:39:48.849 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-28T21:39:48.849 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-28T21:39:48.849 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-28T21:39:48.850 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-28T21:39:48.850 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-28T21:39:48.850 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-28T21:39:48.850 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-28T21:39:48.850 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-28T21:39:48.850 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-28T21:39:48.850 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-28T21:39:48.850 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-28T21:39:48.850 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-28T21:39:48.850 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-28T21:39:48.850 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-28T21:39:48.850 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-28T21:39:48.850 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-28T21:39:48.850 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-28T21:39:48.851 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-28T21:39:48.852 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-28T21:39:48.852 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-28T21:39:48.852 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-28T21:39:48.852 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-28T21:39:48.852 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-28T21:39:48.852 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-28T21:39:48.852 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-28T21:39:48.852 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-28T21:39:48.852 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-28T21:39:48.852 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-28T21:39:48.852 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-28T21:39:48.852 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-28T21:39:48.852 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-28T21:39:48.852 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-28T21:39:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-28T21:39:48.854 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-28T21:39:48.854 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-28T21:39:48.854 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-28T21:39:48.854 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-28T21:39:48.854 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-28T21:39:48.854 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-28T21:39:48.854 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-28T21:39:48.854 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-28T21:39:48.854 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-28T21:39:48.854 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-28T21:39:48.858 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-28T21:39:48.858 DEBUG:teuthology.orchestra.run.smithi153:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-28T21:39:48.880 INFO:teuthology.orchestra.run.smithi153.stdout:postinstall scriptlet (using /bin/sh): 2024-03-28T21:39:48.881 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-28T21:39:48.881 INFO:teuthology.orchestra.run.smithi153.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-28T21:39:48.881 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-03-28T21:39:48.881 INFO:teuthology.orchestra.run.smithi153.stdout:for file in vmlinuz System.map config; do 2024-03-28T21:39:48.881 INFO:teuthology.orchestra.run.smithi153.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-28T21:39:48.881 INFO:teuthology.orchestra.run.smithi153.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-28T21:39:48.881 INFO:teuthology.orchestra.run.smithi153.stdout: fi 2024-03-28T21:39:48.881 INFO:teuthology.orchestra.run.smithi153.stdout:done 2024-03-28T21:39:48.881 INFO:teuthology.orchestra.run.smithi153.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-28T21:39:48.881 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-28T21:39:48.881 INFO:teuthology.orchestra.run.smithi153.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-28T21:39:48.881 INFO:teuthology.orchestra.run.smithi153.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-28T21:39:48.882 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-28T21:39:48.882 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-03-28T21:39:48.882 INFO:teuthology.orchestra.run.smithi153.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-28T21:39:48.882 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-28T21:39:48.882 INFO:teuthology.orchestra.run.smithi153.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-28T21:39:48.882 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-03-28T21:39:48.883 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -qi grub2-tools 2024-03-28T21:39:48.958 INFO:teuthology.orchestra.run.smithi153.stdout:Name : grub2-tools 2024-03-28T21:39:48.958 INFO:teuthology.orchestra.run.smithi153.stdout:Epoch : 1 2024-03-28T21:39:48.958 INFO:teuthology.orchestra.run.smithi153.stdout:Version : 2.06 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:Release : 68.el9 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: x86_64 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:Group : Unspecified 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:Size : 8264254 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:License : GPLv3+ 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:Packager : builder@centos.org 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:Vendor : CentOS 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:Summary : Support tools for GRUB. 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:Description : 2024-03-28T21:39:48.959 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:39:48.960 INFO:teuthology.orchestra.run.smithi153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-28T21:39:48.960 INFO:teuthology.orchestra.run.smithi153.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-28T21:39:48.960 INFO:teuthology.orchestra.run.smithi153.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-28T21:39:48.960 INFO:teuthology.orchestra.run.smithi153.stdout:hardware devices. 2024-03-28T21:39:48.960 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:39:48.960 INFO:teuthology.orchestra.run.smithi153.stdout:This subpackage provides tools for support of all platforms. 2024-03-28T21:39:48.961 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-28T21:39:48.961 INFO:teuthology.task.kernel:Updating grub on smithi153 to boot 6.8.0-g1df0c7e8a235 2024-03-28T21:39:48.961 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-28T21:39:49.012 INFO:teuthology.orchestra.run.smithi165.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-28T21:39:49.620 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-03-28T21:39:51.015 INFO:teuthology.orchestra.run.smithi153.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-28T21:39:51.050 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-03-28T21:39:51.063 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-03-28T21:39:51.078 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.8lMm3rQTYm 2024-03-28T21:39:51.078 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8lMm3rQTYm 2024-03-28T21:39:51.151 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.8lMm3rQTYm 2024-03-28T21:39:51.295 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.8lMm3rQTYm is 6KB 2024-03-28T21:39:51.344 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.8lMm3rQTYm 2024-03-28T21:39:51.358 DEBUG:teuthology.orchestra.run.smithi153:> sudo /bin/ls /boot/loader/entries || true 2024-03-28T21:39:51.433 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-28T21:39:51.433 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-28T21:39:51.433 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-28T21:39:51.434 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-28T21:39:51.435 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-28T21:39:51.572 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-03-28T21:40:11.348 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi165.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-28T21:40:11.348 DEBUG:teuthology.orchestra.run.smithi165:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-28T21:40:11.418 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-28T21:40:11.418 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-28T21:40:11.418 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-28T21:40:11.418 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-28T21:40:11.418 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-28T21:40:11.418 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-28T21:40:11.418 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-28T21:40:11.418 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-28T21:40:11.418 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-28T21:40:11.418 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-28T21:40:11.419 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-28T21:40:11.420 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-28T21:40:11.421 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-28T21:40:11.422 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-28T21:40:11.423 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-28T21:40:11.424 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-28T21:40:11.425 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-28T21:40:11.426 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-28T21:40:11.426 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-28T21:40:11.426 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-28T21:40:11.426 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-28T21:40:11.426 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-28T21:40:11.426 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-28T21:40:11.426 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-28T21:40:11.426 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-28T21:40:11.426 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-28T21:40:11.426 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-28T21:40:11.426 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-28T21:40:11.426 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-28T21:40:11.426 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-28T21:40:11.426 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-28T21:40:11.427 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-28T21:40:11.428 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-28T21:40:11.429 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-28T21:40:11.429 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-28T21:40:11.429 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-28T21:40:11.429 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-28T21:40:11.429 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-28T21:40:11.429 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-28T21:40:11.429 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-28T21:40:11.429 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-28T21:40:11.429 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-28T21:40:11.429 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-28T21:40:11.429 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-28T21:40:11.429 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-28T21:40:11.429 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-28T21:40:11.429 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-28T21:40:11.430 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-28T21:40:11.431 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-28T21:40:11.431 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-28T21:40:11.431 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-28T21:40:11.431 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-28T21:40:11.431 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-28T21:40:11.431 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-28T21:40:11.431 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-28T21:40:11.431 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-28T21:40:11.431 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-28T21:40:11.431 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-28T21:40:11.431 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-28T21:40:11.431 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-28T21:40:11.431 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-28T21:40:11.431 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-28T21:40:11.432 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-28T21:40:11.432 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-28T21:40:11.432 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-28T21:40:11.432 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-28T21:40:11.432 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-28T21:40:11.432 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-28T21:40:11.432 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-28T21:40:11.432 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-28T21:40:11.432 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-28T21:40:11.432 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-28T21:40:11.432 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-28T21:40:11.432 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-28T21:40:11.432 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-28T21:40:11.432 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-28T21:40:11.433 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-28T21:40:11.433 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-28T21:40:11.433 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-28T21:40:11.433 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-28T21:40:11.433 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-28T21:40:11.433 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-28T21:40:11.433 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-28T21:40:11.433 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-28T21:40:11.433 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-28T21:40:11.433 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-28T21:40:11.433 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-28T21:40:11.433 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-28T21:40:11.433 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-28T21:40:11.433 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-28T21:40:11.434 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-28T21:40:11.435 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-28T21:40:11.435 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-28T21:40:11.435 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-28T21:40:11.435 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-28T21:40:11.435 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-28T21:40:11.435 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-28T21:40:11.435 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-28T21:40:11.435 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-28T21:40:11.435 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-28T21:40:11.435 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-28T21:40:11.435 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-28T21:40:11.435 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-28T21:40:11.435 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-28T21:40:11.435 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-28T21:40:11.436 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-28T21:40:11.436 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-28T21:40:11.436 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-28T21:40:11.436 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-28T21:40:11.436 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-28T21:40:11.436 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-28T21:40:11.436 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-28T21:40:11.436 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-28T21:40:11.436 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-28T21:40:11.436 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-28T21:40:11.436 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-28T21:40:11.436 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-28T21:40:11.436 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-28T21:40:11.436 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-28T21:40:11.437 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-28T21:40:11.438 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-28T21:40:11.438 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-28T21:40:11.438 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-28T21:40:11.438 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-28T21:40:11.438 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-28T21:40:11.438 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-28T21:40:11.438 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-28T21:40:11.438 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-28T21:40:11.438 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-28T21:40:11.438 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-28T21:40:11.438 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-28T21:40:11.438 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-28T21:40:11.438 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-28T21:40:11.438 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-28T21:40:11.439 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-28T21:40:11.440 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-28T21:40:11.441 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-28T21:40:11.442 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-28T21:40:11.443 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-28T21:40:11.444 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-28T21:40:11.445 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-28T21:40:11.446 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-28T21:40:11.446 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-28T21:40:11.446 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-28T21:40:11.446 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-28T21:40:11.446 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-28T21:40:11.446 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-28T21:40:11.446 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-28T21:40:11.446 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-28T21:40:11.446 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-28T21:40:11.446 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-28T21:40:11.446 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-28T21:40:11.446 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-28T21:40:11.446 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-28T21:40:11.446 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-28T21:40:11.447 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-28T21:40:11.448 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-28T21:40:11.449 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-28T21:40:11.450 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-28T21:40:11.451 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-28T21:40:11.452 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-28T21:40:11.453 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-28T21:40:11.454 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-28T21:40:11.454 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-28T21:40:11.454 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-28T21:40:11.454 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-28T21:40:11.454 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-28T21:40:11.454 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-28T21:40:11.454 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-28T21:40:11.454 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-28T21:40:11.454 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-28T21:40:11.454 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-28T21:40:11.454 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-28T21:40:11.454 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-28T21:40:11.454 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-28T21:40:11.454 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-28T21:40:11.455 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-28T21:40:11.456 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-28T21:40:11.457 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-28T21:40:11.458 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-28T21:40:11.459 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-28T21:40:11.460 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-28T21:40:11.461 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-28T21:40:11.462 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-28T21:40:11.462 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-28T21:40:11.462 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-28T21:40:11.462 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-28T21:40:11.462 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-28T21:40:11.462 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-28T21:40:11.462 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-28T21:40:11.462 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-28T21:40:11.462 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-28T21:40:11.462 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-28T21:40:11.462 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-28T21:40:11.462 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-28T21:40:11.462 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-28T21:40:11.463 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-28T21:40:11.464 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-28T21:40:11.465 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-28T21:40:11.466 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-28T21:40:11.466 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-28T21:40:11.466 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-28T21:40:11.466 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-28T21:40:11.466 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-28T21:40:11.466 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-28T21:40:11.466 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-28T21:40:11.466 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-28T21:40:11.466 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-28T21:40:11.466 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-28T21:40:11.466 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-28T21:40:11.466 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-28T21:40:11.466 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-28T21:40:11.466 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-28T21:40:11.467 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-28T21:40:11.467 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-28T21:40:11.467 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-28T21:40:11.467 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-28T21:40:11.467 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-28T21:40:11.467 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-28T21:40:11.467 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-28T21:40:11.467 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-28T21:40:11.467 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-28T21:40:11.467 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-28T21:40:11.467 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-28T21:40:11.467 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-28T21:40:11.467 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-28T21:40:11.467 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-28T21:40:11.468 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-28T21:40:11.469 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-28T21:40:11.470 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-28T21:40:11.470 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-28T21:40:11.470 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-28T21:40:11.470 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-28T21:40:11.470 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-28T21:40:11.470 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-28T21:40:11.470 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-28T21:40:11.470 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-28T21:40:11.470 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-28T21:40:11.470 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-28T21:40:11.470 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-28T21:40:11.470 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-28T21:40:11.470 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-28T21:40:11.470 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-28T21:40:11.471 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-28T21:40:11.471 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-28T21:40:11.471 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-28T21:40:11.471 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-28T21:40:11.471 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-28T21:40:11.471 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-28T21:40:11.471 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-28T21:40:11.471 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-28T21:40:11.471 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-28T21:40:11.471 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-28T21:40:11.471 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-28T21:40:11.471 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-28T21:40:11.471 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-28T21:40:11.471 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-28T21:40:11.472 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-28T21:40:11.473 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-28T21:40:11.474 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-28T21:40:11.475 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-28T21:40:11.476 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-28T21:40:11.477 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-28T21:40:11.478 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-28T21:40:11.479 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-28T21:40:11.480 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-28T21:40:11.481 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-28T21:40:11.482 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-28T21:40:11.483 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-28T21:40:11.484 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-28T21:40:11.485 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-28T21:40:11.486 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-28T21:40:11.487 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-28T21:40:11.488 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-28T21:40:11.489 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-28T21:40:11.490 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-28T21:40:11.490 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-28T21:40:11.490 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-28T21:40:11.490 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-28T21:40:11.490 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-28T21:40:11.490 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-28T21:40:11.490 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-28T21:40:11.490 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-28T21:40:11.490 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-28T21:40:11.490 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-28T21:40:11.490 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-28T21:40:11.490 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-28T21:40:11.490 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-28T21:40:11.490 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-28T21:40:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-28T21:40:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-28T21:40:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-28T21:40:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-28T21:40:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-28T21:40:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-28T21:40:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-28T21:40:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-28T21:40:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-28T21:40:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-28T21:40:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-28T21:40:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-28T21:40:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-28T21:40:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-28T21:40:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-28T21:40:11.493 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-28T21:40:11.494 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-28T21:40:11.494 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-28T21:40:11.494 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-28T21:40:11.494 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-28T21:40:11.494 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-28T21:40:11.494 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-28T21:40:11.494 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-28T21:40:11.494 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-28T21:40:11.494 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-28T21:40:11.494 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-28T21:40:11.494 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-28T21:40:11.494 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-28T21:40:11.494 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-28T21:40:11.494 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-28T21:40:11.495 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-28T21:40:11.496 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-28T21:40:11.497 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-28T21:40:11.498 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-28T21:40:11.498 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-28T21:40:11.498 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-28T21:40:11.498 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-28T21:40:11.498 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-28T21:40:11.498 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-28T21:40:11.498 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-28T21:40:11.498 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-28T21:40:11.498 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-28T21:40:11.498 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-28T21:40:11.498 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-28T21:40:11.498 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-28T21:40:11.498 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-28T21:40:11.498 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-28T21:40:11.499 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-28T21:40:11.500 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-28T21:40:11.501 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-28T21:40:11.502 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-28T21:40:11.503 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-28T21:40:11.504 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-28T21:40:11.505 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-28T21:40:11.506 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-28T21:40:11.507 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-28T21:40:11.508 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-28T21:40:11.509 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-28T21:40:11.510 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-28T21:40:11.510 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-28T21:40:11.510 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-28T21:40:11.510 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-28T21:40:11.510 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-28T21:40:11.510 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-28T21:40:11.510 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-28T21:40:11.510 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-28T21:40:11.510 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-28T21:40:11.510 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-28T21:40:11.510 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-28T21:40:11.510 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-28T21:40:11.510 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-28T21:40:11.511 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-28T21:40:11.511 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-28T21:40:11.511 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-28T21:40:11.511 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-28T21:40:11.511 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-28T21:40:11.511 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-28T21:40:11.511 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-28T21:40:11.511 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-28T21:40:11.511 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-28T21:40:11.511 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-28T21:40:11.511 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-28T21:40:11.511 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-28T21:40:11.511 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-28T21:40:11.511 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-28T21:40:11.512 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-28T21:40:11.513 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-28T21:40:11.514 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-28T21:40:11.515 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-28T21:40:11.516 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-28T21:40:11.517 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-28T21:40:11.518 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-28T21:40:11.519 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-28T21:40:11.520 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-28T21:40:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-28T21:40:11.522 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-28T21:40:11.522 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-28T21:40:11.522 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-28T21:40:11.522 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-28T21:40:11.522 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-28T21:40:11.522 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-28T21:40:11.522 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-28T21:40:11.522 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-28T21:40:11.522 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-28T21:40:11.522 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-28T21:40:11.522 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-28T21:40:11.522 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-28T21:40:11.522 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-28T21:40:11.522 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-28T21:40:11.523 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-28T21:40:11.524 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-28T21:40:11.525 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-28T21:40:11.526 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-28T21:40:11.527 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-28T21:40:11.528 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-28T21:40:11.529 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-28T21:40:11.530 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-28T21:40:11.531 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-28T21:40:11.531 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-28T21:40:11.531 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-28T21:40:11.531 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-28T21:40:11.531 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-28T21:40:11.531 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-28T21:40:11.531 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-28T21:40:11.531 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-28T21:40:11.531 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-28T21:40:11.531 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-28T21:40:11.531 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-28T21:40:11.531 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-28T21:40:11.531 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-28T21:40:11.531 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-28T21:40:11.532 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-28T21:40:11.532 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-28T21:40:11.532 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-28T21:40:11.532 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-28T21:40:11.532 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-28T21:40:11.532 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-28T21:40:11.532 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-28T21:40:11.532 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-28T21:40:11.532 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-28T21:40:11.532 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-28T21:40:11.532 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-28T21:40:11.532 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-28T21:40:11.532 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-28T21:40:11.532 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-28T21:40:11.533 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-28T21:40:11.533 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-28T21:40:11.533 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-28T21:40:11.533 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-28T21:40:11.533 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-28T21:40:11.533 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-28T21:40:11.533 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-28T21:40:11.533 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-28T21:40:11.533 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-28T21:40:11.533 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-28T21:40:11.533 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-28T21:40:11.533 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-28T21:40:11.533 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-28T21:40:11.533 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-28T21:40:11.534 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-28T21:40:11.535 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-28T21:40:11.536 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-28T21:40:11.537 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-28T21:40:11.537 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-28T21:40:11.537 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-28T21:40:11.537 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-28T21:40:11.537 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-28T21:40:11.537 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-28T21:40:11.537 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-28T21:40:11.537 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-28T21:40:11.537 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-28T21:40:11.537 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-28T21:40:11.537 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-28T21:40:11.537 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-28T21:40:11.537 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-28T21:40:11.537 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-28T21:40:11.538 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-28T21:40:11.538 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-28T21:40:11.538 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-28T21:40:11.538 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-28T21:40:11.538 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-28T21:40:11.538 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-28T21:40:11.538 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-28T21:40:11.538 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-28T21:40:11.538 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-28T21:40:11.538 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-28T21:40:11.538 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-28T21:40:11.538 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-28T21:40:11.538 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-28T21:40:11.538 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-28T21:40:11.539 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-28T21:40:11.539 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-28T21:40:11.539 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-28T21:40:11.539 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-28T21:40:11.539 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-28T21:40:11.539 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-28T21:40:11.539 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-28T21:40:11.539 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-28T21:40:11.539 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-28T21:40:11.539 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-28T21:40:11.539 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-28T21:40:11.539 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-28T21:40:11.539 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-28T21:40:11.539 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-28T21:40:11.540 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-28T21:40:11.541 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-28T21:40:11.542 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-28T21:40:11.542 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-28T21:40:11.542 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-28T21:40:11.542 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-28T21:40:11.542 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-28T21:40:11.542 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-28T21:40:11.542 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-28T21:40:11.542 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-28T21:40:11.542 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-28T21:40:11.542 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-28T21:40:11.542 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-28T21:40:11.542 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-28T21:40:11.542 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-28T21:40:11.542 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-28T21:40:11.543 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-28T21:40:11.543 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-28T21:40:11.543 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-28T21:40:11.543 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-28T21:40:11.543 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-28T21:40:11.543 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-28T21:40:11.543 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-28T21:40:11.543 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-28T21:40:11.543 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-28T21:40:11.543 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-28T21:40:11.543 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-28T21:40:11.543 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-28T21:40:11.543 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-28T21:40:11.543 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-28T21:40:11.544 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-28T21:40:11.545 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-28T21:40:11.546 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-28T21:40:11.546 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-28T21:40:11.546 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-28T21:40:11.546 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-28T21:40:11.546 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-28T21:40:11.546 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-28T21:40:11.549 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-28T21:40:11.550 DEBUG:teuthology.orchestra.run.smithi165:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-28T21:40:11.572 INFO:teuthology.orchestra.run.smithi165.stdout:postinstall scriptlet (using /bin/sh): 2024-03-28T21:40:11.572 INFO:teuthology.orchestra.run.smithi165.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-28T21:40:11.572 INFO:teuthology.orchestra.run.smithi165.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-28T21:40:11.572 INFO:teuthology.orchestra.run.smithi165.stdout:fi 2024-03-28T21:40:11.572 INFO:teuthology.orchestra.run.smithi165.stdout:for file in vmlinuz System.map config; do 2024-03-28T21:40:11.572 INFO:teuthology.orchestra.run.smithi165.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-28T21:40:11.572 INFO:teuthology.orchestra.run.smithi165.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-28T21:40:11.572 INFO:teuthology.orchestra.run.smithi165.stdout: fi 2024-03-28T21:40:11.572 INFO:teuthology.orchestra.run.smithi165.stdout:done 2024-03-28T21:40:11.572 INFO:teuthology.orchestra.run.smithi165.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-28T21:40:11.572 INFO:teuthology.orchestra.run.smithi165.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-28T21:40:11.573 INFO:teuthology.orchestra.run.smithi165.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-28T21:40:11.573 INFO:teuthology.orchestra.run.smithi165.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-28T21:40:11.573 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-28T21:40:11.573 INFO:teuthology.orchestra.run.smithi165.stdout:fi 2024-03-28T21:40:11.573 INFO:teuthology.orchestra.run.smithi165.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-28T21:40:11.573 INFO:teuthology.orchestra.run.smithi165.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-28T21:40:11.573 INFO:teuthology.orchestra.run.smithi165.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-28T21:40:11.573 INFO:teuthology.orchestra.run.smithi165.stdout:fi 2024-03-28T21:40:11.574 DEBUG:teuthology.orchestra.run.smithi165:> sudo rpm -qi grub2-tools 2024-03-28T21:40:11.649 INFO:teuthology.orchestra.run.smithi165.stdout:Name : grub2-tools 2024-03-28T21:40:11.650 INFO:teuthology.orchestra.run.smithi165.stdout:Epoch : 1 2024-03-28T21:40:11.650 INFO:teuthology.orchestra.run.smithi165.stdout:Version : 2.06 2024-03-28T21:40:11.650 INFO:teuthology.orchestra.run.smithi165.stdout:Release : 68.el9 2024-03-28T21:40:11.650 INFO:teuthology.orchestra.run.smithi165.stdout:Architecture: x86_64 2024-03-28T21:40:11.650 INFO:teuthology.orchestra.run.smithi165.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-28T21:40:11.650 INFO:teuthology.orchestra.run.smithi165.stdout:Group : Unspecified 2024-03-28T21:40:11.650 INFO:teuthology.orchestra.run.smithi165.stdout:Size : 8264254 2024-03-28T21:40:11.650 INFO:teuthology.orchestra.run.smithi165.stdout:License : GPLv3+ 2024-03-28T21:40:11.650 INFO:teuthology.orchestra.run.smithi165.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-28T21:40:11.650 INFO:teuthology.orchestra.run.smithi165.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-28T21:40:11.650 INFO:teuthology.orchestra.run.smithi165.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-28T21:40:11.650 INFO:teuthology.orchestra.run.smithi165.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-28T21:40:11.650 INFO:teuthology.orchestra.run.smithi165.stdout:Packager : builder@centos.org 2024-03-28T21:40:11.650 INFO:teuthology.orchestra.run.smithi165.stdout:Vendor : CentOS 2024-03-28T21:40:11.651 INFO:teuthology.orchestra.run.smithi165.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-28T21:40:11.651 INFO:teuthology.orchestra.run.smithi165.stdout:Summary : Support tools for GRUB. 2024-03-28T21:40:11.651 INFO:teuthology.orchestra.run.smithi165.stdout:Description : 2024-03-28T21:40:11.651 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:40:11.651 INFO:teuthology.orchestra.run.smithi165.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-28T21:40:11.651 INFO:teuthology.orchestra.run.smithi165.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-28T21:40:11.651 INFO:teuthology.orchestra.run.smithi165.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-28T21:40:11.651 INFO:teuthology.orchestra.run.smithi165.stdout:hardware devices. 2024-03-28T21:40:11.651 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:40:11.651 INFO:teuthology.orchestra.run.smithi165.stdout:This subpackage provides tools for support of all platforms. 2024-03-28T21:40:11.652 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-28T21:40:11.652 INFO:teuthology.task.kernel:Updating grub on smithi165 to boot 6.8.0-g1df0c7e8a235 2024-03-28T21:40:11.652 DEBUG:teuthology.orchestra.run.smithi165:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-28T21:40:12.160 INFO:teuthology.orchestra.run.smithi165.stderr:Generating grub configuration file ... 2024-03-28T21:40:13.598 INFO:teuthology.orchestra.run.smithi165.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-28T21:40:13.630 INFO:teuthology.orchestra.run.smithi165.stderr:done 2024-03-28T21:40:13.641 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2024-03-28T21:40:13.655 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.Mejrb69puF 2024-03-28T21:40:13.656 DEBUG:teuthology.orchestra.run.smithi165:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Mejrb69puF 2024-03-28T21:40:13.728 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.Mejrb69puF 2024-03-28T21:40:13.869 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.Mejrb69puF is 6KB 2024-03-28T21:40:13.917 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.Mejrb69puF 2024-03-28T21:40:13.930 DEBUG:teuthology.orchestra.run.smithi165:> sudo /bin/ls /boot/loader/entries || true 2024-03-28T21:40:13.995 INFO:teuthology.orchestra.run.smithi165.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-28T21:40:13.995 INFO:teuthology.orchestra.run.smithi165.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-28T21:40:13.995 INFO:teuthology.orchestra.run.smithi165.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-28T21:40:13.995 INFO:teuthology.orchestra.run.smithi165.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-28T21:40:13.996 DEBUG:teuthology.orchestra.run.smithi165:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-28T21:40:14.150 DEBUG:teuthology.orchestra.run.smithi165:> sudo shutdown -r now 2024-03-28T21:40:21.581 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-28T21:40:21.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-28T21:40:21.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T21:40:44.158 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-28T21:40:44.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-03-28T21:40:44.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T21:40:56.222 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-03-28T21:41:05.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-28T21:41:05.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T21:41:18.750 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-28T21:41:23.618 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-03-28T21:41:27.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-03-28T21:41:27.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T21:41:35.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-28T21:41:35.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T21:41:38.690 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-03-28T21:41:46.146 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-28T21:41:53.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-28T21:41:53.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T21:41:54.117 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-03-28T21:41:54.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-28T21:41:54.656 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-g1df0c7e8a235"... 2024-03-28T21:41:54.656 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-03-28T21:41:54.698 INFO:teuthology.orchestra.run.smithi153.stdout:6.8.0-g1df0c7e8a235 2024-03-28T21:41:54.698 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-28T21:41:54.699 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-28T21:41:54.699 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-28T21:41:55.699 DEBUG:teuthology.parallel:result is None 2024-03-28T21:41:58.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-03-28T21:41:58.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T21:42:01.218 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-28T21:42:16.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-03-28T21:42:16.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T21:42:16.536 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-03-28T21:42:17.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-03-28T21:42:17.099 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.8.0-g1df0c7e8a235"... 2024-03-28T21:42:17.099 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-03-28T21:42:17.137 INFO:teuthology.orchestra.run.smithi165.stdout:6.8.0-g1df0c7e8a235 2024-03-28T21:42:17.137 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-28T21:42:17.137 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-28T21:42:17.137 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-28T21:42:18.138 DEBUG:teuthology.parallel:result is None 2024-03-28T21:42:18.138 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-28T21:42:18.150 INFO:teuthology.task.internal:Creating test directory... 2024-03-28T21:42:18.150 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-28T21:42:18.159 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-28T21:42:18.208 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-28T21:42:18.215 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-28T21:42:18.224 INFO:teuthology.task.internal:Creating archive directory... 2024-03-28T21:42:18.224 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-28T21:42:18.231 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-28T21:42:18.342 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-28T21:42:18.349 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-28T21:42:18.349 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-28T21:42:18.357 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-28T21:42:18.518 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-28T21:42:18.590 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-28T21:42:18.639 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-28T21:42:18.703 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-28T21:42:18.707 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-28T21:42:18.715 INFO:teuthology.task.internal:Configuring sudo... 2024-03-28T21:42:18.715 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-28T21:42:18.722 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-28T21:42:18.818 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-28T21:42:18.829 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-28T21:42:18.829 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-28T21:42:18.837 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-28T21:42:18.916 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-28T21:42:18.997 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-28T21:42:19.110 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-28T21:42:19.192 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-28T21:42:19.285 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:42:19.285 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-28T21:42:19.377 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-28T21:42:19.484 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-28T21:42:19.630 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-28T21:42:19.746 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-28T21:42:19.883 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:42:19.883 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-28T21:42:20.001 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-03-28T21:42:20.009 DEBUG:teuthology.orchestra.run.smithi165:> sudo service rsyslog restart 2024-03-28T21:42:20.145 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-28T21:42:20.232 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-28T21:42:20.594 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-28T21:42:20.602 INFO:teuthology.task.internal:Starting timer... 2024-03-28T21:42:20.602 INFO:teuthology.run_tasks:Running task pcp... 2024-03-28T21:42:20.630 INFO:teuthology.run_tasks:Running task selinux... 2024-03-28T21:42:20.653 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-28T21:42:20.653 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2024-03-28T21:42:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2024-03-28T21:42:20.784 DEBUG:teuthology.orchestra.run.smithi165:> sudo service auditd rotate 2024-03-28T21:42:20.901 INFO:teuthology.orchestra.run.smithi165.stdout:Rotating logs: 2024-03-28T21:42:20.904 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-28T21:42:20.905 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2024-03-28T21:42:20.958 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2024-03-28T21:42:20.958 DEBUG:teuthology.orchestra.run.smithi165:> /usr/sbin/getenforce 2024-03-28T21:42:21.025 INFO:teuthology.orchestra.run.smithi165.stdout:Permissive 2024-03-28T21:42:21.026 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi153.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi165.front.sepia.ceph.com': 'permissive'} 2024-03-28T21:42:21.026 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-28T21:42:21.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T21:42:21.116 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-28T21:42:21.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T21:42:21.199 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-28T21:42:21.199 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2024-03-28T21:42:21.288 DEBUG:teuthology.orchestra.run.smithi165:> sudo /usr/sbin/setenforce permissive 2024-03-28T21:42:21.378 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-28T21:42:21.389 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-28T21:42:21.394 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-28T21:42:21.510 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-28T21:42:21.526 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-28T21:42:21.527 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi153.front.sepia.ceph.com,smithi165.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-28T21:48:20.221 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi153.front.sepia.ceph.com'), Remote(name='ubuntu@smithi165.front.sepia.ceph.com')] 2024-03-28T21:48:20.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-28T21:48:20.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T21:48:20.365 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-03-28T21:48:20.522 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-28T21:48:20.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-03-28T21:48:20.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T21:48:20.667 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-03-28T21:48:20.812 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-03-28T21:48:20.813 INFO:teuthology.run_tasks:Running task clock... 2024-03-28T21:48:20.823 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-28T21:48:20.823 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-28T21:48:20.824 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-28T21:48:20.831 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-28T21:48:20.831 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-28T21:48:20.930 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-28T21:48:20.934 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-28T21:48:20.983 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-28T21:48:20.987 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-28T21:48:21.077 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: ntpd: command not found 2024-03-28T21:48:21.078 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2024-03-28T21:48:21.119 INFO:teuthology.orchestra.run.smithi165.stdout:506 Cannot talk to daemon 2024-03-28T21:48:21.122 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2024-03-28T21:48:21.170 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-28T21:48:21.176 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-28T21:48:21.220 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-28T21:48:21.233 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-28T21:48:21.345 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-03-28T21:48:21.353 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-28T21:48:21.353 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-03-28T21:48:21.353 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T21:48:21.353 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T21:48:21.353 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T21:48:21.353 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T21:48:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-03-28T21:48:21.370 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-28T21:48:21.370 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-03-28T21:48:21.370 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T21:48:21.370 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T21:48:21.371 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T21:48:21.371 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T21:48:21.372 INFO:teuthology.run_tasks:Running task install... 2024-03-28T21:48:21.380 DEBUG:teuthology.task.install:project ceph 2024-03-28T21:48:21.381 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '323d23dc228bbcb7f16f188fdc9c0dcb801844be'}} 2024-03-28T21:48:21.381 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '323d23dc228bbcb7f16f188fdc9c0dcb801844be'} 2024-03-28T21:48:21.381 INFO:teuthology.task.install:Using flavor: default 2024-03-28T21:48:21.387 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-28T21:48:21.387 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-28T21:48:21.387 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '323d23dc228bbcb7f16f188fdc9c0dcb801844be', 'tag': None, 'wait_for_package': False} 2024-03-28T21:48:21.388 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=323d23dc228bbcb7f16f188fdc9c0dcb801844be 2024-03-28T21:48:21.390 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '323d23dc228bbcb7f16f188fdc9c0dcb801844be', 'tag': None, 'wait_for_package': False} 2024-03-28T21:48:21.390 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=323d23dc228bbcb7f16f188fdc9c0dcb801844be 2024-03-28T21:48:21.542 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/323d23dc228bbcb7f16f188fdc9c0dcb801844be/centos/9/flavors/default/ 2024-03-28T21:48:21.542 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1899.g323d23dc 2024-03-28T21:48:21.547 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/323d23dc228bbcb7f16f188fdc9c0dcb801844be/centos/9/flavors/default/ 2024-03-28T21:48:21.547 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1899.g323d23dc 2024-03-28T21:48:21.654 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/323d23dc228bbcb7f16f188fdc9c0dcb801844be/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/323d23dc228bbcb7f16f188fdc9c0dcb801844be/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/323d23dc228bbcb7f16f188fdc9c0dcb801844be/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-28T21:48:21.655 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:48:21.655 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-28T21:48:21.747 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/323d23dc228bbcb7f16f188fdc9c0dcb801844be/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/323d23dc228bbcb7f16f188fdc9c0dcb801844be/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/323d23dc228bbcb7f16f188fdc9c0dcb801844be/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-28T21:48:21.747 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:48:21.747 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-28T21:48:21.758 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-28T21:48:21.759 DEBUG:teuthology.orchestra.run.smithi165:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/323d23dc228bbcb7f16f188fdc9c0dcb801844be/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-28T21:48:21.846 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-28T21:48:21.846 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/323d23dc228bbcb7f16f188fdc9c0dcb801844be/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-28T21:48:21.898 DEBUG:teuthology.orchestra.run.smithi165:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-28T21:48:21.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-28T21:48:22.029 DEBUG:teuthology.orchestra.run.smithi165:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-28T21:48:22.119 INFO:teuthology.orchestra.run.smithi165.stdout:check_obsoletes = 1 2024-03-28T21:48:22.120 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-28T21:48:22.123 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum clean all 2024-03-28T21:48:22.207 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2024-03-28T21:48:22.211 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2024-03-28T21:48:22.488 INFO:teuthology.orchestra.run.smithi165.stdout:74 files removed 2024-03-28T21:48:22.528 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-28T21:48:22.565 INFO:teuthology.orchestra.run.smithi153.stdout:74 files removed 2024-03-28T21:48:22.608 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-28T21:48:23.489 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 220 kB/s | 83 kB 00:00 2024-03-28T21:48:23.639 INFO:teuthology.orchestra.run.smithi165.stdout:ceph packages for x86_64 137 kB/s | 83 kB 00:00 2024-03-28T21:48:24.056 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 23 kB/s | 11 kB 00:00 2024-03-28T21:48:24.356 INFO:teuthology.orchestra.run.smithi165.stdout:ceph noarch packages 18 kB/s | 11 kB 00:00 2024-03-28T21:48:24.506 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-03-28T21:48:24.865 INFO:teuthology.orchestra.run.smithi165.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-03-28T21:48:25.109 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-28T21:48:25.594 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-9 - AppStream 10 MB/s | 6.7 MB 00:00 2024-03-28T21:48:26.911 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - BaseOS 3.9 MB/s | 2.0 MB 00:00 2024-03-28T21:48:27.218 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.0 MB 00:00 2024-03-28T21:48:28.540 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.0 MB 00:01 2024-03-28T21:48:36.556 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 919 kB/s | 8.0 MB 00:08 2024-03-28T21:48:38.840 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-03-28T21:48:43.257 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.1 MB 00:00 2024-03-28T21:48:44.891 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 16 kB 00:00 2024-03-28T21:48:46.201 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-03-28T21:48:51.521 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 887 kB/s | 19 MB 00:21 2024-03-28T21:48:52.026 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-03-28T21:48:54.798 INFO:teuthology.orchestra.run.smithi165.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-28T21:48:54.799 INFO:teuthology.orchestra.run.smithi165.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-28T21:48:54.819 INFO:teuthology.orchestra.run.smithi165.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-28T21:48:54.820 INFO:teuthology.orchestra.run.smithi165.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-28T21:48:54.822 INFO:teuthology.orchestra.run.smithi165.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-28T21:48:54.823 INFO:teuthology.orchestra.run.smithi165.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-28T21:48:54.825 INFO:teuthology.orchestra.run.smithi165.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-28T21:48:54.829 INFO:teuthology.orchestra.run.smithi165.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-28T21:48:54.830 INFO:teuthology.orchestra.run.smithi165.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-28T21:48:54.920 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-03-28T21:48:54.948 INFO:teuthology.orchestra.run.smithi165.stdout:============================================================================================ 2024-03-28T21:48:54.948 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-03-28T21:48:54.948 INFO:teuthology.orchestra.run.smithi165.stdout:============================================================================================ 2024-03-28T21:48:54.948 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-03-28T21:48:54.948 INFO:teuthology.orchestra.run.smithi165.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-28T21:48:54.948 INFO:teuthology.orchestra.run.smithi165.stdout: ceph x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 6.6 k 2024-03-28T21:48:54.948 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 5.3 M 2024-03-28T21:48:54.948 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 889 k 2024-03-28T21:48:54.948 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 145 k 2024-03-28T21:48:54.948 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 1.5 M 2024-03-28T21:48:54.948 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 138 k 2024-03-28T21:48:54.949 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 3.5 M 2024-03-28T21:48:54.949 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 7.4 M 2024-03-28T21:48:54.949 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 49 k 2024-03-28T21:48:54.949 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 9.8 M 2024-03-28T21:48:54.949 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 47 M 2024-03-28T21:48:54.949 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 264 k 2024-03-28T21:48:54.949 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 748 k 2024-03-28T21:48:54.949 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-mirror x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 221 k 2024-03-28T21:48:54.949 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-shell x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 27 k 2024-03-28T21:48:54.949 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-top noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 18 k 2024-03-28T21:48:54.949 INFO:teuthology.orchestra.run.smithi165.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-28T21:48:54.949 INFO:teuthology.orchestra.run.smithi165.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-28T21:48:54.949 INFO:teuthology.orchestra.run.smithi165.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-28T21:48:54.950 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 32 k 2024-03-28T21:48:54.950 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2 x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 746 k 2024-03-28T21:48:54.950 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 127 k 2024-03-28T21:48:54.950 INFO:teuthology.orchestra.run.smithi165.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-28T21:48:54.950 INFO:teuthology.orchestra.run.smithi165.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-28T21:48:54.950 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-28T21:48:54.950 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-28T21:48:54.950 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-28T21:48:54.950 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-28T21:48:54.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 162 k 2024-03-28T21:48:54.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 321 k 2024-03-28T21:48:54.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 299 k 2024-03-28T21:48:54.951 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 100 k 2024-03-28T21:48:54.951 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 86 k 2024-03-28T21:48:54.951 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 3.1 M 2024-03-28T21:48:54.951 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 171 k 2024-03-28T21:48:54.951 INFO:teuthology.orchestra.run.smithi165.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-28T21:48:54.951 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrading: 2024-03-28T21:48:54.951 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-28T21:48:54.951 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-28T21:48:54.951 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-28T21:48:54.951 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-28T21:48:54.951 INFO:teuthology.orchestra.run.smithi165.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-28T21:48:54.951 INFO:teuthology.orchestra.run.smithi165.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-28T21:48:54.951 INFO:teuthology.orchestra.run.smithi165.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-28T21:48:54.952 INFO:teuthology.orchestra.run.smithi165.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-28T21:48:54.952 INFO:teuthology.orchestra.run.smithi165.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-28T21:48:54.952 INFO:teuthology.orchestra.run.smithi165.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-28T21:48:54.952 INFO:teuthology.orchestra.run.smithi165.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-28T21:48:54.952 INFO:teuthology.orchestra.run.smithi165.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-28T21:48:54.952 INFO:teuthology.orchestra.run.smithi165.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-28T21:48:54.952 INFO:teuthology.orchestra.run.smithi165.stdout: librados2 x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 3.4 M 2024-03-28T21:48:54.952 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1 x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 3.1 M 2024-03-28T21:48:54.952 INFO:teuthology.orchestra.run.smithi165.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-28T21:48:54.952 INFO:teuthology.orchestra.run.smithi165.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-28T21:48:54.952 INFO:teuthology.orchestra.run.smithi165.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-28T21:48:54.952 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-28T21:48:54.952 INFO:teuthology.orchestra.run.smithi165.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-28T21:48:54.953 INFO:teuthology.orchestra.run.smithi165.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-28T21:48:54.953 INFO:teuthology.orchestra.run.smithi165.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-28T21:48:54.953 INFO:teuthology.orchestra.run.smithi165.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-28T21:48:54.953 INFO:teuthology.orchestra.run.smithi165.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-28T21:48:54.953 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-03-28T21:48:54.953 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-28T21:48:54.953 INFO:teuthology.orchestra.run.smithi165.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-28T21:48:54.953 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-28T21:48:54.953 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 21 M 2024-03-28T21:48:54.953 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 31 k 2024-03-28T21:48:54.953 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 2.4 M 2024-03-28T21:48:54.953 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 248 k 2024-03-28T21:48:54.953 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 4.7 M 2024-03-28T21:48:54.953 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 17 M 2024-03-28T21:48:54.954 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 15 k 2024-03-28T21:48:54.954 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 25 k 2024-03-28T21:48:54.954 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-28T21:48:54.954 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-28T21:48:54.954 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-28T21:48:54.954 INFO:teuthology.orchestra.run.smithi165.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-28T21:48:54.954 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-28T21:48:54.954 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-28T21:48:54.954 INFO:teuthology.orchestra.run.smithi165.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-28T21:48:54.954 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-28T21:48:54.954 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-28T21:48:54.954 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 163 k 2024-03-28T21:48:54.954 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-28T21:48:54.954 INFO:teuthology.orchestra.run.smithi165.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-28T21:48:54.955 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-28T21:48:54.955 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-28T21:48:54.955 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-28T21:48:54.955 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1 x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 501 k 2024-03-28T21:48:54.955 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-28T21:48:54.955 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2 x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 5.1 M 2024-03-28T21:48:54.955 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-28T21:48:54.955 INFO:teuthology.orchestra.run.smithi165.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-28T21:48:54.955 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-28T21:48:54.955 INFO:teuthology.orchestra.run.smithi165.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-28T21:48:54.955 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-28T21:48:54.955 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-28T21:48:54.955 INFO:teuthology.orchestra.run.smithi165.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-28T21:48:54.956 INFO:teuthology.orchestra.run.smithi165.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-28T21:48:54.956 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-28T21:48:54.956 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-28T21:48:54.956 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-28T21:48:54.956 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-28T21:48:54.956 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-28T21:48:54.956 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-28T21:48:54.956 INFO:teuthology.orchestra.run.smithi165.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-28T21:48:54.956 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-28T21:48:54.956 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-28T21:48:54.956 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-28T21:48:54.956 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 45 k 2024-03-28T21:48:54.956 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 131 k 2024-03-28T21:48:54.956 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-28T21:48:54.957 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-28T21:48:54.957 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-28T21:48:54.957 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-28T21:48:54.957 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-28T21:48:54.957 INFO:teuthology.orchestra.run.smithi165.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-28T21:48:54.957 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-28T21:48:54.957 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-28T21:48:54.957 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-28T21:48:54.957 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-28T21:48:54.957 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-28T21:48:54.957 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-28T21:48:54.957 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-28T21:48:54.957 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-28T21:48:54.957 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-28T21:48:54.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-28T21:48:54.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-28T21:48:54.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-28T21:48:54.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-28T21:48:54.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-28T21:48:54.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-28T21:48:54.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-28T21:48:54.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-28T21:48:54.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-28T21:48:54.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-28T21:48:54.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-28T21:48:54.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-28T21:48:54.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-28T21:48:54.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-28T21:48:54.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-28T21:48:54.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-28T21:48:54.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-28T21:48:54.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-28T21:48:54.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-28T21:48:54.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-28T21:48:54.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-28T21:48:54.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-28T21:48:54.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-28T21:48:54.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-28T21:48:54.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-28T21:48:54.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-28T21:48:54.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-28T21:48:54.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-28T21:48:54.960 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-28T21:48:54.960 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-28T21:48:54.960 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-28T21:48:54.960 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-28T21:48:54.960 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-28T21:48:54.960 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-28T21:48:54.960 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-28T21:48:54.960 INFO:teuthology.orchestra.run.smithi165.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-28T21:48:54.960 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-28T21:48:54.960 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-28T21:48:54.960 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-28T21:48:54.960 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-28T21:48:54.960 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-03-28T21:48:54.960 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-03-28T21:48:54.961 INFO:teuthology.orchestra.run.smithi165.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-28T21:48:54.961 INFO:teuthology.orchestra.run.smithi165.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-28T21:48:54.961 INFO:teuthology.orchestra.run.smithi165.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-28T21:48:54.961 INFO:teuthology.orchestra.run.smithi165.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-28T21:48:54.961 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-28T21:48:54.961 INFO:teuthology.orchestra.run.smithi165.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-28T21:48:54.961 INFO:teuthology.orchestra.run.smithi165.stdout:Installing weak dependencies: 2024-03-28T21:48:54.961 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-03-28T21:48:54.961 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:48:54.961 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-03-28T21:48:54.961 INFO:teuthology.orchestra.run.smithi165.stdout:============================================================================================ 2024-03-28T21:48:54.961 INFO:teuthology.orchestra.run.smithi165.stdout:Install 150 Packages 2024-03-28T21:48:54.961 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrade 24 Packages 2024-03-28T21:48:54.961 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:48:54.962 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 226 M 2024-03-28T21:48:54.962 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-03-28T21:48:55.794 INFO:teuthology.orchestra.run.smithi165.stdout:(1/174): ceph-19.0.0-1899.g323d23dc.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-03-28T21:48:56.194 INFO:teuthology.orchestra.run.smithi165.stdout:(2/174): ceph-base-19.0.0-1899.g323d23dc.el9.x8 6.9 MB/s | 5.3 MB 00:00 2024-03-28T21:48:56.261 INFO:teuthology.orchestra.run.smithi165.stdout:(3/174): ceph-immutable-object-cache-19.0.0-189 2.1 MB/s | 145 kB 00:00 2024-03-28T21:48:56.537 INFO:teuthology.orchestra.run.smithi165.stdout:(4/174): ceph-mds-19.0.0-1899.g323d23dc.el9.x86 8.6 MB/s | 2.4 MB 00:00 2024-03-28T21:48:56.611 INFO:teuthology.orchestra.run.smithi165.stdout:(5/174): ceph-fuse-19.0.0-1899.g323d23dc.el9.x8 1.1 MB/s | 889 kB 00:00 2024-03-28T21:48:56.720 INFO:teuthology.orchestra.run.smithi165.stdout:(6/174): ceph-mgr-19.0.0-1899.g323d23dc.el9.x86 8.2 MB/s | 1.5 MB 00:00 2024-03-28T21:48:57.270 INFO:teuthology.orchestra.run.smithi165.stdout:(7/174): ceph-common-19.0.0-1899.g323d23dc.el9. 11 MB/s | 21 MB 00:01 2024-03-28T21:48:58.060 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.1 MB 00:02 2024-03-28T21:48:58.129 INFO:teuthology.orchestra.run.smithi165.stdout:(8/174): ceph-osd-19.0.0-1899.g323d23dc.el9.x86 12 MB/s | 17 MB 00:01 2024-03-28T21:48:58.179 INFO:teuthology.orchestra.run.smithi165.stdout:(9/174): ceph-selinux-19.0.0-1899.g323d23dc.el9 516 kB/s | 25 kB 00:00 2024-03-28T21:48:58.279 INFO:teuthology.orchestra.run.smithi165.stdout:(10/174): ceph-mon-19.0.0-1899.g323d23dc.el9.x8 2.8 MB/s | 4.7 MB 00:01 2024-03-28T21:48:58.446 INFO:teuthology.orchestra.run.smithi165.stdout:(11/174): ceph-radosgw-19.0.0-1899.g323d23dc.el 8.3 MB/s | 9.8 MB 00:01 2024-03-28T21:48:58.499 INFO:teuthology.orchestra.run.smithi165.stdout:(12/174): cephfs-mirror-19.0.0-1899.g323d23dc.e 1.0 MB/s | 221 kB 00:00 2024-03-28T21:48:58.530 INFO:teuthology.orchestra.run.smithi165.stdout:(13/174): cephfs-shell-19.0.0-1899.g323d23dc.el 326 kB/s | 27 kB 00:00 2024-03-28T21:48:58.563 INFO:teuthology.orchestra.run.smithi165.stdout:(14/174): libcephfs-devel-19.0.0-1899.g323d23dc 502 kB/s | 32 kB 00:00 2024-03-28T21:48:58.622 INFO:teuthology.orchestra.run.smithi165.stdout:(15/174): libcephfs2-19.0.0-1899.g323d23dc.el9. 8.0 MB/s | 746 kB 00:00 2024-03-28T21:48:58.656 INFO:teuthology.orchestra.run.smithi165.stdout:(16/174): libcephsqlite-19.0.0-1899.g323d23dc.e 1.8 MB/s | 163 kB 00:00 2024-03-28T21:48:58.689 INFO:teuthology.orchestra.run.smithi165.stdout:(17/174): librados-devel-19.0.0-1899.g323d23dc. 1.9 MB/s | 127 kB 00:00 2024-03-28T21:48:58.781 INFO:teuthology.orchestra.run.smithi165.stdout:(18/174): libradosstriper1-19.0.0-1899.g323d23d 3.9 MB/s | 501 kB 00:00 2024-03-28T21:48:58.882 INFO:teuthology.orchestra.run.smithi165.stdout:(19/174): python3-ceph-argparse-19.0.0-1899.g32 455 kB/s | 45 kB 00:00 2024-03-28T21:48:58.982 INFO:teuthology.orchestra.run.smithi165.stdout:(20/174): python3-ceph-common-19.0.0-1899.g323d 1.3 MB/s | 131 kB 00:00 2024-03-28T21:48:59.090 INFO:teuthology.orchestra.run.smithi165.stdout:(21/174): python3-cephfs-19.0.0-1899.g323d23dc. 1.5 MB/s | 162 kB 00:00 2024-03-28T21:48:59.233 INFO:teuthology.orchestra.run.smithi165.stdout:(22/174): librgw2-19.0.0-1899.g323d23dc.el9.x86 9.5 MB/s | 5.1 MB 00:00 2024-03-28T21:48:59.274 INFO:teuthology.orchestra.run.smithi165.stdout:(23/174): python3-rados-19.0.0-1899.g323d23dc.e 1.7 MB/s | 321 kB 00:00 2024-03-28T21:48:59.308 INFO:teuthology.orchestra.run.smithi165.stdout:(24/174): python3-rbd-19.0.0-1899.g323d23dc.el9 3.9 MB/s | 299 kB 00:00 2024-03-28T21:48:59.350 INFO:teuthology.orchestra.run.smithi165.stdout:(25/174): python3-rgw-19.0.0-1899.g323d23dc.el9 1.3 MB/s | 100 kB 00:00 2024-03-28T21:48:59.375 INFO:teuthology.orchestra.run.smithi165.stdout:(26/174): rbd-fuse-19.0.0-1899.g323d23dc.el9.x8 1.3 MB/s | 86 kB 00:00 2024-03-28T21:48:59.417 INFO:teuthology.orchestra.run.smithi165.stdout:(27/174): rbd-nbd-19.0.0-1899.g323d23dc.el9.x86 4.1 MB/s | 171 kB 00:00 2024-03-28T21:48:59.484 INFO:teuthology.orchestra.run.smithi165.stdout:(28/174): ceph-grafana-dashboards-19.0.0-1899.g 476 kB/s | 31 kB 00:00 2024-03-28T21:48:59.551 INFO:teuthology.orchestra.run.smithi165.stdout:(29/174): ceph-mgr-cephadm-19.0.0-1899.g323d23d 2.0 MB/s | 138 kB 00:00 2024-03-28T21:48:59.647 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 16 kB 00:00 2024-03-28T21:48:59.893 INFO:teuthology.orchestra.run.smithi165.stdout:(30/174): rbd-mirror-19.0.0-1899.g323d23dc.el9. 5.7 MB/s | 3.1 MB 00:00 2024-03-28T21:49:00.035 INFO:teuthology.orchestra.run.smithi165.stdout:(31/174): ceph-mgr-dashboard-19.0.0-1899.g323d2 7.3 MB/s | 3.5 MB 00:00 2024-03-28T21:49:00.127 INFO:teuthology.orchestra.run.smithi165.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1899.g32 2.7 MB/s | 248 kB 00:00 2024-03-28T21:49:00.211 INFO:teuthology.orchestra.run.smithi165.stdout:(33/174): ceph-mgr-rook-19.0.0-1899.g323d23dc.e 599 kB/s | 49 kB 00:00 2024-03-28T21:49:00.294 INFO:teuthology.orchestra.run.smithi165.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1899.g3 186 kB/s | 15 kB 00:00 2024-03-28T21:49:00.395 INFO:teuthology.orchestra.run.smithi165.stdout:(35/174): ceph-volume-19.0.0-1899.g323d23dc.el9 2.6 MB/s | 264 kB 00:00 2024-03-28T21:49:00.620 INFO:teuthology.orchestra.run.smithi165.stdout:(36/174): cephadm-19.0.0-1899.g323d23dc.el9.noa 3.3 MB/s | 748 kB 00:00 2024-03-28T21:49:00.678 INFO:teuthology.orchestra.run.smithi165.stdout:(37/174): cephfs-top-19.0.0-1899.g323d23dc.el9. 317 kB/s | 18 kB 00:00 2024-03-28T21:49:00.870 INFO:teuthology.orchestra.run.smithi165.stdout:(38/174): ceph-mgr-diskprediction-local-19.0.0- 7.6 MB/s | 7.4 MB 00:00 2024-03-28T21:49:01.513 INFO:teuthology.orchestra.run.smithi165.stdout:(39/174): ceph-test-19.0.0-1899.g323d23dc.el9.x 14 MB/s | 47 MB 00:03 2024-03-28T21:49:01.563 INFO:teuthology.orchestra.run.smithi165.stdout:(40/174): automake-1.16.2-8.el9.noarch.rpm 750 kB/s | 662 kB 00:00 2024-03-28T21:49:01.596 INFO:teuthology.orchestra.run.smithi165.stdout:(41/174): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 920 kB 00:00 2024-03-28T21:49:01.621 INFO:teuthology.orchestra.run.smithi165.stdout:(42/174): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 106 kB 00:00 2024-03-28T21:49:01.646 INFO:teuthology.orchestra.run.smithi165.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 659 kB/s | 32 kB 00:00 2024-03-28T21:49:01.680 INFO:teuthology.orchestra.run.smithi165.stdout:(44/174): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 307 kB 00:00 2024-03-28T21:49:01.847 INFO:teuthology.orchestra.run.smithi165.stdout:(45/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-03-28T21:49:01.872 INFO:teuthology.orchestra.run.smithi165.stdout:(46/174): flexiblas-openblas-openmp-3.0.4-8.el9 78 kB/s | 17 kB 00:00 2024-03-28T21:49:01.897 INFO:teuthology.orchestra.run.smithi165.stdout:(47/174): libaio-devel-0.3.111-13.el9.x86_64.rp 47 kB/s | 10 kB 00:00 2024-03-28T21:49:01.931 INFO:teuthology.orchestra.run.smithi165.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.4 MB/s | 44 kB 00:00 2024-03-28T21:49:01.938 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 21 MB 00:02 2024-03-28T21:49:01.965 INFO:teuthology.orchestra.run.smithi165.stdout:(49/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2024-03-28T21:49:02.006 INFO:teuthology.orchestra.run.smithi165.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 661 kB 00:00 2024-03-28T21:49:02.040 INFO:teuthology.orchestra.run.smithi165.stdout:(51/174): libtool-2.4.6-45.el9.x86_64.rpm 5.5 MB/s | 578 kB 00:00 2024-03-28T21:49:02.057 INFO:teuthology.orchestra.run.smithi165.stdout:(52/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 543 kB/s | 46 kB 00:00 2024-03-28T21:49:02.099 INFO:teuthology.orchestra.run.smithi165.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-03-28T21:49:02.132 INFO:teuthology.orchestra.run.smithi165.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2024-03-28T21:49:02.157 INFO:teuthology.orchestra.run.smithi165.stdout:(55/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.1 MB/s | 217 kB 00:00 2024-03-28T21:49:02.183 INFO:teuthology.orchestra.run.smithi165.stdout:(56/174): openblas-0.3.21-2.el9.x86_64.rpm 430 kB/s | 34 kB 00:00 2024-03-28T21:49:02.383 INFO:teuthology.orchestra.run.smithi165.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 6.8 MB/s | 1.5 MB 00:00 2024-03-28T21:49:02.525 INFO:teuthology.orchestra.run.smithi165.stdout:(58/174): openblas-openmp-0.3.21-2.el9.x86_64.r 13 MB/s | 4.7 MB 00:00 2024-03-28T21:49:02.575 INFO:teuthology.orchestra.run.smithi165.stdout:(59/174): postgresql-contrib-13.14-1.el9.x86_64 2.0 MB/s | 817 kB 00:00 2024-03-28T21:49:02.609 INFO:teuthology.orchestra.run.smithi165.stdout:(60/174): postgresql-private-libs-13.14-1.el9.x 612 kB/s | 132 kB 00:00 2024-03-28T21:49:02.843 INFO:teuthology.orchestra.run.smithi165.stdout:(61/174): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.7 MB 00:00 2024-03-28T21:49:02.868 INFO:teuthology.orchestra.run.smithi165.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 317 kB/s | 78 kB 00:00 2024-03-28T21:49:02.926 INFO:teuthology.orchestra.run.smithi165.stdout:(63/174): protobuf-3.14.0-13.el9.x86_64.rpm 3.3 MB/s | 1.0 MB 00:00 2024-03-28T21:49:03.118 INFO:teuthology.orchestra.run.smithi165.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2024-03-28T21:49:03.151 INFO:teuthology.orchestra.run.smithi165.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 93 kB/s | 24 kB 00:00 2024-03-28T21:49:03.176 INFO:teuthology.orchestra.run.smithi165.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 77 kB/s | 18 kB 00:00 2024-03-28T21:49:03.227 INFO:teuthology.orchestra.run.smithi165.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 651 kB/s | 32 kB 00:00 2024-03-28T21:49:03.269 INFO:teuthology.orchestra.run.smithi165.stdout:(68/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 144 kB 00:00 2024-03-28T21:49:03.394 INFO:teuthology.orchestra.run.smithi165.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 4.8 MB 00:00 2024-03-28T21:49:03.419 INFO:teuthology.orchestra.run.smithi165.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-03-28T21:49:03.453 INFO:teuthology.orchestra.run.smithi165.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 174 kB 00:00 2024-03-28T21:49:03.478 INFO:teuthology.orchestra.run.smithi165.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 1.2 MB/s | 69 kB 00:00 2024-03-28T21:49:03.503 INFO:teuthology.orchestra.run.smithi165.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 509 kB/s | 41 kB 00:00 2024-03-28T21:49:03.537 INFO:teuthology.orchestra.run.smithi165.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 2.8 MB/s | 238 kB 00:00 2024-03-28T21:49:03.570 INFO:teuthology.orchestra.run.smithi165.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2024-03-28T21:49:03.595 INFO:teuthology.orchestra.run.smithi165.stdout:(76/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2024-03-28T21:49:03.621 INFO:teuthology.orchestra.run.smithi165.stdout:(77/174): python3-pytz-2021.1-5.el9.noarch.rpm 594 kB/s | 47 kB 00:00 2024-03-28T21:49:03.663 INFO:teuthology.orchestra.run.smithi165.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 654 kB/s | 43 kB 00:00 2024-03-28T21:49:03.813 INFO:teuthology.orchestra.run.smithi165.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 218 kB/s | 39 kB 00:00 2024-03-28T21:49:04.038 INFO:teuthology.orchestra.run.smithi165.stdout:(80/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-03-28T21:49:04.063 INFO:teuthology.orchestra.run.smithi165.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 106 kB/s | 41 kB 00:00 2024-03-28T21:49:04.097 INFO:teuthology.orchestra.run.smithi165.stdout:(82/174): qatlib-24.02.0-1.el9.x86_64.rpm 802 kB/s | 220 kB 00:00 2024-03-28T21:49:04.122 INFO:teuthology.orchestra.run.smithi165.stdout:(83/174): qatlib-service-24.02.0-1.el9.x86_64.r 628 kB/s | 35 kB 00:00 2024-03-28T21:49:04.147 INFO:teuthology.orchestra.run.smithi165.stdout:(84/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 576 kB/s | 46 kB 00:00 2024-03-28T21:49:04.181 INFO:teuthology.orchestra.run.smithi165.stdout:(85/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 300 kB 00:00 2024-03-28T21:49:04.206 INFO:teuthology.orchestra.run.smithi165.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2024-03-28T21:49:04.231 INFO:teuthology.orchestra.run.smithi165.stdout:(87/174): uuid-1.6.2-55.el9.x86_64.rpm 702 kB/s | 56 kB 00:00 2024-03-28T21:49:04.282 INFO:teuthology.orchestra.run.smithi165.stdout:(88/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 444 kB/s | 44 kB 00:00 2024-03-28T21:49:04.307 INFO:teuthology.orchestra.run.smithi165.stdout:(89/174): fuse-2.9.9-15.el9.x86_64.rpm 797 kB/s | 79 kB 00:00 2024-03-28T21:49:04.349 INFO:teuthology.orchestra.run.smithi165.stdout:(90/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2024-03-28T21:49:04.391 INFO:teuthology.orchestra.run.smithi165.stdout:(91/174): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-03-28T21:49:04.416 INFO:teuthology.orchestra.run.smithi165.stdout:(92/174): python3-ply-3.11-14.el9.noarch.rpm 992 kB/s | 103 kB 00:00 2024-03-28T21:49:04.449 INFO:teuthology.orchestra.run.smithi165.stdout:(93/174): python3-pycparser-2.20-6.el9.noarch.r 2.1 MB/s | 124 kB 00:00 2024-03-28T21:49:04.483 INFO:teuthology.orchestra.run.smithi165.stdout:(94/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.0 MB/s | 187 kB 00:00 2024-03-28T21:49:05.467 INFO:teuthology.orchestra.run.smithi165.stdout:(95/174): libquadmath-11.4.1-3.el9.x86_64.rpm 199 kB/s | 195 kB 00:00 2024-03-28T21:49:05.517 INFO:teuthology.orchestra.run.smithi165.stdout:(96/174): jq-1.6-16.el9.x86_64.rpm 171 kB/s | 187 kB 00:01 2024-03-28T21:49:05.609 INFO:teuthology.orchestra.run.smithi165.stdout:(97/174): elfutils-libelf-devel-0.190-2.el9.x86 237 kB/s | 21 kB 00:00 2024-03-28T21:49:05.651 INFO:teuthology.orchestra.run.smithi165.stdout:(98/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 619 kB/s | 25 kB 00:00 2024-03-28T21:49:05.976 INFO:teuthology.orchestra.run.smithi165.stdout:(99/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 13 MB/s | 4.1 MB 00:00 2024-03-28T21:49:06.035 INFO:teuthology.orchestra.run.smithi165.stdout:(100/174): python3-devel-3.9.17-2.el9.x86_64.rp 4.2 MB/s | 245 kB 00:00 2024-03-28T21:49:06.085 INFO:teuthology.orchestra.run.smithi165.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 4.9 MB/s | 248 kB 00:00 2024-03-28T21:49:06.135 INFO:teuthology.orchestra.run.smithi165.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.9 MB/s | 94 kB 00:00 2024-03-28T21:49:06.210 INFO:teuthology.orchestra.run.smithi165.stdout:(103/174): libgfortran-11.4.1-3.el9.x86_64.rpm 465 kB/s | 803 kB 00:01 2024-03-28T21:49:06.344 INFO:teuthology.orchestra.run.smithi165.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 107 kB/s | 22 kB 00:00 2024-03-28T21:49:06.378 INFO:teuthology.orchestra.run.smithi165.stdout:(105/174): python3-requests-2.25.1-8.el9.noarch 137 kB/s | 125 kB 00:00 2024-03-28T21:49:06.478 INFO:teuthology.orchestra.run.smithi165.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.2 MB/s | 863 kB 00:00 2024-03-28T21:49:07.078 INFO:teuthology.orchestra.run.smithi165.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 40 kB/s | 19 kB 00:00 2024-03-28T21:49:07.403 INFO:teuthology.orchestra.run.smithi165.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 301 kB/s | 309 kB 00:01 2024-03-28T21:49:07.520 INFO:teuthology.orchestra.run.smithi165.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 224 kB/s | 26 kB 00:00 2024-03-28T21:49:07.629 INFO:teuthology.orchestra.run.smithi165.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 451 kB/s | 49 kB 00:00 2024-03-28T21:49:07.662 INFO:teuthology.orchestra.run.smithi165.stdout:(111/174): abseil-cpp-20211102.0-3.el9.x86_64.r 417 kB/s | 548 kB 00:01 2024-03-28T21:49:07.737 INFO:teuthology.orchestra.run.smithi165.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 625 kB/s | 67 kB 00:00 2024-03-28T21:49:07.840 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-03-28T21:49:07.854 INFO:teuthology.orchestra.run.smithi165.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 790 kB/s | 151 kB 00:00 2024-03-28T21:49:08.613 INFO:teuthology.orchestra.run.smithi165.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 723 kB/s | 548 kB 00:00 2024-03-28T21:49:08.738 INFO:teuthology.orchestra.run.smithi165.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 838 kB/s | 838 kB 00:00 2024-03-28T21:49:08.764 INFO:teuthology.orchestra.run.smithi165.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 291 kB/s | 43 kB 00:00 2024-03-28T21:49:08.856 INFO:teuthology.orchestra.run.smithi165.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 277 kB/s | 32 kB 00:00 2024-03-28T21:49:08.881 INFO:teuthology.orchestra.run.smithi165.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 129 kB/s | 15 kB 00:00 2024-03-28T21:49:09.139 INFO:teuthology.orchestra.run.smithi165.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 607 kB/s | 172 kB 00:00 2024-03-28T21:49:09.331 INFO:teuthology.orchestra.run.smithi165.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 797 kB/s | 358 kB 00:00 2024-03-28T21:49:09.440 INFO:teuthology.orchestra.run.smithi165.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 328 kB/s | 35 kB 00:00 2024-03-28T21:49:09.598 INFO:teuthology.orchestra.run.smithi165.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 662 kB/s | 303 kB 00:00 2024-03-28T21:49:09.724 INFO:teuthology.orchestra.run.smithi165.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 716 kB/s | 203 kB 00:00 2024-03-28T21:49:10.024 INFO:teuthology.orchestra.run.smithi165.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 483 kB/s | 144 kB 00:00 2024-03-28T21:49:10.141 INFO:teuthology.orchestra.run.smithi165.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 92 kB/s | 11 kB 00:00 2024-03-28T21:49:10.258 INFO:teuthology.orchestra.run.smithi165.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2024-03-28T21:49:10.367 INFO:teuthology.orchestra.run.smithi165.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 215 kB/s | 23 kB 00:00 2024-03-28T21:49:10.467 INFO:teuthology.orchestra.run.smithi165.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 195 kB/s | 19 kB 00:00 2024-03-28T21:49:10.575 INFO:teuthology.orchestra.run.smithi165.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 183 kB/s | 20 kB 00:00 2024-03-28T21:49:10.582 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-28T21:49:10.584 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-28T21:49:10.603 INFO:teuthology.orchestra.run.smithi153.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-28T21:49:10.605 INFO:teuthology.orchestra.run.smithi153.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-28T21:49:10.606 INFO:teuthology.orchestra.run.smithi153.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-28T21:49:10.607 INFO:teuthology.orchestra.run.smithi153.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-28T21:49:10.610 INFO:teuthology.orchestra.run.smithi153.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-28T21:49:10.613 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-28T21:49:10.614 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-28T21:49:10.700 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-03-28T21:49:10.722 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================ 2024-03-28T21:49:10.722 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-03-28T21:49:10.723 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================ 2024-03-28T21:49:10.723 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-03-28T21:49:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-28T21:49:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 6.6 k 2024-03-28T21:49:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 5.3 M 2024-03-28T21:49:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 889 k 2024-03-28T21:49:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 145 k 2024-03-28T21:49:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 1.5 M 2024-03-28T21:49:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 138 k 2024-03-28T21:49:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 3.5 M 2024-03-28T21:49:10.723 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 7.4 M 2024-03-28T21:49:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 49 k 2024-03-28T21:49:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 9.8 M 2024-03-28T21:49:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 47 M 2024-03-28T21:49:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 264 k 2024-03-28T21:49:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 748 k 2024-03-28T21:49:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 221 k 2024-03-28T21:49:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 27 k 2024-03-28T21:49:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 18 k 2024-03-28T21:49:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-28T21:49:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-28T21:49:10.724 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-28T21:49:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 32 k 2024-03-28T21:49:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 746 k 2024-03-28T21:49:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 127 k 2024-03-28T21:49:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-28T21:49:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-28T21:49:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-28T21:49:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-28T21:49:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-28T21:49:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-28T21:49:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 162 k 2024-03-28T21:49:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 321 k 2024-03-28T21:49:10.725 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 299 k 2024-03-28T21:49:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 100 k 2024-03-28T21:49:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 86 k 2024-03-28T21:49:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 3.1 M 2024-03-28T21:49:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 171 k 2024-03-28T21:49:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-28T21:49:10.726 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-03-28T21:49:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-28T21:49:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-28T21:49:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-28T21:49:10.726 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-28T21:49:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-28T21:49:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-28T21:49:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-28T21:49:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-28T21:49:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-28T21:49:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-28T21:49:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-28T21:49:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-28T21:49:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-28T21:49:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 3.4 M 2024-03-28T21:49:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 3.1 M 2024-03-28T21:49:10.727 INFO:teuthology.orchestra.run.smithi153.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-28T21:49:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-28T21:49:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-28T21:49:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-28T21:49:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-28T21:49:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-28T21:49:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-28T21:49:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-28T21:49:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-28T21:49:10.728 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-03-28T21:49:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-28T21:49:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-28T21:49:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-28T21:49:10.728 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 21 M 2024-03-28T21:49:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 31 k 2024-03-28T21:49:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 2.4 M 2024-03-28T21:49:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 248 k 2024-03-28T21:49:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 4.7 M 2024-03-28T21:49:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 17 M 2024-03-28T21:49:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1899.g323d23dc.el9 ceph-noarch 15 k 2024-03-28T21:49:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 25 k 2024-03-28T21:49:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-28T21:49:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-28T21:49:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-28T21:49:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-28T21:49:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-28T21:49:10.729 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-28T21:49:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-28T21:49:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-28T21:49:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-28T21:49:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 163 k 2024-03-28T21:49:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-28T21:49:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-28T21:49:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-28T21:49:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-28T21:49:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-28T21:49:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 501 k 2024-03-28T21:49:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-28T21:49:10.730 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 5.1 M 2024-03-28T21:49:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-28T21:49:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-28T21:49:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-28T21:49:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-28T21:49:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-28T21:49:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-28T21:49:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-28T21:49:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-28T21:49:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-28T21:49:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-28T21:49:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-28T21:49:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-28T21:49:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-28T21:49:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-28T21:49:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-28T21:49:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-28T21:49:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-28T21:49:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-28T21:49:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 45 k 2024-03-28T21:49:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:19.0.0-1899.g323d23dc.el9 ceph 131 k 2024-03-28T21:49:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-28T21:49:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-28T21:49:10.732 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-28T21:49:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-28T21:49:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-28T21:49:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-28T21:49:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-28T21:49:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-28T21:49:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-28T21:49:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-28T21:49:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-28T21:49:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-28T21:49:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-28T21:49:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-28T21:49:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-28T21:49:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-28T21:49:10.733 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-28T21:49:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-28T21:49:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-28T21:49:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-28T21:49:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-28T21:49:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-28T21:49:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-28T21:49:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-28T21:49:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-28T21:49:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-28T21:49:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-28T21:49:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-28T21:49:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-28T21:49:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-28T21:49:10.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-28T21:49:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-28T21:49:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-28T21:49:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-28T21:49:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-28T21:49:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-28T21:49:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-28T21:49:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-28T21:49:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-28T21:49:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-28T21:49:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-28T21:49:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-28T21:49:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-28T21:49:10.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-28T21:49:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-28T21:49:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-28T21:49:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-28T21:49:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-28T21:49:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-28T21:49:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-28T21:49:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-28T21:49:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-28T21:49:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-28T21:49:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-28T21:49:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-28T21:49:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-03-28T21:49:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-03-28T21:49:10.736 INFO:teuthology.orchestra.run.smithi153.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-28T21:49:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-28T21:49:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-28T21:49:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-28T21:49:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-28T21:49:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-28T21:49:10.737 INFO:teuthology.orchestra.run.smithi153.stdout:Installing weak dependencies: 2024-03-28T21:49:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-03-28T21:49:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:49:10.737 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-03-28T21:49:10.737 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================ 2024-03-28T21:49:10.737 INFO:teuthology.orchestra.run.smithi153.stdout:Install 150 Packages 2024-03-28T21:49:10.737 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 24 Packages 2024-03-28T21:49:10.737 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:49:10.738 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 226 M 2024-03-28T21:49:10.738 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-03-28T21:49:11.534 INFO:teuthology.orchestra.run.smithi153.stdout:(1/174): ceph-19.0.0-1899.g323d23dc.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-03-28T21:49:11.945 INFO:teuthology.orchestra.run.smithi165.stdout:(130/174): python3-kubernetes-26.1.0-2.el9.noar 764 kB/s | 1.0 MB 00:01 2024-03-28T21:49:12.074 INFO:teuthology.orchestra.run.smithi165.stdout:(131/174): python3-grpcio-1.46.7-10.el9.x86_64. 843 kB/s | 2.0 MB 00:02 2024-03-28T21:49:12.092 INFO:teuthology.orchestra.run.smithi153.stdout:(2/174): ceph-fuse-19.0.0-1899.g323d23dc.el9.x8 1.6 MB/s | 889 kB 00:00 2024-03-28T21:49:12.099 INFO:teuthology.orchestra.run.smithi165.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 303 kB/s | 46 kB 00:00 2024-03-28T21:49:12.191 INFO:teuthology.orchestra.run.smithi165.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 680 kB/s | 79 kB 00:00 2024-03-28T21:49:12.192 INFO:teuthology.orchestra.run.smithi153.stdout:(3/174): ceph-immutable-object-cache-19.0.0-189 1.4 MB/s | 145 kB 00:00 2024-03-28T21:49:12.216 INFO:teuthology.orchestra.run.smithi165.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 496 kB/s | 58 kB 00:00 2024-03-28T21:49:12.325 INFO:teuthology.orchestra.run.smithi165.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 152 kB/s | 16 kB 00:00 2024-03-28T21:49:12.384 INFO:teuthology.orchestra.run.smithi153.stdout:(4/174): ceph-base-19.0.0-1899.g323d23dc.el9.x8 4.5 MB/s | 5.3 MB 00:01 2024-03-28T21:49:12.417 INFO:teuthology.orchestra.run.smithi165.stdout:(136/174): libarrow-9.0.0-10.el9.x86_64.rpm 847 kB/s | 4.4 MB 00:05 2024-03-28T21:49:12.526 INFO:teuthology.orchestra.run.smithi165.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 450 kB/s | 90 kB 00:00 2024-03-28T21:49:12.551 INFO:teuthology.orchestra.run.smithi165.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 212 kB/s | 28 kB 00:00 2024-03-28T21:49:12.551 INFO:teuthology.orchestra.run.smithi153.stdout:(5/174): ceph-mgr-19.0.0-1899.g323d23dc.el9.x86 9.0 MB/s | 1.5 MB 00:00 2024-03-28T21:49:12.601 INFO:teuthology.orchestra.run.smithi165.stdout:(139/174): python3-pecan-1.4.2-3.el9.noarch.rpm 665 kB/s | 272 kB 00:00 2024-03-28T21:49:12.635 INFO:teuthology.orchestra.run.smithi165.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 284 kB/s | 31 kB 00:00 2024-03-28T21:49:12.702 INFO:teuthology.orchestra.run.smithi165.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 591 kB/s | 59 kB 00:00 2024-03-28T21:49:12.744 INFO:teuthology.orchestra.run.smithi165.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 331 kB/s | 36 kB 00:00 2024-03-28T21:49:12.802 INFO:teuthology.orchestra.run.smithi165.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 511 kB/s | 51 kB 00:00 2024-03-28T21:49:12.853 INFO:teuthology.orchestra.run.smithi165.stdout:(144/174): python3-routes-2.5.1-5.el9.noarch.rp 626 kB/s | 188 kB 00:00 2024-03-28T21:49:12.910 INFO:teuthology.orchestra.run.smithi153.stdout:(6/174): ceph-mon-19.0.0-1899.g323d23dc.el9.x86 13 MB/s | 4.7 MB 00:00 2024-03-28T21:49:12.985 INFO:teuthology.orchestra.run.smithi153.stdout:(7/174): ceph-mds-19.0.0-1899.g323d23dc.el9.x86 3.0 MB/s | 2.4 MB 00:00 2024-03-28T21:49:12.995 INFO:teuthology.orchestra.run.smithi165.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 468 kB/s | 90 kB 00:00 2024-03-28T21:49:13.095 INFO:teuthology.orchestra.run.smithi165.stdout:(146/174): python3-zc-lockfile-2.0-10.el9.noarc 201 kB/s | 20 kB 00:00 2024-03-28T21:49:13.120 INFO:teuthology.orchestra.run.smithi165.stdout:(147/174): python3-webob-1.8.7-6.el9.noarch.rpm 611 kB/s | 230 kB 00:00 2024-03-28T21:49:13.429 INFO:teuthology.orchestra.run.smithi165.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 576 kB/s | 192 kB 00:00 2024-03-28T21:49:13.462 INFO:teuthology.orchestra.run.smithi165.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 701 kB/s | 427 kB 00:00 2024-03-28T21:49:14.168 INFO:teuthology.orchestra.run.smithi153.stdout:(8/174): ceph-osd-19.0.0-1899.g323d23dc.el9.x86 13 MB/s | 17 MB 00:01 2024-03-28T21:49:14.210 INFO:teuthology.orchestra.run.smithi153.stdout:(9/174): ceph-selinux-19.0.0-1899.g323d23dc.el9 621 kB/s | 25 kB 00:00 2024-03-28T21:49:14.246 INFO:teuthology.orchestra.run.smithi165.stdout:(150/174): librbd1-19.0.0-1899.g323d23dc.el9.x8 4.0 MB/s | 3.1 MB 00:00 2024-03-28T21:49:14.355 INFO:teuthology.orchestra.run.smithi165.stdout:(151/174): NetworkManager-1.47.2-1.el9.x86_64.r 21 MB/s | 2.3 MB 00:00 2024-03-28T21:49:14.438 INFO:teuthology.orchestra.run.smithi165.stdout:(152/174): NetworkManager-libnm-1.47.2-1.el9.x8 22 MB/s | 1.8 MB 00:00 2024-03-28T21:49:14.530 INFO:teuthology.orchestra.run.smithi165.stdout:(153/174): librados2-19.0.0-1899.g323d23dc.el9. 3.1 MB/s | 3.4 MB 00:01 2024-03-28T21:49:14.556 INFO:teuthology.orchestra.run.smithi165.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 353 kB/s | 41 kB 00:00 2024-03-28T21:49:14.589 INFO:teuthology.orchestra.run.smithi165.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 4.2 MB/s | 247 kB 00:00 2024-03-28T21:49:14.623 INFO:teuthology.orchestra.run.smithi165.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.9 MB/s | 321 kB 00:00 2024-03-28T21:49:15.198 INFO:teuthology.orchestra.run.smithi165.stdout:(157/174): thrift-0.15.0-2.el9.x86_64.rpm 780 kB/s | 1.6 MB 00:02 2024-03-28T21:49:15.323 INFO:teuthology.orchestra.run.smithi165.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 52 kB/s | 36 kB 00:00 2024-03-28T21:49:15.348 INFO:teuthology.orchestra.run.smithi165.stdout:(159/174): acl-2.3.1-4.el9.x86_64.rpm 94 kB/s | 71 kB 00:00 2024-03-28T21:49:15.496 INFO:teuthology.orchestra.run.smithi153.stdout:(10/174): ceph-radosgw-19.0.0-1899.g323d23dc.el 3.9 MB/s | 9.8 MB 00:02 2024-03-28T21:49:15.752 INFO:teuthology.orchestra.run.smithi153.stdout:(11/174): ceph-common-19.0.0-1899.g323d23dc.el9 4.5 MB/s | 21 MB 00:04 2024-03-28T21:49:15.786 INFO:teuthology.orchestra.run.smithi153.stdout:(12/174): cephfs-mirror-19.0.0-1899.g323d23dc.e 766 kB/s | 221 kB 00:00 2024-03-28T21:49:15.819 INFO:teuthology.orchestra.run.smithi153.stdout:(13/174): cephfs-shell-19.0.0-1899.g323d23dc.el 411 kB/s | 27 kB 00:00 2024-03-28T21:49:15.844 INFO:teuthology.orchestra.run.smithi153.stdout:(14/174): libcephfs-devel-19.0.0-1899.g323d23dc 548 kB/s | 32 kB 00:00 2024-03-28T21:49:15.912 INFO:teuthology.orchestra.run.smithi153.stdout:(15/174): libcephsqlite-19.0.0-1899.g323d23dc.e 2.4 MB/s | 163 kB 00:00 2024-03-28T21:49:15.995 INFO:teuthology.orchestra.run.smithi153.stdout:(16/174): libcephfs2-19.0.0-1899.g323d23dc.el9. 4.2 MB/s | 746 kB 00:00 2024-03-28T21:49:16.020 INFO:teuthology.orchestra.run.smithi153.stdout:(17/174): librados-devel-19.0.0-1899.g323d23dc. 1.1 MB/s | 127 kB 00:00 2024-03-28T21:49:16.115 INFO:teuthology.orchestra.run.smithi165.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 30 kB/s | 23 kB 00:00 2024-03-28T21:49:16.154 INFO:teuthology.orchestra.run.smithi153.stdout:(18/174): libradosstriper1-19.0.0-1899.g323d23d 3.1 MB/s | 501 kB 00:00 2024-03-28T21:49:16.249 INFO:teuthology.orchestra.run.smithi165.stdout:(161/174): elfutils-libelf-0.190-2.el9.x86_64.r 183 kB/s | 192 kB 00:01 2024-03-28T21:49:16.271 INFO:teuthology.orchestra.run.smithi153.stdout:(19/174): python3-ceph-argparse-19.0.0-1899.g32 391 kB/s | 45 kB 00:00 2024-03-28T21:49:16.332 INFO:teuthology.orchestra.run.smithi165.stdout:(162/174): elfutils-libs-0.190-2.el9.x86_64.rpm 254 kB/s | 256 kB 00:01 2024-03-28T21:49:16.363 INFO:teuthology.orchestra.run.smithi153.stdout:(20/174): python3-ceph-common-19.0.0-1899.g323d 1.4 MB/s | 131 kB 00:00 2024-03-28T21:49:16.463 INFO:teuthology.orchestra.run.smithi153.stdout:(21/174): python3-cephfs-19.0.0-1899.g323d23dc. 1.6 MB/s | 162 kB 00:00 2024-03-28T21:49:16.588 INFO:teuthology.orchestra.run.smithi153.stdout:(22/174): python3-rados-19.0.0-1899.g323d23dc.e 2.5 MB/s | 321 kB 00:00 2024-03-28T21:49:16.689 INFO:teuthology.orchestra.run.smithi153.stdout:(23/174): python3-rbd-19.0.0-1899.g323d23dc.el9 2.9 MB/s | 299 kB 00:00 2024-03-28T21:49:16.781 INFO:teuthology.orchestra.run.smithi153.stdout:(24/174): python3-rgw-19.0.0-1899.g323d23dc.el9 1.1 MB/s | 100 kB 00:00 2024-03-28T21:49:16.881 INFO:teuthology.orchestra.run.smithi153.stdout:(25/174): rbd-fuse-19.0.0-1899.g323d23dc.el9.x8 866 kB/s | 86 kB 00:00 2024-03-28T21:49:17.074 INFO:teuthology.orchestra.run.smithi165.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 113 kB/s | 108 kB 00:00 2024-03-28T21:49:17.193 INFO:teuthology.orchestra.run.smithi165.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 165 kB/s | 155 kB 00:00 2024-03-28T21:49:17.224 INFO:teuthology.orchestra.run.smithi165.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 152 kB/s | 136 kB 00:00 2024-03-28T21:49:17.506 INFO:teuthology.orchestra.run.smithi153.stdout:(26/174): ceph-test-19.0.0-1899.g323d23dc.el9.x 14 MB/s | 47 MB 00:03 2024-03-28T21:49:17.615 INFO:teuthology.orchestra.run.smithi153.stdout:(27/174): librgw2-19.0.0-1899.g323d23dc.el9.x86 3.2 MB/s | 5.1 MB 00:01 2024-03-28T21:49:17.648 INFO:teuthology.orchestra.run.smithi153.stdout:(28/174): rbd-nbd-19.0.0-1899.g323d23dc.el9.x86 1.2 MB/s | 171 kB 00:00 2024-03-28T21:49:17.699 INFO:teuthology.orchestra.run.smithi153.stdout:(29/174): ceph-grafana-dashboards-19.0.0-1899.g 381 kB/s | 31 kB 00:00 2024-03-28T21:49:17.749 INFO:teuthology.orchestra.run.smithi153.stdout:(30/174): ceph-mgr-cephadm-19.0.0-1899.g323d23d 1.3 MB/s | 138 kB 00:00 2024-03-28T21:49:17.849 INFO:teuthology.orchestra.run.smithi153.stdout:(31/174): rbd-mirror-19.0.0-1899.g323d23dc.el9. 3.2 MB/s | 3.1 MB 00:00 2024-03-28T21:49:17.875 INFO:teuthology.orchestra.run.smithi165.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 42 kB/s | 29 kB 00:00 2024-03-28T21:49:17.917 INFO:teuthology.orchestra.run.smithi165.stdout:(167/174): libsmartcols-2.37.4-18.el9.x86_64.rp 76 kB/s | 64 kB 00:00 2024-03-28T21:49:17.941 INFO:teuthology.orchestra.run.smithi153.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1899.g32 2.7 MB/s | 248 kB 00:00 2024-03-28T21:49:18.041 INFO:teuthology.orchestra.run.smithi153.stdout:(33/174): ceph-mgr-rook-19.0.0-1899.g323d23dc.e 498 kB/s | 49 kB 00:00 2024-03-28T21:49:18.133 INFO:teuthology.orchestra.run.smithi153.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1899.g3 169 kB/s | 15 kB 00:00 2024-03-28T21:49:18.267 INFO:teuthology.orchestra.run.smithi153.stdout:(35/174): ceph-mgr-diskprediction-local-19.0.0- 14 MB/s | 7.4 MB 00:00 2024-03-28T21:49:18.301 INFO:teuthology.orchestra.run.smithi153.stdout:(36/174): ceph-volume-19.0.0-1899.g323d23dc.el9 1.6 MB/s | 264 kB 00:00 2024-03-28T21:49:18.351 INFO:teuthology.orchestra.run.smithi153.stdout:(37/174): cephadm-19.0.0-1899.g323d23dc.el9.noa 8.9 MB/s | 748 kB 00:00 2024-03-28T21:49:18.376 INFO:teuthology.orchestra.run.smithi153.stdout:(38/174): cephfs-top-19.0.0-1899.g323d23dc.el9. 245 kB/s | 18 kB 00:00 2024-03-28T21:49:18.460 INFO:teuthology.orchestra.run.smithi153.stdout:(39/174): ceph-mgr-dashboard-19.0.0-1899.g323d2 4.6 MB/s | 3.5 MB 00:00 2024-03-28T21:49:18.802 INFO:teuthology.orchestra.run.smithi153.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 464 kB/s | 106 kB 00:00 2024-03-28T21:49:18.944 INFO:teuthology.orchestra.run.smithi153.stdout:(41/174): bison-3.7.4-5.el9.x86_64.rpm 1.6 MB/s | 920 kB 00:00 2024-03-28T21:49:18.985 INFO:teuthology.orchestra.run.smithi153.stdout:(42/174): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 662 kB 00:00 2024-03-28T21:49:19.086 INFO:teuthology.orchestra.run.smithi153.stdout:(43/174): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 307 kB 00:00 2024-03-28T21:49:19.103 INFO:teuthology.orchestra.run.smithi153.stdout:(44/174): flexiblas-3.0.4-8.el9.x86_64.rpm 201 kB/s | 32 kB 00:00 2024-03-28T21:49:19.495 INFO:teuthology.orchestra.run.smithi153.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 42 kB/s | 17 kB 00:00 2024-03-28T21:49:19.511 INFO:teuthology.orchestra.run.smithi153.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 25 kB/s | 10 kB 00:00 2024-03-28T21:49:19.717 INFO:teuthology.orchestra.run.smithi165.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 497 kB/s | 1.2 MB 00:02 2024-03-28T21:49:19.953 INFO:teuthology.orchestra.run.smithi153.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 362 kB/s | 159 kB 00:00 2024-03-28T21:49:19.978 INFO:teuthology.orchestra.run.smithi153.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 95 kB/s | 44 kB 00:00 2024-03-28T21:49:20.054 INFO:teuthology.orchestra.run.smithi153.stdout:(49/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-03-28T21:49:20.179 INFO:teuthology.orchestra.run.smithi153.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 2.9 MB/s | 661 kB 00:00 2024-03-28T21:49:20.313 INFO:teuthology.orchestra.run.smithi153.stdout:(51/174): libtool-2.4.6-45.el9.x86_64.rpm 1.7 MB/s | 578 kB 00:00 2024-03-28T21:49:20.338 INFO:teuthology.orchestra.run.smithi153.stdout:(52/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 165 kB/s | 46 kB 00:00 2024-03-28T21:49:20.380 INFO:teuthology.orchestra.run.smithi153.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 282 kB 00:00 2024-03-28T21:49:20.422 INFO:teuthology.orchestra.run.smithi153.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2024-03-28T21:49:20.464 INFO:teuthology.orchestra.run.smithi153.stdout:(55/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.7 MB/s | 217 kB 00:00 2024-03-28T21:49:20.498 INFO:teuthology.orchestra.run.smithi153.stdout:(56/174): openblas-0.3.21-2.el9.x86_64.rpm 295 kB/s | 34 kB 00:00 2024-03-28T21:49:21.132 INFO:teuthology.orchestra.run.smithi153.stdout:(57/174): postgresql-contrib-13.14-1.el9.x86_64 1.3 MB/s | 817 kB 00:00 2024-03-28T21:49:21.217 INFO:teuthology.orchestra.run.smithi165.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 311 kB/s | 465 kB 00:01 2024-03-28T21:49:21.406 INFO:teuthology.orchestra.run.smithi153.stdout:(58/174): postgresql-13.14-1.el9.x86_64.rpm 1.6 MB/s | 1.5 MB 00:00 2024-03-28T21:49:21.482 INFO:teuthology.orchestra.run.smithi153.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 380 kB/s | 132 kB 00:00 2024-03-28T21:49:21.782 INFO:teuthology.orchestra.run.smithi153.stdout:(60/174): openblas-openmp-0.3.21-2.el9.x86_64.r 3.5 MB/s | 4.7 MB 00:01 2024-03-28T21:49:21.960 INFO:teuthology.orchestra.run.smithi165.stdout:(170/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 541 kB/s | 2.2 MB 00:04 2024-03-28T21:49:22.051 INFO:teuthology.orchestra.run.smithi165.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 37 kB/s | 31 kB 00:00 2024-03-28T21:49:22.099 INFO:teuthology.orchestra.run.smithi153.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 1.6 MB/s | 1.0 MB 00:00 2024-03-28T21:49:22.124 INFO:teuthology.orchestra.run.smithi153.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 230 kB/s | 78 kB 00:00 2024-03-28T21:49:22.210 INFO:teuthology.orchestra.run.smithi165.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 473 kB/s | 74 kB 00:00 2024-03-28T21:49:22.351 INFO:teuthology.orchestra.run.smithi165.stdout:(173/174): util-linux-2.37.4-18.el9.x86_64.rpm 527 kB/s | 2.3 MB 00:04 2024-03-28T21:49:22.492 INFO:teuthology.orchestra.run.smithi153.stdout:(63/174): python3-jsonpatch-1.21-16.el9.noarch. 68 kB/s | 24 kB 00:00 2024-03-28T21:49:22.800 INFO:teuthology.orchestra.run.smithi153.stdout:(64/174): postgresql-server-13.14-1.el9.x86_64. 4.1 MB/s | 5.7 MB 00:01 2024-03-28T21:49:22.825 INFO:teuthology.orchestra.run.smithi153.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 55 kB/s | 18 kB 00:00 2024-03-28T21:49:23.134 INFO:teuthology.orchestra.run.smithi153.stdout:(66/174): python3-babel-2.9.1-2.el9.noarch.rpm 5.6 MB/s | 5.8 MB 00:01 2024-03-28T21:49:23.159 INFO:teuthology.orchestra.run.smithi153.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 408 kB/s | 144 kB 00:00 2024-03-28T21:49:23.193 INFO:teuthology.orchestra.run.smithi153.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 88 kB/s | 32 kB 00:00 2024-03-28T21:49:23.484 INFO:teuthology.orchestra.run.smithi153.stdout:(69/174): python3-oauthlib-3.1.1-5.el9.noarch.r 610 kB/s | 174 kB 00:00 2024-03-28T21:49:23.510 INFO:teuthology.orchestra.run.smithi153.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 698 kB/s | 217 kB 00:00 2024-03-28T21:49:23.668 INFO:teuthology.orchestra.run.smithi153.stdout:(71/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.0 MB/s | 4.8 MB 00:00 2024-03-28T21:49:23.694 INFO:teuthology.orchestra.run.smithi153.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 333 kB/s | 69 kB 00:00 2024-03-28T21:49:23.719 INFO:teuthology.orchestra.run.smithi153.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 204 kB/s | 41 kB 00:00 2024-03-28T21:49:23.752 INFO:teuthology.orchestra.run.smithi153.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 2.8 MB/s | 238 kB 00:00 2024-03-28T21:49:23.769 INFO:teuthology.orchestra.run.smithi153.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 132 kB 00:00 2024-03-28T21:49:23.803 INFO:teuthology.orchestra.run.smithi153.stdout:(76/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.6 MB/s | 211 kB 00:00 2024-03-28T21:49:23.828 INFO:teuthology.orchestra.run.smithi153.stdout:(77/174): python3-pytz-2021.1-5.el9.noarch.rpm 644 kB/s | 47 kB 00:00 2024-03-28T21:49:23.862 INFO:teuthology.orchestra.run.smithi153.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 477 kB/s | 43 kB 00:00 2024-03-28T21:49:24.304 INFO:teuthology.orchestra.run.smithi153.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 89 kB/s | 39 kB 00:00 2024-03-28T21:49:24.320 INFO:teuthology.orchestra.run.smithi153.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 91 kB/s | 41 kB 00:00 2024-03-28T21:49:24.393 INFO:teuthology.orchestra.run.smithi165.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 452 kB/s | 1.1 MB 00:02 2024-03-28T21:49:24.403 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-03-28T21:49:24.404 INFO:teuthology.orchestra.run.smithi165.stdout:Total 7.7 MB/s | 226 MB 00:29 2024-03-28T21:49:24.587 INFO:teuthology.orchestra.run.smithi153.stdout:(81/174): qatlib-24.02.0-1.el9.x86_64.rpm 778 kB/s | 220 kB 00:00 2024-03-28T21:49:24.613 INFO:teuthology.orchestra.run.smithi153.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 125 kB/s | 35 kB 00:00 2024-03-28T21:49:24.855 INFO:teuthology.orchestra.run.smithi153.stdout:(83/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-03-28T21:49:24.880 INFO:teuthology.orchestra.run.smithi153.stdout:(84/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 159 kB/s | 46 kB 00:00 2024-03-28T21:49:24.913 INFO:teuthology.orchestra.run.smithi153.stdout:(85/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 300 kB 00:00 2024-03-28T21:49:24.938 INFO:teuthology.orchestra.run.smithi153.stdout:(86/174): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-03-28T21:49:24.972 INFO:teuthology.orchestra.run.smithi153.stdout:(87/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 707 kB/s | 63 kB 00:00 2024-03-28T21:49:24.998 INFO:teuthology.orchestra.run.smithi153.stdout:(88/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 536 kB/s | 44 kB 00:00 2024-03-28T21:49:25.031 INFO:teuthology.orchestra.run.smithi153.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2024-03-28T21:49:25.065 INFO:teuthology.orchestra.run.smithi153.stdout:(90/174): fuse-2.9.9-15.el9.x86_64.rpm 866 kB/s | 79 kB 00:00 2024-03-28T21:49:25.115 INFO:teuthology.orchestra.run.smithi153.stdout:(91/174): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.1 MB 00:00 2024-03-28T21:49:25.140 INFO:teuthology.orchestra.run.smithi153.stdout:(92/174): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 103 kB 00:00 2024-03-28T21:49:25.166 INFO:teuthology.orchestra.run.smithi153.stdout:(93/174): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2024-03-28T21:49:25.199 INFO:teuthology.orchestra.run.smithi153.stdout:(94/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-03-28T21:49:25.333 INFO:teuthology.orchestra.run.smithi153.stdout:(95/174): jq-1.6-16.el9.x86_64.rpm 986 kB/s | 187 kB 00:00 2024-03-28T21:49:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-03-28T21:49:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-03-28T21:49:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:(98/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 803 kB 00:00 2024-03-28T21:49:25.567 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-03-28T21:49:25.667 INFO:teuthology.orchestra.run.smithi153.stdout:(99/174): elfutils-libelf-devel-0.190-2.el9.x86 72 kB/s | 21 kB 00:00 2024-03-28T21:49:25.710 INFO:teuthology.orchestra.run.smithi153.stdout:(100/174): libuuid-devel-2.37.4-18.el9.x86_64.r 92 kB/s | 25 kB 00:00 2024-03-28T21:49:25.949 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-03-28T21:49:25.949 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-03-28T21:49:26.110 INFO:teuthology.orchestra.run.smithi153.stdout:(101/174): python3-devel-3.9.17-2.el9.x86_64.rp 556 kB/s | 245 kB 00:00 2024-03-28T21:49:26.143 INFO:teuthology.orchestra.run.smithi153.stdout:(102/174): python3-jinja2-2.11.3-5.el9.noarch.r 572 kB/s | 248 kB 00:00 2024-03-28T21:49:26.202 INFO:teuthology.orchestra.run.smithi153.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 388 kB/s | 22 kB 00:00 2024-03-28T21:49:26.227 INFO:teuthology.orchestra.run.smithi153.stdout:(104/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 804 kB/s | 94 kB 00:00 2024-03-28T21:49:26.361 INFO:teuthology.orchestra.run.smithi153.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 5.3 MB/s | 863 kB 00:00 2024-03-28T21:49:26.661 INFO:teuthology.orchestra.run.smithi153.stdout:(106/174): openssl-devel-3.0.7-27.el9.x86_64.rp 3.5 MB/s | 4.1 MB 00:01 2024-03-28T21:49:26.861 INFO:teuthology.orchestra.run.smithi153.stdout:(107/174): abseil-cpp-20211102.0-3.el9.x86_64.r 867 kB/s | 548 kB 00:00 2024-03-28T21:49:26.928 INFO:teuthology.orchestra.run.smithi153.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 73 kB/s | 19 kB 00:00 2024-03-28T21:49:26.962 INFO:teuthology.orchestra.run.smithi153.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 515 kB/s | 309 kB 00:00 2024-03-28T21:49:27.195 INFO:teuthology.orchestra.run.smithi153.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 98 kB/s | 26 kB 00:00 2024-03-28T21:49:27.312 INFO:teuthology.orchestra.run.smithi153.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 139 kB/s | 49 kB 00:00 2024-03-28T21:49:27.545 INFO:teuthology.orchestra.run.smithi153.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 193 kB/s | 67 kB 00:00 2024-03-28T21:49:27.746 INFO:teuthology.orchestra.run.smithi153.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 349 kB/s | 151 kB 00:00 2024-03-28T21:49:27.846 INFO:teuthology.orchestra.run.smithi153.stdout:(114/174): libarrow-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2024-03-28T21:49:28.196 INFO:teuthology.orchestra.run.smithi153.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 124 kB/s | 43 kB 00:00 2024-03-28T21:49:28.247 INFO:teuthology.orchestra.run.smithi153.stdout:(116/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-03-28T21:49:28.303 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-03-28T21:49:28.304 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-03-28T21:49:28.372 INFO:teuthology.orchestra.run.smithi153.stdout:(117/174): python3-asyncssh-2.13.2-5.el9.noarch 877 kB/s | 548 kB 00:00 2024-03-28T21:49:28.456 INFO:teuthology.orchestra.run.smithi153.stdout:(118/174): python3-cachetools-4.2.4-1.el9.noarc 125 kB/s | 32 kB 00:00 2024-03-28T21:49:28.548 INFO:teuthology.orchestra.run.smithi153.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 50 kB/s | 15 kB 00:00 2024-03-28T21:49:28.832 INFO:teuthology.orchestra.run.smithi153.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 375 kB/s | 172 kB 00:00 2024-03-28T21:49:28.990 INFO:teuthology.orchestra.run.smithi153.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 672 kB/s | 358 kB 00:00 2024-03-28T21:49:29.099 INFO:teuthology.orchestra.run.smithi153.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 133 kB/s | 35 kB 00:00 2024-03-28T21:49:29.132 INFO:teuthology.orchestra.run.smithi153.stdout:(123/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 520 kB/s | 303 kB 00:00 2024-03-28T21:49:29.508 INFO:teuthology.orchestra.run.smithi153.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 392 kB/s | 203 kB 00:00 2024-03-28T21:49:29.641 INFO:teuthology.orchestra.run.smithi153.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 284 kB/s | 144 kB 00:00 2024-03-28T21:49:29.691 INFO:teuthology.orchestra.run.smithi153.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 58 kB/s | 11 kB 00:00 2024-03-28T21:49:29.892 INFO:teuthology.orchestra.run.smithi153.stdout:(127/174): python3-grpcio-1.46.7-10.el9.x86_64. 2.6 MB/s | 2.0 MB 00:00 2024-03-28T21:49:29.917 INFO:teuthology.orchestra.run.smithi153.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 64 kB/s | 18 kB 00:00 2024-03-28T21:49:29.959 INFO:teuthology.orchestra.run.smithi153.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 87 kB/s | 23 kB 00:00 2024-03-28T21:49:30.159 INFO:teuthology.orchestra.run.smithi153.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 73 kB/s | 19 kB 00:00 2024-03-28T21:49:30.184 INFO:teuthology.orchestra.run.smithi153.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 74 kB/s | 20 kB 00:00 2024-03-28T21:49:30.509 INFO:teuthology.orchestra.run.smithi153.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 132 kB/s | 46 kB 00:00 2024-03-28T21:49:30.535 INFO:teuthology.orchestra.run.smithi153.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 225 kB/s | 79 kB 00:00 2024-03-28T21:49:30.668 INFO:teuthology.orchestra.run.smithi153.stdout:(134/174): python3-kubernetes-26.1.0-2.el9.noar 1.4 MB/s | 1.0 MB 00:00 2024-03-28T21:49:30.877 INFO:teuthology.orchestra.run.smithi153.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 157 kB/s | 58 kB 00:00 2024-03-28T21:49:30.935 INFO:teuthology.orchestra.run.smithi153.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 62 kB/s | 16 kB 00:00 2024-03-28T21:49:31.052 INFO:teuthology.orchestra.run.smithi153.stdout:(137/174): python3-pecan-1.4.2-3.el9.noarch.rpm 528 kB/s | 272 kB 00:00 2024-03-28T21:49:31.203 INFO:teuthology.orchestra.run.smithi153.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 106 kB/s | 28 kB 00:00 2024-03-28T21:49:31.228 INFO:teuthology.orchestra.run.smithi153.stdout:(139/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 257 kB/s | 90 kB 00:00 2024-03-28T21:49:31.328 INFO:teuthology.orchestra.run.smithi153.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 112 kB/s | 31 kB 00:00 2024-03-28T21:49:31.595 INFO:teuthology.orchestra.run.smithi153.stdout:(141/174): python3-tempora-5.0.0-2.el9.noarch.r 134 kB/s | 36 kB 00:00 2024-03-28T21:49:31.620 INFO:teuthology.orchestra.run.smithi153.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 151 kB/s | 59 kB 00:00 2024-03-28T21:49:31.720 INFO:teuthology.orchestra.run.smithi153.stdout:(143/174): python3-routes-2.5.1-5.el9.noarch.rp 365 kB/s | 188 kB 00:00 2024-03-28T21:49:31.971 INFO:teuthology.orchestra.run.smithi153.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 136 kB/s | 51 kB 00:00 2024-03-28T21:49:32.138 INFO:teuthology.orchestra.run.smithi153.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 215 kB/s | 90 kB 00:00 2024-03-28T21:49:32.172 INFO:teuthology.orchestra.run.smithi153.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 417 kB/s | 230 kB 00:00 2024-03-28T21:49:32.405 INFO:teuthology.orchestra.run.smithi153.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 75 kB/s | 20 kB 00:00 2024-03-28T21:49:32.564 INFO:teuthology.orchestra.run.smithi153.stdout:(148/174): python3-werkzeug-2.0.3-3.el9.1.noarc 722 kB/s | 427 kB 00:00 2024-03-28T21:49:32.598 INFO:teuthology.orchestra.run.smithi153.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 451 kB/s | 192 kB 00:00 2024-03-28T21:49:33.181 INFO:teuthology.orchestra.run.smithi153.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-03-28T21:49:33.357 INFO:teuthology.orchestra.run.smithi153.stdout:(151/174): librados2-19.0.0-1899.g323d23dc.el9. 4.3 MB/s | 3.4 MB 00:00 2024-03-28T21:49:33.432 INFO:teuthology.orchestra.run.smithi153.stdout:(152/174): NetworkManager-1.47.2-1.el9.x86_64.r 9.2 MB/s | 2.3 MB 00:00 2024-03-28T21:49:33.557 INFO:teuthology.orchestra.run.smithi153.stdout:(153/174): NetworkManager-libnm-1.47.2-1.el9.x8 9.6 MB/s | 1.8 MB 00:00 2024-03-28T21:49:33.574 INFO:teuthology.orchestra.run.smithi153.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 306 kB/s | 41 kB 00:00 2024-03-28T21:49:33.641 INFO:teuthology.orchestra.run.smithi153.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 2.9 MB/s | 247 kB 00:00 2024-03-28T21:49:33.674 INFO:teuthology.orchestra.run.smithi153.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 3.2 MB/s | 321 kB 00:00 2024-03-28T21:49:33.716 INFO:teuthology.orchestra.run.smithi153.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2024-03-28T21:49:33.740 INFO:teuthology.orchestra.run.smithi153.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 567 kB/s | 36 kB 00:00 2024-03-28T21:49:33.790 INFO:teuthology.orchestra.run.smithi153.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.6 MB/s | 192 kB 00:00 2024-03-28T21:49:33.824 INFO:teuthology.orchestra.run.smithi153.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-03-28T21:49:33.841 INFO:teuthology.orchestra.run.smithi153.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 467 kB/s | 23 kB 00:00 2024-03-28T21:49:33.875 INFO:teuthology.orchestra.run.smithi153.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-28T21:49:33.917 INFO:teuthology.orchestra.run.smithi153.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 155 kB 00:00 2024-03-28T21:49:33.951 INFO:teuthology.orchestra.run.smithi153.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 136 kB 00:00 2024-03-28T21:49:33.976 INFO:teuthology.orchestra.run.smithi153.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.1 MB/s | 64 kB 00:00 2024-03-28T21:49:34.001 INFO:teuthology.orchestra.run.smithi153.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 581 kB/s | 29 kB 00:00 2024-03-28T21:49:34.076 INFO:teuthology.orchestra.run.smithi153.stdout:(167/174): librbd1-19.0.0-1899.g323d23dc.el9.x8 2.1 MB/s | 3.1 MB 00:01 2024-03-28T21:49:34.160 INFO:teuthology.orchestra.run.smithi153.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 6.6 MB/s | 1.2 MB 00:00 2024-03-28T21:49:34.227 INFO:teuthology.orchestra.run.smithi153.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 9.6 MB/s | 2.2 MB 00:00 2024-03-28T21:49:34.269 INFO:teuthology.orchestra.run.smithi153.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 4.2 MB/s | 465 kB 00:00 2024-03-28T21:49:34.399 INFO:teuthology.orchestra.run.smithi153.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 182 kB/s | 31 kB 00:00 2024-03-28T21:49:34.511 INFO:teuthology.orchestra.run.smithi153.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 4.5 MB/s | 1.1 MB 00:00 2024-03-28T21:49:34.578 INFO:teuthology.orchestra.run.smithi153.stdout:(173/174): util-linux-2.37.4-18.el9.x86_64.rpm 4.6 MB/s | 2.3 MB 00:00 2024-03-28T21:49:35.214 INFO:teuthology.orchestra.run.smithi153.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 91 kB/s | 74 kB 00:00 2024-03-28T21:49:35.222 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-03-28T21:49:35.223 INFO:teuthology.orchestra.run.smithi153.stdout:Total 9.2 MB/s | 226 MB 00:24 2024-03-28T21:49:35.447 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-03-28T21:49:35.562 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-28T21:49:35.601 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-28T21:49:35.638 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-28T21:49:35.682 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-28T21:49:35.778 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-28T21:49:35.896 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-28T21:49:35.966 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-28T21:49:36.004 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-28T21:49:36.084 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-28T21:49:36.368 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-03-28T21:49:36.504 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-28T21:49:36.536 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librados2-2:19.0.0-1899.g323d23dc.el9.x86_64 10/198 2024-03-28T21:49:36.693 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:19.0.0-1899.g323d23dc.el9.x86_64 10/198 2024-03-28T21:49:36.720 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs2-2:19.0.0-1899.g323d23dc.el9.x86_64 11/198 2024-03-28T21:49:36.749 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-03-28T21:49:36.749 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-03-28T21:49:36.840 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs2-2:19.0.0-1899.g323d23dc.el9.x86_64 11/198 2024-03-28T21:49:36.882 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rados-2:19.0.0-1899.g323d23dc.el9.x86_64 12/198 2024-03-28T21:49:36.958 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-28T21:49:37.239 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-28T21:49:37.295 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-28T21:49:37.317 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephsqlite-2:19.0.0-1899.g323d23dc.el9.x86_64 16/198 2024-03-28T21:49:37.478 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1899.g323d23dc.el9.x86_64 16/198 2024-03-28T21:49:37.502 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libradosstriper1-2:19.0.0-1899.g323d23dc.el9.x86 17/198 2024-03-28T21:49:37.600 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1899.g323d23dc.el9.x86 17/198 2024-03-28T21:49:37.645 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-28T21:49:37.662 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-28T21:49:37.734 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-28T21:49:38.056 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-28T21:49:38.104 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-28T21:49:38.154 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-28T21:49:38.465 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-28T21:49:38.645 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-28T21:49:38.733 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-28T21:49:38.929 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T21:49:38.994 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T21:49:39.101 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-03-28T21:49:39.102 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-03-28T21:49:39.315 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T21:49:39.496 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-28T21:49:39.613 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-28T21:49:39.654 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-28T21:49:39.690 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-28T21:49:39.750 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-28T21:49:39.881 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-28T21:49:39.956 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-28T21:49:40.006 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-28T21:49:40.107 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-28T21:49:40.152 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-28T21:49:40.214 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-28T21:49:40.248 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-28T21:49:40.280 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-28T21:49:40.380 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-28T21:49:40.418 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-common-2:19.0.0-1899.g323d23dc.el9. 39/198 2024-03-28T21:49:40.473 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-argparse-2:19.0.0-1899.g323d23dc.el 40/198 2024-03-28T21:49:40.508 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cephfs-2:19.0.0-1899.g323d23dc.el9.x86_6 41/198 2024-03-28T21:49:40.624 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-28T21:49:40.678 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-28T21:49:40.777 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-28T21:49:40.958 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-28T21:49:41.022 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-28T21:49:41.713 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-28T21:49:41.811 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-28T21:49:41.926 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-28T21:49:41.962 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-28T21:49:41.989 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-28T21:49:42.033 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-28T21:49:42.099 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-28T21:49:42.151 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librados-devel-2:19.0.0-1899.g323d23dc.el9.x86_6 53/198 2024-03-28T21:49:42.193 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-28T21:49:42.574 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-28T21:49:42.794 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-28T21:49:42.877 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-28T21:49:42.947 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-28T21:49:43.155 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-28T21:49:43.205 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-28T21:49:43.269 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-28T21:49:43.357 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-28T21:49:43.405 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-28T21:49:43.444 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-28T21:49:43.528 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-28T21:49:43.571 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-28T21:49:43.627 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-28T21:49:43.691 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-28T21:49:43.884 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-28T21:49:43.950 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-28T21:49:43.989 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-28T21:49:44.398 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-28T21:49:44.558 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-28T21:49:44.604 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-28T21:49:44.700 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-28T21:49:44.739 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-28T21:49:44.772 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-28T21:49:44.965 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-28T21:49:45.136 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-28T21:49:45.261 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-28T21:49:45.313 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-28T21:49:45.374 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-28T21:49:45.441 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-28T21:49:45.668 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-28T21:49:45.731 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-28T21:49:45.890 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-28T21:49:45.938 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-28T21:49:45.979 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-28T21:49:46.018 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-28T21:49:46.049 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-28T21:49:46.087 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-28T21:49:46.145 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-28T21:49:46.195 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-28T21:49:46.237 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-28T21:49:46.287 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-03-28T21:49:46.361 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-28T21:49:46.393 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-28T21:49:46.400 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-28T21:49:46.434 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-28T21:49:46.440 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-28T21:49:46.487 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-28T21:49:46.488 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-28T21:49:46.530 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-28T21:49:46.532 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-28T21:49:46.623 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-28T21:49:46.702 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-28T21:49:46.745 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-28T21:49:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-28T21:49:46.815 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-28T21:49:46.828 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-28T21:49:46.860 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-28T21:49:46.905 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-28T21:49:46.915 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-28T21:49:46.963 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-28T21:49:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-28T21:49:47.162 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-28T21:49:47.325 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-28T21:49:47.360 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:19.0.0-1899.g323d23dc.el9.x86_64 10/198 2024-03-28T21:49:47.510 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:19.0.0-1899.g323d23dc.el9.x86_64 10/198 2024-03-28T21:49:47.538 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:19.0.0-1899.g323d23dc.el9.x86_64 11/198 2024-03-28T21:49:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:19.0.0-1899.g323d23dc.el9.x86_64 11/198 2024-03-28T21:49:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:19.0.0-1899.g323d23dc.el9.x86_64 12/198 2024-03-28T21:49:47.750 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-28T21:49:48.043 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-28T21:49:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-28T21:49:48.120 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-28T21:49:48.126 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:19.0.0-1899.g323d23dc.el9.x86_64 16/198 2024-03-28T21:49:48.178 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-28T21:49:48.212 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-28T21:49:48.268 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1899.g323d23dc.el9.x86_64 16/198 2024-03-28T21:49:48.269 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-28T21:49:48.302 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:19.0.0-1899.g323d23dc.el9.x86 17/198 2024-03-28T21:49:48.379 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-28T21:49:48.392 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1899.g323d23dc.el9.x86 17/198 2024-03-28T21:49:48.430 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-28T21:49:48.437 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-28T21:49:48.462 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-28T21:49:48.524 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-28T21:49:48.661 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-28T21:49:48.702 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-28T21:49:48.794 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-28T21:49:48.802 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-28T21:49:48.863 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-28T21:49:48.912 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-28T21:49:49.234 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-28T21:49:49.431 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-28T21:49:49.509 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-28T21:49:49.589 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-28T21:49:49.704 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T21:49:49.723 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-28T21:49:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T21:49:50.095 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T21:49:50.280 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-28T21:49:50.414 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-28T21:49:50.447 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-28T21:49:50.487 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-28T21:49:50.557 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-28T21:49:50.671 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-28T21:49:50.748 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-28T21:49:50.802 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-28T21:49:50.899 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-28T21:49:50.943 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-28T21:49:51.005 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-28T21:49:51.048 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-28T21:49:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-28T21:49:51.213 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-28T21:49:51.246 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-28T21:49:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:19.0.0-1899.g323d23dc.el9. 39/198 2024-03-28T21:49:51.304 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:19.0.0-1899.g323d23dc.el 40/198 2024-03-28T21:49:51.332 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-28T21:49:51.333 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:19.0.0-1899.g323d23dc.el9.x86_6 41/198 2024-03-28T21:49:51.386 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-28T21:49:51.418 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-28T21:49:51.451 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-28T21:49:51.457 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-28T21:49:51.511 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-28T21:49:51.610 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-28T21:49:51.787 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-28T21:49:51.840 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-28T21:49:51.846 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-28T21:49:51.873 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librbd1-2:19.0.0-1899.g323d23dc.el9.x86_64 124/198 2024-03-28T21:49:51.994 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:19.0.0-1899.g323d23dc.el9.x86_64 124/198 2024-03-28T21:49:52.029 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rbd-2:19.0.0-1899.g323d23dc.el9.x86_64 125/198 2024-03-28T21:49:52.083 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-28T21:49:52.553 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-28T21:49:52.597 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-28T21:49:52.626 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librgw2-2:19.0.0-1899.g323d23dc.el9.x86_64 128/198 2024-03-28T21:49:52.643 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-28T21:49:52.718 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librgw2-2:19.0.0-1899.g323d23dc.el9.x86_64 128/198 2024-03-28T21:49:52.745 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rgw-2:19.0.0-1899.g323d23dc.el9.x86_64 129/198 2024-03-28T21:49:52.799 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-28T21:49:52.845 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-28T21:49:52.871 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-28T21:49:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-28T21:49:52.994 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-28T21:49:53.043 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:19.0.0-1899.g323d23dc.el9.x86_6 53/198 2024-03-28T21:49:53.085 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-28T21:49:53.526 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-28T21:49:53.767 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-28T21:49:53.867 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-28T21:49:53.937 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-28T21:49:54.139 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-28T21:49:54.195 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-28T21:49:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-28T21:49:54.365 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-28T21:49:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-28T21:49:54.442 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-28T21:49:54.507 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-28T21:49:54.551 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-28T21:49:54.612 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-28T21:49:54.671 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-28T21:49:54.860 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-28T21:49:54.916 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-28T21:49:54.978 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-28T21:49:55.028 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-28T21:49:55.158 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-28T21:49:55.202 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-28T21:49:55.247 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-28T21:49:55.284 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-28T21:49:55.317 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-28T21:49:55.392 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.0.0-1899.g323d23dc.el9.x86_64 130/198 2024-03-28T21:49:55.443 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-common-2:19.0.0-1899.g323d23dc.el9.x86_64 130/198 2024-03-28T21:49:55.476 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-28T21:49:55.652 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-28T21:49:55.797 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-28T21:49:55.861 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-28T21:49:55.926 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-28T21:49:55.998 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-28T21:49:56.089 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.0.0-1899.g323d23dc.el9.x86_64 130/198 2024-03-28T21:49:56.166 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-base-2:19.0.0-1899.g323d23dc.el9.x86_64 131/198 2024-03-28T21:49:56.260 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-28T21:49:56.324 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-28T21:49:56.367 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-base-2:19.0.0-1899.g323d23dc.el9.x86_64 131/198 2024-03-28T21:49:56.367 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-28T21:49:56.367 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-28T21:49:56.368 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:49:56.406 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-selinux-2:19.0.0-1899.g323d23dc.el9.x86_64 132/198 2024-03-28T21:49:56.498 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-28T21:49:56.537 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-28T21:49:56.577 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-28T21:49:56.616 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-28T21:49:56.656 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-28T21:49:56.702 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-28T21:49:56.761 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-28T21:49:56.813 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-28T21:49:56.861 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-28T21:49:56.987 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-28T21:49:57.032 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-28T21:49:57.066 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-28T21:49:57.153 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-28T21:49:57.195 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-28T21:49:57.340 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-28T21:49:57.459 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-28T21:49:57.524 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-28T21:49:57.560 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-28T21:49:57.617 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-28T21:49:57.757 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-28T21:49:57.825 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-28T21:49:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-28T21:49:58.841 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-28T21:49:58.875 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-28T21:49:58.930 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-28T21:49:59.043 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-28T21:49:59.100 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-28T21:49:59.335 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-28T21:49:59.372 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-28T21:49:59.467 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-28T21:50:00.270 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-28T21:50:00.408 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-28T21:50:01.932 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-28T21:50:02.018 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-28T21:50:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-28T21:50:02.086 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-28T21:50:02.125 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-28T21:50:02.495 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-28T21:50:02.555 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:19.0.0-1899.g323d23dc.el9.x86_64 124/198 2024-03-28T21:50:02.683 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:19.0.0-1899.g323d23dc.el9.x86_64 124/198 2024-03-28T21:50:02.715 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:19.0.0-1899.g323d23dc.el9.x86_64 125/198 2024-03-28T21:50:02.773 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-28T21:50:03.320 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-28T21:50:03.345 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:19.0.0-1899.g323d23dc.el9.x86_64 128/198 2024-03-28T21:50:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:19.0.0-1899.g323d23dc.el9.x86_64 128/198 2024-03-28T21:50:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:19.0.0-1899.g323d23dc.el9.x86_64 129/198 2024-03-28T21:50:06.128 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.0.0-1899.g323d23dc.el9.x86_64 130/198 2024-03-28T21:50:06.169 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:19.0.0-1899.g323d23dc.el9.x86_64 130/198 2024-03-28T21:50:06.792 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.0.0-1899.g323d23dc.el9.x86_64 130/198 2024-03-28T21:50:06.848 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:19.0.0-1899.g323d23dc.el9.x86_64 131/198 2024-03-28T21:50:07.046 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:19.0.0-1899.g323d23dc.el9.x86_64 131/198 2024-03-28T21:50:07.046 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-28T21:50:07.046 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-28T21:50:07.047 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:07.090 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:19.0.0-1899.g323d23dc.el9.x86_64 132/198 2024-03-28T21:50:09.186 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1899.g323d23dc.el9.x86_64 132/198 2024-03-28T21:50:09.186 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /sys 2024-03-28T21:50:09.186 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /proc 2024-03-28T21:50:09.186 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /mnt 2024-03-28T21:50:09.186 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /var/tmp 2024-03-28T21:50:09.186 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /home 2024-03-28T21:50:09.186 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /root 2024-03-28T21:50:09.186 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /tmp 2024-03-28T21:50:09.186 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:09.402 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-volume-2:19.0.0-1899.g323d23dc.el9.noarch 133/198 2024-03-28T21:50:09.451 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-volume-2:19.0.0-1899.g323d23dc.el9.noarch 133/198 2024-03-28T21:50:09.451 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:09.451 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-28T21:50:09.451 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:11.046 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-osd-2:19.0.0-1899.g323d23dc.el9.x86_64 134/198 2024-03-28T21:50:11.146 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-osd-2:19.0.0-1899.g323d23dc.el9.x86_64 134/198 2024-03-28T21:50:11.147 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:11.147 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-28T21:50:11.147 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-28T21:50:11.147 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-28T21:50:11.147 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:11.396 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mds-2:19.0.0-1899.g323d23dc.el9.x86_64 135/198 2024-03-28T21:50:11.491 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mds-2:19.0.0-1899.g323d23dc.el9.x86_64 135/198 2024-03-28T21:50:11.491 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-28T21:50:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-28T21:50:11.492 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-28T21:50:11.492 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:11.988 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mon-2:19.0.0-1899.g323d23dc.el9.x86_64 136/198 2024-03-28T21:50:12.084 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mon-2:19.0.0-1899.g323d23dc.el9.x86_64 136/198 2024-03-28T21:50:12.084 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:12.084 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-28T21:50:12.084 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-28T21:50:12.084 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-28T21:50:12.084 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:12.207 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-28T21:50:12.772 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:19.0.0-1899.g323d23dc.el9.noarch 138/198 2024-03-28T21:50:12.808 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephadm-2:19.0.0-1899.g323d23dc.el9.noarch 138/198 2024-03-28T21:50:12.857 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1899.g323d23dc.e 139/198 2024-03-28T21:50:12.958 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1899.g323d23dc. 140/198 2024-03-28T21:50:12.996 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1899.g323d23dc.el9.noa 141/198 2024-03-28T21:50:14.291 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1899.g323d23dc.el9.noa 141/198 2024-03-28T21:50:14.358 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1899.g323d23dc.el9.n 142/198 2024-03-28T21:50:15.475 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1899.g323d23dc.el9.n 142/198 2024-03-28T21:50:15.514 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1899.g323 143/198 2024-03-28T21:50:15.657 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1899.g323 143/198 2024-03-28T21:50:15.842 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1899.g323d23dc.el 144/198 2024-03-28T21:50:15.875 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-2:19.0.0-1899.g323d23dc.el9.x86_64 145/198 2024-03-28T21:50:15.951 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1899.g323d23dc.el9.x86_64 145/198 2024-03-28T21:50:15.951 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:15.951 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-28T21:50:15.951 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-28T21:50:15.952 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-28T21:50:15.952 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:16.017 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-rook-2:19.0.0-1899.g323d23dc.el9.noarch 146/198 2024-03-28T21:50:16.054 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1899.g323d23dc.el9.noarch 146/198 2024-03-28T21:50:16.111 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-2:19.0.0-1899.g323d23dc.el9.x86_64 147/198 2024-03-28T21:50:17.051 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-28T21:50:17.086 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-radosgw-2:19.0.0-1899.g323d23dc.el9.x86_64 149/198 2024-03-28T21:50:17.163 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1899.g323d23dc.el9.x86_64 149/198 2024-03-28T21:50:17.163 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:17.163 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-28T21:50:17.163 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-28T21:50:17.163 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-28T21:50:17.163 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:17.242 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1899.g323d2 150/198 2024-03-28T21:50:17.336 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1899.g323d2 150/198 2024-03-28T21:50:17.337 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:17.337 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-28T21:50:17.337 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:17.421 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephfs-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 151/198 2024-03-28T21:50:17.519 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 151/198 2024-03-28T21:50:17.519 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:17.519 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-28T21:50:17.519 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-28T21:50:17.519 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-28T21:50:17.519 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:17.938 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 152/198 2024-03-28T21:50:18.011 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 152/198 2024-03-28T21:50:18.011 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:18.011 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-28T21:50:18.011 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-28T21:50:18.012 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-28T21:50:18.012 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1899.g323d23dc.el9.x86_64 132/198 2024-03-28T21:50:20.097 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2024-03-28T21:50:20.097 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2024-03-28T21:50:20.097 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2024-03-28T21:50:20.097 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2024-03-28T21:50:20.097 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2024-03-28T21:50:20.097 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /root 2024-03-28T21:50:20.097 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2024-03-28T21:50:20.097 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:20.318 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:19.0.0-1899.g323d23dc.el9.noarch 133/198 2024-03-28T21:50:20.363 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:19.0.0-1899.g323d23dc.el9.noarch 133/198 2024-03-28T21:50:20.363 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:20.363 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-28T21:50:20.363 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:21.971 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:19.0.0-1899.g323d23dc.el9.x86_64 134/198 2024-03-28T21:50:22.077 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:19.0.0-1899.g323d23dc.el9.x86_64 134/198 2024-03-28T21:50:22.078 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:22.078 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-28T21:50:22.078 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-28T21:50:22.078 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-28T21:50:22.078 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:22.313 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:19.0.0-1899.g323d23dc.el9.x86_64 135/198 2024-03-28T21:50:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:19.0.0-1899.g323d23dc.el9.x86_64 135/198 2024-03-28T21:50:22.400 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:22.400 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-28T21:50:22.400 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-28T21:50:22.400 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-28T21:50:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:22.880 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:19.0.0-1899.g323d23dc.el9.x86_64 136/198 2024-03-28T21:50:22.974 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:19.0.0-1899.g323d23dc.el9.x86_64 136/198 2024-03-28T21:50:22.975 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:22.975 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-28T21:50:22.975 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-28T21:50:22.975 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-28T21:50:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:22.996 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-test-2:19.0.0-1899.g323d23dc.el9.x86_64 153/198 2024-03-28T21:50:23.051 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-fuse-2:19.0.0-1899.g323d23dc.el9.x86_64 154/198 2024-03-28T21:50:23.085 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-nbd-2:19.0.0-1899.g323d23dc.el9.x86_64 155/198 2024-03-28T21:50:23.099 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-28T21:50:23.123 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-28T21:50:23.408 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephfs-shell-2:19.0.0-1899.g323d23dc.el9.x86_64 157/198 2024-03-28T21:50:23.542 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-28T21:50:23.586 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-fuse-2:19.0.0-1899.g323d23dc.el9.x86_64 159/198 2024-03-28T21:50:23.640 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-28T21:50:23.694 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-28T21:50:23.731 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:19.0.0-1899.g323d23dc.el9.noarch 138/198 2024-03-28T21:50:23.738 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-28T21:50:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:19.0.0-1899.g323d23dc.el9.noarch 138/198 2024-03-28T21:50:23.774 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs-devel-2:19.0.0-1899.g323d23dc.el9.x86_ 163/198 2024-03-28T21:50:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1899.g323d23dc.e 139/198 2024-03-28T21:50:23.819 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-28T21:50:23.871 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-28T21:50:23.929 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1899.g323d23dc. 140/198 2024-03-28T21:50:23.954 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1899.g323d23dc.el9.noa 141/198 2024-03-28T21:50:23.971 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-28T21:50:24.089 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-28T21:50:24.121 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-28T21:50:25.006 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T21:50:25.052 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T21:50:25.120 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T21:50:25.247 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1899.g323d23dc.el9.noa 141/198 2024-03-28T21:50:25.306 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1899.g323d23dc.el9.n 142/198 2024-03-28T21:50:26.402 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1899.g323d23dc.el9.n 142/198 2024-03-28T21:50:26.439 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1899.g323 143/198 2024-03-28T21:50:26.480 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephfs-top-2:19.0.0-1899.g323d23dc.el9.noarch 170/198 2024-03-28T21:50:26.575 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-28T21:50:26.582 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1899.g323 143/198 2024-03-28T21:50:26.621 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-28T21:50:26.734 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-28T21:50:26.752 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1899.g323d23dc.el 144/198 2024-03-28T21:50:26.778 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-28T21:50:26.783 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:19.0.0-1899.g323d23dc.el9.x86_64 145/198 2024-03-28T21:50:26.834 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-28T21:50:26.870 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-28T21:50:26.872 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1899.g323d23dc.el9.x86_64 145/198 2024-03-28T21:50:26.872 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:26.872 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-28T21:50:26.872 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-28T21:50:26.872 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-28T21:50:26.872 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-28T21:50:26.912 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-28T21:50:26.925 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:19.0.0-1899.g323d23dc.el9.noarch 146/198 2024-03-28T21:50:26.962 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1899.g323d23dc.el9.noarch 146/198 2024-03-28T21:50:27.055 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:19.0.0-1899.g323d23dc.el9.x86_64 147/198 2024-03-28T21:50:27.057 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-28T21:50:27.099 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-28T21:50:27.100 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-28T21:50:27.238 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-28T21:50:27.287 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-28T21:50:27.337 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-28T21:50:27.378 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-28T21:50:27.418 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-28T21:50:27.486 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-28T21:50:27.557 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-28T21:50:27.607 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-28T21:50:27.640 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-28T21:50:27.674 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-28T21:50:27.708 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-28T21:50:27.741 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-28T21:50:27.778 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T21:50:27.778 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T21:50:27.987 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-28T21:50:28.027 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:19.0.0-1899.g323d23dc.el9.x86_64 149/198 2024-03-28T21:50:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T21:50:28.109 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-28T21:50:28.117 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1899.g323d23dc.el9.x86_64 149/198 2024-03-28T21:50:28.117 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:28.118 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-28T21:50:28.118 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-28T21:50:28.118 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-28T21:50:28.118 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:28.178 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1899.g323d2 150/198 2024-03-28T21:50:28.247 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-28T21:50:28.271 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1899.g323d2 150/198 2024-03-28T21:50:28.271 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:28.271 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-28T21:50:28.271 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:28.278 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-28T21:50:28.332 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-28T21:50:28.354 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 151/198 2024-03-28T21:50:28.364 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-28T21:50:28.404 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-28T21:50:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 151/198 2024-03-28T21:50:28.458 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:28.458 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-28T21:50:28.458 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-28T21:50:28.458 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-28T21:50:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:28.523 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-28T21:50:28.757 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-28T21:50:28.757 INFO:teuthology.orchestra.run.smithi165.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-28T21:50:28.757 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:28.863 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 152/198 2024-03-28T21:50:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 152/198 2024-03-28T21:50:28.952 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T21:50:28.952 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-28T21:50:28.952 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-28T21:50:28.952 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-28T21:50:28.952 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:33.744 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:19.0.0-1899.g323d23dc.el9.x86_64 153/198 2024-03-28T21:50:33.789 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:19.0.0-1899.g323d23dc.el9.x86_64 154/198 2024-03-28T21:50:33.824 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:19.0.0-1899.g323d23dc.el9.x86_64 155/198 2024-03-28T21:50:33.865 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-28T21:50:34.165 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-shell-2:19.0.0-1899.g323d23dc.el9.x86_64 157/198 2024-03-28T21:50:34.224 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-2:19.0.0-1899.g323d23dc.el9.x86_64 1/198 2024-03-28T21:50:34.224 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-base-2:19.0.0-1899.g323d23dc.el9.x86_64 2/198 2024-03-28T21:50:34.224 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-common-2:19.0.0-1899.g323d23dc.el9.x86_64 3/198 2024-03-28T21:50:34.224 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-fuse-2:19.0.0-1899.g323d23dc.el9.x86_64 4/198 2024-03-28T21:50:34.224 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1899.g323d2 5/198 2024-03-28T21:50:34.224 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mds-2:19.0.0-1899.g323d23dc.el9.x86_64 6/198 2024-03-28T21:50:34.224 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-2:19.0.0-1899.g323d23dc.el9.x86_64 7/198 2024-03-28T21:50:34.224 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mon-2:19.0.0-1899.g323d23dc.el9.x86_64 8/198 2024-03-28T21:50:34.224 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-osd-2:19.0.0-1899.g323d23dc.el9.x86_64 9/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-radosgw-2:19.0.0-1899.g323d23dc.el9.x86_64 10/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-selinux-2:19.0.0-1899.g323d23dc.el9.x86_64 11/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-test-2:19.0.0-1899.g323d23dc.el9.x86_64 12/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephfs-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 13/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephfs-shell-2:19.0.0-1899.g323d23dc.el9.x86_64 14/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs-devel-2:19.0.0-1899.g323d23dc.el9.x86_ 15/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs2-2:19.0.0-1899.g323d23dc.el9.x86_64 16/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephsqlite-2:19.0.0-1899.g323d23dc.el9.x86_64 17/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados-devel-2:19.0.0-1899.g323d23dc.el9.x86_6 18/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libradosstriper1-2:19.0.0-1899.g323d23dc.el9.x86 19/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librgw2-2:19.0.0-1899.g323d23dc.el9.x86_64 20/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1899.g323d23dc.el 21/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-common-2:19.0.0-1899.g323d23dc.el9. 22/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cephfs-2:19.0.0-1899.g323d23dc.el9.x86_6 23/198 2024-03-28T21:50:34.225 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rados-2:19.0.0-1899.g323d23dc.el9.x86_64 24/198 2024-03-28T21:50:34.226 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rbd-2:19.0.0-1899.g323d23dc.el9.x86_64 25/198 2024-03-28T21:50:34.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rgw-2:19.0.0-1899.g323d23dc.el9.x86_64 26/198 2024-03-28T21:50:34.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-fuse-2:19.0.0-1899.g323d23dc.el9.x86_64 27/198 2024-03-28T21:50:34.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 28/198 2024-03-28T21:50:34.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-nbd-2:19.0.0-1899.g323d23dc.el9.x86_64 29/198 2024-03-28T21:50:34.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1899.g323d23dc. 30/198 2024-03-28T21:50:34.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1899.g323d23dc.el9.noa 31/198 2024-03-28T21:50:34.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1899.g323d23dc.el9.n 32/198 2024-03-28T21:50:34.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1899.g323 33/198 2024-03-28T21:50:34.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1899.g323d23dc.el 34/198 2024-03-28T21:50:34.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1899.g323d23dc.el9.noarch 35/198 2024-03-28T21:50:34.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1899.g323d23dc.e 36/198 2024-03-28T21:50:34.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-volume-2:19.0.0-1899.g323d23dc.el9.noarch 37/198 2024-03-28T21:50:34.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephadm-2:19.0.0-1899.g323d23dc.el9.noarch 38/198 2024-03-28T21:50:34.242 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephfs-top-2:19.0.0-1899.g323d23dc.el9.noarch 39/198 2024-03-28T21:50:34.242 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-28T21:50:34.242 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-28T21:50:34.242 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-28T21:50:34.242 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-28T21:50:34.242 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-28T21:50:34.242 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-28T21:50:34.242 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-28T21:50:34.242 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-28T21:50:34.242 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-28T21:50:34.242 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-28T21:50:34.242 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-28T21:50:34.242 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-28T21:50:34.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-28T21:50:34.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-28T21:50:34.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-28T21:50:34.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-28T21:50:34.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-28T21:50:34.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-28T21:50:34.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-03-28T21:50:34.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-03-28T21:50:34.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-03-28T21:50:34.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-03-28T21:50:34.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-28T21:50:34.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-28T21:50:34.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-28T21:50:34.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-28T21:50:34.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-28T21:50:34.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-28T21:50:34.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-28T21:50:34.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-28T21:50:34.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-28T21:50:34.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-28T21:50:34.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-28T21:50:34.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-28T21:50:34.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-28T21:50:34.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-28T21:50:34.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-28T21:50:34.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-28T21:50:34.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-28T21:50:34.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-28T21:50:34.245 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-28T21:50:34.245 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-28T21:50:34.245 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-03-28T21:50:34.245 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-03-28T21:50:34.245 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-03-28T21:50:34.245 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-03-28T21:50:34.245 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-03-28T21:50:34.245 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-03-28T21:50:34.245 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-03-28T21:50:34.245 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-28T21:50:34.245 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-03-28T21:50:34.245 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-03-28T21:50:34.245 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-03-28T21:50:34.245 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-03-28T21:50:34.246 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-03-28T21:50:34.246 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-03-28T21:50:34.246 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-03-28T21:50:34.246 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-03-28T21:50:34.246 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-03-28T21:50:34.246 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-03-28T21:50:34.246 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-03-28T21:50:34.246 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-03-28T21:50:34.246 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-03-28T21:50:34.246 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-03-28T21:50:34.246 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-28T21:50:34.246 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-28T21:50:34.246 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-28T21:50:34.246 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-28T21:50:34.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-28T21:50:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-28T21:50:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-28T21:50:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-28T21:50:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-28T21:50:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-28T21:50:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-28T21:50:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-28T21:50:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-28T21:50:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-28T21:50:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-28T21:50:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-28T21:50:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-28T21:50:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-28T21:50:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-28T21:50:34.249 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-28T21:50:34.249 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-28T21:50:34.249 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-28T21:50:34.249 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-28T21:50:34.249 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-28T21:50:34.249 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-28T21:50:34.249 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-28T21:50:34.249 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-28T21:50:34.249 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-28T21:50:34.249 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-28T21:50:34.249 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-28T21:50:34.249 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-28T21:50:34.249 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-28T21:50:34.249 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-28T21:50:34.250 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:19.0.0-1899.g323d23dc.el9.x86_64 151/198 2024-03-28T21:50:34.250 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-28T21:50:34.250 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:19.0.0-1899.g323d23dc.el9.x86_64 153/198 2024-03-28T21:50:34.250 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-28T21:50:34.250 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-03-28T21:50:34.250 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-28T21:50:34.250 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-03-28T21:50:34.250 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-28T21:50:34.250 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-03-28T21:50:34.250 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-28T21:50:34.250 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-03-28T21:50:34.250 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-28T21:50:34.250 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-03-28T21:50:34.250 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-03-28T21:50:34.251 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-28T21:50:34.251 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-28T21:50:34.251 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-28T21:50:34.251 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-28T21:50:34.251 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-28T21:50:34.251 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-28T21:50:34.251 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-28T21:50:34.251 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-28T21:50:34.251 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-28T21:50:34.251 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-28T21:50:34.251 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-28T21:50:34.251 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-28T21:50:34.251 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-28T21:50:34.251 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-28T21:50:34.252 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-28T21:50:34.253 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-28T21:50:34.253 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-28T21:50:34.253 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-28T21:50:34.253 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-28T21:50:34.287 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-28T21:50:34.336 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:19.0.0-1899.g323d23dc.el9.x86_64 159/198 2024-03-28T21:50:34.391 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-28T21:50:34.452 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-28T21:50:34.497 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-28T21:50:34.531 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:19.0.0-1899.g323d23dc.el9.x86_ 163/198 2024-03-28T21:50:34.570 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-28T21:50:34.620 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-28T21:50:34.708 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-28T21:50:34.833 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-28T21:50:34.877 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-28T21:50:35.782 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T21:50:35.833 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T21:50:35.887 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T21:50:36.781 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-28T21:50:36.781 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:36.781 INFO:teuthology.orchestra.run.smithi165.stdout:Upgraded: 2024-03-28T21:50:36.781 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-28T21:50:36.781 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-28T21:50:36.781 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-28T21:50:36.781 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-28T21:50:36.781 INFO:teuthology.orchestra.run.smithi165.stdout: acl-2.3.1-4.el9.x86_64 2024-03-28T21:50:36.781 INFO:teuthology.orchestra.run.smithi165.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-28T21:50:36.781 INFO:teuthology.orchestra.run.smithi165.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-28T21:50:36.781 INFO:teuthology.orchestra.run.smithi165.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-28T21:50:36.781 INFO:teuthology.orchestra.run.smithi165.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-28T21:50:36.782 INFO:teuthology.orchestra.run.smithi165.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-28T21:50:36.782 INFO:teuthology.orchestra.run.smithi165.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-28T21:50:36.782 INFO:teuthology.orchestra.run.smithi165.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-28T21:50:36.782 INFO:teuthology.orchestra.run.smithi165.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-28T21:50:36.782 INFO:teuthology.orchestra.run.smithi165.stdout: librados2-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.782 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.782 INFO:teuthology.orchestra.run.smithi165.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-28T21:50:36.782 INFO:teuthology.orchestra.run.smithi165.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-28T21:50:36.782 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-28T21:50:36.782 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-28T21:50:36.782 INFO:teuthology.orchestra.run.smithi165.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-28T21:50:36.782 INFO:teuthology.orchestra.run.smithi165.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-28T21:50:36.782 INFO:teuthology.orchestra.run.smithi165.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-28T21:50:36.782 INFO:teuthology.orchestra.run.smithi165.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-28T21:50:36.783 INFO:teuthology.orchestra.run.smithi165.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-28T21:50:36.783 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-03-28T21:50:36.783 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-28T21:50:36.783 INFO:teuthology.orchestra.run.smithi165.stdout: automake-1.16.2-8.el9.noarch 2024-03-28T21:50:36.783 INFO:teuthology.orchestra.run.smithi165.stdout: bison-3.7.4-5.el9.x86_64 2024-03-28T21:50:36.783 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-28T21:50:36.783 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.783 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.783 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.783 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.783 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:36.783 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.783 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.783 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.784 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-shell-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.785 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-top-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:36.785 INFO:teuthology.orchestra.run.smithi165.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-28T21:50:36.785 INFO:teuthology.orchestra.run.smithi165.stdout: flex-2.6.4-9.el9.x86_64 2024-03-28T21:50:36.785 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-28T21:50:36.785 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-28T21:50:36.785 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-28T21:50:36.785 INFO:teuthology.orchestra.run.smithi165.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-28T21:50:36.785 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-28T21:50:36.785 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-28T21:50:36.785 INFO:teuthology.orchestra.run.smithi165.stdout: jq-1.6-16.el9.x86_64 2024-03-28T21:50:36.785 INFO:teuthology.orchestra.run.smithi165.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-28T21:50:36.785 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-28T21:50:36.785 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-28T21:50:36.786 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.786 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.786 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.786 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-28T21:50:36.786 INFO:teuthology.orchestra.run.smithi165.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-28T21:50:36.786 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-28T21:50:36.786 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-28T21:50:36.786 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-28T21:50:36.786 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.786 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.786 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-28T21:50:36.786 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.786 INFO:teuthology.orchestra.run.smithi165.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-28T21:50:36.786 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: lua-5.4.4-4.el9.x86_64 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-13.14-1.el9.x86_64 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-28T21:50:36.787 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-28T21:50:36.788 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-28T21:50:36.788 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-28T21:50:36.788 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-28T21:50:36.788 INFO:teuthology.orchestra.run.smithi165.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-28T21:50:36.788 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-28T21:50:36.788 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-28T21:50:36.788 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-28T21:50:36.788 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.788 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.788 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.788 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-28T21:50:36.788 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-28T21:50:36.788 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-28T21:50:36.788 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-28T21:50:36.789 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-28T21:50:36.789 INFO:teuthology.orchestra.run.smithi165.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-28T21:50:36.789 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-28T21:50:36.789 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-28T21:50:36.789 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-28T21:50:36.789 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-28T21:50:36.789 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-28T21:50:36.789 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-28T21:50:36.789 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-28T21:50:36.789 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-28T21:50:36.789 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-28T21:50:36.789 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-28T21:50:36.789 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-28T21:50:36.789 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-28T21:50:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-28T21:50:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-28T21:50:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-28T21:50:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-28T21:50:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-28T21:50:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-28T21:50:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-28T21:50:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-28T21:50:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-28T21:50:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-28T21:50:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-28T21:50:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-28T21:50:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply-3.11-14.el9.noarch 2024-03-28T21:50:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-28T21:50:36.791 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-28T21:50:36.791 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-28T21:50:36.791 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-28T21:50:36.791 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-28T21:50:36.791 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-28T21:50:36.791 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-28T21:50:36.791 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-28T21:50:36.791 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-28T21:50:36.791 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.791 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.791 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-28T21:50:36.791 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-28T21:50:36.791 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-28T21:50:36.791 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-28T21:50:36.792 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.793 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.793 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:36.793 INFO:teuthology.orchestra.run.smithi165.stdout: re2-1:20211101-3.el9.x86_64 2024-03-28T21:50:36.793 INFO:teuthology.orchestra.run.smithi165.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-28T21:50:36.793 INFO:teuthology.orchestra.run.smithi165.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-28T21:50:36.793 INFO:teuthology.orchestra.run.smithi165.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-28T21:50:36.793 INFO:teuthology.orchestra.run.smithi165.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-28T21:50:36.793 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-28T21:50:36.794 INFO:teuthology.orchestra.run.smithi165.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-28T21:50:36.794 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:36.794 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-03-28T21:50:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-top-2:19.0.0-1899.g323d23dc.el9.noarch 170/198 2024-03-28T21:50:37.296 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-28T21:50:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-28T21:50:37.468 DEBUG:teuthology.parallel:result is None 2024-03-28T21:50:37.471 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-28T21:50:37.507 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-28T21:50:37.540 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-28T21:50:37.574 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-28T21:50:37.615 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-28T21:50:37.615 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-28T21:50:37.754 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-28T21:50:37.796 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-28T21:50:37.796 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-28T21:50:37.934 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-28T21:50:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-28T21:50:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-28T21:50:38.057 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-28T21:50:38.089 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-28T21:50:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-28T21:50:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-28T21:50:38.286 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-28T21:50:38.336 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-28T21:50:38.369 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-28T21:50:38.403 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-28T21:50:38.436 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-28T21:50:38.472 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T21:50:38.473 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T21:50:38.795 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T21:50:38.795 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-28T21:50:38.917 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-28T21:50:38.947 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-28T21:50:39.002 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-28T21:50:39.042 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-28T21:50:39.091 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-28T21:50:39.211 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-28T21:50:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-28T21:50:39.468 INFO:teuthology.orchestra.run.smithi153.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-28T21:50:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:44.674 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:19.0.0-1899.g323d23dc.el9.x86_64 1/198 2024-03-28T21:50:44.674 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:19.0.0-1899.g323d23dc.el9.x86_64 2/198 2024-03-28T21:50:44.674 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:19.0.0-1899.g323d23dc.el9.x86_64 3/198 2024-03-28T21:50:44.674 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:19.0.0-1899.g323d23dc.el9.x86_64 4/198 2024-03-28T21:50:44.674 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1899.g323d2 5/198 2024-03-28T21:50:44.674 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:19.0.0-1899.g323d23dc.el9.x86_64 6/198 2024-03-28T21:50:44.674 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:19.0.0-1899.g323d23dc.el9.x86_64 7/198 2024-03-28T21:50:44.675 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:19.0.0-1899.g323d23dc.el9.x86_64 8/198 2024-03-28T21:50:44.675 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:19.0.0-1899.g323d23dc.el9.x86_64 9/198 2024-03-28T21:50:44.675 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:19.0.0-1899.g323d23dc.el9.x86_64 10/198 2024-03-28T21:50:44.675 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:19.0.0-1899.g323d23dc.el9.x86_64 11/198 2024-03-28T21:50:44.675 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:19.0.0-1899.g323d23dc.el9.x86_64 12/198 2024-03-28T21:50:44.675 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 13/198 2024-03-28T21:50:44.675 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-shell-2:19.0.0-1899.g323d23dc.el9.x86_64 14/198 2024-03-28T21:50:44.675 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:19.0.0-1899.g323d23dc.el9.x86_ 15/198 2024-03-28T21:50:44.675 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:19.0.0-1899.g323d23dc.el9.x86_64 16/198 2024-03-28T21:50:44.675 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:19.0.0-1899.g323d23dc.el9.x86_64 17/198 2024-03-28T21:50:44.675 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:19.0.0-1899.g323d23dc.el9.x86_6 18/198 2024-03-28T21:50:44.675 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:19.0.0-1899.g323d23dc.el9.x86 19/198 2024-03-28T21:50:44.675 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:19.0.0-1899.g323d23dc.el9.x86_64 20/198 2024-03-28T21:50:44.675 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1899.g323d23dc.el 21/198 2024-03-28T21:50:44.676 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:19.0.0-1899.g323d23dc.el9. 22/198 2024-03-28T21:50:44.676 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:19.0.0-1899.g323d23dc.el9.x86_6 23/198 2024-03-28T21:50:44.676 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:19.0.0-1899.g323d23dc.el9.x86_64 24/198 2024-03-28T21:50:44.676 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:19.0.0-1899.g323d23dc.el9.x86_64 25/198 2024-03-28T21:50:44.676 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:19.0.0-1899.g323d23dc.el9.x86_64 26/198 2024-03-28T21:50:44.676 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:19.0.0-1899.g323d23dc.el9.x86_64 27/198 2024-03-28T21:50:44.692 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 28/198 2024-03-28T21:50:44.692 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:19.0.0-1899.g323d23dc.el9.x86_64 29/198 2024-03-28T21:50:44.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1899.g323d23dc. 30/198 2024-03-28T21:50:44.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1899.g323d23dc.el9.noa 31/198 2024-03-28T21:50:44.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1899.g323d23dc.el9.n 32/198 2024-03-28T21:50:44.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1899.g323 33/198 2024-03-28T21:50:44.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1899.g323d23dc.el 34/198 2024-03-28T21:50:44.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1899.g323d23dc.el9.noarch 35/198 2024-03-28T21:50:44.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1899.g323d23dc.e 36/198 2024-03-28T21:50:44.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:19.0.0-1899.g323d23dc.el9.noarch 37/198 2024-03-28T21:50:44.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:19.0.0-1899.g323d23dc.el9.noarch 38/198 2024-03-28T21:50:44.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-top-2:19.0.0-1899.g323d23dc.el9.noarch 39/198 2024-03-28T21:50:44.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-28T21:50:44.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-28T21:50:44.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-28T21:50:44.693 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-28T21:50:44.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-28T21:50:44.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-28T21:50:44.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-28T21:50:44.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-28T21:50:44.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-28T21:50:44.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-28T21:50:44.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-28T21:50:44.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-28T21:50:44.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-28T21:50:44.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-28T21:50:44.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-03-28T21:50:44.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-03-28T21:50:44.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-03-28T21:50:44.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-03-28T21:50:44.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-03-28T21:50:44.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-03-28T21:50:44.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-28T21:50:44.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-28T21:50:44.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-28T21:50:44.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-28T21:50:44.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-28T21:50:44.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-28T21:50:44.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-28T21:50:44.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-28T21:50:44.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-28T21:50:44.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-28T21:50:44.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-28T21:50:44.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-28T21:50:44.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-28T21:50:44.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-28T21:50:44.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-28T21:50:44.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:19.0.0-1899.g323d23dc.el9.x86_64 151/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:19.0.0-1899.g323d23dc.el9.x86_64 153/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-03-28T21:50:44.701 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-28T21:50:44.702 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-03-28T21:50:44.702 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-28T21:50:44.702 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-03-28T21:50:44.702 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-03-28T21:50:44.702 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-28T21:50:44.702 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-28T21:50:44.702 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-28T21:50:44.702 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-28T21:50:44.702 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-28T21:50:44.702 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-28T21:50:44.702 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-28T21:50:44.702 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-28T21:50:44.702 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-28T21:50:44.703 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-28T21:50:44.704 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-28T21:50:44.704 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-28T21:50:44.704 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-28T21:50:44.704 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-28T21:50:44.704 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-28T21:50:44.704 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-28T21:50:44.704 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-28T21:50:44.704 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-28T21:50:44.704 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-28T21:50:47.152 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-28T21:50:47.152 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:47.152 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-03-28T21:50:47.152 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-28T21:50:47.152 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-28T21:50:47.152 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-28T21:50:47.152 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-28T21:50:47.152 INFO:teuthology.orchestra.run.smithi153.stdout: acl-2.3.1-4.el9.x86_64 2024-03-28T21:50:47.152 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-28T21:50:47.152 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-28T21:50:47.153 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-28T21:50:47.153 INFO:teuthology.orchestra.run.smithi153.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-28T21:50:47.153 INFO:teuthology.orchestra.run.smithi153.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-28T21:50:47.153 INFO:teuthology.orchestra.run.smithi153.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-28T21:50:47.153 INFO:teuthology.orchestra.run.smithi153.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-28T21:50:47.153 INFO:teuthology.orchestra.run.smithi153.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-28T21:50:47.153 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.153 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.153 INFO:teuthology.orchestra.run.smithi153.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-28T21:50:47.153 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-28T21:50:47.153 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-28T21:50:47.153 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-28T21:50:47.153 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-28T21:50:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-28T21:50:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-28T21:50:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-28T21:50:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-28T21:50:47.154 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-03-28T21:50:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-28T21:50:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: automake-1.16.2-8.el9.noarch 2024-03-28T21:50:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: bison-3.7.4-5.el9.x86_64 2024-03-28T21:50:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-28T21:50:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.155 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top-2:19.0.0-1899.g323d23dc.el9.noarch 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: flex-2.6.4-9.el9.x86_64 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: jq-1.6-16.el9.x86_64 2024-03-28T21:50:47.156 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-28T21:50:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-28T21:50:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-28T21:50:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-28T21:50:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-28T21:50:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-28T21:50:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-28T21:50:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-28T21:50:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.157 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-28T21:50:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-28T21:50:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-28T21:50:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-28T21:50:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-28T21:50:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-28T21:50:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: lua-5.4.4-4.el9.x86_64 2024-03-28T21:50:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-28T21:50:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-28T21:50:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-28T21:50:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-28T21:50:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-28T21:50:47.158 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-13.14-1.el9.x86_64 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.159 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-28T21:50:47.160 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-28T21:50:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-28T21:50:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-28T21:50:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-28T21:50:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-28T21:50:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-28T21:50:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-28T21:50:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-28T21:50:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-28T21:50:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-28T21:50:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-28T21:50:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-28T21:50:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-28T21:50:47.161 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply-3.11-14.el9.noarch 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.162 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-28T21:50:47.163 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-28T21:50:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-28T21:50:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-28T21:50:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-28T21:50:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:19.0.0-1899.g323d23dc.el9.x86_64 2024-03-28T21:50:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: re2-1:20211101-3.el9.x86_64 2024-03-28T21:50:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-28T21:50:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-28T21:50:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-28T21:50:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-28T21:50:47.164 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-28T21:50:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-28T21:50:47.165 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:47.165 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-03-28T21:50:47.836 DEBUG:teuthology.parallel:result is None 2024-03-28T21:50:47.837 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=323d23dc228bbcb7f16f188fdc9c0dcb801844be 2024-03-28T21:50:47.978 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-28T21:50:48.035 INFO:teuthology.orchestra.run.smithi153.stdout:19.0.0-1899.g323d23dc.el9 2024-03-28T21:50:48.035 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1899.g323d23dc.el9 2024-03-28T21:50:48.035 INFO:teuthology.task.install:The correct ceph version 19.0.0-1899.g323d23dc is installed. 2024-03-28T21:50:48.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=323d23dc228bbcb7f16f188fdc9c0dcb801844be 2024-03-28T21:50:48.182 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-28T21:50:48.253 INFO:teuthology.orchestra.run.smithi165.stdout:19.0.0-1899.g323d23dc.el9 2024-03-28T21:50:48.254 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1899.g323d23dc.el9 2024-03-28T21:50:48.254 INFO:teuthology.task.install:The correct ceph version 19.0.0-1899.g323d23dc is installed. 2024-03-28T21:50:48.256 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-28T21:50:48.256 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:50:48.256 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-28T21:50:48.345 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:50:48.346 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-28T21:50:48.445 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-28T21:50:48.446 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:50:48.446 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-03-28T21:50:48.522 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-28T21:50:48.645 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:50:48.646 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/daemon-helper 2024-03-28T21:50:48.745 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-28T21:50:48.837 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-28T21:50:48.838 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:50:48.838 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-28T21:50:48.914 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-28T21:50:49.030 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:50:49.030 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-28T21:50:49.130 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-28T21:50:49.257 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-28T21:50:49.257 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:50:49.257 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-03-28T21:50:49.330 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-28T21:50:49.439 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:50:49.439 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/stdin-killer 2024-03-28T21:50:49.534 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-28T21:50:49.629 INFO:teuthology.run_tasks:Running task ceph... 2024-03-28T21:50:49.725 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-28T21:50:49.725 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-03-28T21:50:49.731 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 777 /var/log/ceph 2024-03-28T21:50:49.832 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-28T21:50:49.832 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-28T21:50:49.837 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-28T21:50:49.932 INFO:tasks.ceph:Creating extra log directories... 2024-03-28T21:50:49.932 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-28T21:50:49.937 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-28T21:50:50.043 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-28T21:50:50.043 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-28T21:50:50.043 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-28T21:50:50.043 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:50:50.043 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-28T21:50:50.085 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-28T21:50:50.288 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-28T21:50:50.358 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:50:50.358 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-28T21:50:50.414 DEBUG:teuthology.orchestra.run.smithi165:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-28T21:50:50.675 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-28T21:50:50.782 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-28T21:50:50.782 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-28T21:50:50.783 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7627059', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '323d23dc228bbcb7f16f188fdc9c0dcb801844be'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '323d23dc228bbcb7f16f188fdc9c0dcb801844be'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '55f5138942aa4866e49329c9103468889cec3f73'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7214, 'sha1': '323d23dc228bbcb7f16f188fdc9c0dcb801844be', 'sleep_before_teardown': 0, 'subset': '39/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '55f5138942aa4866e49329c9103468889cec3f73', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNyOn+XjEEeviiRfh8n2NmY+aed5azVsvfvaq3kTllg3aA9QgGG2vUXMxHMAGJOgP1qq2fzaLhDYXpFLDGi22ZE=', 'smithi165.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPK0PWKqju/yAHgFV04dllBlqvQvg+g5UAX7WuVR1JQ61iINE4wq0MbSs4qy2l8xIk/fXIda2zvHNEWJxHU/dWQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '323d23dc228bbcb7f16f188fdc9c0dcb801844be'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '323d23dc228bbcb7f16f188fdc9c0dcb801844be', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-27_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-28T21:50:50.784 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-28T21:50:50.789 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-28T21:50:50.844 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-03-28T21:50:50.874 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/run/ceph 2024-03-28T21:50:50.974 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:50:50.975 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-03-28T21:50:51.017 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-28T21:50:51.017 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-03-28T21:50:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-28T21:50:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T21:50:51.103 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 632 Links: 1 2024-03-28T21:50:51.103 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T21:50:51.103 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T21:50:51.103 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-28 21:50:39.909109306 +0000 2024-03-28T21:50:51.103 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-28 21:47:48.493843869 +0000 2024-03-28T21:50:51.104 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-28 21:47:48.493843869 +0000 2024-03-28T21:50:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-03-28 21:47:48.493843869 +0000 2024-03-28T21:50:51.104 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-28T21:50:51.216 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-28T21:50:51.216 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-28T21:50:51.217 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000363786 s, 1.4 MB/s 2024-03-28T21:50:51.220 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-28T21:50:51.261 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-03-28T21:50:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-28T21:50:51.342 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T21:50:51.342 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 651 Links: 1 2024-03-28T21:50:51.342 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T21:50:51.342 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T21:50:51.342 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-28 21:50:39.909109306 +0000 2024-03-28T21:50:51.342 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-28 21:47:49.068833572 +0000 2024-03-28T21:50:51.343 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-28 21:47:49.068833572 +0000 2024-03-28T21:50:51.343 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-03-28 21:47:49.068833572 +0000 2024-03-28T21:50:51.343 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-28T21:50:51.471 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-28T21:50:51.471 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-28T21:50:51.471 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000484461 s, 1.1 MB/s 2024-03-28T21:50:51.475 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-28T21:50:51.525 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-03-28T21:50:51.575 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-28T21:50:51.575 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T21:50:51.575 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 669 Links: 1 2024-03-28T21:50:51.575 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T21:50:51.575 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T21:50:51.575 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-28 21:50:39.910109288 +0000 2024-03-28T21:50:51.576 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-28 21:47:49.636823399 +0000 2024-03-28T21:50:51.576 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-28 21:47:49.636823399 +0000 2024-03-28T21:50:51.576 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-03-28 21:47:49.636823399 +0000 2024-03-28T21:50:51.576 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-28T21:50:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-28T21:50:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-28T21:50:51.659 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000344759 s, 1.5 MB/s 2024-03-28T21:50:51.663 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-28T21:50:51.721 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-03-28T21:50:51.771 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-28T21:50:51.771 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T21:50:51.771 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-03-28T21:50:51.771 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T21:50:51.771 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T21:50:51.771 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-28 21:50:39.910109288 +0000 2024-03-28T21:50:51.771 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-28 21:47:50.205813208 +0000 2024-03-28T21:50:51.771 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-28 21:47:50.205813208 +0000 2024-03-28T21:50:51.771 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-03-28 21:47:50.205813208 +0000 2024-03-28T21:50:51.771 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-28T21:50:51.854 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-28T21:50:51.854 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-28T21:50:51.854 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000344053 s, 1.5 MB/s 2024-03-28T21:50:51.857 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-28T21:50:51.911 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-28T21:50:51.911 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:50:51.911 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/scratch_devs of=/dev/stdout 2024-03-28T21:50:51.967 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-28T21:50:51.967 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_1 2024-03-28T21:50:52.014 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-28T21:50:52.015 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T21:50:52.015 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-03-28T21:50:52.015 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T21:50:52.015 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T21:50:52.015 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-03-28 21:50:29.182005490 +0000 2024-03-28T21:50:52.015 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-03-28 21:47:49.312302478 +0000 2024-03-28T21:50:52.015 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-03-28 21:47:49.312302478 +0000 2024-03-28T21:50:52.015 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-03-28 21:47:49.312302478 +0000 2024-03-28T21:50:52.015 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-28T21:50:52.104 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-03-28T21:50:52.104 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-03-28T21:50:52.104 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000343223 s, 1.5 MB/s 2024-03-28T21:50:52.108 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-28T21:50:52.166 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_2 2024-03-28T21:50:52.221 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-28T21:50:52.221 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T21:50:52.221 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 651 Links: 1 2024-03-28T21:50:52.222 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T21:50:52.222 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T21:50:52.222 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-03-28 21:50:29.183005475 +0000 2024-03-28T21:50:52.222 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-03-28 21:47:49.847294209 +0000 2024-03-28T21:50:52.222 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-03-28 21:47:49.847294209 +0000 2024-03-28T21:50:52.222 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-03-28 21:47:49.847294209 +0000 2024-03-28T21:50:52.222 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-28T21:50:52.309 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-03-28T21:50:52.309 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-03-28T21:50:52.309 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000327913 s, 1.6 MB/s 2024-03-28T21:50:52.313 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-28T21:50:52.366 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_3 2024-03-28T21:50:52.414 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-28T21:50:52.415 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T21:50:52.415 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-03-28T21:50:52.415 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T21:50:52.415 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T21:50:52.415 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-03-28 21:50:29.184005460 +0000 2024-03-28T21:50:52.416 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-03-28 21:47:50.417285399 +0000 2024-03-28T21:50:52.416 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-03-28 21:47:50.417285399 +0000 2024-03-28T21:50:52.416 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-03-28 21:47:50.417285399 +0000 2024-03-28T21:50:52.416 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-28T21:50:52.502 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-03-28T21:50:52.503 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-03-28T21:50:52.503 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000454137 s, 1.1 MB/s 2024-03-28T21:50:52.506 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-28T21:50:52.561 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_4 2024-03-28T21:50:52.612 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-28T21:50:52.612 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T21:50:52.612 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 690 Links: 1 2024-03-28T21:50:52.612 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T21:50:52.612 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T21:50:52.613 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-03-28 21:50:29.185005444 +0000 2024-03-28T21:50:52.613 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-03-28 21:47:50.985276620 +0000 2024-03-28T21:50:52.613 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-03-28 21:47:50.985276620 +0000 2024-03-28T21:50:52.613 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-03-28 21:47:50.985276620 +0000 2024-03-28T21:50:52.613 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-28T21:50:52.700 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-03-28T21:50:52.701 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-03-28T21:50:52.701 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000361296 s, 1.4 MB/s 2024-03-28T21:50:52.705 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-28T21:50:52.759 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-28T21:50:52.760 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-28T21:50:52.760 INFO:tasks.ceph:Generating config... 2024-03-28T21:50:52.761 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-28T21:50:52.761 INFO:tasks.ceph:[client] debug client = 20 2024-03-28T21:50:52.761 INFO:tasks.ceph:[client] debug ms = 1 2024-03-28T21:50:52.761 INFO:tasks.ceph:[client] pid file = 2024-03-28T21:50:52.761 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-28T21:50:52.761 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-28T21:50:52.761 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-28T21:50:52.761 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-28T21:50:52.762 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-28T21:50:52.762 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-28T21:50:52.762 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-28T21:50:52.762 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-28T21:50:52.762 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-28T21:50:52.762 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-28T21:50:52.762 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-28T21:50:52.762 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-28T21:50:52.762 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-28T21:50:52.762 INFO:tasks.ceph:[mgr] debug client = 20 2024-03-28T21:50:52.762 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-28T21:50:52.762 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-28T21:50:52.762 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-28T21:50:52.762 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-28T21:50:52.763 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-28T21:50:52.763 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-03-28T21:50:52.763 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-28T21:50:52.763 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-28T21:50:52.763 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-28T21:50:52.763 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-28T21:50:52.763 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-28T21:50:52.763 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-28T21:50:52.763 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-28T21:50:52.763 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-28T21:50:52.763 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-28T21:50:52.763 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-28T21:50:52.763 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-28T21:50:52.763 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-28T21:50:52.764 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-28T21:50:52.764 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-28T21:50:52.764 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-28T21:50:52.764 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-28T21:50:52.764 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-28T21:50:52.764 INFO:tasks.ceph:Setting up mon.a... 2024-03-28T21:50:52.764 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-28T21:50:52.904 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.keyring 2024-03-28T21:50:52.913 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-28T21:50:53.047 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-28T21:50:53.139 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.153'), ('mon.b', '172.21.15.165'), ('mon.c', '[v2:172.21.15.165:3301,v1:172.21.15.165:6790]')] 2024-03-28T21:50:53.139 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.153,172.21.15.165,[v2:172.21.15.165:3301,v1:172.21.15.165:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-28T21:50:53.140 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:50:53.140 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-28T21:50:53.195 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.153 --add b 172.21.15.165 --addv c '[v2:172.21.15.165:3301,v1:172.21.15.165:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-28T21:50:53.346 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-28T21:50:53.347 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: generated fsid 2549e48d-ef7b-419c-89c4-4d0726d7d873 2024-03-28T21:50:53.347 INFO:teuthology.orchestra.run.smithi153.stdout:setting min_mon_release = quincy 2024-03-28T21:50:53.347 INFO:teuthology.orchestra.run.smithi153.stdout:epoch 0 2024-03-28T21:50:53.347 INFO:teuthology.orchestra.run.smithi153.stdout:fsid 2549e48d-ef7b-419c-89c4-4d0726d7d873 2024-03-28T21:50:53.347 INFO:teuthology.orchestra.run.smithi153.stdout:last_changed 2024-03-28T21:50:53.345903+0000 2024-03-28T21:50:53.347 INFO:teuthology.orchestra.run.smithi153.stdout:created 2024-03-28T21:50:53.345903+0000 2024-03-28T21:50:53.347 INFO:teuthology.orchestra.run.smithi153.stdout:min_mon_release 17 (quincy) 2024-03-28T21:50:53.347 INFO:teuthology.orchestra.run.smithi153.stdout:election_strategy: 1 2024-03-28T21:50:53.347 INFO:teuthology.orchestra.run.smithi153.stdout:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-03-28T21:50:53.347 INFO:teuthology.orchestra.run.smithi153.stdout:1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.b 2024-03-28T21:50:53.347 INFO:teuthology.orchestra.run.smithi153.stdout:2: [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] mon.c 2024-03-28T21:50:53.348 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-28T21:50:53.350 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-28T21:50:53.399 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2549e48d-ef7b-419c-89c4-4d0726d7d873... 2024-03-28T21:50:53.399 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-28T21:50:53.446 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-28T21:50:53.609 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-03-28T21:50:53.609 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-03-28T21:50:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-28T21:50:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-03-28T21:50:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-03-28T21:50:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-03-28T21:50:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-03-28T21:50:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-03-28T21:50:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.610 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-03-28T21:50:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-03-28T21:50:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-28T21:50:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-03-28T21:50:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-03-28T21:50:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-28T21:50:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-03-28T21:50:53.611 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-03-28T21:50:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-03-28T21:50:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-03-28T21:50:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-03-28T21:50:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-03-28T21:50:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-03-28T21:50:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-03-28T21:50:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-28T21:50:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-28T21:50:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-03-28T21:50:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-28T21:50:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.612 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-03-28T21:50:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-03-28T21:50:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-03-28T21:50:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-03-28T21:50:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-03-28T21:50:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.153,172.21.15.165,[v2:172.21.15.165:3301,v1:172.21.15.165:6790]" 2024-03-28T21:50:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2024-03-28T21:50:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 2549e48d-ef7b-419c-89c4-4d0726d7d873 2024-03-28T21:50:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.613 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-03-28T21:50:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-03-28T21:50:53.613 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-03-28T21:50:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-03-28T21:50:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-03-28T21:50:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-03-28T21:50:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-03-28T21:50:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-03-28T21:50:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-03-28T21:50:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-03-28T21:50:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-03-28T21:50:53.614 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-03-28T21:50:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-03-28T21:50:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-03-28T21:50:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-03-28T21:50:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-03-28T21:50:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-03-28T21:50:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-03-28T21:50:53.615 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-03-28T21:50:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-03-28T21:50:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2024-03-28T21:50:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2024-03-28T21:50:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2024-03-28T21:50:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-03-28T21:50:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-03-28T21:50:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2024-03-28T21:50:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2024-03-28T21:50:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-28T21:50:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-03-28T21:50:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2024-03-28T21:50:53.616 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-03-28T21:50:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-03-28T21:50:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-03-28T21:50:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-03-28T21:50:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-03-28T21:50:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-03-28T21:50:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.617 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-03-28T21:50:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-28T21:50:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-03-28T21:50:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-03-28T21:50:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-03-28T21:50:53.617 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-03-28T21:50:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-03-28T21:50:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-03-28T21:50:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-03-28T21:50:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.618 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-03-28T21:50:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-28T21:50:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-03-28T21:50:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-03-28T21:50:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-03-28T21:50:53.618 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.619 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: mon down mkfs grace = 300 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-28T21:50:53.620 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds balancer = 20 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = True 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2024-03-28T21:50:53.621 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = True 2024-03-28T21:50:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-03-28T21:50:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-03-28T21:50:53.622 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-03-28T21:50:53.622 INFO:teuthology.orchestra.run.smithi165.stdout:[global] 2024-03-28T21:50:53.622 INFO:teuthology.orchestra.run.smithi165.stdout: chdir = "" 2024-03-28T21:50:53.622 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-28T21:50:53.622 INFO:teuthology.orchestra.run.smithi165.stdout: auth supported = cephx 2024-03-28T21:50:53.622 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.623 INFO:teuthology.orchestra.run.smithi165.stdout: filestore xattr use omap = true 2024-03-28T21:50:53.623 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.623 INFO:teuthology.orchestra.run.smithi165.stdout: mon clock drift allowed = 1.000 2024-03-28T21:50:53.623 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.623 INFO:teuthology.orchestra.run.smithi165.stdout: osd crush chooseleaf type = 0 2024-03-28T21:50:53.623 INFO:teuthology.orchestra.run.smithi165.stdout: auth debug = true 2024-03-28T21:50:53.623 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.623 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on old message = true 2024-03-28T21:50:53.623 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on bug = true 2024-03-28T21:50:53.623 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.623 INFO:teuthology.orchestra.run.smithi165.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-28T21:50:53.623 INFO:teuthology.orchestra.run.smithi165.stdout: mon pg warn max object skew = 0 2024-03-28T21:50:53.623 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.623 INFO:teuthology.orchestra.run.smithi165.stdout: # disable pg_autoscaler by default for new pools 2024-03-28T21:50:53.624 INFO:teuthology.orchestra.run.smithi165.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-28T21:50:53.624 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.624 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default size = 2 2024-03-28T21:50:53.624 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.624 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow primary affinity = true 2024-03-28T21:50:53.624 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow pg remap = true 2024-03-28T21:50:53.624 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on legacy crush tunables = false 2024-03-28T21:50:53.624 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on crush straw calc version zero = false 2024-03-28T21:50:53.624 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on no sortbitwise = false 2024-03-28T21:50:53.624 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on osd down out interval zero = false 2024-03-28T21:50:53.624 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on too few osds = false 2024-03-28T21:50:53.624 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-28T21:50:53.624 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-28T21:50:53.624 INFO:teuthology.orchestra.run.smithi165.stdout: mon_allow_pool_size_one = true 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: osd default data pool replay window = 5 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: mon allow pool delete = true 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: mon cluster log file level = debug 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: debug asserts on shutdown = true 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: mon health detail to clog = false 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: mon host = "172.21.15.153,172.21.15.165,[v2:172.21.15.165:3301,v1:172.21.15.165:6790]" 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on skipped message = False 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: fsid = 2549e48d-ef7b-419c-89c4-4d0726d7d873 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout:[osd] 2024-03-28T21:50:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: osd journal size = 100 2024-03-28T21:50:53.626 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.626 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub load threshold = 5.0 2024-03-28T21:50:53.626 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub max interval = 600 2024-03-28T21:50:53.626 INFO:teuthology.orchestra.run.smithi165.stdout: osd mclock profile = high_recovery_ops 2024-03-28T21:50:53.626 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.626 INFO:teuthology.orchestra.run.smithi165.stdout: osd recover clone overlap = true 2024-03-28T21:50:53.626 INFO:teuthology.orchestra.run.smithi165.stdout: osd recovery max chunk = 1048576 2024-03-28T21:50:53.626 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.626 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug shutdown = true 2024-03-28T21:50:53.626 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug op order = true 2024-03-28T21:50:53.626 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug verify stray on activate = true 2024-03-28T21:50:53.626 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug trim objects = true 2024-03-28T21:50:53.626 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: osd open classes on start = true 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug pg log writeout = true 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: osd deep scrub update digest min age = 30 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: osd map max advance = 10 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: journal zero on create = true 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: filestore ondisk finisher threads = 3 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: filestore apply finisher threads = 3 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: bdev debug aio = true 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug misdirected ops = true 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: bdev async discard = True 2024-03-28T21:50:53.627 INFO:teuthology.orchestra.run.smithi165.stdout: bdev enable discard = True 2024-03-28T21:50:53.628 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore allocator = bitmap 2024-03-28T21:50:53.628 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore block size = 96636764160 2024-03-28T21:50:53.628 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore fsck on mount = True 2024-03-28T21:50:53.628 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluefs = 1/20 2024-03-28T21:50:53.628 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluestore = 1/20 2024-03-28T21:50:53.628 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-03-28T21:50:53.628 INFO:teuthology.orchestra.run.smithi165.stdout: debug osd = 20 2024-03-28T21:50:53.628 INFO:teuthology.orchestra.run.smithi165.stdout: debug rocksdb = 4/10 2024-03-28T21:50:53.628 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd backfillfull_ratio = 0.85 2024-03-28T21:50:53.628 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd full ratio = 0.9 2024-03-28T21:50:53.628 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd nearfull ratio = 0.8 2024-03-28T21:50:53.628 INFO:teuthology.orchestra.run.smithi165.stdout: osd failsafe full ratio = 0.95 2024-03-28T21:50:53.628 INFO:teuthology.orchestra.run.smithi165.stdout: osd objectstore = bluestore 2024-03-28T21:50:53.629 INFO:teuthology.orchestra.run.smithi165.stdout: osd op complaint time = 180 2024-03-28T21:50:53.629 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.629 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr] 2024-03-28T21:50:53.629 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-03-28T21:50:53.629 INFO:teuthology.orchestra.run.smithi165.stdout: debug mgr = 20 2024-03-28T21:50:53.629 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-03-28T21:50:53.629 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-03-28T21:50:53.629 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-03-28T21:50:53.629 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-03-28T21:50:53.629 INFO:teuthology.orchestra.run.smithi165.stdout: mgr/telemetry/nag = false 2024-03-28T21:50:53.629 INFO:teuthology.orchestra.run.smithi165.stdout: debug client = 20 2024-03-28T21:50:53.629 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.629 INFO:teuthology.orchestra.run.smithi165.stdout:[mon] 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: debug paxos = 20 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: mon data avail warn = 5 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: mon mgr mkfs grace = 240 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd reporter subtree level = osd 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd prime pg temp = true 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: auth mon ticket ttl = 660 # 11m 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: auth service ticket ttl = 240 # 4m 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.630 INFO:teuthology.orchestra.run.smithi165.stdout: # don't complain about insecure global_id in the test suite 2024-03-28T21:50:53.631 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-28T21:50:53.631 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-28T21:50:53.631 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.631 INFO:teuthology.orchestra.run.smithi165.stdout: # 1m isn't quite enough 2024-03-28T21:50:53.631 INFO:teuthology.orchestra.run.smithi165.stdout: mon_down_mkfs_grace = 2m 2024-03-28T21:50:53.631 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.631 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_filestore_osds = false 2024-03-28T21:50:53.631 INFO:teuthology.orchestra.run.smithi165.stdout: mon down mkfs grace = 300 2024-03-28T21:50:53.631 INFO:teuthology.orchestra.run.smithi165.stdout: mon op complaint time = 120 2024-03-28T21:50:53.631 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-03-28T21:50:53.631 INFO:teuthology.orchestra.run.smithi165.stdout:[client] 2024-03-28T21:50:53.631 INFO:teuthology.orchestra.run.smithi165.stdout: rgw cache enabled = true 2024-03-28T21:50:53.631 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable ops log = true 2024-03-28T21:50:53.631 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable usage log = true 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout: client mount timeout = 600 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout: debug client = 20 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = "" 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout: rados mon op timeout = 900 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout: rados osd op timeout = 900 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.a] 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.b] 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.c] 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.a] 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.c] 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.b] 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.d] 2024-03-28T21:50:53.632 INFO:teuthology.orchestra.run.smithi165.stdout:[mds] 2024-03-28T21:50:53.633 INFO:teuthology.orchestra.run.smithi165.stdout: debug mds = 20 2024-03-28T21:50:53.633 INFO:teuthology.orchestra.run.smithi165.stdout: debug mds balancer = 20 2024-03-28T21:50:53.633 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-03-28T21:50:53.633 INFO:teuthology.orchestra.run.smithi165.stdout: mds debug frag = True 2024-03-28T21:50:53.633 INFO:teuthology.orchestra.run.smithi165.stdout: mds debug scatterstat = True 2024-03-28T21:50:53.633 INFO:teuthology.orchestra.run.smithi165.stdout: mds op complaint time = 180 2024-03-28T21:50:53.633 INFO:teuthology.orchestra.run.smithi165.stdout: mds verify scatter = True 2024-03-28T21:50:53.633 INFO:teuthology.orchestra.run.smithi165.stdout: osd op complaint time = 180 2024-03-28T21:50:53.633 INFO:teuthology.orchestra.run.smithi165.stdout: rados mon op timeout = 900 2024-03-28T21:50:53.633 INFO:teuthology.orchestra.run.smithi165.stdout: rados osd op timeout = 900 2024-03-28T21:50:53.662 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-28T21:50:53.662 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-28T21:50:53.805 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-28T21:50:53.805 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:50:53.805 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-28T21:50:53.853 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:50:53.853 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-28T21:50:53.951 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-03-28T21:50:53.951 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:50:53.951 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-28T21:50:53.951 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-28T21:50:54.103 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:50:54.103 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-28T21:50:54.198 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi165.front.sepia.ceph.com 2024-03-28T21:50:54.198 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:50:54.198 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-28T21:50:54.198 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-28T21:50:54.338 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:50:54.338 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-28T21:50:54.430 INFO:tasks.ceph:Setting up mon nodes... 2024-03-28T21:50:54.431 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-28T21:50:54.431 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-28T21:50:54.621 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-28T21:50:54.632 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-28T21:50:54.790 INFO:teuthology.orchestra.run.smithi165.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-28T21:50:54.801 INFO:tasks.ceph:Setting up mds nodes... 2024-03-28T21:50:54.801 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-28T21:50:54.994 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-28T21:50:55.003 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-28T21:50:55.101 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-28T21:50:55.286 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-28T21:50:55.295 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-28T21:50:55.386 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-28T21:50:55.545 INFO:teuthology.orchestra.run.smithi165.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-28T21:50:55.553 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-28T21:50:55.624 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-28T21:50:55.799 INFO:teuthology.orchestra.run.smithi165.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-28T21:50:55.808 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-28T21:50:55.900 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-28T21:50:55.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-28T21:50:56.029 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-28T21:50:56.086 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-28T21:50:56.213 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-28T21:50:56.277 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-28T21:50:56.401 INFO:teuthology.orchestra.run.smithi165.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-28T21:50:56.456 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-28T21:50:56.582 INFO:teuthology.orchestra.run.smithi165.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-28T21:50:56.640 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-28T21:50:56.640 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-28T21:50:56.640 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-28T21:50:56.739 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-28T21:50:56.740 INFO:tasks.ceph:role: osd.0 2024-03-28T21:50:56.740 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-28T21:50:56.740 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-28T21:50:56.838 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T21:50:56.838 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T21:50:56.838 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T21:50:56.839 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-28T21:50:56.839 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T21:50:56.839 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-03-28T21:50:56.839 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T21:50:56.839 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-28T21:50:56.839 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T21:50:56.839 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T21:50:57.358 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-03-28T21:50:57.364 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-03-28T21:50:57.364 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-28T21:50:57.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-28T21:50:57.648 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-28T21:50:57.725 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-28T21:50:57.725 INFO:tasks.ceph:role: osd.1 2024-03-28T21:50:57.725 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-28T21:50:57.725 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-28T21:50:57.809 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T21:50:57.809 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T21:50:57.809 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T21:50:57.809 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-28T21:50:57.809 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T21:50:57.809 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-03-28T21:50:57.809 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T21:50:57.810 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-28T21:50:57.810 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T21:50:57.810 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T21:50:58.305 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-03-28T21:50:58.311 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-03-28T21:50:58.311 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-28T21:50:58.436 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-28T21:50:58.513 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-28T21:50:58.596 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-28T21:50:58.596 INFO:tasks.ceph:role: osd.2 2024-03-28T21:50:58.596 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-28T21:50:58.596 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-28T21:50:58.680 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T21:50:58.680 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T21:50:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T21:50:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-28T21:50:58.681 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T21:50:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-03-28T21:50:58.681 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T21:50:58.681 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-28T21:50:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T21:50:58.681 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T21:50:59.195 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-03-28T21:50:59.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-03-28T21:50:59.200 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-28T21:50:59.389 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-28T21:50:59.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-28T21:50:59.582 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-28T21:50:59.583 INFO:tasks.ceph:role: osd.3 2024-03-28T21:50:59.583 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-28T21:50:59.583 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-28T21:50:59.679 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T21:50:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T21:50:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T21:50:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-28T21:50:59.679 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T21:50:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-03-28T21:50:59.679 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T21:50:59.679 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-28T21:50:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T21:50:59.680 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T21:51:00.169 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-03-28T21:51:00.175 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-03-28T21:51:00.176 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-28T21:51:00.325 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-28T21:51:00.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T21:51:00.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:00.569+0000 7f1a8c80c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-28T21:51:00.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:00.572+0000 7f1a8c80c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-28T21:51:00.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:00.572+0000 7f1a8c80c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-28T21:51:00.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:00.572+0000 7f1a8c80c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-28T21:51:00.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:00.572+0000 7f1a8c80c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-28T21:51:00.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:00.583+0000 7f1a8c80c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-28T21:51:03.768 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-28T21:51:03.867 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T21:51:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:04.004+0000 7f6cd0219640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-28T21:51:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:04.005+0000 7f6cd0219640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-28T21:51:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:04.005+0000 7f6cd0219640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-28T21:51:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:04.005+0000 7f6cd0219640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-28T21:51:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:04.005+0000 7f6cd0219640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-28T21:51:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:04.008+0000 7f6cd0219640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-28T21:51:06.933 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-28T21:51:07.032 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T21:51:07.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:07.167+0000 7f8395411640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-28T21:51:07.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:07.167+0000 7f8395411640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-28T21:51:07.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:07.167+0000 7f8395411640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-28T21:51:07.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:07.167+0000 7f8395411640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-28T21:51:07.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:07.167+0000 7f8395411640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-28T21:51:07.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:07.169+0000 7f8395411640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-28T21:51:10.091 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-28T21:51:10.189 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T21:51:10.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:10.323+0000 7fe829422640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-28T21:51:10.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:10.324+0000 7fe829422640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-28T21:51:10.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:10.324+0000 7fe829422640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-28T21:51:10.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:10.324+0000 7fe829422640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-28T21:51:10.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:10.324+0000 7fe829422640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-28T21:51:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:10.326+0000 7fe829422640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-28T21:51:13.255 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-28T21:51:13.354 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-28T21:51:13.456 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-28T21:51:13.456 INFO:tasks.ceph:role: osd.4 2024-03-28T21:51:13.457 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com 2024-03-28T21:51:13.457 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-28T21:51:13.559 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T21:51:13.559 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T21:51:13.559 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T21:51:13.559 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-28T21:51:13.559 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T21:51:13.559 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-03-28T21:51:13.559 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T21:51:13.559 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-28T21:51:13.559 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T21:51:13.560 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T21:51:14.076 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-03-28T21:51:14.082 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-03-28T21:51:14.082 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-28T21:51:14.268 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-28T21:51:14.372 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-28T21:51:14.458 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-28T21:51:14.458 INFO:tasks.ceph:role: osd.5 2024-03-28T21:51:14.458 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi165.front.sepia.ceph.com 2024-03-28T21:51:14.458 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-28T21:51:14.550 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T21:51:14.550 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T21:51:14.551 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T21:51:14.551 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-28T21:51:14.551 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T21:51:14.551 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-03-28T21:51:14.551 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T21:51:14.551 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-28T21:51:14.551 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T21:51:14.551 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T21:51:15.023 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-03-28T21:51:15.030 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-03-28T21:51:15.030 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-28T21:51:15.154 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-28T21:51:15.232 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-28T21:51:15.315 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-28T21:51:15.316 INFO:tasks.ceph:role: osd.6 2024-03-28T21:51:15.316 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi165.front.sepia.ceph.com 2024-03-28T21:51:15.316 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-28T21:51:15.401 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T21:51:15.401 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T21:51:15.401 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T21:51:15.401 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-28T21:51:15.401 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T21:51:15.401 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-03-28T21:51:15.401 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T21:51:15.401 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-28T21:51:15.401 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T21:51:15.401 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T21:51:15.924 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-03-28T21:51:15.932 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-03-28T21:51:15.932 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-28T21:51:16.127 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-28T21:51:16.223 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-28T21:51:16.309 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-28T21:51:16.309 INFO:tasks.ceph:role: osd.7 2024-03-28T21:51:16.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi165.front.sepia.ceph.com 2024-03-28T21:51:16.310 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-28T21:51:16.407 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T21:51:16.407 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T21:51:16.407 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T21:51:16.407 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-28T21:51:16.407 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T21:51:16.407 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-03-28T21:51:16.408 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T21:51:16.408 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-28T21:51:16.408 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T21:51:16.408 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T21:51:16.864 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-03-28T21:51:16.870 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-03-28T21:51:16.871 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-28T21:51:17.017 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-28T21:51:17.109 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T21:51:17.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:17.247+0000 7fa6cb21e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-28T21:51:17.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:17.252+0000 7fa6cb21e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-28T21:51:17.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:17.252+0000 7fa6cb21e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-28T21:51:17.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:17.252+0000 7fa6cb21e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-28T21:51:17.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:17.252+0000 7fa6cb21e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-28T21:51:17.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:17.255+0000 7fa6cb21e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-28T21:51:20.200 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-28T21:51:20.295 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T21:51:20.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:20.428+0000 7f5bab20c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-28T21:51:20.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:20.429+0000 7f5bab20c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-28T21:51:20.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:20.429+0000 7f5bab20c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-28T21:51:20.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:20.429+0000 7f5bab20c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-28T21:51:20.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:20.429+0000 7f5bab20c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-28T21:51:20.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:20.431+0000 7f5bab20c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-28T21:51:20.785 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:51:20.792 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:51:23.605 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-28T21:51:23.701 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T21:51:23.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:23.836+0000 7f0426e1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-28T21:51:23.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:23.837+0000 7f0426e1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-28T21:51:23.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:23.837+0000 7f0426e1b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-28T21:51:23.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:23.837+0000 7f0426e1b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-28T21:51:23.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:23.837+0000 7f0426e1b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-28T21:51:23.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:23.839+0000 7f0426e1b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-28T21:51:27.005 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-28T21:51:27.098 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T21:51:27.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:27.222+0000 7f164dbbb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-28T21:51:27.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:27.223+0000 7f164dbbb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-28T21:51:27.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:27.223+0000 7f164dbbb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-28T21:51:27.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:27.223+0000 7f164dbbb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-28T21:51:27.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:27.223+0000 7f164dbbb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-28T21:51:27.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:27.225+0000 7f164dbbb640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-28T21:51:30.394 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-28T21:51:30.491 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-28T21:51:30.492 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:51:30.492 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-28T21:51:30.592 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:51:30.592 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-28T21:51:30.690 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:51:30.690 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-28T21:51:30.784 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:51:30.785 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-28T21:51:30.877 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:51:30.878 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-28T21:51:30.972 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:51:30.972 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-28T21:51:31.067 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:51:31.067 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-28T21:51:31.164 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:51:31.164 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-28T21:51:31.263 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:51:31.263 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-28T21:51:31.358 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:51:31.358 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-28T21:51:31.453 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:51:31.453 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-28T21:51:31.548 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:51:31.548 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-28T21:51:31.643 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:51:31.643 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-28T21:51:31.738 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:51:31.738 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-28T21:51:31.833 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:51:31.833 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-28T21:51:31.889 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:51:31.889 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-28T21:51:31.944 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:51:31.944 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-28T21:51:31.999 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:51:31.999 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-28T21:51:32.050 INFO:tasks.ceph:Adding keys to all mons... 2024-03-28T21:51:32.050 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-28T21:51:32.057 DEBUG:teuthology.orchestra.run.smithi165:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-28T21:51:32.137 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr.y] 2024-03-28T21:51:32.137 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQA+5gVmXf4EJRAAs1jwJgrAUJxEKBFDyxXxsg== 2024-03-28T21:51:32.137 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.a] 2024-03-28T21:51:32.137 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQA+5gVmZ/I2OxAAgJssqqSY/xt2MLUxfNeJbg== 2024-03-28T21:51:32.137 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.c] 2024-03-28T21:51:32.137 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQA/5gVmbUkCERAAjDwHvMAXCTzX92+JX+d+uQ== 2024-03-28T21:51:32.138 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.0] 2024-03-28T21:51:32.138 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQBE5gVmh4gIIhAAiPprW1aqSCIFWEt4H+nOKA== 2024-03-28T21:51:32.138 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.1] 2024-03-28T21:51:32.138 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQBI5gVmfYhhABAAMdXy0w1kDNmj8ZVzREwmDg== 2024-03-28T21:51:32.138 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.2] 2024-03-28T21:51:32.138 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQBL5gVm1xIMChAA0t3uAjMLMnbY7eWe4ifFpw== 2024-03-28T21:51:32.138 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.3] 2024-03-28T21:51:32.138 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQBO5gVmr1JlExAASsUfv6m0M7j/Jiwx9N8nWQ== 2024-03-28T21:51:32.138 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr.x] 2024-03-28T21:51:32.138 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQA+5gVmEskWLxAAJmE18GXPQENiw9BuGNFkSQ== 2024-03-28T21:51:32.138 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.b] 2024-03-28T21:51:32.138 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQA/5gVmwdZ9IBAAal5ua9YPJk0URlidxPk4BQ== 2024-03-28T21:51:32.138 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.d] 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQA/5gVmBByYLxAAENbTxlJ8HWfBx0AAVALKLQ== 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.4] 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQBV5gVmlpXCDhAALhHCR8t4lqD8BBLLdP/W5w== 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.5] 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQBY5gVmwO2UGRAAKwfM2Y56FRD1BSqOQTORGw== 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.6] 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQBb5gVm27DnMRAAP30Jep4QPVrg8ar+pw+xIw== 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.7] 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQBf5gVmX8VMDRAA/OIBRaqTPKcwCUoTlQiCyQ== 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout:[client.0] 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQBA5gVmoG2wARAAshqkf7uwt2GxtPnRirjPtA== 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout:[client.2] 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQBA5gVmLROwDBAAtk2obNFzs1H4b13HTnAuPg== 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout:[client.1] 2024-03-28T21:51:32.139 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQBA5gVmWoLgFxAA2L2+rMbLC6dq9H8yn99iWw== 2024-03-28T21:51:32.140 INFO:teuthology.orchestra.run.smithi165.stdout:[client.3] 2024-03-28T21:51:32.140 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQBA5gVmtXSwIhAAQ4YtDhgFApQrtcdzdShKrg== 2024-03-28T21:51:32.147 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2024-03-28T21:51:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQA+5gVmXf4EJRAAs1jwJgrAUJxEKBFDyxXxsg== 2024-03-28T21:51:32.147 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-03-28T21:51:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQA+5gVmZ/I2OxAAgJssqqSY/xt2MLUxfNeJbg== 2024-03-28T21:51:32.147 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-03-28T21:51:32.147 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQA/5gVmbUkCERAAjDwHvMAXCTzX92+JX+d+uQ== 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBE5gVmh4gIIhAAiPprW1aqSCIFWEt4H+nOKA== 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBI5gVmfYhhABAAMdXy0w1kDNmj8ZVzREwmDg== 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBL5gVm1xIMChAA0t3uAjMLMnbY7eWe4ifFpw== 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBO5gVmr1JlExAASsUfv6m0M7j/Jiwx9N8nWQ== 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQA+5gVmEskWLxAAJmE18GXPQENiw9BuGNFkSQ== 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQA/5gVmwdZ9IBAAal5ua9YPJk0URlidxPk4BQ== 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQA/5gVmBByYLxAAENbTxlJ8HWfBx0AAVALKLQ== 2024-03-28T21:51:32.148 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2024-03-28T21:51:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBV5gVmlpXCDhAALhHCR8t4lqD8BBLLdP/W5w== 2024-03-28T21:51:32.149 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2024-03-28T21:51:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBY5gVmwO2UGRAAKwfM2Y56FRD1BSqOQTORGw== 2024-03-28T21:51:32.149 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2024-03-28T21:51:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBb5gVm27DnMRAAP30Jep4QPVrg8ar+pw+xIw== 2024-03-28T21:51:32.149 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2024-03-28T21:51:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBf5gVmX8VMDRAA/OIBRaqTPKcwCUoTlQiCyQ== 2024-03-28T21:51:32.149 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-03-28T21:51:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBA5gVmoG2wARAAshqkf7uwt2GxtPnRirjPtA== 2024-03-28T21:51:32.149 INFO:teuthology.orchestra.run.smithi153.stdout:[client.2] 2024-03-28T21:51:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBA5gVmLROwDBAAtk2obNFzs1H4b13HTnAuPg== 2024-03-28T21:51:32.149 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2024-03-28T21:51:32.149 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBA5gVmWoLgFxAA2L2+rMbLC6dq9H8yn99iWw== 2024-03-28T21:51:32.149 INFO:teuthology.orchestra.run.smithi153.stdout:[client.3] 2024-03-28T21:51:32.150 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBA5gVmtXSwIhAAQ4YtDhgFApQrtcdzdShKrg== 2024-03-28T21:51:32.151 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-28T21:51:32.160 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-28T21:51:32.328 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T21:51:32.336 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T21:51:32.482 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T21:51:32.489 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T21:51:32.634 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:32.641 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:32.775 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:32.779 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:32.914 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:32.921 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:33.057 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:33.065 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:33.211 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-28T21:51:33.219 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-28T21:51:33.359 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T21:51:33.371 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T21:51:33.519 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T21:51:33.529 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T21:51:33.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:33.689 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:33.831 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:33.842 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:33.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:33.994 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:34.138 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:34.148 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T21:51:34.301 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-28T21:51:34.309 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-28T21:51:34.456 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-28T21:51:34.463 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-28T21:51:34.614 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-28T21:51:34.619 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-28T21:51:34.763 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-28T21:51:34.769 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-28T21:51:34.915 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-28T21:51:34.915 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-28T21:51:34.996 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-28T21:51:35.145 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-28T21:51:35.229 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-28T21:51:35.328 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-28T21:51:35.481 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-28T21:51:35.569 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-28T21:51:35.658 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-28T21:51:35.812 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-28T21:51:35.893 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-28T21:51:35.900 DEBUG:teuthology.orchestra.run.smithi165:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-28T21:51:35.951 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-28T21:51:35.951 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-28T21:51:35.951 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-28T21:51:35.957 INFO:tasks.ceph.mon.a:Started 2024-03-28T21:51:35.957 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-28T21:51:35.957 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-28T21:51:35.963 INFO:tasks.ceph.mon.b:Started 2024-03-28T21:51:35.963 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-28T21:51:35.963 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-28T21:51:35.970 INFO:tasks.ceph.mon.c:Started 2024-03-28T21:51:35.970 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-28T21:51:35.970 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-28T21:51:35.970 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-28T21:51:35.975 INFO:tasks.ceph.mgr.y:Started 2024-03-28T21:51:35.975 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-28T21:51:35.975 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-28T21:51:35.980 INFO:tasks.ceph.mgr.x:Started 2024-03-28T21:51:35.980 INFO:tasks.ceph:Setting crush tunables to default 2024-03-28T21:51:35.980 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd crush tunables default 2024-03-28T21:51:36.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.155+0000 7f460e800640 1 Processor -- start 2024-03-28T21:51:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.155+0000 7f460e800640 1 -- start start 2024-03-28T21:51:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.156+0000 7f460e800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46080b2ad0 0x7f46080cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.156+0000 7f460e800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46080d2f90 con 0x7f460815e2e0 2024-03-28T21:51:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.156+0000 7f460e800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46080b0fe0 con 0x7f46080ced00 2024-03-28T21:51:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.156+0000 7f460e800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f46080b0d90 con 0x7f46080b2ad0 2024-03-28T21:51:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.157+0000 7f45ffe00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f46080ced00 0x7f46080cf1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:44410/0 (socket says 172.21.15.153:44410) 2024-03-28T21:51:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.157+0000 7f45ffe00640 1 -- 172.21.15.153:0/3625511034 learned_addr learned my addr 172.21.15.153:0/3625511034 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:51:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.157+0000 7f4607e00640 1 --2- 172.21.15.153:0/3625511034 >> v2:172.21.15.153:3300/0 conn(0x7f46080b2ad0 0x7f46080cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.157+0000 7f4607e00640 1 -- 172.21.15.153:0/3625511034 >> v2:172.21.15.153:3300/0 conn(0x7f46080b2ad0 msgr2=0x7f46080cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-28T21:51:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.157+0000 7f4607e00640 1 -- 172.21.15.153:0/3625511034 >> v2:172.21.15.153:3300/0 conn(0x7f46080b2ad0 msgr2=0x7f46080cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T21:51:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.157+0000 7f4607e00640 1 --2- 172.21.15.153:0/3625511034 >> v2:172.21.15.153:3300/0 conn(0x7f46080b2ad0 0x7f46080cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T21:51:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.157+0000 7f4607e00640 1 --2- 172.21.15.153:0/3625511034 >> v2:172.21.15.153:3300/0 conn(0x7f46080b2ad0 0x7f46080cf8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T21:51:36.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.358+0000 7f4607e00640 1 --2- 172.21.15.153:0/3625511034 >> v2:172.21.15.153:3300/0 conn(0x7f46080b2ad0 0x7f46080cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:36.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.358+0000 7f4607e00640 1 -- 172.21.15.153:0/3625511034 >> v2:172.21.15.153:3300/0 conn(0x7f46080b2ad0 msgr2=0x7f46080cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-28T21:51:36.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.358+0000 7f4607e00640 1 -- 172.21.15.153:0/3625511034 >> v2:172.21.15.153:3300/0 conn(0x7f46080b2ad0 msgr2=0x7f46080cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T21:51:36.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.358+0000 7f4607e00640 1 --2- 172.21.15.153:0/3625511034 >> v2:172.21.15.153:3300/0 conn(0x7f46080b2ad0 0x7f46080cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T21:51:36.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.359+0000 7f4607e00640 1 --2- 172.21.15.153:0/3625511034 >> v2:172.21.15.153:3300/0 conn(0x7f46080b2ad0 0x7f46080cf8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T21:51:36.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.403+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 810826909 0 0) 0x7f46080d2f90 con 0x7f460815e2e0 2024-03-28T21:51:36.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.403+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45ec003520 con 0x7f460815e2e0 2024-03-28T21:51:36.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.404+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727641870 0 0) 0x7f46080b0fe0 con 0x7f46080ced00 2024-03-28T21:51:36.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.404+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46080d2f90 con 0x7f46080ced00 2024-03-28T21:51:36.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.404+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 359750900 0 0) 0x7f45ec003520 con 0x7f460815e2e0 2024-03-28T21:51:36.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.404+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 >> v2:172.21.15.153:3300/0 conn(0x7f46080b2ad0 msgr2=0x7f46080cf8c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T21:51:36.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.404+0000 7f4606a00640 1 --2- 172.21.15.153:0/3625511034 >> v2:172.21.15.153:3300/0 conn(0x7f46080b2ad0 0x7f46080cf8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:36.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.404+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 >> v1:172.21.15.165:6789/0 conn(0x7f46080ced00 legacy=0x7f46080cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:36.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.404+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46080b12c0 con 0x7f460815e2e0 2024-03-28T21:51:36.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.405+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f45f8001670 con 0x7f460815e2e0 2024-03-28T21:51:36.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.405+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 >> v1:172.21.15.153:6789/0 conn(0x7f460815e2e0 legacy=0x7f46080d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:36.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.405+0000 7f4606a00640 1 --2- 172.21.15.153:0/3625511034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec004bf0 0x7f45ec004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:36.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.405+0000 7f4606a00640 1 --2- 172.21.15.153:0/3625511034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec0037a0 0x7f45ec003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:36.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.405+0000 7f4606a00640 1 --2- 172.21.15.153:0/3625511034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45ec004230 0x7f45ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:36.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.405+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f46080b0d90 con 0x7f45ec004230 2024-03-28T21:51:36.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.406+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f45ec00c1e0 con 0x7f45ec0037a0 2024-03-28T21:51:36.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.406+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f45ec00c3e0 con 0x7f45ec004bf0 2024-03-28T21:51:36.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.406+0000 7f4607400640 1 --2- 172.21.15.153:0/3625511034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec004bf0 0x7f45ec004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.406+0000 7f4607e00640 1 --2- 172.21.15.153:0/3625511034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45ec004230 0x7f45ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.406+0000 7f45ffe00640 1 --2- 172.21.15.153:0/3625511034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec0037a0 0x7f45ec003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.407+0000 7f4607e00640 1 -- 172.21.15.153:0/3625511034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec004bf0 msgr2=0x7f45ec004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.407+0000 7f4607e00640 1 --2- 172.21.15.153:0/3625511034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec004bf0 0x7f45ec004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.407+0000 7f4607e00640 1 -- 172.21.15.153:0/3625511034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec0037a0 msgr2=0x7f45ec003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.407+0000 7f4607e00640 1 --2- 172.21.15.153:0/3625511034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec0037a0 0x7f45ec003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.407+0000 7f4607e00640 1 -- 172.21.15.153:0/3625511034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ec003520 con 0x7f45ec004230 2024-03-28T21:51:36.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.407+0000 7f4607400640 1 --2- 172.21.15.153:0/3625511034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec004bf0 0x7f45ec004ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:51:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.410+0000 7f4607e00640 1 -- 172.21.15.153:0/3625511034 reap_dead start 2024-03-28T21:51:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.410+0000 7f4607e00640 1 --2- 172.21.15.153:0/3625511034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45ec004230 0x7f45ec00b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4600009fa0 tx=0x7f45ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be9d4cab97dcf27 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:36.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.411+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460003a070 con 0x7f45ec004230 2024-03-28T21:51:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.411+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4600035410 con 0x7f45ec004230 2024-03-28T21:51:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.411+0000 7f4606a00640 1 -- 172.21.15.153:0/3625511034 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8007b30 con 0x7f45ec004230 2024-03-28T21:51:36.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.413+0000 7f460e800640 1 -- 172.21.15.153:0/3625511034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45ec004230 msgr2=0x7f45ec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:36.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.413+0000 7f460e800640 1 --2- 172.21.15.153:0/3625511034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45ec004230 0x7f45ec00b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4600009fa0 tx=0x7f45ec005830 comp rx=0 tx=0).stop 2024-03-28T21:51:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.413+0000 7f460e800640 1 -- 172.21.15.153:0/3625511034 shutdown_connections 2024-03-28T21:51:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.413+0000 7f460e800640 1 --2- 172.21.15.153:0/3625511034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45ec004230 0x7f45ec00b9c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.413+0000 7f460e800640 1 -- 172.21.15.153:0/3625511034 >> 172.21.15.153:0/3625511034 conn(0x7f460809d4a0 msgr2=0x7f46080d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.413+0000 7f460e800640 1 -- 172.21.15.153:0/3625511034 shutdown_connections 2024-03-28T21:51:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.413+0000 7f460e800640 1 -- 172.21.15.153:0/3625511034 wait complete. 2024-03-28T21:51:36.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.417+0000 7f460e800640 1 Processor -- start 2024-03-28T21:51:36.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.417+0000 7f460e800640 1 -- start start 2024-03-28T21:51:36.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.419+0000 7f460e800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec004230 0x7f46080b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.419+0000 7f460e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f460815c820 0x7f4608156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.419+0000 7f460e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46080b5550 0x7f46080b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.419+0000 7f460e800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f46080d2740 con 0x7f46080b5550 2024-03-28T21:51:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.419+0000 7f460e800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f46080b1630 con 0x7f45ec004230 2024-03-28T21:51:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.419+0000 7f460e800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f46080d28c0 con 0x7f460815c820 2024-03-28T21:51:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.419+0000 7f4607e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46080b5550 0x7f46080b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.419+0000 7f4607e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46080b5550 0x7f46080b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40778/0 (socket says 172.21.15.153:40778) 2024-03-28T21:51:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.419+0000 7f4607e00640 1 -- 172.21.15.153:0/1980786286 learned_addr learned my addr 172.21.15.153:0/1980786286 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.419+0000 7f45ffe00640 1 --2- 172.21.15.153:0/1980786286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f460815c820 0x7f4608156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.419+0000 7f4607400640 1 --2- 172.21.15.153:0/1980786286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec004230 0x7f46080b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.420+0000 7f4607e00640 1 -- 172.21.15.153:0/1980786286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f460815c820 msgr2=0x7f4608156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.420+0000 7f4607e00640 1 --2- 172.21.15.153:0/1980786286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f460815c820 0x7f4608156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.420+0000 7f4607e00640 1 -- 172.21.15.153:0/1980786286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec004230 msgr2=0x7f46080b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.420+0000 7f4607e00640 1 --2- 172.21.15.153:0/1980786286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec004230 0x7f46080b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.420+0000 7f4607e00640 1 -- 172.21.15.153:0/1980786286 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46080b4dc0 con 0x7f46080b5550 2024-03-28T21:51:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.420+0000 7f4607400640 1 --2- 172.21.15.153:0/1980786286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec004230 0x7f46080b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:51:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.420+0000 7f4607e00640 1 --2- 172.21.15.153:0/1980786286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46080b5550 0x7f46080b59d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f46000073f0 tx=0x7f4600004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.421+0000 7f45ff400640 1 -- 172.21.15.153:0/1980786286 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460003a040 con 0x7f46080b5550 2024-03-28T21:51:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.421+0000 7f45ff400640 1 -- 172.21.15.153:0/1980786286 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4600048070 con 0x7f46080b5550 2024-03-28T21:51:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.421+0000 7f45ff400640 1 -- 172.21.15.153:0/1980786286 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600009ba0 con 0x7f46080b5550 2024-03-28T21:51:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.421+0000 7f460e800640 1 -- 172.21.15.153:0/1980786286 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46080b4800 con 0x7f46080b5550 2024-03-28T21:51:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.421+0000 7f460e800640 1 -- 172.21.15.153:0/1980786286 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46080cb340 con 0x7f46080b5550 2024-03-28T21:51:36.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.423+0000 7f460e800640 1 -- 172.21.15.153:0/1980786286 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4608068ff0 con 0x7f46080b5550 2024-03-28T21:51:36.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.423+0000 7f45ff400640 1 -- 172.21.15.153:0/1980786286 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f460003d040 con 0x7f46080b5550 2024-03-28T21:51:36.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.423+0000 7f45ff400640 1 -- 172.21.15.153:0/1980786286 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f460004d7d0 con 0x7f46080b5550 2024-03-28T21:51:36.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.427+0000 7f45ff400640 1 -- 172.21.15.153:0/1980786286 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f460004d9d0 con 0x7f46080b5550 2024-03-28T21:51:36.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.539+0000 7f460e800640 1 -- 172.21.15.153:0/1980786286 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f46080ce1b0 con 0x7f46080b5550 2024-03-28T21:51:36.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.542+0000 7f45ff400640 1 -- 172.21.15.153:0/1980786286 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f460004dc60 con 0x7f46080b5550 2024-03-28T21:51:36.544 INFO:teuthology.orchestra.run.smithi153.stderr:adjusted tunables profile to default 2024-03-28T21:51:36.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.544+0000 7f460e800640 1 -- 172.21.15.153:0/1980786286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46080b5550 msgr2=0x7f46080b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:36.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.544+0000 7f460e800640 1 --2- 172.21.15.153:0/1980786286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46080b5550 0x7f46080b59d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f46000073f0 tx=0x7f4600004a40 comp rx=0 tx=0).stop 2024-03-28T21:51:36.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.544+0000 7f460e800640 1 -- 172.21.15.153:0/1980786286 shutdown_connections 2024-03-28T21:51:36.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.544+0000 7f460e800640 1 --2- 172.21.15.153:0/1980786286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46080b5550 0x7f46080b59d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:36.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.544+0000 7f460e800640 1 --2- 172.21.15.153:0/1980786286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f460815c820 0x7f4608156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:36.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.544+0000 7f460e800640 1 --2- 172.21.15.153:0/1980786286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec004230 0x7f46080b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:36.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.544+0000 7f460e800640 1 -- 172.21.15.153:0/1980786286 >> 172.21.15.153:0/1980786286 conn(0x7f460809d4a0 msgr2=0x7f46080b8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:36.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.544+0000 7f460e800640 1 -- 172.21.15.153:0/1980786286 shutdown_connections 2024-03-28T21:51:36.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:36.544+0000 7f460e800640 1 -- 172.21.15.153:0/1980786286 wait complete. 2024-03-28T21:51:36.562 INFO:tasks.ceph:check_enable_crimson: False 2024-03-28T21:51:36.562 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-28T21:51:36.563 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:51:36.563 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-28T21:51:36.646 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:51:36.646 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-28T21:51:36.766 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:51:36.766 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-28T21:51:36.893 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:51:36.893 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-28T21:51:37.004 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:37.002+0000 7f1311012040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-28T21:51:37.017 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:51:37.017 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-28T21:51:37.033 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:37.031+0000 7fdbe662c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-28T21:51:37.071 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:37.069+0000 7f1311012040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-28T21:51:37.096 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:37.094+0000 7fdbe662c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-28T21:51:37.105 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:51:37.105 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-28T21:51:37.191 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:51:37.191 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-28T21:51:37.323 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:51:37.323 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-28T21:51:37.413 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new deb956d8-9e6d-42b7-9498-49ec835254eb 0 2024-03-28T21:51:37.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.649+0000 7fce24e00640 1 Processor -- start 2024-03-28T21:51:37.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.649+0000 7fce24e00640 1 -- start start 2024-03-28T21:51:37.653 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.651+0000 7fce24e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fce20161ce0 0x7fce200b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:37.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.651+0000 7fce24e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce200d24a0 0x7fce200d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:37.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.651+0000 7fce24e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce200ceca0 con 0x7fce201608f0 2024-03-28T21:51:37.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.651+0000 7fce24e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fce200d2e50 con 0x7fce20161ce0 2024-03-28T21:51:37.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.651+0000 7fce24e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fce200d1520 con 0x7fce200d24a0 2024-03-28T21:51:37.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.651+0000 7fce1e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce200d24a0 0x7fce200d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:37.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.651+0000 7fce1d400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fce20161ce0 0x7fce200b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:37.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.651+0000 7fce1e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce200d24a0 0x7fce200d2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58854/0 (socket says 172.21.15.165:58854) 2024-03-28T21:51:37.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.651+0000 7fce1e800640 1 -- 172.21.15.165:0/499130338 learned_addr learned my addr 172.21.15.165:0/499130338 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-03-28T21:51:37.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.651+0000 7fce1e800640 1 -- 172.21.15.165:0/499130338 >> v2:172.21.15.165:3300/0 conn(0x7fce20161ce0 msgr2=0x7fce200b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:37.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.651+0000 7fce1e800640 1 --2- 172.21.15.165:0/499130338 >> v2:172.21.15.165:3300/0 conn(0x7fce20161ce0 0x7fce200b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:37.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.651+0000 7fce1e800640 1 -- 172.21.15.165:0/499130338 >> v1:172.21.15.153:6789/0 conn(0x7fce201608f0 legacy=0x7fce200d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:37.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.651+0000 7fce1e800640 1 -- 172.21.15.165:0/499130338 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce200d1800 con 0x7fce200d24a0 2024-03-28T21:51:37.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.652+0000 7fce1d400640 1 --2- 172.21.15.165:0/499130338 >> v2:172.21.15.165:3300/0 conn(0x7fce20161ce0 0x7fce200b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:51:37.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.652+0000 7fce1e800640 1 --2- 172.21.15.165:0/499130338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce200d24a0 0x7fce200d2910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fce18009e50 tx=0x7fce1802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce79a088ec51e6e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:37.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.653+0000 7fce1ca00640 1 -- 172.21.15.165:0/499130338 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1802cb00 con 0x7fce200d24a0 2024-03-28T21:51:37.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.653+0000 7fce1ca00640 1 -- 172.21.15.165:0/499130338 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1802cca0 con 0x7fce200d24a0 2024-03-28T21:51:37.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.653+0000 7fce1ca00640 1 -- 172.21.15.165:0/499130338 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18034610 con 0x7fce200d24a0 2024-03-28T21:51:37.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.653+0000 7fce24e00640 1 -- 172.21.15.165:0/499130338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce200d24a0 msgr2=0x7fce200d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:37.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.653+0000 7fce24e00640 1 --2- 172.21.15.165:0/499130338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce200d24a0 0x7fce200d2910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fce18009e50 tx=0x7fce1802bf60 comp rx=0 tx=0).stop 2024-03-28T21:51:37.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.654+0000 7fce24e00640 1 -- 172.21.15.165:0/499130338 shutdown_connections 2024-03-28T21:51:37.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.654+0000 7fce24e00640 1 --2- 172.21.15.165:0/499130338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce200d24a0 0x7fce200d2910 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:37.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.654+0000 7fce24e00640 1 --2- 172.21.15.165:0/499130338 >> v2:172.21.15.165:3300/0 conn(0x7fce20161ce0 0x7fce200b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:37.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.654+0000 7fce24e00640 1 -- 172.21.15.165:0/499130338 >> 172.21.15.165:0/499130338 conn(0x7fce2009d430 msgr2=0x7fce200d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:37.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.654+0000 7fce24e00640 1 -- 172.21.15.165:0/499130338 shutdown_connections 2024-03-28T21:51:37.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.654+0000 7fce24e00640 1 -- 172.21.15.165:0/499130338 wait complete. 2024-03-28T21:51:37.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.655+0000 7fce24e00640 1 Processor -- start 2024-03-28T21:51:37.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.655+0000 7fce24e00640 1 -- start start 2024-03-28T21:51:37.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.656+0000 7fce24e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce200d24a0 0x7fce2015c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:37.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.656+0000 7fce24e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce201608f0 0x7fce20160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:37.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.656+0000 7fce24e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce20161ce0 0x7fce20161210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:37.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.656+0000 7fce24e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce200b3280 con 0x7fce200d24a0 2024-03-28T21:51:37.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.656+0000 7fce24e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce200cf220 con 0x7fce201608f0 2024-03-28T21:51:37.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.656+0000 7fce24e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fce200b3400 con 0x7fce20161ce0 2024-03-28T21:51:37.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.657+0000 7fce1e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce20161ce0 0x7fce20161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:37.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.657+0000 7fce1d400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce201608f0 0x7fce20160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:37.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.657+0000 7fce1e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce20161ce0 0x7fce20161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58856/0 (socket says 172.21.15.165:58856) 2024-03-28T21:51:37.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.657+0000 7fce1e800640 1 -- 172.21.15.165:0/656598754 learned_addr learned my addr 172.21.15.165:0/656598754 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-03-28T21:51:37.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.657+0000 7fce1de00640 1 --2- 172.21.15.165:0/656598754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce200d24a0 0x7fce2015c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:37.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.657+0000 7fce1e800640 1 -- 172.21.15.165:0/656598754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce201608f0 msgr2=0x7fce20160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:37.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.657+0000 7fce1e800640 1 --2- 172.21.15.165:0/656598754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce201608f0 0x7fce20160cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:37.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.657+0000 7fce1e800640 1 -- 172.21.15.165:0/656598754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce200d24a0 msgr2=0x7fce2015c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:37.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.657+0000 7fce1e800640 1 --2- 172.21.15.165:0/656598754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce200d24a0 0x7fce2015c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:37.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.657+0000 7fce1e800640 1 -- 172.21.15.165:0/656598754 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce201f7200 con 0x7fce20161ce0 2024-03-28T21:51:37.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.657+0000 7fce1e800640 1 --2- 172.21.15.165:0/656598754 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce20161ce0 0x7fce20161210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce18009e50 tx=0x7fce18004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:37.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.658+0000 7fce16000640 1 -- 172.21.15.165:0/656598754 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18043020 con 0x7fce20161ce0 2024-03-28T21:51:37.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.658+0000 7fce16000640 1 -- 172.21.15.165:0/656598754 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1802ce50 con 0x7fce20161ce0 2024-03-28T21:51:37.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.658+0000 7fce24e00640 1 -- 172.21.15.165:0/656598754 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce201f74a0 con 0x7fce20161ce0 2024-03-28T21:51:37.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.658+0000 7fce16000640 1 -- 172.21.15.165:0/656598754 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18009510 con 0x7fce20161ce0 2024-03-28T21:51:37.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.658+0000 7fce24e00640 1 -- 172.21.15.165:0/656598754 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fce201f7a60 con 0x7fce20161ce0 2024-03-28T21:51:37.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.658+0000 7fce16000640 1 -- 172.21.15.165:0/656598754 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fce18046020 con 0x7fce20161ce0 2024-03-28T21:51:37.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.658+0000 7fce16000640 1 -- 172.21.15.165:0/656598754 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fce1803edc0 con 0x7fce20161ce0 2024-03-28T21:51:37.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.659+0000 7fce24e00640 1 -- 172.21.15.165:0/656598754 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce20068ff0 con 0x7fce20161ce0 2024-03-28T21:51:37.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.662+0000 7fce16000640 1 -- 172.21.15.165:0/656598754 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fce1804d030 con 0x7fce20161ce0 2024-03-28T21:51:37.728 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:37.727+0000 7fdbe662c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-28T21:51:37.737 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:37.735+0000 7f1311012040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-28T21:51:37.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.762+0000 7fce24e00640 1 -- 172.21.15.165:0/656598754 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd new", "uuid": "deb956d8-9e6d-42b7-9498-49ec835254eb", "id": 0} v 0) -- 0x7fce200d0290 con 0x7fce20161ce0 2024-03-28T21:51:37.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.770+0000 7fce16000640 1 -- 172.21.15.165:0/656598754 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "deb956d8-9e6d-42b7-9498-49ec835254eb", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fce1802cb10 con 0x7fce20161ce0 2024-03-28T21:51:37.772 INFO:teuthology.orchestra.run.smithi165.stdout:0 2024-03-28T21:51:37.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.771+0000 7fce24e00640 1 -- 172.21.15.165:0/656598754 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce20161ce0 msgr2=0x7fce20161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:37.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.771+0000 7fce24e00640 1 --2- 172.21.15.165:0/656598754 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce20161ce0 0x7fce20161210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce18009e50 tx=0x7fce18004a40 comp rx=0 tx=0).stop 2024-03-28T21:51:37.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.772+0000 7fce24e00640 1 -- 172.21.15.165:0/656598754 shutdown_connections 2024-03-28T21:51:37.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.772+0000 7fce24e00640 1 --2- 172.21.15.165:0/656598754 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce20161ce0 0x7fce20161210 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:37.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.772+0000 7fce24e00640 1 --2- 172.21.15.165:0/656598754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce201608f0 0x7fce20160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:37.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.772+0000 7fce24e00640 1 --2- 172.21.15.165:0/656598754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce200d24a0 0x7fce2015c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:37.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.772+0000 7fce24e00640 1 -- 172.21.15.165:0/656598754 >> 172.21.15.165:0/656598754 conn(0x7fce2009d430 msgr2=0x7fce200b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:37.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.772+0000 7fce24e00640 1 -- 172.21.15.165:0/656598754 shutdown_connections 2024-03-28T21:51:37.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.772+0000 7fce24e00640 1 -- 172.21.15.165:0/656598754 wait complete. 2024-03-28T21:51:37.791 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 923897c9-f6ee-4b7f-82fe-e6452ed4d3ab 1 2024-03-28T21:51:37.793 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:37.792+0000 7fdbe662c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-28T21:51:37.808 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:37.806+0000 7f1311012040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-28T21:51:37.844 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:37.842+0000 7fdbe662c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-28T21:51:37.864 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:37.862+0000 7f1311012040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-28T21:51:37.907 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:37.905+0000 7fdbe662c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-28T21:51:37.934 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:37.932+0000 7f1311012040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-28T21:51:37.956 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:37.955+0000 7fdbe662c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-28T21:51:37.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.977+0000 7f8d8e600640 1 Processor -- start 2024-03-28T21:51:37.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.978+0000 7f8d8e600640 1 -- start start 2024-03-28T21:51:37.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.979+0000 7f8d8e600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8d88161420 0x7f8d88169200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:37.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.979+0000 7f8d8e600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d8815fc50 con 0x7f8d88072370 2024-03-28T21:51:37.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.979+0000 7f8d8e600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d8815f140 con 0x7f8d8806c180 2024-03-28T21:51:37.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.979+0000 7f8d8e600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8d8815ff80 con 0x7f8d88161420 2024-03-28T21:51:37.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.980+0000 7f8d87400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f8d8806c180 0x7f8d8806c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.165:50990/0 (socket says 172.21.15.165:50990) 2024-03-28T21:51:37.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.980+0000 7f8d87400640 1 -- 172.21.15.165:0/3032865419 learned_addr learned my addr 172.21.15.165:0/3032865419 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-03-28T21:51:37.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.980+0000 7f8d87e00640 1 --2- 172.21.15.165:0/3032865419 >> v2:172.21.15.165:3300/0 conn(0x7f8d88161420 0x7f8d88169200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:37.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.980+0000 7f8d86a00640 1 -- 172.21.15.165:0/3032865419 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1515689923 0 0) 0x7f8d8815f140 con 0x7f8d8806c180 2024-03-28T21:51:37.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.980+0000 7f8d86a00640 1 -- 172.21.15.165:0/3032865419 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d6c003520 con 0x7f8d8806c180 2024-03-28T21:51:37.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.980+0000 7f8d87e00640 1 -- 172.21.15.165:0/3032865419 >> v1:172.21.15.165:6789/0 conn(0x7f8d8806c180 legacy=0x7f8d8806c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:37.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.980+0000 7f8d87e00640 1 -- 172.21.15.165:0/3032865419 >> v1:172.21.15.153:6789/0 conn(0x7f8d88072370 legacy=0x7f8d8815e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:37.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.980+0000 7f8d87e00640 1 -- 172.21.15.165:0/3032865419 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8815f420 con 0x7f8d88161420 2024-03-28T21:51:37.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.981+0000 7f8d87e00640 1 --2- 172.21.15.165:0/3032865419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d88161420 0x7f8d88169200 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009d90 tx=0x7f8d8002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db29f35dd1af750 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:37.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.981+0000 7f8d86a00640 1 -- 172.21.15.165:0/3032865419 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80039070 con 0x7f8d88161420 2024-03-28T21:51:37.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.982+0000 7f8d86a00640 1 -- 172.21.15.165:0/3032865419 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d8002cd00 con 0x7f8d88161420 2024-03-28T21:51:37.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.982+0000 7f8d86a00640 1 -- 172.21.15.165:0/3032865419 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80034660 con 0x7f8d88161420 2024-03-28T21:51:37.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.982+0000 7f8d8e600640 1 -- 172.21.15.165:0/3032865419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d88161420 msgr2=0x7f8d88169200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:37.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.982+0000 7f8d8e600640 1 --2- 172.21.15.165:0/3032865419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d88161420 0x7f8d88169200 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009d90 tx=0x7f8d8002bf50 comp rx=0 tx=0).stop 2024-03-28T21:51:37.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.982+0000 7f8d8e600640 1 -- 172.21.15.165:0/3032865419 shutdown_connections 2024-03-28T21:51:37.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.982+0000 7f8d8e600640 1 --2- 172.21.15.165:0/3032865419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d88161420 0x7f8d88169200 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:37.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.982+0000 7f8d8e600640 1 -- 172.21.15.165:0/3032865419 >> 172.21.15.165:0/3032865419 conn(0x7f8d88071700 msgr2=0x7f8d88071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:37.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.982+0000 7f8d8e600640 1 -- 172.21.15.165:0/3032865419 shutdown_connections 2024-03-28T21:51:37.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.983+0000 7f8d8e600640 1 -- 172.21.15.165:0/3032865419 wait complete. 2024-03-28T21:51:37.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.984+0000 7f8d8e600640 1 Processor -- start 2024-03-28T21:51:37.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.984+0000 7f8d8e600640 1 -- start start 2024-03-28T21:51:37.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.985+0000 7f8d8e600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d8806c180 0x7f8d88151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:37.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.985+0000 7f8d8e600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d88072370 0x7f8d88159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:37.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.985+0000 7f8d8e600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d88161420 0x7f8d8815b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:37.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.985+0000 7f8d8e600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8d88169740 con 0x7f8d88072370 2024-03-28T21:51:37.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.985+0000 7f8d8e600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8d88070070 con 0x7f8d88161420 2024-03-28T21:51:37.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.985+0000 7f8d8e600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8d881698c0 con 0x7f8d8806c180 2024-03-28T21:51:37.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.986+0000 7f8d87e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d88161420 0x7f8d8815b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:37.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.986+0000 7f8d87e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d88161420 0x7f8d8815b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:41020/0 (socket says 172.21.15.165:41020) 2024-03-28T21:51:37.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.986+0000 7f8d87e00640 1 -- 172.21.15.165:0/2260928495 learned_addr learned my addr 172.21.15.165:0/2260928495 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-03-28T21:51:37.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.986+0000 7f8d87400640 1 --2- 172.21.15.165:0/2260928495 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d8806c180 0x7f8d88151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:37.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.986+0000 7f8d7fe00640 1 --2- 172.21.15.165:0/2260928495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d88072370 0x7f8d88159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:37.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.986+0000 7f8d87e00640 1 -- 172.21.15.165:0/2260928495 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d8806c180 msgr2=0x7f8d88151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:37.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.986+0000 7f8d87e00640 1 --2- 172.21.15.165:0/2260928495 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d8806c180 0x7f8d88151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:37.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.986+0000 7f8d87e00640 1 -- 172.21.15.165:0/2260928495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d88072370 msgr2=0x7f8d88159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:37.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.986+0000 7f8d87e00640 1 --2- 172.21.15.165:0/2260928495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d88072370 0x7f8d88159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:37.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.986+0000 7f8d87e00640 1 -- 172.21.15.165:0/2260928495 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d881539d0 con 0x7f8d88161420 2024-03-28T21:51:37.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.986+0000 7f8d87e00640 1 --2- 172.21.15.165:0/2260928495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d88161420 0x7f8d8815b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009d90 tx=0x7f8d80004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:37.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.987+0000 7f8d7f400640 1 -- 172.21.15.165:0/2260928495 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80044020 con 0x7f8d88161420 2024-03-28T21:51:37.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.987+0000 7f8d7f400640 1 -- 172.21.15.165:0/2260928495 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d8003a040 con 0x7f8d88161420 2024-03-28T21:51:37.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.987+0000 7f8d7f400640 1 -- 172.21.15.165:0/2260928495 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80039050 con 0x7f8d88161420 2024-03-28T21:51:37.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.987+0000 7f8d8e600640 1 -- 172.21.15.165:0/2260928495 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d88153d10 con 0x7f8d88161420 2024-03-28T21:51:37.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.987+0000 7f8d8e600640 1 -- 172.21.15.165:0/2260928495 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d88154550 con 0x7f8d88161420 2024-03-28T21:51:37.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.987+0000 7f8d7f400640 1 -- 172.21.15.165:0/2260928495 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8d80003bd0 con 0x7f8d88161420 2024-03-28T21:51:37.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.987+0000 7f8d7f400640 1 -- 172.21.15.165:0/2260928495 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8d8003ea00 con 0x7f8d88161420 2024-03-28T21:51:37.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.988+0000 7f8d8e600640 1 -- 172.21.15.165:0/2260928495 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d88068ff0 con 0x7f8d88161420 2024-03-28T21:51:37.991 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:37.989+0000 7f1311012040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-28T21:51:37.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:37.991+0000 7f8d7f400640 1 -- 172.21.15.165:0/2260928495 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8d8004e060 con 0x7f8d88161420 2024-03-28T21:51:38.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.067+0000 7f8d8e600640 1 -- 172.21.15.165:0/2260928495 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd new", "uuid": "923897c9-f6ee-4b7f-82fe-e6452ed4d3ab", "id": 1} v 0) -- 0x7f8d88154720 con 0x7f8d88161420 2024-03-28T21:51:38.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.074+0000 7f8d7f400640 1 -- 172.21.15.165:0/2260928495 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "923897c9-f6ee-4b7f-82fe-e6452ed4d3ab", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f8d88153d10 con 0x7f8d88161420 2024-03-28T21:51:38.077 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-03-28T21:51:38.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.076+0000 7f8d8e600640 1 -- 172.21.15.165:0/2260928495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d88161420 msgr2=0x7f8d8815b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:38.079 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.076+0000 7f8d8e600640 1 --2- 172.21.15.165:0/2260928495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d88161420 0x7f8d8815b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009d90 tx=0x7f8d80004a40 comp rx=0 tx=0).stop 2024-03-28T21:51:38.079 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.076+0000 7f8d8e600640 1 -- 172.21.15.165:0/2260928495 shutdown_connections 2024-03-28T21:51:38.079 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.076+0000 7f8d8e600640 1 --2- 172.21.15.165:0/2260928495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d88161420 0x7f8d8815b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.079 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.076+0000 7f8d8e600640 1 --2- 172.21.15.165:0/2260928495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d88072370 0x7f8d88159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.079 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.076+0000 7f8d8e600640 1 --2- 172.21.15.165:0/2260928495 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d8806c180 0x7f8d88151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.079 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.076+0000 7f8d8e600640 1 -- 172.21.15.165:0/2260928495 >> 172.21.15.165:0/2260928495 conn(0x7f8d88071700 msgr2=0x7f8d8806db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:38.079 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.076+0000 7f8d8e600640 1 -- 172.21.15.165:0/2260928495 shutdown_connections 2024-03-28T21:51:38.079 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.076+0000 7f8d8e600640 1 -- 172.21.15.165:0/2260928495 wait complete. 2024-03-28T21:51:38.087 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:38.085+0000 7fdbe662c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-28T21:51:38.095 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 89b94640-452b-47a3-baec-82445e427d13 2 2024-03-28T21:51:38.134 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:38.132+0000 7f1311012040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-28T21:51:38.167 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:38.165+0000 7fdbe662c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-28T21:51:38.220 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:38.218+0000 7f1311012040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-28T21:51:38.220 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:38.219+0000 7fdbe662c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-28T21:51:38.277 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:38.274+0000 7f1311012040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-28T21:51:38.280 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:38.278+0000 7fdbe662c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-28T21:51:38.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.316+0000 7f8213200640 1 Processor -- start 2024-03-28T21:51:38.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.316+0000 7f8213200640 1 -- start start 2024-03-28T21:51:38.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.318+0000 7f8213200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f821415e4a0 0x7f82140d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.318+0000 7f8213200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82140d2170 con 0x7f821415e0c0 2024-03-28T21:51:38.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.318+0000 7f8213200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82140cf8f0 con 0x7f82140d1d40 2024-03-28T21:51:38.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.318+0000 7f8213200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f82140cfbd0 con 0x7f821415e4a0 2024-03-28T21:51:38.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.318+0000 7f820be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f821415e4a0 0x7f82140d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.318+0000 7f8212800640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f82140d1d40 0x7f82140b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.165:50992/0 (socket says 172.21.15.165:50992) 2024-03-28T21:51:38.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.318+0000 7f820be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f821415e4a0 0x7f82140d4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:41026/0 (socket says 172.21.15.165:41026) 2024-03-28T21:51:38.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.318+0000 7f8212800640 1 -- 172.21.15.165:0/2477574045 learned_addr learned my addr 172.21.15.165:0/2477574045 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-03-28T21:51:38.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.319+0000 7f820be00640 1 -- 172.21.15.165:0/2477574045 >> v1:172.21.15.165:6789/0 conn(0x7f82140d1d40 legacy=0x7f82140b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:38.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.319+0000 7f820be00640 1 -- 172.21.15.165:0/2477574045 >> v1:172.21.15.153:6789/0 conn(0x7f821415e0c0 legacy=0x7f82140cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:38.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.319+0000 7f820be00640 1 -- 172.21.15.165:0/2477574045 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82140b3a30 con 0x7f821415e4a0 2024-03-28T21:51:38.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.319+0000 7f8211400640 1 -- 172.21.15.165:0/2477574045 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1740710500 0 0) 0x7f82140cf8f0 con 0x7f82140d1d40 2024-03-28T21:51:38.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.320+0000 7f820be00640 1 --2- 172.21.15.165:0/2477574045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f821415e4a0 0x7f82140d4a80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0097a0 tx=0x7f81fc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5b4705b7baaa83c server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:38.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.320+0000 7f8211400640 1 -- 172.21.15.165:0/2477574045 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc034070 con 0x7f821415e4a0 2024-03-28T21:51:38.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.320+0000 7f8211400640 1 -- 172.21.15.165:0/2477574045 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc030610 con 0x7f821415e4a0 2024-03-28T21:51:38.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.320+0000 7f8211400640 1 -- 172.21.15.165:0/2477574045 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0309e0 con 0x7f821415e4a0 2024-03-28T21:51:38.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.321+0000 7f8213200640 1 -- 172.21.15.165:0/2477574045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f821415e4a0 msgr2=0x7f82140d4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:38.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.321+0000 7f8213200640 1 --2- 172.21.15.165:0/2477574045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f821415e4a0 0x7f82140d4a80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0097a0 tx=0x7f81fc02b960 comp rx=0 tx=0).stop 2024-03-28T21:51:38.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.321+0000 7f8213200640 1 -- 172.21.15.165:0/2477574045 shutdown_connections 2024-03-28T21:51:38.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.321+0000 7f8213200640 1 --2- 172.21.15.165:0/2477574045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f821415e4a0 0x7f82140d4a80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.321+0000 7f8213200640 1 -- 172.21.15.165:0/2477574045 >> 172.21.15.165:0/2477574045 conn(0x7f82140d3f60 msgr2=0x7f82140d4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:38.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.321+0000 7f8213200640 1 -- 172.21.15.165:0/2477574045 shutdown_connections 2024-03-28T21:51:38.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.321+0000 7f8213200640 1 -- 172.21.15.165:0/2477574045 wait complete. 2024-03-28T21:51:38.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.322+0000 7f8213200640 1 Processor -- start 2024-03-28T21:51:38.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.323+0000 7f8213200640 1 -- start start 2024-03-28T21:51:38.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8213200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82140d1d40 0x7f8214154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8213200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f821415e0c0 0x7f8214154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8213200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821415e4a0 0x7f8214160de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8213200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82140cf510 con 0x7f821415e4a0 2024-03-28T21:51:38.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8213200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f82140cf390 con 0x7f821415e0c0 2024-03-28T21:51:38.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8213200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f82140cf690 con 0x7f82140d1d40 2024-03-28T21:51:38.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8211e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82140d1d40 0x7f8214154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f820be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f821415e0c0 0x7f8214154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8211e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82140d1d40 0x7f8214154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58876/0 (socket says 172.21.15.165:58876) 2024-03-28T21:51:38.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f820be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f821415e0c0 0x7f8214154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:41038/0 (socket says 172.21.15.165:41038) 2024-03-28T21:51:38.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8211e00640 1 -- 172.21.15.165:0/2148868399 learned_addr learned my addr 172.21.15.165:0/2148868399 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-03-28T21:51:38.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8212800640 1 --2- 172.21.15.165:0/2148868399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821415e4a0 0x7f8214160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8211e00640 1 -- 172.21.15.165:0/2148868399 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f821415e0c0 msgr2=0x7f8214154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:38.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8211e00640 1 --2- 172.21.15.165:0/2148868399 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f821415e0c0 0x7f8214154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8211e00640 1 -- 172.21.15.165:0/2148868399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821415e4a0 msgr2=0x7f8214160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:38.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8211e00640 1 --2- 172.21.15.165:0/2148868399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821415e4a0 0x7f8214160de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8211e00640 1 -- 172.21.15.165:0/2148868399 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82140b9b50 con 0x7f82140d1d40 2024-03-28T21:51:38.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.324+0000 7f8212800640 1 --2- 172.21.15.165:0/2148868399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821415e4a0 0x7f8214160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:51:38.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.325+0000 7f8211e00640 1 --2- 172.21.15.165:0/2148868399 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82140d1d40 0x7f8214154640 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f820400c480 tx=0x7f820400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:38.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.325+0000 7f820a000640 1 -- 172.21.15.165:0/2148868399 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82040052d0 con 0x7f82140d1d40 2024-03-28T21:51:38.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.325+0000 7f820a000640 1 -- 172.21.15.165:0/2148868399 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8204005470 con 0x7f82140d1d40 2024-03-28T21:51:38.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.325+0000 7f820a000640 1 -- 172.21.15.165:0/2148868399 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204012870 con 0x7f82140d1d40 2024-03-28T21:51:38.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.325+0000 7f8213200640 1 -- 172.21.15.165:0/2148868399 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82140b8f40 con 0x7f82140d1d40 2024-03-28T21:51:38.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.325+0000 7f8213200640 1 -- 172.21.15.165:0/2148868399 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f82140b9500 con 0x7f82140d1d40 2024-03-28T21:51:38.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.325+0000 7f820a000640 1 -- 172.21.15.165:0/2148868399 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8204012a10 con 0x7f82140d1d40 2024-03-28T21:51:38.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.325+0000 7f820a000640 1 -- 172.21.15.165:0/2148868399 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f8204012d00 con 0x7f82140d1d40 2024-03-28T21:51:38.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.326+0000 7f8213200640 1 -- 172.21.15.165:0/2148868399 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8214068ff0 con 0x7f82140d1d40 2024-03-28T21:51:38.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.329+0000 7f820a000640 1 -- 172.21.15.165:0/2148868399 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f82040035f0 con 0x7f82140d1d40 2024-03-28T21:51:38.335 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:38.334+0000 7fdbe662c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-28T21:51:38.341 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:38.339+0000 7f1311012040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-28T21:51:38.400 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:38.397+0000 7f1311012040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-28T21:51:38.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.406+0000 7f8213200640 1 -- 172.21.15.165:0/2148868399 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd new", "uuid": "89b94640-452b-47a3-baec-82445e427d13", "id": 2} v 0) -- 0x7f82140cadf0 con 0x7f82140d1d40 2024-03-28T21:51:38.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.413+0000 7f820a000640 1 -- 172.21.15.165:0/2148868399 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89b94640-452b-47a3-baec-82445e427d13", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f82040038b0 con 0x7f82140d1d40 2024-03-28T21:51:38.415 INFO:teuthology.orchestra.run.smithi165.stdout:2 2024-03-28T21:51:38.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.414+0000 7f8213200640 1 -- 172.21.15.165:0/2148868399 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82140d1d40 msgr2=0x7f8214154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:38.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.414+0000 7f8213200640 1 --2- 172.21.15.165:0/2148868399 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82140d1d40 0x7f8214154640 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f820400c480 tx=0x7f820400c940 comp rx=0 tx=0).stop 2024-03-28T21:51:38.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.414+0000 7f8213200640 1 -- 172.21.15.165:0/2148868399 shutdown_connections 2024-03-28T21:51:38.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.414+0000 7f8213200640 1 --2- 172.21.15.165:0/2148868399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821415e4a0 0x7f8214160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.414+0000 7f8213200640 1 --2- 172.21.15.165:0/2148868399 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f821415e0c0 0x7f8214154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.414+0000 7f8213200640 1 --2- 172.21.15.165:0/2148868399 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82140d1d40 0x7f8214154640 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.414+0000 7f8213200640 1 -- 172.21.15.165:0/2148868399 >> 172.21.15.165:0/2148868399 conn(0x7f82140d3f60 msgr2=0x7f82140b6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:38.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.414+0000 7f8213200640 1 -- 172.21.15.165:0/2148868399 shutdown_connections 2024-03-28T21:51:38.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.414+0000 7f8213200640 1 -- 172.21.15.165:0/2148868399 wait complete. 2024-03-28T21:51:38.432 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 7aad7ea5-d427-40d3-a20f-693f094c884d 3 2024-03-28T21:51:38.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.621+0000 7f67c3200640 1 Processor -- start 2024-03-28T21:51:38.624 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.621+0000 7f67c3200640 1 -- start start 2024-03-28T21:51:38.625 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c3200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f67c415e0c0 0x7f67c40d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c415e4a0 0x7f67c40d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c3200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f67c40cea70 0x7f67c40ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c3200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f67c40cf8f0 con 0x7f67c40cea70 2024-03-28T21:51:38.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c3200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f67c40cfbd0 con 0x7f67c415e0c0 2024-03-28T21:51:38.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f67c40b3a30 con 0x7f67c415e4a0 2024-03-28T21:51:38.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c1e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f67c415e0c0 0x7f67c40d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c1400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c415e4a0 0x7f67c40d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c1e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f67c415e0c0 0x7f67c40d4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:41054/0 (socket says 172.21.15.165:41054) 2024-03-28T21:51:38.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c1e00640 1 -- 172.21.15.165:0/1851395288 learned_addr learned my addr 172.21.15.165:0/1851395288 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-03-28T21:51:38.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c2800640 1 --2- 172.21.15.165:0/1851395288 >> v2:172.21.15.153:3300/0 conn(0x7f67c40cea70 0x7f67c40ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c1e00640 1 -- 172.21.15.165:0/1851395288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c415e4a0 msgr2=0x7f67c40d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:38.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c1e00640 1 --2- 172.21.15.165:0/1851395288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c415e4a0 0x7f67c40d1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c1e00640 1 -- 172.21.15.165:0/1851395288 >> v2:172.21.15.153:3300/0 conn(0x7f67c40cea70 msgr2=0x7f67c40ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:38.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c1e00640 1 --2- 172.21.15.165:0/1851395288 >> v2:172.21.15.153:3300/0 conn(0x7f67c40cea70 0x7f67c40ceee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c1e00640 1 -- 172.21.15.165:0/1851395288 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c40cf420 con 0x7f67c415e0c0 2024-03-28T21:51:38.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c1400640 1 --2- 172.21.15.165:0/1851395288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c415e4a0 0x7f67c40d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:51:38.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.623+0000 7f67c2800640 1 --2- 172.21.15.165:0/1851395288 >> v2:172.21.15.153:3300/0 conn(0x7f67c40cea70 0x7f67c40ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:51:38.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.625+0000 7f67c1e00640 1 --2- 172.21.15.165:0/1851395288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415e0c0 0x7f67c40d4a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f67c408cbd0 tx=0x7f67b402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ebde1ec6d80ab3b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:38.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.625+0000 7f67c0a00640 1 -- 172.21.15.165:0/1851395288 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b4035020 con 0x7f67c415e0c0 2024-03-28T21:51:38.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.625+0000 7f67c0a00640 1 -- 172.21.15.165:0/1851395288 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b4031870 con 0x7f67c415e0c0 2024-03-28T21:51:38.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.625+0000 7f67c0a00640 1 -- 172.21.15.165:0/1851395288 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b4031c40 con 0x7f67c415e0c0 2024-03-28T21:51:38.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.625+0000 7f67c3200640 1 -- 172.21.15.165:0/1851395288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415e0c0 msgr2=0x7f67c40d4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:38.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.625+0000 7f67c3200640 1 --2- 172.21.15.165:0/1851395288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415e0c0 0x7f67c40d4a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f67c408cbd0 tx=0x7f67b402b910 comp rx=0 tx=0).stop 2024-03-28T21:51:38.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.626+0000 7f67c3200640 1 -- 172.21.15.165:0/1851395288 shutdown_connections 2024-03-28T21:51:38.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.626+0000 7f67c3200640 1 --2- 172.21.15.165:0/1851395288 >> v2:172.21.15.153:3300/0 conn(0x7f67c40cea70 0x7f67c40ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.626+0000 7f67c3200640 1 --2- 172.21.15.165:0/1851395288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c415e4a0 0x7f67c40d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.626+0000 7f67c3200640 1 --2- 172.21.15.165:0/1851395288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415e0c0 0x7f67c40d4a80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.626+0000 7f67c3200640 1 -- 172.21.15.165:0/1851395288 >> 172.21.15.165:0/1851395288 conn(0x7f67c40d3f60 msgr2=0x7f67c40d4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:38.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.626+0000 7f67c3200640 1 -- 172.21.15.165:0/1851395288 shutdown_connections 2024-03-28T21:51:38.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.626+0000 7f67c3200640 1 -- 172.21.15.165:0/1851395288 wait complete. 2024-03-28T21:51:38.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.627+0000 7f67c3200640 1 Processor -- start 2024-03-28T21:51:38.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.627+0000 7f67c3200640 1 -- start start 2024-03-28T21:51:38.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.628+0000 7f67c3200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c40cea70 0x7f67c4160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.628+0000 7f67c3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415e0c0 0x7f67c415eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.628+0000 7f67c3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c415e4a0 0x7f67c4159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.628+0000 7f67c3200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67c40d0920 con 0x7f67c40cea70 2024-03-28T21:51:38.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.628+0000 7f67c3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f67c40d07a0 con 0x7f67c415e0c0 2024-03-28T21:51:38.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.628+0000 7f67c3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f67c40d0aa0 con 0x7f67c415e4a0 2024-03-28T21:51:38.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.629+0000 7f67c1400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415e0c0 0x7f67c415eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.629+0000 7f67c2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c415e4a0 0x7f67c4159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.629+0000 7f67c1400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415e0c0 0x7f67c415eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:41060/0 (socket says 172.21.15.165:41060) 2024-03-28T21:51:38.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.629+0000 7f67c2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c415e4a0 0x7f67c4159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58880/0 (socket says 172.21.15.165:58880) 2024-03-28T21:51:38.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.629+0000 7f67c1400640 1 -- 172.21.15.165:0/3314755078 learned_addr learned my addr 172.21.15.165:0/3314755078 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-03-28T21:51:38.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.629+0000 7f67c1e00640 1 --2- 172.21.15.165:0/3314755078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c40cea70 0x7f67c4160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.629+0000 7f67c1400640 1 -- 172.21.15.165:0/3314755078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c415e4a0 msgr2=0x7f67c4159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:38.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.629+0000 7f67c1400640 1 --2- 172.21.15.165:0/3314755078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c415e4a0 0x7f67c4159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.629+0000 7f67c1400640 1 -- 172.21.15.165:0/3314755078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c40cea70 msgr2=0x7f67c4160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:38.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.629+0000 7f67c1400640 1 --2- 172.21.15.165:0/3314755078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c40cea70 0x7f67c4160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.629+0000 7f67c1400640 1 -- 172.21.15.165:0/3314755078 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c415f290 con 0x7f67c415e0c0 2024-03-28T21:51:38.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.629+0000 7f67c1400640 1 --2- 172.21.15.165:0/3314755078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415e0c0 0x7f67c415eba0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f67b000e960 tx=0x7f67b000ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:38.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.630+0000 7f67ba000640 1 -- 172.21.15.165:0/3314755078 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b0017070 con 0x7f67c415e0c0 2024-03-28T21:51:38.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.630+0000 7f67ba000640 1 -- 172.21.15.165:0/3314755078 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b000ca00 con 0x7f67c415e0c0 2024-03-28T21:51:38.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.630+0000 7f67ba000640 1 -- 172.21.15.165:0/3314755078 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b000cdd0 con 0x7f67c415e0c0 2024-03-28T21:51:38.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.630+0000 7f67c3200640 1 -- 172.21.15.165:0/3314755078 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c415f570 con 0x7f67c415e0c0 2024-03-28T21:51:38.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.630+0000 7f67c3200640 1 -- 172.21.15.165:0/3314755078 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c415fb30 con 0x7f67c415e0c0 2024-03-28T21:51:38.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.630+0000 7f67ba000640 1 -- 172.21.15.165:0/3314755078 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f67b001a070 con 0x7f67c415e0c0 2024-03-28T21:51:38.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.630+0000 7f67ba000640 1 -- 172.21.15.165:0/3314755078 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f67b001c8e0 con 0x7f67c415e0c0 2024-03-28T21:51:38.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.631+0000 7f67c3200640 1 -- 172.21.15.165:0/3314755078 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c4068ff0 con 0x7f67c415e0c0 2024-03-28T21:51:38.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.633+0000 7f67ba000640 1 -- 172.21.15.165:0/3314755078 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f67b001cb80 con 0x7f67c415e0c0 2024-03-28T21:51:38.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.712+0000 7f67c3200640 1 -- 172.21.15.165:0/3314755078 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7aad7ea5-d427-40d3-a20f-693f094c884d", "id": 3} v 0) -- 0x7f67c40b30d0 con 0x7f67c415e0c0 2024-03-28T21:51:38.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.721+0000 7f67ba000640 1 -- 172.21.15.165:0/3314755078 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7aad7ea5-d427-40d3-a20f-693f094c884d", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f67b001cde0 con 0x7f67c415e0c0 2024-03-28T21:51:38.723 INFO:teuthology.orchestra.run.smithi165.stdout:3 2024-03-28T21:51:38.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.722+0000 7f67c3200640 1 -- 172.21.15.165:0/3314755078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415e0c0 msgr2=0x7f67c415eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:38.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.722+0000 7f67c3200640 1 --2- 172.21.15.165:0/3314755078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415e0c0 0x7f67c415eba0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f67b000e960 tx=0x7f67b000ee20 comp rx=0 tx=0).stop 2024-03-28T21:51:38.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.722+0000 7f67c3200640 1 -- 172.21.15.165:0/3314755078 shutdown_connections 2024-03-28T21:51:38.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.722+0000 7f67c3200640 1 --2- 172.21.15.165:0/3314755078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c415e4a0 0x7f67c4159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.722+0000 7f67c3200640 1 --2- 172.21.15.165:0/3314755078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415e0c0 0x7f67c415eba0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.722+0000 7f67c3200640 1 --2- 172.21.15.165:0/3314755078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c40cea70 0x7f67c4160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.722+0000 7f67c3200640 1 -- 172.21.15.165:0/3314755078 >> 172.21.15.165:0/3314755078 conn(0x7f67c40d3f60 msgr2=0x7f67c40b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:38.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.723+0000 7f67c3200640 1 -- 172.21.15.165:0/3314755078 shutdown_connections 2024-03-28T21:51:38.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.723+0000 7f67c3200640 1 -- 172.21.15.165:0/3314755078 wait complete. 2024-03-28T21:51:38.741 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new ad0ddb33-3bee-49f0-84e6-796a1f5c688a 4 2024-03-28T21:51:38.789 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:38.788+0000 7fdbe662c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-28T21:51:38.886 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:38.883+0000 7f1311012040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-28T21:51:38.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.928+0000 7fa119800640 1 Processor -- start 2024-03-28T21:51:38.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.928+0000 7fa119800640 1 -- start start 2024-03-28T21:51:38.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.929+0000 7fa119800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa11415e0c0 0x7fa1140d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.929+0000 7fa119800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa11415e4a0 0x7fa1140d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa119800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa1140cea70 0x7fa1140ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa119800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa1140cf8f0 con 0x7fa11415e0c0 2024-03-28T21:51:38.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa119800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa1140cfbd0 con 0x7fa1140cea70 2024-03-28T21:51:38.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa119800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa1140b3a30 con 0x7fa11415e4a0 2024-03-28T21:51:38.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa118e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa1140cea70 0x7fa1140ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa113400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa11415e4a0 0x7fa1140d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa118e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa1140cea70 0x7fa1140ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:41068/0 (socket says 172.21.15.165:41068) 2024-03-28T21:51:38.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa118e00640 1 -- 172.21.15.165:0/2549964651 learned_addr learned my addr 172.21.15.165:0/2549964651 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-03-28T21:51:38.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa113e00640 1 --2- 172.21.15.165:0/2549964651 >> v2:172.21.15.153:3300/0 conn(0x7fa11415e0c0 0x7fa1140d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa118e00640 1 -- 172.21.15.165:0/2549964651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa11415e4a0 msgr2=0x7fa1140d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:38.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa118e00640 1 --2- 172.21.15.165:0/2549964651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa11415e4a0 0x7fa1140d1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa118e00640 1 -- 172.21.15.165:0/2549964651 >> v2:172.21.15.153:3300/0 conn(0x7fa11415e0c0 msgr2=0x7fa1140d4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:38.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa118e00640 1 --2- 172.21.15.165:0/2549964651 >> v2:172.21.15.153:3300/0 conn(0x7fa11415e0c0 0x7fa1140d4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa118e00640 1 -- 172.21.15.165:0/2549964651 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1140cf420 con 0x7fa1140cea70 2024-03-28T21:51:38.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.930+0000 7fa113e00640 1 --2- 172.21.15.165:0/2549964651 >> v2:172.21.15.153:3300/0 conn(0x7fa11415e0c0 0x7fa1140d4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:51:38.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.931+0000 7fa118e00640 1 --2- 172.21.15.165:0/2549964651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1140cea70 0x7fa1140ceee0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa11408cfc0 tx=0x7fa10c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b97129ac8331cf2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:38.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.932+0000 7fa112a00640 1 -- 172.21.15.165:0/2549964651 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c02ca80 con 0x7fa1140cea70 2024-03-28T21:51:38.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.932+0000 7fa112a00640 1 -- 172.21.15.165:0/2549964651 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10c02cc20 con 0x7fa1140cea70 2024-03-28T21:51:38.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.932+0000 7fa112a00640 1 -- 172.21.15.165:0/2549964651 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0343f0 con 0x7fa1140cea70 2024-03-28T21:51:38.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.932+0000 7fa119800640 1 -- 172.21.15.165:0/2549964651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1140cea70 msgr2=0x7fa1140ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:38.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.932+0000 7fa119800640 1 --2- 172.21.15.165:0/2549964651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1140cea70 0x7fa1140ceee0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa11408cfc0 tx=0x7fa10c02bee0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.933+0000 7fa119800640 1 -- 172.21.15.165:0/2549964651 shutdown_connections 2024-03-28T21:51:38.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.933+0000 7fa119800640 1 --2- 172.21.15.165:0/2549964651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1140cea70 0x7fa1140ceee0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.933+0000 7fa119800640 1 --2- 172.21.15.165:0/2549964651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa11415e4a0 0x7fa1140d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.933+0000 7fa119800640 1 --2- 172.21.15.165:0/2549964651 >> v2:172.21.15.153:3300/0 conn(0x7fa11415e0c0 0x7fa1140d4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.933+0000 7fa119800640 1 -- 172.21.15.165:0/2549964651 >> 172.21.15.165:0/2549964651 conn(0x7fa1140d3f60 msgr2=0x7fa1140d4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:38.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.933+0000 7fa119800640 1 -- 172.21.15.165:0/2549964651 shutdown_connections 2024-03-28T21:51:38.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.933+0000 7fa119800640 1 -- 172.21.15.165:0/2549964651 wait complete. 2024-03-28T21:51:38.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.934+0000 7fa119800640 1 Processor -- start 2024-03-28T21:51:38.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.934+0000 7fa119800640 1 -- start start 2024-03-28T21:51:38.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.935+0000 7fa119800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1140cea70 0x7fa11415f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.935+0000 7fa119800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa11415e0c0 0x7fa114160250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.935+0000 7fa119800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa11415e4a0 0x7fa114159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:38.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.935+0000 7fa119800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa1140d0920 con 0x7fa11415e0c0 2024-03-28T21:51:38.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.935+0000 7fa119800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa1140d07a0 con 0x7fa1140cea70 2024-03-28T21:51:38.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.935+0000 7fa119800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa1140d0aa0 con 0x7fa11415e4a0 2024-03-28T21:51:38.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.936+0000 7fa113e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1140cea70 0x7fa11415f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.936+0000 7fa118e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa11415e4a0 0x7fa114159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.936+0000 7fa113e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1140cea70 0x7fa11415f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:41072/0 (socket says 172.21.15.165:41072) 2024-03-28T21:51:38.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.936+0000 7fa113e00640 1 -- 172.21.15.165:0/2563214618 learned_addr learned my addr 172.21.15.165:0/2563214618 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-03-28T21:51:38.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.936+0000 7fa118e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa11415e4a0 0x7fa114159e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58906/0 (socket says 172.21.15.165:58906) 2024-03-28T21:51:38.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.936+0000 7fa113400640 1 --2- 172.21.15.165:0/2563214618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa11415e0c0 0x7fa114160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:38.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.936+0000 7fa113e00640 1 -- 172.21.15.165:0/2563214618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa11415e4a0 msgr2=0x7fa114159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:38.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.936+0000 7fa113e00640 1 --2- 172.21.15.165:0/2563214618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa11415e4a0 0x7fa114159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.936+0000 7fa113e00640 1 -- 172.21.15.165:0/2563214618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa11415e0c0 msgr2=0x7fa114160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:38.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.936+0000 7fa113e00640 1 --2- 172.21.15.165:0/2563214618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa11415e0c0 0x7fa114160250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:38.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.936+0000 7fa113e00640 1 -- 172.21.15.165:0/2563214618 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1140b7bc0 con 0x7fa1140cea70 2024-03-28T21:51:38.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.936+0000 7fa118e00640 1 --2- 172.21.15.165:0/2563214618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa11415e4a0 0x7fa114159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:51:38.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.936+0000 7fa113400640 1 --2- 172.21.15.165:0/2563214618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa11415e0c0 0x7fa114160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:51:38.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.936+0000 7fa113e00640 1 --2- 172.21.15.165:0/2563214618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1140cea70 0x7fa11415f2e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa10400e810 tx=0x7fa10400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:38.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.937+0000 7fa10be00640 1 -- 172.21.15.165:0/2563214618 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10400f040 con 0x7fa1140cea70 2024-03-28T21:51:38.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.937+0000 7fa10be00640 1 -- 172.21.15.165:0/2563214618 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa104004030 con 0x7fa1140cea70 2024-03-28T21:51:38.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.937+0000 7fa10be00640 1 -- 172.21.15.165:0/2563214618 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104004400 con 0x7fa1140cea70 2024-03-28T21:51:38.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.937+0000 7fa119800640 1 -- 172.21.15.165:0/2563214618 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa114160790 con 0x7fa1140cea70 2024-03-28T21:51:38.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.937+0000 7fa119800640 1 -- 172.21.15.165:0/2563214618 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa11415fbd0 con 0x7fa1140cea70 2024-03-28T21:51:38.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.937+0000 7fa10be00640 1 -- 172.21.15.165:0/2563214618 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa10400ca60 con 0x7fa1140cea70 2024-03-28T21:51:38.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.937+0000 7fa10be00640 1 -- 172.21.15.165:0/2563214618 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fa104003b20 con 0x7fa1140cea70 2024-03-28T21:51:38.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.938+0000 7fa119800640 1 -- 172.21.15.165:0/2563214618 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa11415fda0 con 0x7fa1140cea70 2024-03-28T21:51:38.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:38.940+0000 7fa10be00640 1 -- 172.21.15.165:0/2563214618 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa104017020 con 0x7fa1140cea70 2024-03-28T21:51:38.949 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:38.948+0000 7fdbe662c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-28T21:51:39.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.019+0000 7fa119800640 1 -- 172.21.15.165:0/2563214618 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ad0ddb33-3bee-49f0-84e6-796a1f5c688a", "id": 4} v 0) -- 0x7fa1140cadf0 con 0x7fa1140cea70 2024-03-28T21:51:39.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.026+0000 7fa10be00640 1 -- 172.21.15.165:0/2563214618 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad0ddb33-3bee-49f0-84e6-796a1f5c688a", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fa10400ce20 con 0x7fa1140cea70 2024-03-28T21:51:39.029 INFO:teuthology.orchestra.run.smithi165.stdout:4 2024-03-28T21:51:39.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.028+0000 7fa119800640 1 -- 172.21.15.165:0/2563214618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1140cea70 msgr2=0x7fa11415f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.028+0000 7fa119800640 1 --2- 172.21.15.165:0/2563214618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1140cea70 0x7fa11415f2e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa10400e810 tx=0x7fa10400ecd0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.028+0000 7fa119800640 1 -- 172.21.15.165:0/2563214618 shutdown_connections 2024-03-28T21:51:39.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.028+0000 7fa119800640 1 --2- 172.21.15.165:0/2563214618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa11415e4a0 0x7fa114159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.028+0000 7fa119800640 1 --2- 172.21.15.165:0/2563214618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa11415e0c0 0x7fa114160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.028+0000 7fa119800640 1 --2- 172.21.15.165:0/2563214618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1140cea70 0x7fa11415f2e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.028+0000 7fa119800640 1 -- 172.21.15.165:0/2563214618 >> 172.21.15.165:0/2563214618 conn(0x7fa1140d3f60 msgr2=0x7fa1140b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:39.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.028+0000 7fa119800640 1 -- 172.21.15.165:0/2563214618 shutdown_connections 2024-03-28T21:51:39.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.028+0000 7fa119800640 1 -- 172.21.15.165:0/2563214618 wait complete. 2024-03-28T21:51:39.046 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new ac813b43-7eb2-4e48-908c-36aeb30f6520 5 2024-03-28T21:51:39.056 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:39.054+0000 7f1311012040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-28T21:51:39.073 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:39.072+0000 7fdbe662c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-28T21:51:39.127 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:39.125+0000 7fdbe662c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-28T21:51:39.199 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:39.196+0000 7f1311012040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-28T21:51:39.228 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.226+0000 7fbabae00640 1 Processor -- start 2024-03-28T21:51:39.229 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.226+0000 7fbabae00640 1 -- start start 2024-03-28T21:51:39.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.228+0000 7fbabae00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbab415dfe0 0x7fbab406e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.228+0000 7fbabae00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbab40b4650 0x7fbab406c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.228+0000 7fbabae00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbab40ae5f0 con 0x7fbab406e890 2024-03-28T21:51:39.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.228+0000 7fbabae00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbab40b34f0 con 0x7fbab415dfe0 2024-03-28T21:51:39.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.228+0000 7fbabae00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbab40ae8d0 con 0x7fbab40b4650 2024-03-28T21:51:39.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.228+0000 7fbaba400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbab40b4650 0x7fbab406c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.228+0000 7fbaba400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbab40b4650 0x7fbab406c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:41074/0 (socket says 172.21.15.165:41074) 2024-03-28T21:51:39.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.228+0000 7fbaba400640 1 -- 172.21.15.165:0/3733661725 learned_addr learned my addr 172.21.15.165:0/3733661725 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-03-28T21:51:39.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.228+0000 7fbab9a00640 1 --2- 172.21.15.165:0/3733661725 >> v2:172.21.15.153:3300/0 conn(0x7fbab415dfe0 0x7fbab406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.229+0000 7fbaba400640 1 -- 172.21.15.165:0/3733661725 >> v2:172.21.15.153:3300/0 conn(0x7fbab415dfe0 msgr2=0x7fbab406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:39.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.229+0000 7fbaba400640 1 --2- 172.21.15.165:0/3733661725 >> v2:172.21.15.153:3300/0 conn(0x7fbab415dfe0 0x7fbab406e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.229+0000 7fbaba400640 1 -- 172.21.15.165:0/3733661725 >> v1:172.21.15.153:6789/0 conn(0x7fbab406e890 legacy=0x7fbab40b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.229+0000 7fbaba400640 1 -- 172.21.15.165:0/3733661725 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab40b3740 con 0x7fbab40b4650 2024-03-28T21:51:39.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.229+0000 7fbab3e00640 1 -- 172.21.15.165:0/3733661725 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944129538 0 0) 0x7fbab40ae5f0 con 0x7fbab406e890 2024-03-28T21:51:39.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.230+0000 7fbaba400640 1 --2- 172.21.15.165:0/3733661725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbab40b4650 0x7fbab406c180 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbab40d0350 tx=0x7fbaac02bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da99ea16f34ae05e server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:39.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.230+0000 7fbab3e00640 1 -- 172.21.15.165:0/3733661725 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac02cb20 con 0x7fbab40b4650 2024-03-28T21:51:39.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.230+0000 7fbab3e00640 1 -- 172.21.15.165:0/3733661725 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaac02ccc0 con 0x7fbab40b4650 2024-03-28T21:51:39.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.230+0000 7fbab3e00640 1 -- 172.21.15.165:0/3733661725 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac034610 con 0x7fbab40b4650 2024-03-28T21:51:39.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.231+0000 7fbabae00640 1 -- 172.21.15.165:0/3733661725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbab40b4650 msgr2=0x7fbab406c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.231+0000 7fbabae00640 1 --2- 172.21.15.165:0/3733661725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbab40b4650 0x7fbab406c180 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbab40d0350 tx=0x7fbaac02bf80 comp rx=0 tx=0).stop 2024-03-28T21:51:39.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.231+0000 7fbabae00640 1 -- 172.21.15.165:0/3733661725 shutdown_connections 2024-03-28T21:51:39.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.231+0000 7fbabae00640 1 --2- 172.21.15.165:0/3733661725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbab40b4650 0x7fbab406c180 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.231+0000 7fbabae00640 1 --2- 172.21.15.165:0/3733661725 >> v2:172.21.15.153:3300/0 conn(0x7fbab415dfe0 0x7fbab406e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.231+0000 7fbabae00640 1 -- 172.21.15.165:0/3733661725 >> 172.21.15.165:0/3733661725 conn(0x7fbab4071780 msgr2=0x7fbab4071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:39.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.231+0000 7fbabae00640 1 -- 172.21.15.165:0/3733661725 shutdown_connections 2024-03-28T21:51:39.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.231+0000 7fbabae00640 1 -- 172.21.15.165:0/3733661725 wait complete. 2024-03-28T21:51:39.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.233+0000 7fbabae00640 1 Processor -- start 2024-03-28T21:51:39.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.233+0000 7fbabae00640 1 -- start start 2024-03-28T21:51:39.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.234+0000 7fbabae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbab406e890 0x7fbab4148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.234+0000 7fbabae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbab40b4650 0x7fbab41496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.234+0000 7fbabae00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab415dfe0 0x7fbab414be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.234+0000 7fbabae00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbab406c6c0 con 0x7fbab415dfe0 2024-03-28T21:51:39.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.234+0000 7fbabae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbab415e3c0 con 0x7fbab40b4650 2024-03-28T21:51:39.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.234+0000 7fbabae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbab406c840 con 0x7fbab406e890 2024-03-28T21:51:39.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.234+0000 7fbab9a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbab406e890 0x7fbab4148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.234+0000 7fbab9000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbab40b4650 0x7fbab41496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.234+0000 7fbab9a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbab406e890 0x7fbab4148c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58908/0 (socket says 172.21.15.165:58908) 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.234+0000 7fbab9a00640 1 -- 172.21.15.165:0/1376635740 learned_addr learned my addr 172.21.15.165:0/1376635740 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.235+0000 7fbaba400640 1 --2- 172.21.15.165:0/1376635740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab415dfe0 0x7fbab414be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.235+0000 7fbab9a00640 1 -- 172.21.15.165:0/1376635740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbab40b4650 msgr2=0x7fbab41496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.235+0000 7fbab9a00640 1 --2- 172.21.15.165:0/1376635740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbab40b4650 0x7fbab41496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.235+0000 7fbab9a00640 1 -- 172.21.15.165:0/1376635740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab415dfe0 msgr2=0x7fbab414be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.235+0000 7fbab9a00640 1 --2- 172.21.15.165:0/1376635740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab415dfe0 0x7fbab414be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.235+0000 7fbab9a00640 1 -- 172.21.15.165:0/1376635740 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab415a6d0 con 0x7fbab406e890 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.235+0000 7fbab9000640 1 --2- 172.21.15.165:0/1376635740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbab40b4650 0x7fbab41496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.235+0000 7fbab9a00640 1 --2- 172.21.15.165:0/1376635740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbab406e890 0x7fbab4148c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800e870 tx=0x7fbaa800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.235+0000 7fbab1600640 1 -- 172.21.15.165:0/1376635740 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8017070 con 0x7fbab406e890 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.236+0000 7fbab1600640 1 -- 172.21.15.165:0/1376635740 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa800c940 con 0x7fbab406e890 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.236+0000 7fbabae00640 1 -- 172.21.15.165:0/1376635740 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab415a9b0 con 0x7fbab406e890 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.236+0000 7fbab1600640 1 -- 172.21.15.165:0/1376635740 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800cd30 con 0x7fbab406e890 2024-03-28T21:51:39.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.236+0000 7fbabae00640 1 -- 172.21.15.165:0/1376635740 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab415af70 con 0x7fbab406e890 2024-03-28T21:51:39.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.236+0000 7fbab1600640 1 -- 172.21.15.165:0/1376635740 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbaa801a070 con 0x7fbab406e890 2024-03-28T21:51:39.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.236+0000 7fbab1600640 1 -- 172.21.15.165:0/1376635740 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fbaa80139f0 con 0x7fbab406e890 2024-03-28T21:51:39.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.237+0000 7fbabae00640 1 -- 172.21.15.165:0/1376635740 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbab40681c0 con 0x7fbab406e890 2024-03-28T21:51:39.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.239+0000 7fbab1600640 1 -- 172.21.15.165:0/1376635740 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbaa8013470 con 0x7fbab406e890 2024-03-28T21:51:39.253 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:39.251+0000 7fdbe662c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-28T21:51:39.256 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:39.254+0000 7f1311012040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-28T21:51:39.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.315+0000 7fbabae00640 1 -- 172.21.15.165:0/1376635740 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ac813b43-7eb2-4e48-908c-36aeb30f6520", "id": 5} v 0) -- 0x7fbab40cfd50 con 0x7fbab406e890 2024-03-28T21:51:39.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.322+0000 7fbab1600640 1 -- 172.21.15.165:0/1376635740 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ac813b43-7eb2-4e48-908c-36aeb30f6520", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fbaa8013650 con 0x7fbab406e890 2024-03-28T21:51:39.324 INFO:teuthology.orchestra.run.smithi165.stdout:5 2024-03-28T21:51:39.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.323+0000 7fbabae00640 1 -- 172.21.15.165:0/1376635740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbab406e890 msgr2=0x7fbab4148c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.323+0000 7fbabae00640 1 --2- 172.21.15.165:0/1376635740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbab406e890 0x7fbab4148c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800e870 tx=0x7fbaa800ed30 comp rx=0 tx=0).stop 2024-03-28T21:51:39.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.323+0000 7fbabae00640 1 -- 172.21.15.165:0/1376635740 shutdown_connections 2024-03-28T21:51:39.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.323+0000 7fbabae00640 1 --2- 172.21.15.165:0/1376635740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab415dfe0 0x7fbab414be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.323+0000 7fbabae00640 1 --2- 172.21.15.165:0/1376635740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbab40b4650 0x7fbab41496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.323+0000 7fbabae00640 1 --2- 172.21.15.165:0/1376635740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbab406e890 0x7fbab4148c80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.323+0000 7fbabae00640 1 -- 172.21.15.165:0/1376635740 >> 172.21.15.165:0/1376635740 conn(0x7fbab4071780 msgr2=0x7fbab40ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:39.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.324+0000 7fbabae00640 1 -- 172.21.15.165:0/1376635740 shutdown_connections 2024-03-28T21:51:39.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.324+0000 7fbabae00640 1 -- 172.21.15.165:0/1376635740 wait complete. 2024-03-28T21:51:39.341 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new d2e32c14-63e8-419e-92c3-c6faf1801849 6 2024-03-28T21:51:39.365 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:39.363+0000 7fdbe662c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-28T21:51:39.390 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:39.388+0000 7f1311012040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-28T21:51:39.509 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:39.507+0000 7f1311012040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-28T21:51:39.542 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:39.540+0000 7fdbe662c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-28T21:51:39.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.569+0000 7f1a31e00640 1 Processor -- start 2024-03-28T21:51:39.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.569+0000 7f1a31e00640 1 -- start start 2024-03-28T21:51:39.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.570+0000 7f1a31e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a2c1608f0 0x7f1a2c0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.570+0000 7f1a31e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1a2c0d2bb0 0x7f1a2c0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.570+0000 7f1a31e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2c0ceca0 con 0x7f1a2c0d0a60 2024-03-28T21:51:39.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.570+0000 7f1a31e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1a2c0d1520 con 0x7f1a2c0d2bb0 2024-03-28T21:51:39.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.570+0000 7f1a31e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1a2c0d1800 con 0x7f1a2c1608f0 2024-03-28T21:51:39.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.571+0000 7f1a2aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a2c1608f0 0x7f1a2c0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.571+0000 7f1a2aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a2c1608f0 0x7f1a2c0b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58918/0 (socket says 172.21.15.165:58918) 2024-03-28T21:51:39.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.571+0000 7f1a2aa00640 1 -- 172.21.15.165:0/3643939116 learned_addr learned my addr 172.21.15.165:0/3643939116 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-03-28T21:51:39.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.571+0000 7f1a2b400640 1 --2- 172.21.15.165:0/3643939116 >> v2:172.21.15.165:3300/0 conn(0x7f1a2c0d2bb0 0x7f1a2c0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.571+0000 7f1a2aa00640 1 -- 172.21.15.165:0/3643939116 >> v2:172.21.15.165:3300/0 conn(0x7f1a2c0d2bb0 msgr2=0x7f1a2c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:39.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.571+0000 7f1a2aa00640 1 --2- 172.21.15.165:0/3643939116 >> v2:172.21.15.165:3300/0 conn(0x7f1a2c0d2bb0 0x7f1a2c0d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.571+0000 7f1a2aa00640 1 -- 172.21.15.165:0/3643939116 >> v1:172.21.15.153:6789/0 conn(0x7f1a2c0d0a60 legacy=0x7f1a2c0d24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.571+0000 7f1a2aa00640 1 -- 172.21.15.165:0/3643939116 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c0cef40 con 0x7f1a2c1608f0 2024-03-28T21:51:39.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.572+0000 7f1a2aa00640 1 --2- 172.21.15.165:0/3643939116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a2c1608f0 0x7f1a2c0b3a60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009870 tx=0x7f1a1c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf148d8e4063a7e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:39.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.572+0000 7f1a29600640 1 -- 172.21.15.165:0/3643939116 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c034070 con 0x7f1a2c1608f0 2024-03-28T21:51:39.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.573+0000 7f1a29600640 1 -- 172.21.15.165:0/3643939116 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c030840 con 0x7f1a2c1608f0 2024-03-28T21:51:39.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.573+0000 7f1a29600640 1 -- 172.21.15.165:0/3643939116 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c030c10 con 0x7f1a2c1608f0 2024-03-28T21:51:39.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.573+0000 7f1a31e00640 1 -- 172.21.15.165:0/3643939116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a2c1608f0 msgr2=0x7f1a2c0b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.573+0000 7f1a31e00640 1 --2- 172.21.15.165:0/3643939116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a2c1608f0 0x7f1a2c0b3a60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009870 tx=0x7f1a1c02b980 comp rx=0 tx=0).stop 2024-03-28T21:51:39.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.573+0000 7f1a31e00640 1 -- 172.21.15.165:0/3643939116 shutdown_connections 2024-03-28T21:51:39.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.573+0000 7f1a31e00640 1 --2- 172.21.15.165:0/3643939116 >> v2:172.21.15.165:3300/0 conn(0x7f1a2c0d2bb0 0x7f1a2c0d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.573+0000 7f1a31e00640 1 --2- 172.21.15.165:0/3643939116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a2c1608f0 0x7f1a2c0b3a60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.573+0000 7f1a31e00640 1 -- 172.21.15.165:0/3643939116 >> 172.21.15.165:0/3643939116 conn(0x7f1a2c09d430 msgr2=0x7f1a2c0d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:39.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.573+0000 7f1a31e00640 1 -- 172.21.15.165:0/3643939116 shutdown_connections 2024-03-28T21:51:39.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.573+0000 7f1a31e00640 1 -- 172.21.15.165:0/3643939116 wait complete. 2024-03-28T21:51:39.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.575+0000 7f1a31e00640 1 Processor -- start 2024-03-28T21:51:39.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.575+0000 7f1a31e00640 1 -- start start 2024-03-28T21:51:39.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.576+0000 7f1a31e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a2c0d0a60 0x7f1a2c151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.576+0000 7f1a31e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a2c0d2bb0 0x7f1a2c09dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.576+0000 7f1a31e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c1608f0 0x7f1a2c09e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.576+0000 7f1a31e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c0b3400 con 0x7f1a2c1608f0 2024-03-28T21:51:39.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.576+0000 7f1a31e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c0b3280 con 0x7f1a2c0d2bb0 2024-03-28T21:51:39.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.576+0000 7f1a31e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1a2c161ce0 con 0x7f1a2c0d0a60 2024-03-28T21:51:39.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.576+0000 7f1a2aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a2c0d0a60 0x7f1a2c151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.576+0000 7f1a2a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a2c0d2bb0 0x7f1a2c09dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.576+0000 7f1a2aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a2c0d0a60 0x7f1a2c151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58924/0 (socket says 172.21.15.165:58924) 2024-03-28T21:51:39.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.576+0000 7f1a2a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a2c0d2bb0 0x7f1a2c09dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:41110/0 (socket says 172.21.15.165:41110) 2024-03-28T21:51:39.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.576+0000 7f1a2aa00640 1 -- 172.21.15.165:0/484880443 learned_addr learned my addr 172.21.15.165:0/484880443 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-03-28T21:51:39.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.577+0000 7f1a2b400640 1 --2- 172.21.15.165:0/484880443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c1608f0 0x7f1a2c09e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.577+0000 7f1a2aa00640 1 -- 172.21.15.165:0/484880443 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a2c0d2bb0 msgr2=0x7f1a2c09dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.577+0000 7f1a2aa00640 1 --2- 172.21.15.165:0/484880443 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a2c0d2bb0 0x7f1a2c09dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.577+0000 7f1a2aa00640 1 -- 172.21.15.165:0/484880443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c1608f0 msgr2=0x7f1a2c09e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.577+0000 7f1a2aa00640 1 --2- 172.21.15.165:0/484880443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c1608f0 0x7f1a2c09e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.577+0000 7f1a2aa00640 1 -- 172.21.15.165:0/484880443 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c151ab0 con 0x7f1a2c0d0a60 2024-03-28T21:51:39.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.577+0000 7f1a2aa00640 1 --2- 172.21.15.165:0/484880443 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a2c0d0a60 0x7f1a2c151570 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c02b9c0 tx=0x7f1a1c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:39.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.577+0000 7f1a23400640 1 -- 172.21.15.165:0/484880443 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c034040 con 0x7f1a2c0d0a60 2024-03-28T21:51:39.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.577+0000 7f1a23400640 1 -- 172.21.15.165:0/484880443 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c03ada0 con 0x7f1a2c0d0a60 2024-03-28T21:51:39.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.577+0000 7f1a31e00640 1 -- 172.21.15.165:0/484880443 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2c0a0e90 con 0x7f1a2c0d0a60 2024-03-28T21:51:39.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.577+0000 7f1a23400640 1 -- 172.21.15.165:0/484880443 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c044610 con 0x7f1a2c0d0a60 2024-03-28T21:51:39.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.577+0000 7f1a31e00640 1 -- 172.21.15.165:0/484880443 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2c0a1450 con 0x7f1a2c0d0a60 2024-03-28T21:51:39.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.578+0000 7f1a23400640 1 -- 172.21.15.165:0/484880443 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1a1c04b060 con 0x7f1a2c0d0a60 2024-03-28T21:51:39.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.578+0000 7f1a23400640 1 -- 172.21.15.165:0/484880443 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f1a1c04da40 con 0x7f1a2c0d0a60 2024-03-28T21:51:39.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.579+0000 7f1a31e00640 1 -- 172.21.15.165:0/484880443 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a2c068ff0 con 0x7f1a2c0d0a60 2024-03-28T21:51:39.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.582+0000 7f1a23400640 1 -- 172.21.15.165:0/484880443 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1a2c151ab0 con 0x7f1a2c0d0a60 2024-03-28T21:51:39.591 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:39.590+0000 7fdbe662c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-28T21:51:39.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.661+0000 7f1a31e00640 1 -- 172.21.15.165:0/484880443 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d2e32c14-63e8-419e-92c3-c6faf1801849", "id": 6} v 0) -- 0x7f1a2c0d4f40 con 0x7f1a2c0d0a60 2024-03-28T21:51:39.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.670+0000 7f1a23400640 1 -- 172.21.15.165:0/484880443 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2e32c14-63e8-419e-92c3-c6faf1801849", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f1a1c03f070 con 0x7f1a2c0d0a60 2024-03-28T21:51:39.673 INFO:teuthology.orchestra.run.smithi165.stdout:6 2024-03-28T21:51:39.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.672+0000 7f1a31e00640 1 -- 172.21.15.165:0/484880443 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a2c0d0a60 msgr2=0x7f1a2c151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.672+0000 7f1a31e00640 1 --2- 172.21.15.165:0/484880443 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a2c0d0a60 0x7f1a2c151570 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c02b9c0 tx=0x7f1a1c0046c0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.673+0000 7f1a31e00640 1 -- 172.21.15.165:0/484880443 shutdown_connections 2024-03-28T21:51:39.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.673+0000 7f1a31e00640 1 --2- 172.21.15.165:0/484880443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c1608f0 0x7f1a2c09e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.673+0000 7f1a31e00640 1 --2- 172.21.15.165:0/484880443 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a2c0d2bb0 0x7f1a2c09dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.673+0000 7f1a31e00640 1 --2- 172.21.15.165:0/484880443 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a2c0d0a60 0x7f1a2c151570 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.673+0000 7f1a31e00640 1 -- 172.21.15.165:0/484880443 >> 172.21.15.165:0/484880443 conn(0x7f1a2c09d430 msgr2=0x7f1a2c0d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:39.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.673+0000 7f1a31e00640 1 -- 172.21.15.165:0/484880443 shutdown_connections 2024-03-28T21:51:39.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.673+0000 7f1a31e00640 1 -- 172.21.15.165:0/484880443 wait complete. 2024-03-28T21:51:39.690 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 618b18e0-409a-453c-919f-b4e89cb43a88 7 2024-03-28T21:51:39.695 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:39.693+0000 7f1311012040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-28T21:51:39.748 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:39.746+0000 7f1311012040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-28T21:51:39.766 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:39.765+0000 7fdbe662c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-28T21:51:39.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.873+0000 7f4716800640 1 Processor -- start 2024-03-28T21:51:39.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.873+0000 7f4716800640 1 -- start start 2024-03-28T21:51:39.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.875+0000 7f4716800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f471015e4a0 0x7f47100d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.875+0000 7f4716800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f47100d1d40 0x7f47100cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.875+0000 7f4716800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47100d21b0 con 0x7f471015e0c0 2024-03-28T21:51:39.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.875+0000 7f4716800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f47100cf6c0 con 0x7f47100d1d40 2024-03-28T21:51:39.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.875+0000 7f4716800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f47100cf8f0 con 0x7f471015e4a0 2024-03-28T21:51:39.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.875+0000 7f4714a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f471015e4a0 0x7f47100d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.875+0000 7f4714a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f471015e4a0 0x7f47100d4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58928/0 (socket says 172.21.15.165:58928) 2024-03-28T21:51:39.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.875+0000 7f4715e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f47100d1d40 0x7f47100cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.875+0000 7f4714a00640 1 -- 172.21.15.165:0/1343503967 learned_addr learned my addr 172.21.15.165:0/1343503967 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-03-28T21:51:39.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.875+0000 7f4714a00640 1 -- 172.21.15.165:0/1343503967 >> v2:172.21.15.165:3300/0 conn(0x7f47100d1d40 msgr2=0x7f47100cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:39.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.875+0000 7f4714a00640 1 --2- 172.21.15.165:0/1343503967 >> v2:172.21.15.165:3300/0 conn(0x7f47100d1d40 0x7f47100cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.875+0000 7f4714a00640 1 -- 172.21.15.165:0/1343503967 >> v1:172.21.15.153:6789/0 conn(0x7f471015e0c0 legacy=0x7f47100cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.875+0000 7f4714a00640 1 -- 172.21.15.165:0/1343503967 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47100cfbd0 con 0x7f471015e4a0 2024-03-28T21:51:39.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.875+0000 7f4715e00640 1 --2- 172.21.15.165:0/1343503967 >> v2:172.21.15.165:3300/0 conn(0x7f47100d1d40 0x7f47100cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:51:39.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.877+0000 7f4714a00640 1 --2- 172.21.15.165:0/1343503967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f471015e4a0 0x7f47100d4a80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009870 tx=0x7f46fc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=222f9130390c2e3d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:39.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.877+0000 7f470fe00640 1 -- 172.21.15.165:0/1343503967 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc034070 con 0x7f471015e4a0 2024-03-28T21:51:39.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.877+0000 7f470fe00640 1 -- 172.21.15.165:0/1343503967 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46fc030840 con 0x7f471015e4a0 2024-03-28T21:51:39.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.877+0000 7f470fe00640 1 -- 172.21.15.165:0/1343503967 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc030c10 con 0x7f471015e4a0 2024-03-28T21:51:39.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.877+0000 7f4716800640 1 -- 172.21.15.165:0/1343503967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f471015e4a0 msgr2=0x7f47100d4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.878+0000 7f4716800640 1 --2- 172.21.15.165:0/1343503967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f471015e4a0 0x7f47100d4a80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009870 tx=0x7f46fc02b980 comp rx=0 tx=0).stop 2024-03-28T21:51:39.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.878+0000 7f4716800640 1 -- 172.21.15.165:0/1343503967 shutdown_connections 2024-03-28T21:51:39.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.878+0000 7f4716800640 1 --2- 172.21.15.165:0/1343503967 >> v2:172.21.15.165:3300/0 conn(0x7f47100d1d40 0x7f47100cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.878+0000 7f4716800640 1 --2- 172.21.15.165:0/1343503967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f471015e4a0 0x7f47100d4a80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.878+0000 7f4716800640 1 -- 172.21.15.165:0/1343503967 >> 172.21.15.165:0/1343503967 conn(0x7f47100d3f60 msgr2=0x7f47100d4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:39.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.878+0000 7f4716800640 1 -- 172.21.15.165:0/1343503967 shutdown_connections 2024-03-28T21:51:39.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.878+0000 7f4716800640 1 -- 172.21.15.165:0/1343503967 wait complete. 2024-03-28T21:51:39.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.879+0000 7f4716800640 1 Processor -- start 2024-03-28T21:51:39.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.880+0000 7f4716800640 1 -- start start 2024-03-28T21:51:39.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.880+0000 7f4716800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47100d1d40 0x7f4710155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.880+0000 7f4716800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f471015e0c0 0x7f47100ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.880+0000 7f4716800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f471015e4a0 0x7f47100b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:39.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.881+0000 7f4716800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f47100b40b0 con 0x7f47100d1d40 2024-03-28T21:51:39.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.881+0000 7f4716800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f47100b3f30 con 0x7f471015e4a0 2024-03-28T21:51:39.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.881+0000 7f4716800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f47100b4230 con 0x7f471015e0c0 2024-03-28T21:51:39.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.881+0000 7f4714a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f471015e0c0 0x7f47100ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.881+0000 7f4714a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f471015e0c0 0x7f47100ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58938/0 (socket says 172.21.15.165:58938) 2024-03-28T21:51:39.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.881+0000 7f4714a00640 1 -- 172.21.15.165:0/1215697013 learned_addr learned my addr 172.21.15.165:0/1215697013 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-03-28T21:51:39.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.881+0000 7f4715e00640 1 --2- 172.21.15.165:0/1215697013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f471015e4a0 0x7f47100b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.881+0000 7f4715400640 1 --2- 172.21.15.165:0/1215697013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47100d1d40 0x7f4710155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:39.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.881+0000 7f4714a00640 1 -- 172.21.15.165:0/1215697013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f471015e4a0 msgr2=0x7f47100b82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.881+0000 7f4714a00640 1 --2- 172.21.15.165:0/1215697013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f471015e4a0 0x7f47100b82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.881+0000 7f4714a00640 1 -- 172.21.15.165:0/1215697013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47100d1d40 msgr2=0x7f4710155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.881+0000 7f4714a00640 1 --2- 172.21.15.165:0/1215697013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47100d1d40 0x7f4710155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.881+0000 7f4714a00640 1 -- 172.21.15.165:0/1215697013 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47100c86e0 con 0x7f471015e0c0 2024-03-28T21:51:39.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.881+0000 7f4715400640 1 --2- 172.21.15.165:0/1215697013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47100d1d40 0x7f4710155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:51:39.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.882+0000 7f4714a00640 1 --2- 172.21.15.165:0/1215697013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f471015e0c0 0x7f47100ca330 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0090b0 tx=0x7f46fc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:39.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.882+0000 7f470d600640 1 -- 172.21.15.165:0/1215697013 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc034040 con 0x7f471015e0c0 2024-03-28T21:51:39.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.882+0000 7f470d600640 1 -- 172.21.15.165:0/1215697013 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46fc03ada0 con 0x7f471015e0c0 2024-03-28T21:51:39.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.882+0000 7f470d600640 1 -- 172.21.15.165:0/1215697013 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc044630 con 0x7f471015e0c0 2024-03-28T21:51:39.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.882+0000 7f4716800640 1 -- 172.21.15.165:0/1215697013 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47100c89c0 con 0x7f471015e0c0 2024-03-28T21:51:39.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.882+0000 7f4716800640 1 -- 172.21.15.165:0/1215697013 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47100c8f80 con 0x7f471015e0c0 2024-03-28T21:51:39.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.882+0000 7f470d600640 1 -- 172.21.15.165:0/1215697013 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f46fc04b060 con 0x7f471015e0c0 2024-03-28T21:51:39.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.882+0000 7f470d600640 1 -- 172.21.15.165:0/1215697013 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f46fc0447d0 con 0x7f471015e0c0 2024-03-28T21:51:39.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.883+0000 7f4716800640 1 -- 172.21.15.165:0/1215697013 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4710068ff0 con 0x7f471015e0c0 2024-03-28T21:51:39.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.885+0000 7f470d600640 1 -- 172.21.15.165:0/1215697013 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f46fc03f070 con 0x7f471015e0c0 2024-03-28T21:51:39.940 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:39.938+0000 7f1311012040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-28T21:51:39.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.960+0000 7f4716800640 1 -- 172.21.15.165:0/1215697013 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd new", "uuid": "618b18e0-409a-453c-919f-b4e89cb43a88", "id": 7} v 0) -- 0x7f47100cadf0 con 0x7f471015e0c0 2024-03-28T21:51:39.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.971+0000 7f470d600640 1 -- 172.21.15.165:0/1215697013 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "618b18e0-409a-453c-919f-b4e89cb43a88", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f46fc044aa0 con 0x7f471015e0c0 2024-03-28T21:51:39.973 INFO:teuthology.orchestra.run.smithi165.stdout:7 2024-03-28T21:51:39.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.972+0000 7f4716800640 1 -- 172.21.15.165:0/1215697013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f471015e0c0 msgr2=0x7f47100ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:39.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.972+0000 7f4716800640 1 --2- 172.21.15.165:0/1215697013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f471015e0c0 0x7f47100ca330 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0090b0 tx=0x7f46fc0046c0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.972+0000 7f4716800640 1 -- 172.21.15.165:0/1215697013 shutdown_connections 2024-03-28T21:51:39.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.972+0000 7f4716800640 1 --2- 172.21.15.165:0/1215697013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f471015e4a0 0x7f47100b82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.972+0000 7f4716800640 1 --2- 172.21.15.165:0/1215697013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f471015e0c0 0x7f47100ca330 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.972+0000 7f4716800640 1 --2- 172.21.15.165:0/1215697013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47100d1d40 0x7f4710155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:39.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.972+0000 7f4716800640 1 -- 172.21.15.165:0/1215697013 >> 172.21.15.165:0/1215697013 conn(0x7f47100d3f60 msgr2=0x7f47100b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:39.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.972+0000 7f4716800640 1 -- 172.21.15.165:0/1215697013 shutdown_connections 2024-03-28T21:51:39.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:51:39.972+0000 7f4716800640 1 -- 172.21.15.165:0/1215697013 wait complete. 2024-03-28T21:51:39.990 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-28T21:51:39.990 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-28T21:51:39.998 INFO:tasks.ceph.osd.0:Started 2024-03-28T21:51:39.998 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-28T21:51:39.998 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-28T21:51:40.005 INFO:tasks.ceph.osd.1:Started 2024-03-28T21:51:40.005 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-28T21:51:40.005 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-28T21:51:40.009 INFO:tasks.ceph.osd.2:Started 2024-03-28T21:51:40.010 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-28T21:51:40.010 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-28T21:51:40.014 INFO:tasks.ceph.osd.3:Started 2024-03-28T21:51:40.014 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-28T21:51:40.015 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-28T21:51:40.019 INFO:tasks.ceph.osd.4:Started 2024-03-28T21:51:40.019 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-28T21:51:40.019 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-28T21:51:40.023 INFO:tasks.ceph.osd.5:Started 2024-03-28T21:51:40.024 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-28T21:51:40.024 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-28T21:51:40.028 INFO:tasks.ceph.osd.6:Started 2024-03-28T21:51:40.028 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-28T21:51:40.028 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-28T21:51:40.032 INFO:tasks.ceph.osd.7:Started 2024-03-28T21:51:40.032 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:51:40.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.252+0000 7f622c000640 1 Processor -- start 2024-03-28T21:51:40.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.253+0000 7f622c000640 1 -- start start 2024-03-28T21:51:40.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.254+0000 7f622c000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f622415e2b0 0x7f62240b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:40.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.254+0000 7f622c000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f622415e690 con 0x7f62240b4830 2024-03-28T21:51:40.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.254+0000 7f622c000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62240ae530 con 0x7f62240adf10 2024-03-28T21:51:40.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.254+0000 7f622c000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f62240b4070 con 0x7f622415e2b0 2024-03-28T21:51:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.254+0000 7f622a000640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f62240adf10 0x7f6224071520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:44428/0 (socket says 172.21.15.153:44428) 2024-03-28T21:51:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.254+0000 7f622a000640 1 -- 172.21.15.153:0/2260723519 learned_addr learned my addr 172.21.15.153:0/2260723519 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:51:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.254+0000 7f6229600640 1 --2- 172.21.15.153:0/2260723519 >> v2:172.21.15.153:3300/0 conn(0x7f622415e2b0 0x7f62240b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.255+0000 7f6223e00640 1 -- 172.21.15.153:0/2260723519 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2882665875 0 0) 0x7f62240ae530 con 0x7f62240adf10 2024-03-28T21:51:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.255+0000 7f6223e00640 1 -- 172.21.15.153:0/2260723519 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f620c003520 con 0x7f62240adf10 2024-03-28T21:51:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.255+0000 7f6229600640 1 -- 172.21.15.153:0/2260723519 >> v1:172.21.15.165:6789/0 conn(0x7f62240adf10 legacy=0x7f6224071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.255+0000 7f6229600640 1 -- 172.21.15.153:0/2260723519 >> v1:172.21.15.153:6789/0 conn(0x7f62240b4830 legacy=0x7f62240ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.255+0000 7f6229600640 1 -- 172.21.15.153:0/2260723519 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62240ae810 con 0x7f622415e2b0 2024-03-28T21:51:40.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.256+0000 7f6229600640 1 --2- 172.21.15.153:0/2260723519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f622415e2b0 0x7f62240b42f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f62180097a0 tx=0x7f621802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c8a9511ca6bfed server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:40.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.256+0000 7f6223e00640 1 -- 172.21.15.153:0/2260723519 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6218034070 con 0x7f622415e2b0 2024-03-28T21:51:40.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.256+0000 7f6223e00640 1 -- 172.21.15.153:0/2260723519 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6218030610 con 0x7f622415e2b0 2024-03-28T21:51:40.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.256+0000 7f6223e00640 1 -- 172.21.15.153:0/2260723519 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62180309c0 con 0x7f622415e2b0 2024-03-28T21:51:40.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.257+0000 7f622c000640 1 -- 172.21.15.153:0/2260723519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f622415e2b0 msgr2=0x7f62240b42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.257+0000 7f622c000640 1 --2- 172.21.15.153:0/2260723519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f622415e2b0 0x7f62240b42f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f62180097a0 tx=0x7f621802b960 comp rx=0 tx=0).stop 2024-03-28T21:51:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.257+0000 7f622c000640 1 -- 172.21.15.153:0/2260723519 shutdown_connections 2024-03-28T21:51:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.257+0000 7f622c000640 1 --2- 172.21.15.153:0/2260723519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f622415e2b0 0x7f62240b42f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.257+0000 7f622c000640 1 -- 172.21.15.153:0/2260723519 >> 172.21.15.153:0/2260723519 conn(0x7f62240b1a30 msgr2=0x7f62240b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.257+0000 7f622c000640 1 -- 172.21.15.153:0/2260723519 shutdown_connections 2024-03-28T21:51:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.257+0000 7f622c000640 1 -- 172.21.15.153:0/2260723519 wait complete. 2024-03-28T21:51:40.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.259+0000 7f622c000640 1 Processor -- start 2024-03-28T21:51:40.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.259+0000 7f622c000640 1 -- start start 2024-03-28T21:51:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f622c000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62240adf10 0x7f6224150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f622c000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62240b4830 0x7f6224160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f622c000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f622415e2b0 0x7f6224160f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f622c000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f62240aedd0 con 0x7f622415e2b0 2024-03-28T21:51:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f622c000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6224071c30 con 0x7f62240b4830 2024-03-28T21:51:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f622c000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6224071db0 con 0x7f62240adf10 2024-03-28T21:51:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f622a000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f622415e2b0 0x7f6224160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f622a000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f622415e2b0 0x7f6224160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40838/0 (socket says 172.21.15.153:40838) 2024-03-28T21:51:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f622a000640 1 -- 172.21.15.153:0/932549913 learned_addr learned my addr 172.21.15.153:0/932549913 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f6228c00640 1 --2- 172.21.15.153:0/932549913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62240b4830 0x7f6224160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f6229600640 1 --2- 172.21.15.153:0/932549913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62240adf10 0x7f6224150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f622a000640 1 -- 172.21.15.153:0/932549913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62240adf10 msgr2=0x7f6224150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f622a000640 1 --2- 172.21.15.153:0/932549913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62240adf10 0x7f6224150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f622a000640 1 -- 172.21.15.153:0/932549913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62240b4830 msgr2=0x7f6224160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f622a000640 1 --2- 172.21.15.153:0/932549913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62240b4830 0x7f6224160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:40.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.260+0000 7f622a000640 1 -- 172.21.15.153:0/932549913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6224151ce0 con 0x7f622415e2b0 2024-03-28T21:51:40.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.261+0000 7f622a000640 1 --2- 172.21.15.153:0/932549913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f622415e2b0 0x7f6224160f90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f621c00cb70 tx=0x7f621c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:40.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.261+0000 7f6221600640 1 -- 172.21.15.153:0/932549913 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c017070 con 0x7f622415e2b0 2024-03-28T21:51:40.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.261+0000 7f6221600640 1 -- 172.21.15.153:0/932549913 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621c00ace0 con 0x7f622415e2b0 2024-03-28T21:51:40.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.261+0000 7f622c000640 1 -- 172.21.15.153:0/932549913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6224157240 con 0x7f622415e2b0 2024-03-28T21:51:40.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.261+0000 7f6221600640 1 -- 172.21.15.153:0/932549913 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c012620 con 0x7f622415e2b0 2024-03-28T21:51:40.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.261+0000 7f622c000640 1 -- 172.21.15.153:0/932549913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6224157800 con 0x7f622415e2b0 2024-03-28T21:51:40.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.261+0000 7f6221600640 1 -- 172.21.15.153:0/932549913 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f621c01a070 con 0x7f622415e2b0 2024-03-28T21:51:40.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.261+0000 7f6221600640 1 -- 172.21.15.153:0/932549913 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f621c007740 con 0x7f622415e2b0 2024-03-28T21:51:40.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.262+0000 7f622c000640 1 -- 172.21.15.153:0/932549913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6224068ff0 con 0x7f622415e2b0 2024-03-28T21:51:40.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.265+0000 7f6221600640 1 -- 172.21.15.153:0/932549913 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f621c021070 con 0x7f622415e2b0 2024-03-28T21:51:40.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.328+0000 7f622c000640 1 -- 172.21.15.153:0/932549913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6224072170 con 0x7f622415e2b0 2024-03-28T21:51:40.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.329+0000 7f6221600640 1 -- 172.21.15.153:0/932549913 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f621c01c440 con 0x7f622415e2b0 2024-03-28T21:51:40.330 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:51:40.330 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":10,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:39.963809+0000","last_up_change":"0.000000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:51:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.330+0000 7f622c000640 1 -- 172.21.15.153:0/932549913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f622415e2b0 msgr2=0x7f6224160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.330+0000 7f622c000640 1 --2- 172.21.15.153:0/932549913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f622415e2b0 0x7f6224160f90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f621c00cb70 tx=0x7f621c00a430 comp rx=0 tx=0).stop 2024-03-28T21:51:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.330+0000 7f622c000640 1 -- 172.21.15.153:0/932549913 shutdown_connections 2024-03-28T21:51:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.330+0000 7f622c000640 1 --2- 172.21.15.153:0/932549913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f622415e2b0 0x7f6224160f90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:40.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.330+0000 7f622c000640 1 --2- 172.21.15.153:0/932549913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62240b4830 0x7f6224160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:40.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.330+0000 7f622c000640 1 --2- 172.21.15.153:0/932549913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62240adf10 0x7f6224150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:40.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.330+0000 7f622c000640 1 -- 172.21.15.153:0/932549913 >> 172.21.15.153:0/932549913 conn(0x7f62240b1a30 msgr2=0x7f62241511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:40.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.330+0000 7f622c000640 1 -- 172.21.15.153:0/932549913 shutdown_connections 2024-03-28T21:51:40.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:40.330+0000 7f622c000640 1 -- 172.21.15.153:0/932549913 wait complete. 2024-03-28T21:51:40.347 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-28T21:51:40.347 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-28T21:51:40.700 INFO:tasks.ceph.osd.6.smithi165.stderr:2024-03-28T21:51:40.698+0000 7fb50400c640 -1 Falling back to public interface 2024-03-28T21:51:40.705 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-03-28T21:51:40.703+0000 7f9a2e40c640 -1 Falling back to public interface 2024-03-28T21:51:40.710 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-03-28T21:51:40.709+0000 7f43da011640 -1 Falling back to public interface 2024-03-28T21:51:40.742 INFO:tasks.ceph.osd.7.smithi165.stderr:2024-03-28T21:51:40.740+0000 7fdf9f699640 -1 Falling back to public interface 2024-03-28T21:51:40.742 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-03-28T21:51:40.741+0000 7fb6ba8c8640 -1 Falling back to public interface 2024-03-28T21:51:40.746 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-03-28T21:51:40.744+0000 7f3389149640 -1 Falling back to public interface 2024-03-28T21:51:40.749 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-03-28T21:51:40.748+0000 7f2780185640 -1 Falling back to public interface 2024-03-28T21:51:40.756 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-03-28T21:51:40.755+0000 7fb015618640 -1 Falling back to public interface 2024-03-28T21:51:40.913 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:40.911+0000 7fdbe662c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-28T21:51:41.060 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:41.058+0000 7f1311012040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-28T21:51:41.154 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-28T21:51:41.233 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:41.231+0000 7fdbe662c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-28T21:51:41.296 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:41.295+0000 7fdbe662c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-28T21:51:41.316 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.315+0000 7f310d000640 1 Processor -- start 2024-03-28T21:51:41.317 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.315+0000 7f310d000640 1 -- start start 2024-03-28T21:51:41.318 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.316+0000 7f310d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f310815e450 0x7f310806c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:41.318 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.316+0000 7f310d000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f310809b140 0x7f3108070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:41.318 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.316+0000 7f310d000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31080cff20 con 0x7f31080cc5d0 2024-03-28T21:51:41.318 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.316+0000 7f310d000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f31080d0b30 con 0x7f310809b140 2024-03-28T21:51:41.318 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.316+0000 7f310d000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f31080d0200 con 0x7f310815e450 2024-03-28T21:51:41.318 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.317+0000 7f30ffe00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f31080cc5d0 0x7f310809aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:39638/0 (socket says 172.21.15.153:39638) 2024-03-28T21:51:41.319 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.317+0000 7f30ffe00640 1 -- 172.21.15.153:0/2980155592 learned_addr learned my addr 172.21.15.153:0/2980155592 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:51:41.319 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.317+0000 7f3106800640 1 --2- 172.21.15.153:0/2980155592 >> v2:172.21.15.165:3300/0 conn(0x7f310809b140 0x7f3108070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:41.319 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.317+0000 7f3105e00640 1 --2- 172.21.15.153:0/2980155592 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f310815e450 0x7f310806c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:41.320 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.317+0000 7f3105400640 1 -- 172.21.15.153:0/2980155592 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891008486 0 0) 0x7f31080cff20 con 0x7f31080cc5d0 2024-03-28T21:51:41.320 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.317+0000 7f3105400640 1 -- 172.21.15.153:0/2980155592 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30ec003520 con 0x7f31080cc5d0 2024-03-28T21:51:41.320 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.317+0000 7f3106800640 1 -- 172.21.15.153:0/2980155592 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f310815e450 msgr2=0x7f310806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:41.320 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.317+0000 7f3106800640 1 --2- 172.21.15.153:0/2980155592 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f310815e450 0x7f310806c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:41.320 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.317+0000 7f3106800640 1 -- 172.21.15.153:0/2980155592 >> v1:172.21.15.153:6789/0 conn(0x7f31080cc5d0 legacy=0x7f310809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:41.320 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.317+0000 7f3106800640 1 -- 172.21.15.153:0/2980155592 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31080d04e0 con 0x7f310809b140 2024-03-28T21:51:41.320 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.317+0000 7f3105e00640 1 --2- 172.21.15.153:0/2980155592 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f310815e450 0x7f310806c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:51:41.320 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.318+0000 7f3106800640 1 --2- 172.21.15.153:0/2980155592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f310809b140 0x7f3108070630 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3100009d90 tx=0x7f310002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5c7051d0328acbe server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:41.321 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.319+0000 7f3105400640 1 -- 172.21.15.153:0/2980155592 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100039070 con 0x7f310809b140 2024-03-28T21:51:41.321 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.319+0000 7f3105400640 1 -- 172.21.15.153:0/2980155592 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310002cc50 con 0x7f310809b140 2024-03-28T21:51:41.321 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.319+0000 7f3105400640 1 -- 172.21.15.153:0/2980155592 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100034440 con 0x7f310809b140 2024-03-28T21:51:41.321 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.319+0000 7f310d000640 1 -- 172.21.15.153:0/2980155592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f310809b140 msgr2=0x7f3108070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:41.321 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.319+0000 7f310d000640 1 --2- 172.21.15.153:0/2980155592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f310809b140 0x7f3108070630 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3100009d90 tx=0x7f310002bea0 comp rx=0 tx=0).stop 2024-03-28T21:51:41.321 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.319+0000 7f310d000640 1 -- 172.21.15.153:0/2980155592 shutdown_connections 2024-03-28T21:51:41.322 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.319+0000 7f310d000640 1 --2- 172.21.15.153:0/2980155592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f310809b140 0x7f3108070630 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:41.322 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.319+0000 7f310d000640 1 --2- 172.21.15.153:0/2980155592 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f310815e450 0x7f310806c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:41.322 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.319+0000 7f310d000640 1 -- 172.21.15.153:0/2980155592 >> 172.21.15.153:0/2980155592 conn(0x7f31080b3b10 msgr2=0x7f31080b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:41.322 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.320+0000 7f310d000640 1 -- 172.21.15.153:0/2980155592 shutdown_connections 2024-03-28T21:51:41.322 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.320+0000 7f310d000640 1 -- 172.21.15.153:0/2980155592 wait complete. 2024-03-28T21:51:41.322 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.321+0000 7f310d000640 1 Processor -- start 2024-03-28T21:51:41.322 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.321+0000 7f310d000640 1 -- start start 2024-03-28T21:51:41.325 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.322+0000 7f310d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f310809b140 0x7f31080b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:41.325 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.322+0000 7f310d000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31080cc5d0 0x7f310815edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:41.325 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.322+0000 7f310d000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f310815e450 0x7f310814d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:41.325 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.322+0000 7f310d000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f310815e830 con 0x7f31080cc5d0 2024-03-28T21:51:41.325 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.322+0000 7f310d000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f310806c9d0 con 0x7f310815e450 2024-03-28T21:51:41.325 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.322+0000 7f310d000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f31080b1940 con 0x7f310809b140 2024-03-28T21:51:41.326 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.322+0000 7f30ffe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31080cc5d0 0x7f310815edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:41.326 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.322+0000 7f30ffe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31080cc5d0 0x7f310815edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40852/0 (socket says 172.21.15.153:40852) 2024-03-28T21:51:41.326 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.322+0000 7f30ffe00640 1 -- 172.21.15.153:0/1516156690 learned_addr learned my addr 172.21.15.153:0/1516156690 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:41.326 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.322+0000 7f3105e00640 1 --2- 172.21.15.153:0/1516156690 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f310809b140 0x7f31080b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:41.326 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.323+0000 7f3106800640 1 --2- 172.21.15.153:0/1516156690 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f310815e450 0x7f310814d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:41.326 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.323+0000 7f30ffe00640 1 -- 172.21.15.153:0/1516156690 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f310809b140 msgr2=0x7f31080b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:41.326 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.323+0000 7f30ffe00640 1 --2- 172.21.15.153:0/1516156690 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f310809b140 0x7f31080b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:41.326 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.323+0000 7f30ffe00640 1 -- 172.21.15.153:0/1516156690 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f310815e450 msgr2=0x7f310814d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:41.326 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.323+0000 7f30ffe00640 1 --2- 172.21.15.153:0/1516156690 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f310815e450 0x7f310814d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:41.326 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.323+0000 7f30ffe00640 1 -- 172.21.15.153:0/1516156690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31080b1c20 con 0x7f31080cc5d0 2024-03-28T21:51:41.326 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.323+0000 7f30ffe00640 1 --2- 172.21.15.153:0/1516156690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31080cc5d0 0x7f310815edb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f30f000c460 tx=0x7f30f000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:41.326 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.323+0000 7f30fe000640 1 -- 172.21.15.153:0/1516156690 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0017070 con 0x7f31080cc5d0 2024-03-28T21:51:41.326 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.323+0000 7f30fe000640 1 -- 172.21.15.153:0/1516156690 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f0005ce0 con 0x7f31080cc5d0 2024-03-28T21:51:41.327 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.323+0000 7f310d000640 1 -- 172.21.15.153:0/1516156690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31080b1f60 con 0x7f31080cc5d0 2024-03-28T21:51:41.327 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.323+0000 7f30fe000640 1 -- 172.21.15.153:0/1516156690 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0007290 con 0x7f31080cc5d0 2024-03-28T21:51:41.327 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.324+0000 7f310d000640 1 -- 172.21.15.153:0/1516156690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31080b1630 con 0x7f31080cc5d0 2024-03-28T21:51:41.327 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.324+0000 7f30fe000640 1 -- 172.21.15.153:0/1516156690 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f30f001a070 con 0x7f31080cc5d0 2024-03-28T21:51:41.327 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.324+0000 7f30fe000640 1 -- 172.21.15.153:0/1516156690 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f30f0012ad0 con 0x7f31080cc5d0 2024-03-28T21:51:41.327 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.325+0000 7f310d000640 1 -- 172.21.15.153:0/1516156690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f310806d640 con 0x7f31080cc5d0 2024-03-28T21:51:41.330 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.329+0000 7f30fe000640 1 -- 172.21.15.153:0/1516156690 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f310806d640 con 0x7f31080cc5d0 2024-03-28T21:51:41.375 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:41.373+0000 7f1311012040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-28T21:51:41.395 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.394+0000 7f310d000640 1 -- 172.21.15.153:0/1516156690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f310804f4b0 con 0x7f31080cc5d0 2024-03-28T21:51:41.396 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.395+0000 7f30fe000640 1 -- 172.21.15.153:0/1516156690 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f30f0021080 con 0x7f31080cc5d0 2024-03-28T21:51:41.396 INFO:teuthology.misc.health.smithi153.stdout: 2024-03-28T21:51:41.396 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":10,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:39.963809+0000","last_up_change":"0.000000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:51:41.397 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.396+0000 7f310d000640 1 -- 172.21.15.153:0/1516156690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31080cc5d0 msgr2=0x7f310815edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:41.397 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.396+0000 7f310d000640 1 --2- 172.21.15.153:0/1516156690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31080cc5d0 0x7f310815edb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f30f000c460 tx=0x7f30f000c920 comp rx=0 tx=0).stop 2024-03-28T21:51:41.397 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.396+0000 7f310d000640 1 -- 172.21.15.153:0/1516156690 shutdown_connections 2024-03-28T21:51:41.398 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.396+0000 7f310d000640 1 --2- 172.21.15.153:0/1516156690 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f310815e450 0x7f310814d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:41.398 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.396+0000 7f310d000640 1 --2- 172.21.15.153:0/1516156690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31080cc5d0 0x7f310815edb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:41.398 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.396+0000 7f310d000640 1 --2- 172.21.15.153:0/1516156690 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f310809b140 0x7f31080b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:41.398 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.396+0000 7f310d000640 1 -- 172.21.15.153:0/1516156690 >> 172.21.15.153:0/1516156690 conn(0x7f31080b3b10 msgr2=0x7f31080aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:41.398 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.396+0000 7f310d000640 1 -- 172.21.15.153:0/1516156690 shutdown_connections 2024-03-28T21:51:41.398 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:41.396+0000 7f310d000640 1 -- 172.21.15.153:0/1516156690 wait complete. 2024-03-28T21:51:41.410 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-28T21:51:41.436 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:41.434+0000 7f1311012040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-28T21:51:41.439 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:41.437+0000 7fdbe662c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-28T21:51:41.574 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-03-28T21:51:41.572+0000 7f1311012040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-28T21:51:42.481 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:42.479+0000 7fdb86800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-28T21:51:42.481 INFO:tasks.ceph.mgr.y.smithi153.stderr:2024-03-28T21:51:42.479+0000 7fdb86800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-28T21:51:44.231 INFO:tasks.ceph.osd.6.smithi165.stderr:2024-03-28T21:51:44.229+0000 7fb50400c640 -1 osd.6 0 log_to_monitors true 2024-03-28T21:51:44.268 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-03-28T21:51:44.266+0000 7fb6ba8c8640 -1 osd.1 0 log_to_monitors true 2024-03-28T21:51:44.282 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-03-28T21:51:44.280+0000 7f9a2e40c640 -1 osd.4 0 log_to_monitors true 2024-03-28T21:51:44.317 INFO:tasks.ceph.osd.7.smithi165.stderr:2024-03-28T21:51:44.315+0000 7fdf9f699640 -1 osd.7 0 log_to_monitors true 2024-03-28T21:51:44.319 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-03-28T21:51:44.317+0000 7f3389149640 -1 osd.5 0 log_to_monitors true 2024-03-28T21:51:44.320 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-03-28T21:51:44.318+0000 7fb015618640 -1 osd.3 0 log_to_monitors true 2024-03-28T21:51:44.487 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-03-28T21:51:44.485+0000 7f43da011640 -1 osd.2 0 log_to_monitors true 2024-03-28T21:51:44.563 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-03-28T21:51:44.560+0000 7f2780185640 -1 osd.0 0 log_to_monitors true 2024-03-28T21:51:47.171 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-03-28T21:51:47.168+0000 7fb6b4e00640 -1 osd.1 0 waiting for initial osdmap 2024-03-28T21:51:47.188 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-03-28T21:51:47.186+0000 7fb6ab800640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T21:51:47.201 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-03-28T21:51:47.198+0000 7fb00f400640 -1 osd.3 0 waiting for initial osdmap 2024-03-28T21:51:47.252 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-03-28T21:51:47.250+0000 7fb005e00640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T21:51:47.841 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-03-28T21:51:47.839+0000 7f3383600640 -1 osd.5 0 waiting for initial osdmap 2024-03-28T21:51:47.848 INFO:tasks.ceph.osd.7.smithi165.stderr:2024-03-28T21:51:47.846+0000 7fdf9ba00640 -1 osd.7 0 waiting for initial osdmap 2024-03-28T21:51:47.850 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-03-28T21:51:47.848+0000 7f9a28200640 -1 osd.4 0 waiting for initial osdmap 2024-03-28T21:51:47.850 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-03-28T21:51:47.848+0000 7f337a000640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T21:51:47.857 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-03-28T21:51:47.855+0000 7f9a1ec00640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T21:51:47.858 INFO:tasks.ceph.osd.7.smithi165.stderr:2024-03-28T21:51:47.856+0000 7fdf90600640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T21:51:47.867 INFO:tasks.ceph.osd.6.smithi165.stderr:2024-03-28T21:51:47.865+0000 7fb4fde00640 -1 osd.6 0 waiting for initial osdmap 2024-03-28T21:51:47.874 INFO:tasks.ceph.osd.6.smithi165.stderr:2024-03-28T21:51:47.872+0000 7fb4f4800640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T21:51:48.094 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-03-28T21:51:48.091+0000 7f277a600640 -1 osd.0 0 waiting for initial osdmap 2024-03-28T21:51:48.100 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-03-28T21:51:48.097+0000 7f2771000640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T21:51:48.135 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-03-28T21:51:48.133+0000 7f43d5c00640 -1 osd.2 0 waiting for initial osdmap 2024-03-28T21:51:48.143 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-03-28T21:51:48.141+0000 7f43ca800640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T21:51:48.217 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-28T21:51:48.373 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.370+0000 7f138d400640 1 Processor -- start 2024-03-28T21:51:48.373 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.371+0000 7f138d400640 1 -- start start 2024-03-28T21:51:48.374 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.372+0000 7f138d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13881459d0 0x7f13880cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:48.374 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.372+0000 7f138d400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13880cea20 con 0x7f13880cc850 2024-03-28T21:51:48.374 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.372+0000 7f138d400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13880ced00 con 0x7f13880b2250 2024-03-28T21:51:48.375 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.372+0000 7f138d400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1388145db0 con 0x7f13881459d0 2024-03-28T21:51:48.375 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.372+0000 7f1385e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f13880cc850 0x7f13880b1b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50628/0 (socket says 172.21.15.153:50628) 2024-03-28T21:51:48.375 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.372+0000 7f1385e00640 1 -- 172.21.15.153:0/2303764247 learned_addr learned my addr 172.21.15.153:0/2303764247 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:51:48.379 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.372+0000 7f1386800640 1 --2- 172.21.15.153:0/2303764247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13881459d0 0x7f13880cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:48.379 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 -- 172.21.15.153:0/2303764247 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 11285341 0 0) 0x7f13880cea20 con 0x7f13880cc850 2024-03-28T21:51:48.379 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 -- 172.21.15.153:0/2303764247 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f136c003520 con 0x7f13880cc850 2024-03-28T21:51:48.379 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 -- 172.21.15.153:0/2303764247 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1982440769 0 0) 0x7f136c003520 con 0x7f13880cc850 2024-03-28T21:51:48.379 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 -- 172.21.15.153:0/2303764247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13881459d0 msgr2=0x7f13880cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:48.379 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 --2- 172.21.15.153:0/2303764247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13881459d0 0x7f13880cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.379 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 -- 172.21.15.153:0/2303764247 >> v1:172.21.15.165:6789/0 conn(0x7f13880b2250 legacy=0x7f1388070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:48.379 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 -- 172.21.15.153:0/2303764247 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13880cefe0 con 0x7f13880cc850 2024-03-28T21:51:48.379 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 -- 172.21.15.153:0/2303764247 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f1374001690 con 0x7f13880cc850 2024-03-28T21:51:48.379 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 -- 172.21.15.153:0/2303764247 >> v1:172.21.15.153:6789/0 conn(0x7f13880cc850 legacy=0x7f13880b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:48.379 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 --2- 172.21.15.153:0/2303764247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f136c003a50 0x7f136c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:48.379 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 --2- 172.21.15.153:0/2303764247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13881459d0 0x7f136c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:48.380 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 --2- 172.21.15.153:0/2303764247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f136c004d40 0x7f136c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:48.380 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 -- 172.21.15.153:0/2303764247 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1388145db0 con 0x7f136c004d40 2024-03-28T21:51:48.380 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 -- 172.21.15.153:0/2303764247 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f136c00bad0 con 0x7f136c003a50 2024-03-28T21:51:48.380 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1385400640 1 -- 172.21.15.153:0/2303764247 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f136c00bcd0 con 0x7f13881459d0 2024-03-28T21:51:48.380 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.373+0000 7f1387200640 1 --2- 172.21.15.153:0/2303764247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f136c004d40 0x7f136c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:48.380 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.374+0000 7f1385e00640 1 --2- 172.21.15.153:0/2303764247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13881459d0 0x7f136c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:48.380 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.374+0000 7f1386800640 1 --2- 172.21.15.153:0/2303764247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f136c003a50 0x7f136c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:48.380 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.374+0000 7f1387200640 1 -- 172.21.15.153:0/2303764247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13881459d0 msgr2=0x7f136c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:48.380 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.374+0000 7f1387200640 1 --2- 172.21.15.153:0/2303764247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13881459d0 0x7f136c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.380 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.374+0000 7f1387200640 1 -- 172.21.15.153:0/2303764247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f136c003a50 msgr2=0x7f136c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:48.380 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.374+0000 7f1387200640 1 --2- 172.21.15.153:0/2303764247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f136c003a50 0x7f136c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.380 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.374+0000 7f1387200640 1 -- 172.21.15.153:0/2303764247 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136c003520 con 0x7f136c004d40 2024-03-28T21:51:48.380 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.374+0000 7f1386800640 1 --2- 172.21.15.153:0/2303764247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f136c003a50 0x7f136c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:51:48.381 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.375+0000 7f1387200640 1 --2- 172.21.15.153:0/2303764247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f136c004d40 0x7f136c0051c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f13880b2f80 tx=0x7f136c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce48d338e5269d90 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:48.381 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.375+0000 7f1385400640 1 -- 172.21.15.153:0/2303764247 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1380001370 con 0x7f136c004d40 2024-03-28T21:51:48.381 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.375+0000 7f1385400640 1 -- 172.21.15.153:0/2303764247 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13800052d0 con 0x7f136c004d40 2024-03-28T21:51:48.381 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.375+0000 7f1385400640 1 -- 172.21.15.153:0/2303764247 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1380003830 con 0x7f136c004d40 2024-03-28T21:51:48.381 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.376+0000 7f138d400640 1 -- 172.21.15.153:0/2303764247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f136c004d40 msgr2=0x7f136c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:48.381 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.376+0000 7f138d400640 1 --2- 172.21.15.153:0/2303764247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f136c004d40 0x7f136c0051c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f13880b2f80 tx=0x7f136c005830 comp rx=0 tx=0).stop 2024-03-28T21:51:48.381 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.376+0000 7f1387200640 1 -- 172.21.15.153:0/2303764247 reap_dead start 2024-03-28T21:51:48.381 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.376+0000 7f138d400640 1 -- 172.21.15.153:0/2303764247 shutdown_connections 2024-03-28T21:51:48.381 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.376+0000 7f138d400640 1 -- 172.21.15.153:0/2303764247 >> 172.21.15.153:0/2303764247 conn(0x7f138806b170 msgr2=0x7f138806b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:48.381 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.376+0000 7f138d400640 1 -- 172.21.15.153:0/2303764247 shutdown_connections 2024-03-28T21:51:48.381 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.376+0000 7f138d400640 1 -- 172.21.15.153:0/2303764247 wait complete. 2024-03-28T21:51:48.384 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.377+0000 7f138d400640 1 Processor -- start 2024-03-28T21:51:48.384 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.378+0000 7f138d400640 1 -- start start 2024-03-28T21:51:48.384 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.378+0000 7f138d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f136c004d40 0x7f138813cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:48.384 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.378+0000 7f138d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1388141440 0x7f1388140470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:48.384 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.378+0000 7f138d400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13881409b0 0x7f1388143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:48.384 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.379+0000 7f138d400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f138806e030 con 0x7f1388141440 2024-03-28T21:51:48.384 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.379+0000 7f138d400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13880cd310 con 0x7f13881409b0 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.379+0000 7f138d400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f13880ccc90 con 0x7f136c004d40 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.379+0000 7f1385e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1388141440 0x7f1388140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.379+0000 7f1385e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1388141440 0x7f1388140470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47086/0 (socket says 172.21.15.153:47086) 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.379+0000 7f1385e00640 1 -- 172.21.15.153:0/3301452455 learned_addr learned my addr 172.21.15.153:0/3301452455 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.379+0000 7f1386800640 1 --2- 172.21.15.153:0/3301452455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f136c004d40 0x7f138813cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.379+0000 7f1387200640 1 --2- 172.21.15.153:0/3301452455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13881409b0 0x7f1388143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.379+0000 7f1385e00640 1 -- 172.21.15.153:0/3301452455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f136c004d40 msgr2=0x7f138813cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.379+0000 7f1385e00640 1 --2- 172.21.15.153:0/3301452455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f136c004d40 0x7f138813cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.379+0000 7f1385e00640 1 -- 172.21.15.153:0/3301452455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13881409b0 msgr2=0x7f1388143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.379+0000 7f1385e00640 1 --2- 172.21.15.153:0/3301452455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13881409b0 0x7f1388143e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.379+0000 7f1385e00640 1 -- 172.21.15.153:0/3301452455 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138813d0a0 con 0x7f1388141440 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.379+0000 7f1385e00640 1 --2- 172.21.15.153:0/3301452455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1388141440 0x7f1388140470 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f137400e700 tx=0x7f137400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.380+0000 7f137ea00640 1 -- 172.21.15.153:0/3301452455 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137400ee10 con 0x7f1388141440 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.380+0000 7f137ea00640 1 -- 172.21.15.153:0/3301452455 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1374018070 con 0x7f1388141440 2024-03-28T21:51:48.385 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.380+0000 7f138d400640 1 -- 172.21.15.153:0/3301452455 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1388142dd0 con 0x7f1388141440 2024-03-28T21:51:48.386 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.380+0000 7f137ea00640 1 -- 172.21.15.153:0/3301452455 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137400cb10 con 0x7f1388141440 2024-03-28T21:51:48.386 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.380+0000 7f138d400640 1 -- 172.21.15.153:0/3301452455 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1388143670 con 0x7f1388141440 2024-03-28T21:51:48.386 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.381+0000 7f138d400640 1 -- 172.21.15.153:0/3301452455 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13881431c0 con 0x7f1388141440 2024-03-28T21:51:48.386 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.382+0000 7f137ea00640 1 -- 172.21.15.153:0/3301452455 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) ==== 89724+0+0 (secure 0 0 0) 0x7f137400ccb0 con 0x7f1388141440 2024-03-28T21:51:48.386 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.383+0000 7f137ea00640 1 --2- 172.21.15.153:0/3301452455 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f136806b440 0x7f136806d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:48.387 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.383+0000 7f137ea00640 1 -- 172.21.15.153:0/3301452455 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 4471+0+0 (secure 0 0 0) 0x7f1374089af0 con 0x7f1388141440 2024-03-28T21:51:48.387 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.383+0000 7f1386800640 1 --2- 172.21.15.153:0/3301452455 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f136806b440 0x7f136806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:48.387 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.383+0000 7f1386800640 1 --2- 172.21.15.153:0/3301452455 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f136806b440 0x7f136806d900 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f13881eadc0 tx=0x7f137800d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:48.390 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.388+0000 7f137ea00640 1 -- 172.21.15.153:0/3301452455 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1374058f10 con 0x7f1388141440 2024-03-28T21:51:48.592 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.590+0000 7f138d400640 1 -- 172.21.15.153:0/3301452455 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f138806eed0 con 0x7f1388141440 2024-03-28T21:51:48.593 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.591+0000 7f137ea00640 1 -- 172.21.15.153:0/3301452455 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+10957 (secure 0 0 0) 0x7f1374058810 con 0x7f1388141440 2024-03-28T21:51:48.593 INFO:teuthology.misc.health.smithi153.stdout: 2024-03-28T21:51:48.593 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":14,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:48.177621+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:51:48.597 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.593+0000 7f138d400640 1 -- 172.21.15.153:0/3301452455 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f136806b440 msgr2=0x7f136806d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:48.597 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.593+0000 7f138d400640 1 --2- 172.21.15.153:0/3301452455 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f136806b440 0x7f136806d900 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f13881eadc0 tx=0x7f137800d040 comp rx=0 tx=0).stop 2024-03-28T21:51:48.597 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.593+0000 7f138d400640 1 -- 172.21.15.153:0/3301452455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1388141440 msgr2=0x7f1388140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:48.597 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.593+0000 7f138d400640 1 --2- 172.21.15.153:0/3301452455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1388141440 0x7f1388140470 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f137400e700 tx=0x7f137400ebc0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.598 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.594+0000 7f138d400640 1 -- 172.21.15.153:0/3301452455 shutdown_connections 2024-03-28T21:51:48.598 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.594+0000 7f138d400640 1 --2- 172.21.15.153:0/3301452455 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f136806b440 0x7f136806d900 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.598 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.594+0000 7f138d400640 1 --2- 172.21.15.153:0/3301452455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13881409b0 0x7f1388143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.598 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.594+0000 7f138d400640 1 --2- 172.21.15.153:0/3301452455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1388141440 0x7f1388140470 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.598 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.594+0000 7f138d400640 1 --2- 172.21.15.153:0/3301452455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f136c004d40 0x7f138813cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.598 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.594+0000 7f138d400640 1 -- 172.21.15.153:0/3301452455 >> 172.21.15.153:0/3301452455 conn(0x7f138806b170 msgr2=0x7f13880b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:48.599 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.594+0000 7f138d400640 1 -- 172.21.15.153:0/3301452455 shutdown_connections 2024-03-28T21:51:48.599 INFO:teuthology.misc.health.smithi153.stderr:2024-03-28T21:51:48.594+0000 7f138d400640 1 -- 172.21.15.153:0/3301452455 wait complete. 2024-03-28T21:51:48.611 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-28T21:51:48.612 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-28T21:51:48.612 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-28T21:51:48.612 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-28T21:51:48.618 INFO:tasks.ceph.mds.a:Started 2024-03-28T21:51:48.618 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-28T21:51:48.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-28T21:51:48.622 INFO:tasks.ceph.mds.c:Started 2024-03-28T21:51:48.623 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-28T21:51:48.623 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-28T21:51:48.631 INFO:tasks.ceph.mds.b:Started 2024-03-28T21:51:48.631 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-28T21:51:48.631 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-28T21:51:48.639 INFO:tasks.ceph.mds.d:Started 2024-03-28T21:51:48.639 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-28T21:51:48.639 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:51:48.770 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2024-03-28T21:51:48.771 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2024-03-28T21:51:48.789 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-03-28T21:51:48.802 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-03-28T21:51:48.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.823+0000 7f282ce00640 1 Processor -- start 2024-03-28T21:51:48.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.824+0000 7f282ce00640 1 -- start start 2024-03-28T21:51:48.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.825+0000 7f282ce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2828159a10 0x7f282815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:48.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.825+0000 7f282ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28280ad830 0x7f282806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:48.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.825+0000 7f282ce00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28280b2e60 con 0x7f282806e270 2024-03-28T21:51:48.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.825+0000 7f282ce00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f28280adc70 con 0x7f2828159a10 2024-03-28T21:51:48.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.825+0000 7f282ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2828159df0 con 0x7f28280ad830 2024-03-28T21:51:48.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.825+0000 7f281d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28280ad830 0x7f282806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:48.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.825+0000 7f281d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28280ad830 0x7f282806dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:46712/0 (socket says 172.21.15.153:46712) 2024-03-28T21:51:48.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.825+0000 7f281d400640 1 -- 172.21.15.153:0/460254681 learned_addr learned my addr 172.21.15.153:0/460254681 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:48.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.825+0000 7f2825e00640 1 --2- 172.21.15.153:0/460254681 >> v2:172.21.15.165:3300/0 conn(0x7f2828159a10 0x7f282815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:48.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.825+0000 7f2826800640 1 --1- 172.21.15.153:0/460254681 >> v1:172.21.15.165:6789/0 conn(0x7f282806e270 0x7f282815fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:45508/0 (socket says 172.21.15.153:45508) 2024-03-28T21:51:48.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.826+0000 7f281d400640 1 -- 172.21.15.153:0/460254681 >> v2:172.21.15.165:3300/0 conn(0x7f2828159a10 msgr2=0x7f282815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:48.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.826+0000 7f281d400640 1 --2- 172.21.15.153:0/460254681 >> v2:172.21.15.165:3300/0 conn(0x7f2828159a10 0x7f282815cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.826+0000 7f281d400640 1 -- 172.21.15.153:0/460254681 >> v1:172.21.15.165:6789/0 conn(0x7f282806e270 legacy=0x7f282815fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:48.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.826+0000 7f281d400640 1 -- 172.21.15.153:0/460254681 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28280adf10 con 0x7f28280ad830 2024-03-28T21:51:48.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.826+0000 7f2825e00640 1 --2- 172.21.15.153:0/460254681 >> v2:172.21.15.165:3300/0 conn(0x7f2828159a10 0x7f282815cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:51:48.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.827+0000 7f281d400640 1 --2- 172.21.15.153:0/460254681 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28280ad830 0x7f282806dd30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2810009870 tx=0x7f281002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20cc0a1a6426de74 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:48.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.827+0000 7f2825400640 1 -- 172.21.15.153:0/460254681 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810035020 con 0x7f28280ad830 2024-03-28T21:51:48.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.827+0000 7f2825400640 1 -- 172.21.15.153:0/460254681 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2810031640 con 0x7f28280ad830 2024-03-28T21:51:48.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.827+0000 7f2825400640 1 -- 172.21.15.153:0/460254681 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281002d040 con 0x7f28280ad830 2024-03-28T21:51:48.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.828+0000 7f282ce00640 1 -- 172.21.15.153:0/460254681 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28280ad830 msgr2=0x7f282806dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:48.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.828+0000 7f282ce00640 1 --2- 172.21.15.153:0/460254681 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28280ad830 0x7f282806dd30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2810009870 tx=0x7f281002b8f0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.828+0000 7f282ce00640 1 -- 172.21.15.153:0/460254681 shutdown_connections 2024-03-28T21:51:48.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.828+0000 7f282ce00640 1 --2- 172.21.15.153:0/460254681 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28280ad830 0x7f282806dd30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.828+0000 7f282ce00640 1 --2- 172.21.15.153:0/460254681 >> v2:172.21.15.165:3300/0 conn(0x7f2828159a10 0x7f282815cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.828+0000 7f282ce00640 1 -- 172.21.15.153:0/460254681 >> 172.21.15.153:0/460254681 conn(0x7f28280b1a30 msgr2=0x7f28280b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:48.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.828+0000 7f282ce00640 1 -- 172.21.15.153:0/460254681 shutdown_connections 2024-03-28T21:51:48.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.828+0000 7f282ce00640 1 -- 172.21.15.153:0/460254681 wait complete. 2024-03-28T21:51:48.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.829+0000 7f282ce00640 1 Processor -- start 2024-03-28T21:51:48.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.830+0000 7f282ce00640 1 -- start start 2024-03-28T21:51:48.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.830+0000 7f282ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f282806e270 0x7f28281f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:48.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.830+0000 7f282ce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280ad830 0x7f28281efde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:48.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f282ce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2828159a10 0x7f2828071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:48.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f282ce00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f28280ae4d0 con 0x7f28280ad830 2024-03-28T21:51:48.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f282ce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f28280b3100 con 0x7f2828159a10 2024-03-28T21:51:48.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f282ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f28280b4630 con 0x7f282806e270 2024-03-28T21:51:48.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f281d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280ad830 0x7f28281efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:48.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f281d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280ad830 0x7f28281efde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47118/0 (socket says 172.21.15.153:47118) 2024-03-28T21:51:48.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f281d400640 1 -- 172.21.15.153:0/418109494 learned_addr learned my addr 172.21.15.153:0/418109494 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:48.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f2826800640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2828159a10 0x7f2828071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:48.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f2825e00640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f282806e270 0x7f28281f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:48.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f281d400640 1 -- 172.21.15.153:0/418109494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f282806e270 msgr2=0x7f28281f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:48.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f281d400640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f282806e270 0x7f28281f2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f281d400640 1 -- 172.21.15.153:0/418109494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2828159a10 msgr2=0x7f2828071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:48.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f281d400640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2828159a10 0x7f2828071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:48.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f281d400640 1 -- 172.21.15.153:0/418109494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28280ce870 con 0x7f28280ad830 2024-03-28T21:51:48.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.831+0000 7f2826800640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2828159a10 0x7f2828071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:51:48.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.832+0000 7f281d400640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280ad830 0x7f28281efde0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2810000c00 tx=0x7f28100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:48.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.832+0000 7f281ea00640 1 -- 172.21.15.153:0/418109494 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810040070 con 0x7f28280ad830 2024-03-28T21:51:48.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.832+0000 7f281ea00640 1 -- 172.21.15.153:0/418109494 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28100399f0 con 0x7f28280ad830 2024-03-28T21:51:48.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.832+0000 7f281ea00640 1 -- 172.21.15.153:0/418109494 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810035040 con 0x7f28280ad830 2024-03-28T21:51:48.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.832+0000 7f282ce00640 1 -- 172.21.15.153:0/418109494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282809aaf0 con 0x7f28280ad830 2024-03-28T21:51:48.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.832+0000 7f282ce00640 1 -- 172.21.15.153:0/418109494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282809b0b0 con 0x7f28280ad830 2024-03-28T21:51:48.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.833+0000 7f282ce00640 1 -- 172.21.15.153:0/418109494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2828068ff0 con 0x7f28280ad830 2024-03-28T21:51:48.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.834+0000 7f281ea00640 1 -- 172.21.15.153:0/418109494 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) ==== 89724+0+0 (secure 0 0 0) 0x7f281004b060 con 0x7f28280ad830 2024-03-28T21:51:48.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.835+0000 7f281ea00640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f280406b440 0x7f280406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:48.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.835+0000 7f281ea00640 1 -- 172.21.15.153:0/418109494 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 4471+0+0 (secure 0 0 0) 0x7f28100ab450 con 0x7f28280ad830 2024-03-28T21:51:48.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.835+0000 7f2825e00640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f280406b440 0x7f280406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:48.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.836+0000 7f2825e00640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f280406b440 0x7f280406d900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2818009560 tx=0x7f2818009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:48.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:48.839+0000 7f281ea00640 1 -- 172.21.15.153:0/418109494 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f281007a7e0 con 0x7f28280ad830 2024-03-28T21:51:49.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.030+0000 7f282ce00640 1 -- 172.21.15.153:0/418109494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28280aea60 con 0x7f28280ad830 2024-03-28T21:51:49.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.031+0000 7f281ea00640 1 -- 172.21.15.153:0/418109494 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+10957 (secure 0 0 0) 0x7f281007a0e0 con 0x7f28280ad830 2024-03-28T21:51:49.034 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:51:49.034 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":14,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:48.177621+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:51:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.034+0000 7f282ce00640 1 -- 172.21.15.153:0/418109494 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f280406b440 msgr2=0x7f280406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.034+0000 7f282ce00640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f280406b440 0x7f280406d900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2818009560 tx=0x7f2818009190 comp rx=0 tx=0).stop 2024-03-28T21:51:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.034+0000 7f282ce00640 1 -- 172.21.15.153:0/418109494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280ad830 msgr2=0x7f28281efde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.034+0000 7f282ce00640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280ad830 0x7f28281efde0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2810000c00 tx=0x7f28100046c0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.034+0000 7f282ce00640 1 -- 172.21.15.153:0/418109494 shutdown_connections 2024-03-28T21:51:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.034+0000 7f282ce00640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f280406b440 0x7f280406d900 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.034+0000 7f282ce00640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2828159a10 0x7f2828071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.034+0000 7f282ce00640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280ad830 0x7f28281efde0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.034+0000 7f282ce00640 1 --2- 172.21.15.153:0/418109494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f282806e270 0x7f28281f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.034+0000 7f282ce00640 1 -- 172.21.15.153:0/418109494 >> 172.21.15.153:0/418109494 conn(0x7f28280b1a30 msgr2=0x7f2828155e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:49.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.034+0000 7f282ce00640 1 -- 172.21.15.153:0/418109494 shutdown_connections 2024-03-28T21:51:49.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.035+0000 7f282ce00640 1 -- 172.21.15.153:0/418109494 wait complete. 2024-03-28T21:51:49.053 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-03-28T21:51:49.054 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T21:51:49.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.252+0000 7f8728600640 1 Processor -- start 2024-03-28T21:51:49.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.252+0000 7f8728600640 1 -- start start 2024-03-28T21:51:49.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.253+0000 7f8728600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8720159a10 0x7f872015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:49.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.253+0000 7f8728600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f87200ad830 0x7f872006dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:49.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.253+0000 7f8728600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87200b2e60 con 0x7f872006e270 2024-03-28T21:51:49.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.253+0000 7f8728600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f87200adc70 con 0x7f87200ad830 2024-03-28T21:51:49.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.253+0000 7f8728600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8720159df0 con 0x7f8720159a10 2024-03-28T21:51:49.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.254+0000 7f8725c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8720159a10 0x7f872015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:49.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.254+0000 7f8725c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8720159a10 0x7f872015cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:46724/0 (socket says 172.21.15.153:46724) 2024-03-28T21:51:49.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.254+0000 7f8725c00640 1 -- 172.21.15.153:0/2662275951 learned_addr learned my addr 172.21.15.153:0/2662275951 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:49.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.254+0000 7f8725200640 1 --2- 172.21.15.153:0/2662275951 >> v2:172.21.15.165:3300/0 conn(0x7f87200ad830 0x7f872006dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:49.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.255+0000 7f8725c00640 1 -- 172.21.15.153:0/2662275951 >> v2:172.21.15.165:3300/0 conn(0x7f87200ad830 msgr2=0x7f872006dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:49.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.255+0000 7f8725c00640 1 --2- 172.21.15.153:0/2662275951 >> v2:172.21.15.165:3300/0 conn(0x7f87200ad830 0x7f872006dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.255+0000 7f8725c00640 1 -- 172.21.15.153:0/2662275951 >> v1:172.21.15.165:6789/0 conn(0x7f872006e270 legacy=0x7f872015fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:49.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.255+0000 7f8725c00640 1 -- 172.21.15.153:0/2662275951 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87200adf10 con 0x7f8720159a10 2024-03-28T21:51:49.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.255+0000 7f8725200640 1 --2- 172.21.15.153:0/2662275951 >> v2:172.21.15.165:3300/0 conn(0x7f87200ad830 0x7f872006dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:51:49.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.256+0000 7f8725c00640 1 --2- 172.21.15.153:0/2662275951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8720159a10 0x7f872015cf00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8714009870 tx=0x7f871402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36c7c19c8dd1c83a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:49.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.257+0000 7f871fe00640 1 -- 172.21.15.153:0/2662275951 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714035020 con 0x7f8720159a10 2024-03-28T21:51:49.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.257+0000 7f871fe00640 1 -- 172.21.15.153:0/2662275951 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8714031640 con 0x7f8720159a10 2024-03-28T21:51:49.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.257+0000 7f871fe00640 1 -- 172.21.15.153:0/2662275951 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871402d040 con 0x7f8720159a10 2024-03-28T21:51:49.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.257+0000 7f8728600640 1 -- 172.21.15.153:0/2662275951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8720159a10 msgr2=0x7f872015cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:49.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.257+0000 7f8728600640 1 --2- 172.21.15.153:0/2662275951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8720159a10 0x7f872015cf00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8714009870 tx=0x7f871402b8f0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.258+0000 7f8728600640 1 -- 172.21.15.153:0/2662275951 shutdown_connections 2024-03-28T21:51:49.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.258+0000 7f8728600640 1 --2- 172.21.15.153:0/2662275951 >> v2:172.21.15.165:3300/0 conn(0x7f87200ad830 0x7f872006dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.258+0000 7f8728600640 1 --2- 172.21.15.153:0/2662275951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8720159a10 0x7f872015cf00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.258+0000 7f8728600640 1 -- 172.21.15.153:0/2662275951 >> 172.21.15.153:0/2662275951 conn(0x7f87200b1a30 msgr2=0x7f87200b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:49.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.258+0000 7f8728600640 1 -- 172.21.15.153:0/2662275951 shutdown_connections 2024-03-28T21:51:49.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.258+0000 7f8728600640 1 -- 172.21.15.153:0/2662275951 wait complete. 2024-03-28T21:51:49.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.259+0000 7f8728600640 1 Processor -- start 2024-03-28T21:51:49.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.259+0000 7f8728600640 1 -- start start 2024-03-28T21:51:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.260+0000 7f8728600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872006e270 0x7f872009bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.260+0000 7f8728600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87200ad830 0x7f8720071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.260+0000 7f8728600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8720159a10 0x7f87201e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.260+0000 7f8728600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f87200ae4d0 con 0x7f872006e270 2024-03-28T21:51:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.260+0000 7f8728600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f87200b3100 con 0x7f8720159a10 2024-03-28T21:51:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.260+0000 7f8728600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f87200b4630 con 0x7f87200ad830 2024-03-28T21:51:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.260+0000 7f8725c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872006e270 0x7f872009bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.260+0000 7f8725c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872006e270 0x7f872009bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47128/0 (socket says 172.21.15.153:47128) 2024-03-28T21:51:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.260+0000 7f8725c00640 1 -- 172.21.15.153:0/2563690816 learned_addr learned my addr 172.21.15.153:0/2563690816 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.261+0000 7f8725200640 1 --2- 172.21.15.153:0/2563690816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87200ad830 0x7f8720071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.261+0000 7f8725c00640 1 -- 172.21.15.153:0/2563690816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87200ad830 msgr2=0x7f8720071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.261+0000 7f8725c00640 1 --2- 172.21.15.153:0/2563690816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87200ad830 0x7f8720071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.261+0000 7f8726600640 1 --2- 172.21.15.153:0/2563690816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8720159a10 0x7f87201e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.261+0000 7f8725c00640 1 -- 172.21.15.153:0/2563690816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8720159a10 msgr2=0x7f87201e66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.261+0000 7f8725c00640 1 --2- 172.21.15.153:0/2563690816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8720159a10 0x7f87201e66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.261+0000 7f8725c00640 1 -- 172.21.15.153:0/2563690816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872009c870 con 0x7f872006e270 2024-03-28T21:51:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.261+0000 7f8725c00640 1 --2- 172.21.15.153:0/2563690816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872006e270 0x7f872009bf40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8714000c00 tx=0x7f87140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.261+0000 7f871d600640 1 -- 172.21.15.153:0/2563690816 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714040070 con 0x7f872006e270 2024-03-28T21:51:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.261+0000 7f871d600640 1 -- 172.21.15.153:0/2563690816 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87140399f0 con 0x7f872006e270 2024-03-28T21:51:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.261+0000 7f8728600640 1 -- 172.21.15.153:0/2563690816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f872009cb50 con 0x7f872006e270 2024-03-28T21:51:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.261+0000 7f871d600640 1 -- 172.21.15.153:0/2563690816 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714035040 con 0x7f872006e270 2024-03-28T21:51:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.262+0000 7f8728600640 1 -- 172.21.15.153:0/2563690816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f872009d110 con 0x7f872006e270 2024-03-28T21:51:49.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.263+0000 7f8728600640 1 -- 172.21.15.153:0/2563690816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8720068ff0 con 0x7f872006e270 2024-03-28T21:51:49.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.263+0000 7f871d600640 1 -- 172.21.15.153:0/2563690816 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) ==== 89724+0+0 (secure 0 0 0) 0x7f871404b060 con 0x7f872006e270 2024-03-28T21:51:49.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.265+0000 7f871d600640 1 --2- 172.21.15.153:0/2563690816 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f870006b440 0x7f870006d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:49.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.265+0000 7f871d600640 1 -- 172.21.15.153:0/2563690816 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4471+0+0 (secure 0 0 0) 0x7f87140ab4e0 con 0x7f872006e270 2024-03-28T21:51:49.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.265+0000 7f8725200640 1 --2- 172.21.15.153:0/2563690816 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f870006b440 0x7f870006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:49.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.265+0000 7f8725200640 1 --2- 172.21.15.153:0/2563690816 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f870006b440 0x7f870006d900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f870c009560 tx=0x7f870c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:49.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.269+0000 7f871d600640 1 -- 172.21.15.153:0/2563690816 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f871407a880 con 0x7f872006e270 2024-03-28T21:51:49.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.504+0000 7f8728600640 1 -- 172.21.15.153:0/2563690816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f872006cf30 con 0x7f872006e270 2024-03-28T21:51:49.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.533+0000 7f871d600640 1 -- 172.21.15.153:0/2563690816 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f871407a180 con 0x7f872006e270 2024-03-28T21:51:49.536 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:51:49.536 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/3516257974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3516257974},{"type":"v1","addr":"172.21.15.153:6836","nonce":3516257974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-28T21:51:49.536 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 2 2024-03-28T21:51:49.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.536+0000 7f8728600640 1 -- 172.21.15.153:0/2563690816 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f870006b440 msgr2=0x7f870006d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:49.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.536+0000 7f8728600640 1 --2- 172.21.15.153:0/2563690816 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f870006b440 0x7f870006d900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f870c009560 tx=0x7f870c008040 comp rx=0 tx=0).stop 2024-03-28T21:51:49.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.536+0000 7f8728600640 1 -- 172.21.15.153:0/2563690816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872006e270 msgr2=0x7f872009bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:49.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.536+0000 7f8728600640 1 --2- 172.21.15.153:0/2563690816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872006e270 0x7f872009bf40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8714000c00 tx=0x7f87140046c0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.536+0000 7f8728600640 1 -- 172.21.15.153:0/2563690816 shutdown_connections 2024-03-28T21:51:49.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.536+0000 7f8728600640 1 --2- 172.21.15.153:0/2563690816 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f870006b440 0x7f870006d900 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.536+0000 7f8728600640 1 --2- 172.21.15.153:0/2563690816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8720159a10 0x7f87201e66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.536+0000 7f8728600640 1 --2- 172.21.15.153:0/2563690816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87200ad830 0x7f8720071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.536+0000 7f8728600640 1 --2- 172.21.15.153:0/2563690816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f872006e270 0x7f872009bf40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:49.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.537+0000 7f8728600640 1 -- 172.21.15.153:0/2563690816 >> 172.21.15.153:0/2563690816 conn(0x7f87200b1a30 msgr2=0x7f87200b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:49.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.537+0000 7f8728600640 1 -- 172.21.15.153:0/2563690816 shutdown_connections 2024-03-28T21:51:49.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:49.537+0000 7f8728600640 1 -- 172.21.15.153:0/2563690816 wait complete. 2024-03-28T21:51:50.966 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:51:50.974 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:51:51.556 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T21:51:51.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.779+0000 7fc923200640 1 Processor -- start 2024-03-28T21:51:51.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.779+0000 7fc923200640 1 -- start start 2024-03-28T21:51:51.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.780+0000 7fc923200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9240d02c0 0x7fc9240b5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:51.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.780+0000 7fc923200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc924162b90 con 0x7fc924161d80 2024-03-28T21:51:51.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.780+0000 7fc923200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9240d2820 con 0x7fc9240b3820 2024-03-28T21:51:51.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.780+0000 7fc923200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc9240d2b00 con 0x7fc9240d02c0 2024-03-28T21:51:51.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.780+0000 7fc921e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc924161d80 0x7fc924162160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50636/0 (socket says 172.21.15.153:50636) 2024-03-28T21:51:51.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.780+0000 7fc921e00640 1 -- 172.21.15.153:0/1600974407 learned_addr learned my addr 172.21.15.153:0/1600974407 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:51:51.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.780+0000 7fc920a00640 1 -- 172.21.15.153:0/1600974407 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328634036 0 0) 0x7fc924162b90 con 0x7fc924161d80 2024-03-28T21:51:51.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.780+0000 7fc922800640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9240d02c0 0x7fc9240b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc920a00640 1 -- 172.21.15.153:0/1600974407 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc908003520 con 0x7fc924161d80 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc920a00640 1 -- 172.21.15.153:0/1600974407 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1492420820 0 0) 0x7fc908003520 con 0x7fc924161d80 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc920a00640 1 -- 172.21.15.153:0/1600974407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9240d02c0 msgr2=0x7fc9240b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc920a00640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9240d02c0 0x7fc9240b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc920a00640 1 -- 172.21.15.153:0/1600974407 >> v1:172.21.15.165:6789/0 conn(0x7fc9240b3820 legacy=0x7fc9240cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc920a00640 1 -- 172.21.15.153:0/1600974407 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9240d2de0 con 0x7fc924161d80 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc920a00640 1 -- 172.21.15.153:0/1600974407 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fc914001670 con 0x7fc924161d80 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc922800640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9240d02c0 0x7fc9240b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc920a00640 1 -- 172.21.15.153:0/1600974407 >> v1:172.21.15.153:6789/0 conn(0x7fc924161d80 legacy=0x7fc924162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc920a00640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc908003a50 0x7fc908003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc920a00640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9240d02c0 0x7fc908004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc920a00640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908004d90 0x7fc908005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc920a00640 1 -- 172.21.15.153:0/1600974407 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc9240d2b00 con 0x7fc908004d90 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc920a00640 1 -- 172.21.15.153:0/1600974407 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc90800bc20 con 0x7fc908003a50 2024-03-28T21:51:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc920a00640 1 -- 172.21.15.153:0/1600974407 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc90800be20 con 0x7fc9240d02c0 2024-03-28T21:51:51.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.781+0000 7fc922800640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908004d90 0x7fc908005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:51.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.782+0000 7fc921400640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9240d02c0 0x7fc908004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:51.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.782+0000 7fc921e00640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc908003a50 0x7fc908003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:51.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.782+0000 7fc922800640 1 -- 172.21.15.153:0/1600974407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9240d02c0 msgr2=0x7fc908004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:51.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.782+0000 7fc922800640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9240d02c0 0x7fc908004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:51.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.782+0000 7fc922800640 1 -- 172.21.15.153:0/1600974407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc908003a50 msgr2=0x7fc908003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:51.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.782+0000 7fc922800640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc908003a50 0x7fc908003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:51.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.782+0000 7fc922800640 1 -- 172.21.15.153:0/1600974407 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc908003520 con 0x7fc908004d90 2024-03-28T21:51:51.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.782+0000 7fc921400640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9240d02c0 0x7fc908004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:51:51.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.782+0000 7fc921e00640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc908003a50 0x7fc908003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:51:51.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.783+0000 7fc922800640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908004d90 0x7fc908005210 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0073b0 tx=0x7fc908005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96497c648be7c840 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:51.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.783+0000 7fc920a00640 1 -- 172.21.15.153:0/1600974407 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c039070 con 0x7fc908004d90 2024-03-28T21:51:51.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.783+0000 7fc920a00640 1 -- 172.21.15.153:0/1600974407 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c02cd30 con 0x7fc908004d90 2024-03-28T21:51:51.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.783+0000 7fc920a00640 1 -- 172.21.15.153:0/1600974407 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c009c80 con 0x7fc908004d90 2024-03-28T21:51:51.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.784+0000 7fc923200640 1 -- 172.21.15.153:0/1600974407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908004d90 msgr2=0x7fc908005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:51.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.784+0000 7fc923200640 1 --2- 172.21.15.153:0/1600974407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc908004d90 0x7fc908005210 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0073b0 tx=0x7fc908005830 comp rx=0 tx=0).stop 2024-03-28T21:51:51.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.784+0000 7fc922800640 1 -- 172.21.15.153:0/1600974407 reap_dead start 2024-03-28T21:51:51.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.784+0000 7fc923200640 1 -- 172.21.15.153:0/1600974407 shutdown_connections 2024-03-28T21:51:51.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.784+0000 7fc923200640 1 -- 172.21.15.153:0/1600974407 >> 172.21.15.153:0/1600974407 conn(0x7fc9240d3f10 msgr2=0x7fc9240d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:51.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.784+0000 7fc923200640 1 -- 172.21.15.153:0/1600974407 shutdown_connections 2024-03-28T21:51:51.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.784+0000 7fc923200640 1 -- 172.21.15.153:0/1600974407 wait complete. 2024-03-28T21:51:51.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.786+0000 7fc923200640 1 Processor -- start 2024-03-28T21:51:51.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.786+0000 7fc923200640 1 -- start start 2024-03-28T21:51:51.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.787+0000 7fc923200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9241f4090 0x7fc9240b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:51.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.787+0000 7fc923200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9241f4470 0x7fc92415bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:51.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.787+0000 7fc923200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc92415c040 0x7fc9241f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:51.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.787+0000 7fc923200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc9240ceae0 con 0x7fc9241f4090 2024-03-28T21:51:51.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.787+0000 7fc923200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc924161a60 con 0x7fc92415c040 2024-03-28T21:51:51.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.787+0000 7fc923200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc9240cec60 con 0x7fc9241f4470 2024-03-28T21:51:51.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.787+0000 7fc921e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9241f4090 0x7fc9240b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:51.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.787+0000 7fc921e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9241f4090 0x7fc9240b6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47164/0 (socket says 172.21.15.153:47164) 2024-03-28T21:51:51.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.787+0000 7fc921e00640 1 -- 172.21.15.153:0/2396648908 learned_addr learned my addr 172.21.15.153:0/2396648908 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:51.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.787+0000 7fc921400640 1 --2- 172.21.15.153:0/2396648908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9241f4470 0x7fc92415bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:51.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.787+0000 7fc921e00640 1 -- 172.21.15.153:0/2396648908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9241f4470 msgr2=0x7fc92415bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:51.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.788+0000 7fc921e00640 1 --2- 172.21.15.153:0/2396648908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9241f4470 0x7fc92415bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:51.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.788+0000 7fc921e00640 1 -- 172.21.15.153:0/2396648908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc92415c040 msgr2=0x7fc9241f7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:51.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.788+0000 7fc922800640 1 --2- 172.21.15.153:0/2396648908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc92415c040 0x7fc9241f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:51.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.788+0000 7fc921e00640 1 --2- 172.21.15.153:0/2396648908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc92415c040 0x7fc9241f7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:51.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.788+0000 7fc921e00640 1 -- 172.21.15.153:0/2396648908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9240b6fd0 con 0x7fc9241f4090 2024-03-28T21:51:51.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.788+0000 7fc921e00640 1 --2- 172.21.15.153:0/2396648908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9241f4090 0x7fc9240b6a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc91400d7f0 tx=0x7fc91400dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:51.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.788+0000 7fc91a000640 1 -- 172.21.15.153:0/2396648908 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914019070 con 0x7fc9241f4090 2024-03-28T21:51:51.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.788+0000 7fc91a000640 1 -- 172.21.15.153:0/2396648908 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc914004cb0 con 0x7fc9241f4090 2024-03-28T21:51:51.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.788+0000 7fc91a000640 1 -- 172.21.15.153:0/2396648908 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914004e60 con 0x7fc9241f4090 2024-03-28T21:51:51.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.788+0000 7fc923200640 1 -- 172.21.15.153:0/2396648908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9241f8c60 con 0x7fc9241f4090 2024-03-28T21:51:51.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.788+0000 7fc923200640 1 -- 172.21.15.153:0/2396648908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc92415fee0 con 0x7fc9241f4090 2024-03-28T21:51:51.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.790+0000 7fc923200640 1 -- 172.21.15.153:0/2396648908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc92404f520 con 0x7fc9241f4090 2024-03-28T21:51:51.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.791+0000 7fc91a000640 1 -- 172.21.15.153:0/2396648908 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) ==== 89724+0+0 (secure 0 0 0) 0x7fc914007310 con 0x7fc9241f4090 2024-03-28T21:51:51.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.792+0000 7fc91a000640 1 --2- 172.21.15.153:0/2396648908 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc90406b470 0x7fc90406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:51.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.792+0000 7fc91a000640 1 -- 172.21.15.153:0/2396648908 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fc914089840 con 0x7fc9241f4090 2024-03-28T21:51:51.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.792+0000 7fc921400640 1 --2- 172.21.15.153:0/2396648908 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc90406b470 0x7fc90406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:51.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.792+0000 7fc921400640 1 --2- 172.21.15.153:0/2396648908 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc90406b470 0x7fc90406d930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc910000f60 tx=0x7fc910009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:51.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:51.797+0000 7fc91a000640 1 -- 172.21.15.153:0/2396648908 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc914058ae0 con 0x7fc9241f4090 2024-03-28T21:51:52.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.039+0000 7fc923200640 1 -- 172.21.15.153:0/2396648908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc92415c420 con 0x7fc9241f4090 2024-03-28T21:51:52.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.039+0000 7fc91a000640 1 -- 172.21.15.153:0/2396648908 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7fc9140583e0 con 0x7fc9241f4090 2024-03-28T21:51:52.042 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:51:52.042 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/207550071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":207550071},{"type":"v1","addr":"172.21.15.165:6835","nonce":207550071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/900073633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":900073633},{"type":"v1","addr":"172.21.15.153:6837","nonce":900073633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3915706377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3915706377},{"type":"v1","addr":"172.21.15.165:6833","nonce":3915706377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/3516257974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3516257974},{"type":"v1","addr":"172.21.15.153:6836","nonce":3516257974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-28T21:51:52.042 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 3 2024-03-28T21:51:52.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.042+0000 7fc923200640 1 -- 172.21.15.153:0/2396648908 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc90406b470 msgr2=0x7fc90406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:52.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.042+0000 7fc923200640 1 --2- 172.21.15.153:0/2396648908 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc90406b470 0x7fc90406d930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc910000f60 tx=0x7fc910009040 comp rx=0 tx=0).stop 2024-03-28T21:51:52.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.042+0000 7fc923200640 1 -- 172.21.15.153:0/2396648908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9241f4090 msgr2=0x7fc9240b6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:52.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.042+0000 7fc923200640 1 --2- 172.21.15.153:0/2396648908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9241f4090 0x7fc9240b6a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc91400d7f0 tx=0x7fc91400dcb0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.042+0000 7fc923200640 1 -- 172.21.15.153:0/2396648908 shutdown_connections 2024-03-28T21:51:52.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.042+0000 7fc923200640 1 --2- 172.21.15.153:0/2396648908 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc90406b470 0x7fc90406d930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.042+0000 7fc923200640 1 --2- 172.21.15.153:0/2396648908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc92415c040 0x7fc9241f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.042+0000 7fc923200640 1 --2- 172.21.15.153:0/2396648908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9241f4470 0x7fc92415bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.042+0000 7fc923200640 1 --2- 172.21.15.153:0/2396648908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9241f4090 0x7fc9240b6a90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.042+0000 7fc923200640 1 -- 172.21.15.153:0/2396648908 >> 172.21.15.153:0/2396648908 conn(0x7fc9240d3f10 msgr2=0x7fc924162160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:52.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.042+0000 7fc923200640 1 -- 172.21.15.153:0/2396648908 shutdown_connections 2024-03-28T21:51:52.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.042+0000 7fc923200640 1 -- 172.21.15.153:0/2396648908 wait complete. 2024-03-28T21:51:52.067 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:51:52.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.262+0000 7f9c7f200640 1 Processor -- start 2024-03-28T21:51:52.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.262+0000 7f9c7f200640 1 -- start start 2024-03-28T21:51:52.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.264+0000 7f9c7f200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9c78161d80 0x7f9c780b5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:52.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.264+0000 7f9c7f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c780d02c0 0x7f9c780cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:52.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.264+0000 7f9c7f200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c78162b90 con 0x7f9c780b3820 2024-03-28T21:51:52.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.264+0000 7f9c7f200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9c780d2820 con 0x7f9c78161d80 2024-03-28T21:51:52.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.264+0000 7f9c7f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9c780d2b00 con 0x7f9c780d02c0 2024-03-28T21:51:52.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.264+0000 7f9c7de00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9c78161d80 0x7f9c780b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:52.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.264+0000 7f9c7de00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9c78161d80 0x7f9c780b5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47166/0 (socket says 172.21.15.153:47166) 2024-03-28T21:51:52.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.264+0000 7f9c7de00640 1 -- 172.21.15.153:0/2114499879 learned_addr learned my addr 172.21.15.153:0/2114499879 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:52.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.265+0000 7f9c7e800640 1 --2- 172.21.15.153:0/2114499879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c780d02c0 0x7f9c780cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:52.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.265+0000 7f9c7de00640 1 -- 172.21.15.153:0/2114499879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c780d02c0 msgr2=0x7f9c780cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:52.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.265+0000 7f9c7de00640 1 --2- 172.21.15.153:0/2114499879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c780d02c0 0x7f9c780cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.265+0000 7f9c7de00640 1 -- 172.21.15.153:0/2114499879 >> v1:172.21.15.165:6789/0 conn(0x7f9c780b3820 legacy=0x7f9c78162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:52.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.265+0000 7f9c7de00640 1 -- 172.21.15.153:0/2114499879 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c780d2de0 con 0x7f9c78161d80 2024-03-28T21:51:52.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.265+0000 7f9c7e800640 1 --2- 172.21.15.153:0/2114499879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c780d02c0 0x7f9c780cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:51:52.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.266+0000 7f9c7de00640 1 --2- 172.21.15.153:0/2114499879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78161d80 0x7f9c780b5340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009870 tx=0x7f9c6c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9ea13c7e5e4699 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:52.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.266+0000 7f9c7ca00640 1 -- 172.21.15.153:0/2114499879 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0317c0 con 0x7f9c78161d80 2024-03-28T21:51:52.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.266+0000 7f9c7ca00640 1 -- 172.21.15.153:0/2114499879 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c6c037070 con 0x7f9c78161d80 2024-03-28T21:51:52.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.266+0000 7f9c7ca00640 1 -- 172.21.15.153:0/2114499879 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c031b80 con 0x7f9c78161d80 2024-03-28T21:51:52.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.267+0000 7f9c7f200640 1 -- 172.21.15.153:0/2114499879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78161d80 msgr2=0x7f9c780b5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:52.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.267+0000 7f9c7f200640 1 --2- 172.21.15.153:0/2114499879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78161d80 0x7f9c780b5340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009870 tx=0x7f9c6c02b860 comp rx=0 tx=0).stop 2024-03-28T21:51:52.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.267+0000 7f9c7f200640 1 -- 172.21.15.153:0/2114499879 shutdown_connections 2024-03-28T21:51:52.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.267+0000 7f9c7f200640 1 --2- 172.21.15.153:0/2114499879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c780d02c0 0x7f9c780cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.267+0000 7f9c7f200640 1 --2- 172.21.15.153:0/2114499879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78161d80 0x7f9c780b5340 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.267+0000 7f9c7f200640 1 -- 172.21.15.153:0/2114499879 >> 172.21.15.153:0/2114499879 conn(0x7f9c780d3f10 msgr2=0x7f9c780d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:52.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.267+0000 7f9c7f200640 1 -- 172.21.15.153:0/2114499879 shutdown_connections 2024-03-28T21:51:52.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.267+0000 7f9c7f200640 1 -- 172.21.15.153:0/2114499879 wait complete. 2024-03-28T21:51:52.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.269+0000 7f9c7f200640 1 Processor -- start 2024-03-28T21:51:52.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.269+0000 7f9c7f200640 1 -- start start 2024-03-28T21:51:52.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.270+0000 7f9c7f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c780b3820 0x7f9c780b94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:52.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.270+0000 7f9c7f200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c780d02c0 0x7f9c780c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:52.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.270+0000 7f9c7f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78161d80 0x7f9c781f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:52.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.270+0000 7f9c7f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c780ceae0 con 0x7f9c78161d80 2024-03-28T21:51:52.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.270+0000 7f9c7f200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9c78161a60 con 0x7f9c780d02c0 2024-03-28T21:51:52.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.270+0000 7f9c7f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9c780cec60 con 0x7f9c780b3820 2024-03-28T21:51:52.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.270+0000 7f9c7e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78161d80 0x7f9c781f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:52.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.270+0000 7f9c7e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78161d80 0x7f9c781f7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47174/0 (socket says 172.21.15.153:47174) 2024-03-28T21:51:52.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.270+0000 7f9c7e800640 1 -- 172.21.15.153:0/2332892686 learned_addr learned my addr 172.21.15.153:0/2332892686 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:52.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.270+0000 7f9c7de00640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c780b3820 0x7f9c780b94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:52.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.271+0000 7f9c7d400640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c780d02c0 0x7f9c780c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:52.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.271+0000 7f9c7e800640 1 -- 172.21.15.153:0/2332892686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c780b3820 msgr2=0x7f9c780b94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:52.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.271+0000 7f9c7e800640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c780b3820 0x7f9c780b94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.271+0000 7f9c7e800640 1 -- 172.21.15.153:0/2332892686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c780d02c0 msgr2=0x7f9c780c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:52.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.271+0000 7f9c7e800640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c780d02c0 0x7f9c780c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.271+0000 7f9c7e800640 1 -- 172.21.15.153:0/2332892686 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c781f8930 con 0x7f9c78161d80 2024-03-28T21:51:52.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.271+0000 7f9c7d400640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c780d02c0 0x7f9c780c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:51:52.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.271+0000 7f9c7e800640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78161d80 0x7f9c781f7e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400cef0 tx=0x7f9c7400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:52.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.271+0000 7f9c72000640 1 -- 172.21.15.153:0/2332892686 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7401a070 con 0x7f9c78161d80 2024-03-28T21:51:52.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.271+0000 7f9c72000640 1 -- 172.21.15.153:0/2332892686 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c7400d860 con 0x7f9c78161d80 2024-03-28T21:51:52.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.271+0000 7f9c72000640 1 -- 172.21.15.153:0/2332892686 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400dc50 con 0x7f9c78161d80 2024-03-28T21:51:52.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.271+0000 7f9c7f200640 1 -- 172.21.15.153:0/2332892686 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c781f8c10 con 0x7f9c78161d80 2024-03-28T21:51:52.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.271+0000 7f9c7f200640 1 -- 172.21.15.153:0/2332892686 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c780b8f90 con 0x7f9c78161d80 2024-03-28T21:51:52.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.273+0000 7f9c7f200640 1 -- 172.21.15.153:0/2332892686 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c780b9190 con 0x7f9c78161d80 2024-03-28T21:51:52.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.274+0000 7f9c72000640 1 -- 172.21.15.153:0/2332892686 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) ==== 89724+0+0 (secure 0 0 0) 0x7f9c7401d070 con 0x7f9c78161d80 2024-03-28T21:51:52.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.275+0000 7f9c72000640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9c5c06b440 0x7f9c5c06d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:52.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.275+0000 7f9c72000640 1 -- 172.21.15.153:0/2332892686 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f9c7408a700 con 0x7f9c78161d80 2024-03-28T21:51:52.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.280+0000 7f9c72000640 1 -- 172.21.15.153:0/2332892686 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9c780b9190 con 0x7f9c78161d80 2024-03-28T21:51:52.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.285+0000 7f9c7de00640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9c5c06b440 0x7f9c5c06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:52.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.286+0000 7f9c7de00640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9c5c06b440 0x7f9c5c06d900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c036000 tx=0x7f9c6c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:52.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.481+0000 7f9c7f200640 1 -- 172.21.15.153:0/2332892686 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c780b9d70 con 0x7f9c78161d80 2024-03-28T21:51:52.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.482+0000 7f9c72000640 1 -- 172.21.15.153:0/2332892686 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12932 (secure 0 0 0) 0x7f9c740599d0 con 0x7f9c78161d80 2024-03-28T21:51:52.484 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:51:52.485 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":18,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:52.201166+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:51:52.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.485+0000 7f9c7f200640 1 -- 172.21.15.153:0/2332892686 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9c5c06b440 msgr2=0x7f9c5c06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:52.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.485+0000 7f9c7f200640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9c5c06b440 0x7f9c5c06d900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c036000 tx=0x7f9c6c03d040 comp rx=0 tx=0).stop 2024-03-28T21:51:52.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.485+0000 7f9c7f200640 1 -- 172.21.15.153:0/2332892686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78161d80 msgr2=0x7f9c781f7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:52.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.485+0000 7f9c7f200640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78161d80 0x7f9c781f7e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400cef0 tx=0x7f9c7400a710 comp rx=0 tx=0).stop 2024-03-28T21:51:52.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.485+0000 7f9c7f200640 1 -- 172.21.15.153:0/2332892686 shutdown_connections 2024-03-28T21:51:52.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.485+0000 7f9c7f200640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9c5c06b440 0x7f9c5c06d900 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.485+0000 7f9c7f200640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78161d80 0x7f9c781f7e70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.485+0000 7f9c7f200640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c780d02c0 0x7f9c780c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.485+0000 7f9c7f200640 1 --2- 172.21.15.153:0/2332892686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c780b3820 0x7f9c780b94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.485+0000 7f9c7f200640 1 -- 172.21.15.153:0/2332892686 >> 172.21.15.153:0/2332892686 conn(0x7f9c780d3f10 msgr2=0x7f9c780b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:52.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.485+0000 7f9c7f200640 1 -- 172.21.15.153:0/2332892686 shutdown_connections 2024-03-28T21:51:52.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.485+0000 7f9c7f200640 1 -- 172.21.15.153:0/2332892686 wait complete. 2024-03-28T21:51:52.505 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T21:51:52.505 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T21:51:52.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.687+0000 7f44bbe00640 1 Processor -- start 2024-03-28T21:51:52.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.687+0000 7f44bbe00640 1 -- start start 2024-03-28T21:51:52.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.688+0000 7f44bbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44b4161a20 0x7f44b40d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:52.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.688+0000 7f44bbe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f44b40d1010 0x7f44b40b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:52.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.689+0000 7f44bbe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b40d1470 con 0x7f44b40b45f0 2024-03-28T21:51:52.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.689+0000 7f44bbe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f44b40b3320 con 0x7f44b40d1010 2024-03-28T21:51:52.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.689+0000 7f44bbe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f44b40d2910 con 0x7f44b4161a20 2024-03-28T21:51:52.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.689+0000 7f44b9e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f44b40b45f0 0x7f44b40b4a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50646/0 (socket says 172.21.15.153:50646) 2024-03-28T21:51:52.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.689+0000 7f44b9e00640 1 -- 172.21.15.153:0/1635681551 learned_addr learned my addr 172.21.15.153:0/1635681551 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:51:52.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.689+0000 7f44b9400640 1 --2- 172.21.15.153:0/1635681551 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44b4161a20 0x7f44b40d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:52.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.689+0000 7f44b8a00640 1 --2- 172.21.15.153:0/1635681551 >> v2:172.21.15.165:3300/0 conn(0x7f44b40d1010 0x7f44b40b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:52.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.689+0000 7f44b3e00640 1 -- 172.21.15.153:0/1635681551 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4011436617 0 0) 0x7f44b40d1470 con 0x7f44b40b45f0 2024-03-28T21:51:52.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.689+0000 7f44b3e00640 1 -- 172.21.15.153:0/1635681551 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f449c003520 con 0x7f44b40b45f0 2024-03-28T21:51:52.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.690+0000 7f44b9400640 1 -- 172.21.15.153:0/1635681551 >> v2:172.21.15.165:3300/0 conn(0x7f44b40d1010 msgr2=0x7f44b40b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:52.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.690+0000 7f44b9400640 1 --2- 172.21.15.153:0/1635681551 >> v2:172.21.15.165:3300/0 conn(0x7f44b40d1010 0x7f44b40b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.690+0000 7f44b3e00640 1 -- 172.21.15.153:0/1635681551 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3735819527 0 0) 0x7f449c003520 con 0x7f44b40b45f0 2024-03-28T21:51:52.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.690+0000 7f44b9400640 1 -- 172.21.15.153:0/1635681551 >> v1:172.21.15.153:6789/0 conn(0x7f44b40b45f0 legacy=0x7f44b40b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:52.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.690+0000 7f44b9400640 1 -- 172.21.15.153:0/1635681551 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b40d2bf0 con 0x7f44b4161a20 2024-03-28T21:51:52.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.691+0000 7f44b9400640 1 --2- 172.21.15.153:0/1635681551 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44b4161a20 0x7f44b40d0ad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f44a80097a0 tx=0x7f44a802b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ce7ed9b29a1b12a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:52.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.692+0000 7f44b3e00640 1 -- 172.21.15.153:0/1635681551 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a8037070 con 0x7f44b4161a20 2024-03-28T21:51:52.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.692+0000 7f44b3e00640 1 -- 172.21.15.153:0/1635681551 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44a8030510 con 0x7f44b4161a20 2024-03-28T21:51:52.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.692+0000 7f44b3e00640 1 -- 172.21.15.153:0/1635681551 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0019f0 con 0x7f44b4161a20 2024-03-28T21:51:52.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.693+0000 7f44bbe00640 1 -- 172.21.15.153:0/1635681551 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44b4161a20 msgr2=0x7f44b40d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:52.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.693+0000 7f44bbe00640 1 --2- 172.21.15.153:0/1635681551 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44b4161a20 0x7f44b40d0ad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f44a80097a0 tx=0x7f44a802b710 comp rx=0 tx=0).stop 2024-03-28T21:51:52.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.693+0000 7f44bbe00640 1 -- 172.21.15.153:0/1635681551 shutdown_connections 2024-03-28T21:51:52.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.693+0000 7f44bbe00640 1 --2- 172.21.15.153:0/1635681551 >> v2:172.21.15.165:3300/0 conn(0x7f44b40d1010 0x7f44b40b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.693+0000 7f44bbe00640 1 --2- 172.21.15.153:0/1635681551 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44b4161a20 0x7f44b40d0ad0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.693+0000 7f44bbe00640 1 -- 172.21.15.153:0/1635681551 >> 172.21.15.153:0/1635681551 conn(0x7f44b409d430 msgr2=0x7f44b40d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:52.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.693+0000 7f44bbe00640 1 -- 172.21.15.153:0/1635681551 shutdown_connections 2024-03-28T21:51:52.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.693+0000 7f44bbe00640 1 -- 172.21.15.153:0/1635681551 wait complete. 2024-03-28T21:51:52.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.695+0000 7f44bbe00640 1 Processor -- start 2024-03-28T21:51:52.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.695+0000 7f44bbe00640 1 -- start start 2024-03-28T21:51:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44bbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44b40b45f0 0x7f44b415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44bbe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44b40d1010 0x7f44b415c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44bbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44b4161a20 0x7f44b40ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44bbe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f44b40d31b0 con 0x7f44b4161a20 2024-03-28T21:51:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44bbe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f44b40b3b90 con 0x7f44b40d1010 2024-03-28T21:51:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44bbe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f44b4161e00 con 0x7f44b40b45f0 2024-03-28T21:51:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44b9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44b4161a20 0x7f44b40ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44b9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44b4161a20 0x7f44b40ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47176/0 (socket says 172.21.15.153:47176) 2024-03-28T21:51:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44b9e00640 1 -- 172.21.15.153:0/2281893414 learned_addr learned my addr 172.21.15.153:0/2281893414 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44b9400640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44b40b45f0 0x7f44b415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44b8a00640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44b40d1010 0x7f44b415c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:52.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44b9e00640 1 -- 172.21.15.153:0/2281893414 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44b40b45f0 msgr2=0x7f44b415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:52.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44b9e00640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44b40b45f0 0x7f44b415a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44b9e00640 1 -- 172.21.15.153:0/2281893414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44b40d1010 msgr2=0x7f44b415c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:52.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44b9e00640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44b40d1010 0x7f44b415c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44b9e00640 1 -- 172.21.15.153:0/2281893414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b40b6d70 con 0x7f44b4161a20 2024-03-28T21:51:52.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.696+0000 7f44b9400640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44b40b45f0 0x7f44b415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:51:52.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.697+0000 7f44b9e00640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44b4161a20 0x7f44b40ccbe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00cc10 tx=0x7f44ac00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:52.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.697+0000 7f44b1600640 1 -- 172.21.15.153:0/2281893414 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac00ce20 con 0x7f44b4161a20 2024-03-28T21:51:52.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.697+0000 7f44b1600640 1 -- 172.21.15.153:0/2281893414 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ac012400 con 0x7f44b4161a20 2024-03-28T21:51:52.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.697+0000 7f44b1600640 1 -- 172.21.15.153:0/2281893414 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0127b0 con 0x7f44b4161a20 2024-03-28T21:51:52.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.697+0000 7f44bbe00640 1 -- 172.21.15.153:0/2281893414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b40b7050 con 0x7f44b4161a20 2024-03-28T21:51:52.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.697+0000 7f44bbe00640 1 -- 172.21.15.153:0/2281893414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b40cc8a0 con 0x7f44b4161a20 2024-03-28T21:51:52.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.698+0000 7f44bbe00640 1 -- 172.21.15.153:0/2281893414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b4068ff0 con 0x7f44b4161a20 2024-03-28T21:51:52.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.699+0000 7f44b1600640 1 -- 172.21.15.153:0/2281893414 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) ==== 89724+0+0 (secure 0 0 0) 0x7f44ac012950 con 0x7f44b4161a20 2024-03-28T21:51:52.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.700+0000 7f44b1600640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f449406b440 0x7f449406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:52.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.700+0000 7f44b1600640 1 -- 172.21.15.153:0/2281893414 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f44ac08a5b0 con 0x7f44b4161a20 2024-03-28T21:51:52.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.700+0000 7f44b9400640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f449406b440 0x7f449406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:52.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.701+0000 7f44b9400640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f449406b440 0x7f449406d900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f44a8034000 tx=0x7f44a8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:52.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.704+0000 7f44b1600640 1 -- 172.21.15.153:0/2281893414 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f44ac0182b0 con 0x7f44b4161a20 2024-03-28T21:51:52.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.903+0000 7f44bbe00640 1 -- 172.21.15.153:0/2281893414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f44b40a1ef0 con 0x7f44b4161a20 2024-03-28T21:51:52.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.904+0000 7f44b1600640 1 -- 172.21.15.153:0/2281893414 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7f44ac08a030 con 0x7f44b4161a20 2024-03-28T21:51:52.907 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-28T21:51:52.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.907+0000 7f44bbe00640 1 -- 172.21.15.153:0/2281893414 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f449406b440 msgr2=0x7f449406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:52.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.907+0000 7f44bbe00640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f449406b440 0x7f449406d900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f44a8034000 tx=0x7f44a8008030 comp rx=0 tx=0).stop 2024-03-28T21:51:52.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.907+0000 7f44bbe00640 1 -- 172.21.15.153:0/2281893414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44b4161a20 msgr2=0x7f44b40ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:52.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.907+0000 7f44bbe00640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44b4161a20 0x7f44b40ccbe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00cc10 tx=0x7f44ac00a430 comp rx=0 tx=0).stop 2024-03-28T21:51:52.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.907+0000 7f44bbe00640 1 -- 172.21.15.153:0/2281893414 shutdown_connections 2024-03-28T21:51:52.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.907+0000 7f44bbe00640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f449406b440 0x7f449406d900 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.907+0000 7f44bbe00640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44b4161a20 0x7f44b40ccbe0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.907+0000 7f44bbe00640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44b40d1010 0x7f44b415c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.907+0000 7f44bbe00640 1 --2- 172.21.15.153:0/2281893414 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44b40b45f0 0x7f44b415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:52.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.907+0000 7f44bbe00640 1 -- 172.21.15.153:0/2281893414 >> 172.21.15.153:0/2281893414 conn(0x7f44b409d430 msgr2=0x7f44b40b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:52.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.907+0000 7f44bbe00640 1 -- 172.21.15.153:0/2281893414 shutdown_connections 2024-03-28T21:51:52.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:52.907+0000 7f44bbe00640 1 -- 172.21.15.153:0/2281893414 wait complete. 2024-03-28T21:51:52.928 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-28T21:51:53.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.141+0000 7efd2ac00640 1 Processor -- start 2024-03-28T21:51:53.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.141+0000 7efd2ac00640 1 -- start start 2024-03-28T21:51:53.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.143+0000 7efd2ac00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7efd24142720 0x7efd2406e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:53.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.143+0000 7efd2ac00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efd24072810 0x7efd240cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:53.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.143+0000 7efd2ac00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd2406db60 con 0x7efd2406ee20 2024-03-28T21:51:53.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.143+0000 7efd2ac00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7efd24071d60 con 0x7efd24072810 2024-03-28T21:51:53.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.143+0000 7efd2ac00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7efd24142b00 con 0x7efd24142720 2024-03-28T21:51:53.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.143+0000 7efd28e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7efd2406ee20 0x7efd24072100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46758/0 (socket says 172.21.15.153:46758) 2024-03-28T21:51:53.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.143+0000 7efd28e00640 1 -- 172.21.15.153:0/1071995485 learned_addr learned my addr 172.21.15.153:0/1071995485 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:51:53.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.143+0000 7efd2a200640 1 --2- 172.21.15.153:0/1071995485 >> v2:172.21.15.153:3300/0 conn(0x7efd24072810 0x7efd240cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:53.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.144+0000 7efd29800640 1 --2- 172.21.15.153:0/1071995485 >> v2:172.21.15.165:3300/0 conn(0x7efd24142720 0x7efd2406e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:53.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.144+0000 7efd23e00640 1 -- 172.21.15.153:0/1071995485 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 506080663 0 0) 0x7efd2406db60 con 0x7efd2406ee20 2024-03-28T21:51:53.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.144+0000 7efd23e00640 1 -- 172.21.15.153:0/1071995485 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd0c003520 con 0x7efd2406ee20 2024-03-28T21:51:53.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.144+0000 7efd2a200640 1 -- 172.21.15.153:0/1071995485 >> v2:172.21.15.165:3300/0 conn(0x7efd24142720 msgr2=0x7efd2406e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:53.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.144+0000 7efd2a200640 1 --2- 172.21.15.153:0/1071995485 >> v2:172.21.15.165:3300/0 conn(0x7efd24142720 0x7efd2406e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.144+0000 7efd2a200640 1 -- 172.21.15.153:0/1071995485 >> v1:172.21.15.153:6789/0 conn(0x7efd2406ee20 legacy=0x7efd24072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:53.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.144+0000 7efd2a200640 1 -- 172.21.15.153:0/1071995485 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd24071a80 con 0x7efd24072810 2024-03-28T21:51:53.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.145+0000 7efd2a200640 1 --2- 172.21.15.153:0/1071995485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd24072810 0x7efd240cd710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd240b2690 tx=0x7efd1c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4bc205962f19ae4 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:53.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.145+0000 7efd23e00640 1 -- 172.21.15.153:0/1071995485 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c039070 con 0x7efd24072810 2024-03-28T21:51:53.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.145+0000 7efd23e00640 1 -- 172.21.15.153:0/1071995485 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c02cbf0 con 0x7efd24072810 2024-03-28T21:51:53.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.145+0000 7efd23e00640 1 -- 172.21.15.153:0/1071995485 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c034440 con 0x7efd24072810 2024-03-28T21:51:53.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.146+0000 7efd2ac00640 1 -- 172.21.15.153:0/1071995485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd24072810 msgr2=0x7efd240cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:53.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.146+0000 7efd2ac00640 1 --2- 172.21.15.153:0/1071995485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd24072810 0x7efd240cd710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd240b2690 tx=0x7efd1c02be40 comp rx=0 tx=0).stop 2024-03-28T21:51:53.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.146+0000 7efd2ac00640 1 -- 172.21.15.153:0/1071995485 shutdown_connections 2024-03-28T21:51:53.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.146+0000 7efd2ac00640 1 --2- 172.21.15.153:0/1071995485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd24072810 0x7efd240cd710 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.146+0000 7efd2ac00640 1 --2- 172.21.15.153:0/1071995485 >> v2:172.21.15.165:3300/0 conn(0x7efd24142720 0x7efd2406e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.146+0000 7efd2ac00640 1 -- 172.21.15.153:0/1071995485 >> 172.21.15.153:0/1071995485 conn(0x7efd240b1890 msgr2=0x7efd240b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.146+0000 7efd2ac00640 1 -- 172.21.15.153:0/1071995485 shutdown_connections 2024-03-28T21:51:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.146+0000 7efd2ac00640 1 -- 172.21.15.153:0/1071995485 wait complete. 2024-03-28T21:51:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.148+0000 7efd2ac00640 1 Processor -- start 2024-03-28T21:51:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.148+0000 7efd2ac00640 1 -- start start 2024-03-28T21:51:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.149+0000 7efd2ac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd24072810 0x7efd240cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:53.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.149+0000 7efd2ac00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd24142720 0x7efd2415b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:53.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.149+0000 7efd2ac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415c4b0 0x7efd2413a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:53.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.149+0000 7efd2ac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd2406e3c0 con 0x7efd2415c4b0 2024-03-28T21:51:53.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.149+0000 7efd2ac00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efd2406e0e0 con 0x7efd24142720 2024-03-28T21:51:53.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.149+0000 7efd2ac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efd240cdc50 con 0x7efd24072810 2024-03-28T21:51:53.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.149+0000 7efd2a200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415c4b0 0x7efd2413a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.149+0000 7efd2a200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415c4b0 0x7efd2413a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54010/0 (socket says 172.21.15.153:54010) 2024-03-28T21:51:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.149+0000 7efd2a200640 1 -- 172.21.15.153:0/2794765238 learned_addr learned my addr 172.21.15.153:0/2794765238 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.149+0000 7efd29800640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd24072810 0x7efd240cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.150+0000 7efd2a200640 1 -- 172.21.15.153:0/2794765238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd24072810 msgr2=0x7efd240cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.150+0000 7efd28e00640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd24142720 0x7efd2415b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.150+0000 7efd2a200640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd24072810 0x7efd240cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.150+0000 7efd2a200640 1 -- 172.21.15.153:0/2794765238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd24142720 msgr2=0x7efd2415b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.150+0000 7efd2a200640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd24142720 0x7efd2415b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.150+0000 7efd2a200640 1 -- 172.21.15.153:0/2794765238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2413a820 con 0x7efd2415c4b0 2024-03-28T21:51:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.150+0000 7efd29800640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd24072810 0x7efd240cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:51:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.150+0000 7efd2a200640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415c4b0 0x7efd2413a2e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009e80 tx=0x7efd1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.150+0000 7efd21600640 1 -- 172.21.15.153:0/2794765238 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c039050 con 0x7efd2415c4b0 2024-03-28T21:51:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.150+0000 7efd21600640 1 -- 172.21.15.153:0/2794765238 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c045070 con 0x7efd2415c4b0 2024-03-28T21:51:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.150+0000 7efd21600640 1 -- 172.21.15.153:0/2794765238 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c009450 con 0x7efd2415c4b0 2024-03-28T21:51:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.150+0000 7efd2ac00640 1 -- 172.21.15.153:0/2794765238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2415ca00 con 0x7efd2415c4b0 2024-03-28T21:51:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.150+0000 7efd2ac00640 1 -- 172.21.15.153:0/2794765238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2415cfc0 con 0x7efd2415c4b0 2024-03-28T21:51:53.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.151+0000 7efd2ac00640 1 -- 172.21.15.153:0/2794765238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd2404f520 con 0x7efd2415c4b0 2024-03-28T21:51:53.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.152+0000 7efd21600640 1 -- 172.21.15.153:0/2794765238 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) ==== 89724+0+0 (secure 0 0 0) 0x7efd1c03e850 con 0x7efd2415c4b0 2024-03-28T21:51:53.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.153+0000 7efd21600640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0406b440 0x7efd0406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:53.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.153+0000 7efd21600640 1 -- 172.21.15.153:0/2794765238 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7efd1c0acdd0 con 0x7efd2415c4b0 2024-03-28T21:51:53.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.153+0000 7efd29800640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0406b440 0x7efd0406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:53.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.154+0000 7efd29800640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0406b440 0x7efd0406d900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efd18006fd0 tx=0x7efd18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:53.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.158+0000 7efd21600640 1 -- 172.21.15.153:0/2794765238 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7efd1c07c100 con 0x7efd2415c4b0 2024-03-28T21:51:53.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.356+0000 7efd2ac00640 1 -- 172.21.15.153:0/2794765238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7efd24072210 con 0x7efd2415c4b0 2024-03-28T21:51:53.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.357+0000 7efd21600640 1 -- 172.21.15.153:0/2794765238 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7efd1c07ba00 con 0x7efd2415c4b0 2024-03-28T21:51:53.359 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:51:53.359 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2024-03-28T21:51:53.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:51:53.359 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2024-03-28T21:51:53.359 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": ".mgr" 2024-03-28T21:51:53.359 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:51:53.359 INFO:teuthology.orchestra.run.smithi153.stdout:] 2024-03-28T21:51:53.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.359+0000 7efd2ac00640 1 -- 172.21.15.153:0/2794765238 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0406b440 msgr2=0x7efd0406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:53.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.359+0000 7efd2ac00640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0406b440 0x7efd0406d900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efd18006fd0 tx=0x7efd18008040 comp rx=0 tx=0).stop 2024-03-28T21:51:53.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.359+0000 7efd2ac00640 1 -- 172.21.15.153:0/2794765238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415c4b0 msgr2=0x7efd2413a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:53.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.359+0000 7efd2ac00640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415c4b0 0x7efd2413a2e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009e80 tx=0x7efd1c004a40 comp rx=0 tx=0).stop 2024-03-28T21:51:53.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.359+0000 7efd2ac00640 1 -- 172.21.15.153:0/2794765238 shutdown_connections 2024-03-28T21:51:53.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.359+0000 7efd2ac00640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0406b440 0x7efd0406d900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.359+0000 7efd2ac00640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415c4b0 0x7efd2413a2e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.359+0000 7efd2ac00640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd24142720 0x7efd2415b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.359+0000 7efd2ac00640 1 --2- 172.21.15.153:0/2794765238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd24072810 0x7efd240cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.359+0000 7efd2ac00640 1 -- 172.21.15.153:0/2794765238 >> 172.21.15.153:0/2794765238 conn(0x7efd240b1890 msgr2=0x7efd240b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:53.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.359+0000 7efd2ac00640 1 -- 172.21.15.153:0/2794765238 shutdown_connections 2024-03-28T21:51:53.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.359+0000 7efd2ac00640 1 -- 172.21.15.153:0/2794765238 wait complete. 2024-03-28T21:51:53.382 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-28T21:51:53.382 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-28T21:51:53.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.599+0000 7f9f89000640 1 Processor -- start 2024-03-28T21:51:53.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.599+0000 7f9f89000640 1 -- start start 2024-03-28T21:51:53.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.601+0000 7f9f89000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9f8406b170 0x7f9f8406b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:53.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.601+0000 7f9f89000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f8406d910 0x7f9f8406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:53.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.601+0000 7f9f89000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8406ba90 con 0x7f9f84145220 2024-03-28T21:51:53.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.601+0000 7f9f89000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9f84145a70 con 0x7f9f8406b170 2024-03-28T21:51:53.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.601+0000 7f9f89000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9f84145790 con 0x7f9f8406d910 2024-03-28T21:51:53.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.601+0000 7f9f82a00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f9f84145220 0x7f9f8406e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:45888/0 (socket says 172.21.15.153:45888) 2024-03-28T21:51:53.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.601+0000 7f9f82a00640 1 -- 172.21.15.153:0/1345525723 learned_addr learned my addr 172.21.15.153:0/1345525723 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:51:53.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.601+0000 7f9f83400640 1 --2- 172.21.15.153:0/1345525723 >> v2:172.21.15.165:3300/0 conn(0x7f9f8406b170 0x7f9f8406b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:53.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.601+0000 7f9f83e00640 1 --2- 172.21.15.153:0/1345525723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f8406d910 0x7f9f8406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:53.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.602+0000 7f9f82000640 1 -- 172.21.15.153:0/1345525723 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 363351904 0 0) 0x7f9f8406ba90 con 0x7f9f84145220 2024-03-28T21:51:53.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.602+0000 7f9f82000640 1 -- 172.21.15.153:0/1345525723 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f68003520 con 0x7f9f84145220 2024-03-28T21:51:53.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.602+0000 7f9f83400640 1 -- 172.21.15.153:0/1345525723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f8406d910 msgr2=0x7f9f8406dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:53.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.602+0000 7f9f83400640 1 --2- 172.21.15.153:0/1345525723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f8406d910 0x7f9f8406dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.602+0000 7f9f83400640 1 -- 172.21.15.153:0/1345525723 >> v1:172.21.15.165:6789/0 conn(0x7f9f84145220 legacy=0x7f9f8406e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:53.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.602+0000 7f9f83400640 1 -- 172.21.15.153:0/1345525723 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8406ce30 con 0x7f9f8406b170 2024-03-28T21:51:53.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.604+0000 7f9f83400640 1 --2- 172.21.15.153:0/1345525723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f8406b170 0x7f9f8406b550 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f740097a0 tx=0x7f9f7402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4fb686a771d751e server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:53.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.604+0000 7f9f82000640 1 -- 172.21.15.153:0/1345525723 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f74035020 con 0x7f9f8406b170 2024-03-28T21:51:53.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.604+0000 7f9f82000640 1 -- 172.21.15.153:0/1345525723 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f74031830 con 0x7f9f8406b170 2024-03-28T21:51:53.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.604+0000 7f9f82000640 1 -- 172.21.15.153:0/1345525723 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f74031c00 con 0x7f9f8406b170 2024-03-28T21:51:53.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.604+0000 7f9f89000640 1 -- 172.21.15.153:0/1345525723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f8406b170 msgr2=0x7f9f8406b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:53.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.604+0000 7f9f89000640 1 --2- 172.21.15.153:0/1345525723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f8406b170 0x7f9f8406b550 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f740097a0 tx=0x7f9f7402b8d0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.605+0000 7f9f89000640 1 -- 172.21.15.153:0/1345525723 shutdown_connections 2024-03-28T21:51:53.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.605+0000 7f9f89000640 1 --2- 172.21.15.153:0/1345525723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f8406d910 0x7f9f8406dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.605+0000 7f9f89000640 1 --2- 172.21.15.153:0/1345525723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f8406b170 0x7f9f8406b550 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.605+0000 7f9f89000640 1 -- 172.21.15.153:0/1345525723 >> 172.21.15.153:0/1345525723 conn(0x7f9f840cfda0 msgr2=0x7f9f840d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:53.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.605+0000 7f9f89000640 1 -- 172.21.15.153:0/1345525723 shutdown_connections 2024-03-28T21:51:53.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.605+0000 7f9f89000640 1 -- 172.21.15.153:0/1345525723 wait complete. 2024-03-28T21:51:53.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.606+0000 7f9f89000640 1 Processor -- start 2024-03-28T21:51:53.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.607+0000 7f9f89000640 1 -- start start 2024-03-28T21:51:53.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.607+0000 7f9f89000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f8406b170 0x7f9f840b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:53.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.607+0000 7f9f89000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f8406d910 0x7f9f840b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:53.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.607+0000 7f9f89000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f84145220 0x7f9f840b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:53.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.607+0000 7f9f89000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9f84144ea0 con 0x7f9f8406b170 2024-03-28T21:51:53.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.607+0000 7f9f89000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8406d3f0 con 0x7f9f84145220 2024-03-28T21:51:53.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.607+0000 7f9f89000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9f84145020 con 0x7f9f8406d910 2024-03-28T21:51:53.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.608+0000 7f9f83400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f8406b170 0x7f9f840b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:53.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.608+0000 7f9f83400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f8406b170 0x7f9f840b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54020/0 (socket says 172.21.15.153:54020) 2024-03-28T21:51:53.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.608+0000 7f9f83400640 1 -- 172.21.15.153:0/1105560023 learned_addr learned my addr 172.21.15.153:0/1105560023 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:53.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.608+0000 7f9f83e00640 1 --2- 172.21.15.153:0/1105560023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f84145220 0x7f9f840b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:53.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.608+0000 7f9f82a00640 1 --2- 172.21.15.153:0/1105560023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f8406d910 0x7f9f840b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:53.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.608+0000 7f9f83400640 1 -- 172.21.15.153:0/1105560023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f8406d910 msgr2=0x7f9f840b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:53.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.608+0000 7f9f83400640 1 --2- 172.21.15.153:0/1105560023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f8406d910 0x7f9f840b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.608+0000 7f9f83400640 1 -- 172.21.15.153:0/1105560023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f84145220 msgr2=0x7f9f840b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:53.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.608+0000 7f9f83400640 1 --2- 172.21.15.153:0/1105560023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f84145220 0x7f9f840b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.608+0000 7f9f83400640 1 -- 172.21.15.153:0/1105560023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8413d530 con 0x7f9f8406b170 2024-03-28T21:51:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.608+0000 7f9f83400640 1 --2- 172.21.15.153:0/1105560023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f8406b170 0x7f9f840b4120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009890 tx=0x7f9f740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.609+0000 7f9f7b400640 1 -- 172.21.15.153:0/1105560023 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f74035040 con 0x7f9f8406b170 2024-03-28T21:51:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.609+0000 7f9f7b400640 1 -- 172.21.15.153:0/1105560023 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f7403b920 con 0x7f9f8406b170 2024-03-28T21:51:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.609+0000 7f9f89000640 1 -- 172.21.15.153:0/1105560023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f8415c5f0 con 0x7f9f8406b170 2024-03-28T21:51:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.609+0000 7f9f7b400640 1 -- 172.21.15.153:0/1105560023 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7403bd10 con 0x7f9f8406b170 2024-03-28T21:51:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.609+0000 7f9f89000640 1 -- 172.21.15.153:0/1105560023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f8415cbb0 con 0x7f9f8406b170 2024-03-28T21:51:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.610+0000 7f9f89000640 1 -- 172.21.15.153:0/1105560023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f840b5c50 con 0x7f9f8406b170 2024-03-28T21:51:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.611+0000 7f9f7b400640 1 -- 172.21.15.153:0/1105560023 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) ==== 89724+0+0 (secure 0 0 0) 0x7f9f74038020 con 0x7f9f8406b170 2024-03-28T21:51:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.612+0000 7f9f7b400640 1 --2- 172.21.15.153:0/1105560023 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9f6406b440 0x7f9f6406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.612+0000 7f9f7b400640 1 -- 172.21.15.153:0/1105560023 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f9f740abe50 con 0x7f9f8406b170 2024-03-28T21:51:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.612+0000 7f9f82a00640 1 --2- 172.21.15.153:0/1105560023 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9f6406b440 0x7f9f6406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:53.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.613+0000 7f9f82a00640 1 --2- 172.21.15.153:0/1105560023 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9f6406b440 0x7f9f6406d900 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9f8413da80 tx=0x7f9f70009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:53.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.616+0000 7f9f7b400640 1 -- 172.21.15.153:0/1105560023 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9f840b5c50 con 0x7f9f8406b170 2024-03-28T21:51:53.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:53.814+0000 7f9f89000640 1 -- 172.21.15.153:0/1105560023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9f840b0f80 con 0x7f9f8406b170 2024-03-28T21:51:54.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.684+0000 7f9f7b400640 1 -- 172.21.15.153:0/1105560023 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f9f740af030 con 0x7f9f8406b170 2024-03-28T21:51:54.687 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2024-03-28T21:51:54.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.689+0000 7f9f89000640 1 -- 172.21.15.153:0/1105560023 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9f6406b440 msgr2=0x7f9f6406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:54.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.689+0000 7f9f89000640 1 --2- 172.21.15.153:0/1105560023 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9f6406b440 0x7f9f6406d900 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9f8413da80 tx=0x7f9f70009040 comp rx=0 tx=0).stop 2024-03-28T21:51:54.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.689+0000 7f9f89000640 1 -- 172.21.15.153:0/1105560023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f8406b170 msgr2=0x7f9f840b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:54.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.689+0000 7f9f89000640 1 --2- 172.21.15.153:0/1105560023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f8406b170 0x7f9f840b4120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009890 tx=0x7f9f740046c0 comp rx=0 tx=0).stop 2024-03-28T21:51:54.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.690+0000 7f9f89000640 1 -- 172.21.15.153:0/1105560023 shutdown_connections 2024-03-28T21:51:54.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.690+0000 7f9f89000640 1 --2- 172.21.15.153:0/1105560023 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9f6406b440 0x7f9f6406d900 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:54.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.690+0000 7f9f89000640 1 --2- 172.21.15.153:0/1105560023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f84145220 0x7f9f840b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:54.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.690+0000 7f9f89000640 1 --2- 172.21.15.153:0/1105560023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f8406d910 0x7f9f840b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:54.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.690+0000 7f9f89000640 1 --2- 172.21.15.153:0/1105560023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f8406b170 0x7f9f840b4120 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:54.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.690+0000 7f9f89000640 1 -- 172.21.15.153:0/1105560023 >> 172.21.15.153:0/1105560023 conn(0x7f9f840cfda0 msgr2=0x7f9f840afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:54.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.690+0000 7f9f89000640 1 -- 172.21.15.153:0/1105560023 shutdown_connections 2024-03-28T21:51:54.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.690+0000 7f9f89000640 1 -- 172.21.15.153:0/1105560023 wait complete. 2024-03-28T21:51:54.726 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-28T21:51:54.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.920+0000 7f7317800640 1 Processor -- start 2024-03-28T21:51:54.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.920+0000 7f7317800640 1 -- start start 2024-03-28T21:51:54.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.922+0000 7f7317800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7310071ce0 0x7f731006cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:54.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.922+0000 7f7317800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7310070f20 con 0x7f73100cef30 2024-03-28T21:51:54.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.922+0000 7f7317800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7310071200 con 0x7f73100acd80 2024-03-28T21:51:54.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.922+0000 7f7317800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7310072170 con 0x7f7310071ce0 2024-03-28T21:51:54.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.922+0000 7f7314e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f73100cef30 0x7f73100cf310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46774/0 (socket says 172.21.15.153:46774) 2024-03-28T21:51:54.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.922+0000 7f7314e00640 1 -- 172.21.15.153:0/103589732 learned_addr learned my addr 172.21.15.153:0/103589732 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:51:54.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.922+0000 7f7315800640 1 --2- 172.21.15.153:0/103589732 >> v2:172.21.15.153:3300/0 conn(0x7f7310071ce0 0x7f731006cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:54.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.922+0000 7f730fe00640 1 -- 172.21.15.153:0/103589732 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446308885 0 0) 0x7f7310070f20 con 0x7f73100cef30 2024-03-28T21:51:54.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.922+0000 7f730fe00640 1 -- 172.21.15.153:0/103589732 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72f4003520 con 0x7f73100cef30 2024-03-28T21:51:54.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.923+0000 7f7315800640 1 -- 172.21.15.153:0/103589732 >> v1:172.21.15.165:6789/0 conn(0x7f73100acd80 legacy=0x7f73100728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:54.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.923+0000 7f7315800640 1 -- 172.21.15.153:0/103589732 >> v1:172.21.15.153:6789/0 conn(0x7f73100cef30 legacy=0x7f73100cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:54.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.923+0000 7f7315800640 1 -- 172.21.15.153:0/103589732 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73100714e0 con 0x7f7310071ce0 2024-03-28T21:51:54.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.924+0000 7f7315800640 1 --2- 172.21.15.153:0/103589732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7310071ce0 0x7f731006cb00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7308009d90 tx=0x7f730802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0849bd70217671d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:54.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.924+0000 7f730fe00640 1 -- 172.21.15.153:0/103589732 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308039070 con 0x7f7310071ce0 2024-03-28T21:51:54.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.924+0000 7f730fe00640 1 -- 172.21.15.153:0/103589732 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730802cc60 con 0x7f7310071ce0 2024-03-28T21:51:54.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.924+0000 7f730fe00640 1 -- 172.21.15.153:0/103589732 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308034660 con 0x7f7310071ce0 2024-03-28T21:51:54.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.924+0000 7f7317800640 1 -- 172.21.15.153:0/103589732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7310071ce0 msgr2=0x7f731006cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:54.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.924+0000 7f7317800640 1 --2- 172.21.15.153:0/103589732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7310071ce0 0x7f731006cb00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7308009d90 tx=0x7f730802beb0 comp rx=0 tx=0).stop 2024-03-28T21:51:54.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.925+0000 7f7317800640 1 -- 172.21.15.153:0/103589732 shutdown_connections 2024-03-28T21:51:54.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.925+0000 7f7317800640 1 --2- 172.21.15.153:0/103589732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7310071ce0 0x7f731006cb00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:54.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.925+0000 7f7317800640 1 -- 172.21.15.153:0/103589732 >> 172.21.15.153:0/103589732 conn(0x7f73100b19a0 msgr2=0x7f73100b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:54.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.925+0000 7f7317800640 1 -- 172.21.15.153:0/103589732 shutdown_connections 2024-03-28T21:51:54.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.925+0000 7f7317800640 1 -- 172.21.15.153:0/103589732 wait complete. 2024-03-28T21:51:54.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.926+0000 7f7317800640 1 Processor -- start 2024-03-28T21:51:54.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.926+0000 7f7317800640 1 -- start start 2024-03-28T21:51:54.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.927+0000 7f7317800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7310071ce0 0x7f73100cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:54.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.927+0000 7f7317800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73100acd80 0x7f73101f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:54.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.927+0000 7f7317800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73100cef30 0x7f73101f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:54.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.927+0000 7f7317800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f731015c370 con 0x7f73100cef30 2024-03-28T21:51:54.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.927+0000 7f7317800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f731015c1f0 con 0x7f7310071ce0 2024-03-28T21:51:54.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.927+0000 7f7317800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f731006d040 con 0x7f73100acd80 2024-03-28T21:51:54.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.928+0000 7f7315800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73100cef30 0x7f73101f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.928+0000 7f7315800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73100cef30 0x7f73101f7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54042/0 (socket says 172.21.15.153:54042) 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.928+0000 7f7315800640 1 -- 172.21.15.153:0/893209103 learned_addr learned my addr 172.21.15.153:0/893209103 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.928+0000 7f7314e00640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7310071ce0 0x7f73100cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.928+0000 7f7307e00640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73100acd80 0x7f73101f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.928+0000 7f7315800640 1 -- 172.21.15.153:0/893209103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73100acd80 msgr2=0x7f73101f7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.928+0000 7f7315800640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73100acd80 0x7f73101f7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.928+0000 7f7315800640 1 -- 172.21.15.153:0/893209103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7310071ce0 msgr2=0x7f73100cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.928+0000 7f7315800640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7310071ce0 0x7f73100cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.928+0000 7f7315800640 1 -- 172.21.15.153:0/893209103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731014fc50 con 0x7f73100cef30 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.928+0000 7f7307e00640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73100acd80 0x7f73101f7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.928+0000 7f7315800640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73100cef30 0x7f73101f7ad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7308009d90 tx=0x7f7308004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.929+0000 7f730d600640 1 -- 172.21.15.153:0/893209103 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308039050 con 0x7f73100cef30 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.929+0000 7f730d600640 1 -- 172.21.15.153:0/893209103 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7308045070 con 0x7f73100cef30 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.929+0000 7f730d600640 1 -- 172.21.15.153:0/893209103 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308009450 con 0x7f73100cef30 2024-03-28T21:51:54.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.929+0000 7f7317800640 1 -- 172.21.15.153:0/893209103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f731014ff30 con 0x7f73100cef30 2024-03-28T21:51:54.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.929+0000 7f7317800640 1 -- 172.21.15.153:0/893209103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7310153510 con 0x7f73100cef30 2024-03-28T21:51:54.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.930+0000 7f7317800640 1 -- 172.21.15.153:0/893209103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7310068ff0 con 0x7f73100cef30 2024-03-28T21:51:54.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.931+0000 7f730d600640 1 -- 172.21.15.153:0/893209103 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f730803e850 con 0x7f73100cef30 2024-03-28T21:51:54.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.932+0000 7f730d600640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f72ec06b4d0 0x7f72ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:54.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.932+0000 7f730d600640 1 -- 172.21.15.153:0/893209103 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f73080ace40 con 0x7f73100cef30 2024-03-28T21:51:54.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.932+0000 7f7314e00640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f72ec06b4d0 0x7f72ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:54.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.933+0000 7f7314e00640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f72ec06b4d0 0x7f72ec06d990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7300005880 tx=0x7f7300009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:54.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:54.937+0000 7f730d600640 1 -- 172.21.15.153:0/893209103 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7308032e20 con 0x7f73100cef30 2024-03-28T21:51:55.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.133+0000 7f7317800640 1 -- 172.21.15.153:0/893209103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f73100adde0 con 0x7f73100cef30 2024-03-28T21:51:55.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.700+0000 7f730d600640 1 -- 172.21.15.153:0/893209103 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7f730807bfe0 con 0x7f73100cef30 2024-03-28T21:51:55.704 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2024-03-28T21:51:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.704+0000 7f7317800640 1 -- 172.21.15.153:0/893209103 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f72ec06b4d0 msgr2=0x7f72ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.704+0000 7f7317800640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f72ec06b4d0 0x7f72ec06d990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7300005880 tx=0x7f7300009040 comp rx=0 tx=0).stop 2024-03-28T21:51:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.704+0000 7f7317800640 1 -- 172.21.15.153:0/893209103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73100cef30 msgr2=0x7f73101f7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.704+0000 7f7317800640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73100cef30 0x7f73101f7ad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7308009d90 tx=0x7f7308004a40 comp rx=0 tx=0).stop 2024-03-28T21:51:55.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.706+0000 7f7317800640 1 -- 172.21.15.153:0/893209103 shutdown_connections 2024-03-28T21:51:55.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.706+0000 7f7317800640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f72ec06b4d0 0x7f72ec06d990 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:55.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.706+0000 7f7317800640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73100cef30 0x7f73101f7ad0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:55.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.706+0000 7f7317800640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73100acd80 0x7f73101f7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:55.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.706+0000 7f7317800640 1 --2- 172.21.15.153:0/893209103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7310071ce0 0x7f73100cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:55.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.706+0000 7f7317800640 1 -- 172.21.15.153:0/893209103 >> 172.21.15.153:0/893209103 conn(0x7f73100b19a0 msgr2=0x7f73100b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:55.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.707+0000 7f7317800640 1 -- 172.21.15.153:0/893209103 shutdown_connections 2024-03-28T21:51:55.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.707+0000 7f7317800640 1 -- 172.21.15.153:0/893209103 wait complete. 2024-03-28T21:51:55.747 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-28T21:51:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.926+0000 7f5412400640 1 Processor -- start 2024-03-28T21:51:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.927+0000 7f5412400640 1 -- start start 2024-03-28T21:51:55.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.928+0000 7f5412400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f540c15b060 0x7f540c0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:55.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.928+0000 7f5412400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f540c0cdbc0 0x7f540c0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:55.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.928+0000 7f5412400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f540c0b4cc0 con 0x7f540c0b4490 2024-03-28T21:51:55.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.928+0000 7f5412400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f540c0ce020 con 0x7f540c0cdbc0 2024-03-28T21:51:55.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.928+0000 7f5412400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f540c0cee50 con 0x7f540c15b060 2024-03-28T21:51:55.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.929+0000 7f540aa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f540c0cdbc0 0x7f540c0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:55.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.929+0000 7f540aa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f540c0cdbc0 0x7f540c0b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54058/0 (socket says 172.21.15.153:54058) 2024-03-28T21:51:55.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.929+0000 7f540aa00640 1 -- 172.21.15.153:0/883880194 learned_addr learned my addr 172.21.15.153:0/883880194 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:55.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.929+0000 7f540b400640 1 --2- 172.21.15.153:0/883880194 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f540c15b060 0x7f540c0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:55.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.929+0000 7f540aa00640 1 -- 172.21.15.153:0/883880194 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f540c15b060 msgr2=0x7f540c0cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:55.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.929+0000 7f540aa00640 1 --2- 172.21.15.153:0/883880194 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f540c15b060 0x7f540c0cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:55.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.930+0000 7f540aa00640 1 -- 172.21.15.153:0/883880194 >> v1:172.21.15.165:6789/0 conn(0x7f540c0b4490 legacy=0x7f540c0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:55.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.930+0000 7f540aa00640 1 -- 172.21.15.153:0/883880194 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540c0b4fa0 con 0x7f540c0cdbc0 2024-03-28T21:51:55.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.931+0000 7f540aa00640 1 --2- 172.21.15.153:0/883880194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c0cdbc0 0x7f540c0b3f50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009870 tx=0x7f53f402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6057df02d086694a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:55.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.931+0000 7f540a000640 1 -- 172.21.15.153:0/883880194 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4034070 con 0x7f540c0cdbc0 2024-03-28T21:51:55.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.931+0000 7f540a000640 1 -- 172.21.15.153:0/883880194 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f4030840 con 0x7f540c0cdbc0 2024-03-28T21:51:55.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.931+0000 7f540a000640 1 -- 172.21.15.153:0/883880194 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4030c10 con 0x7f540c0cdbc0 2024-03-28T21:51:55.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.932+0000 7f5412400640 1 -- 172.21.15.153:0/883880194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c0cdbc0 msgr2=0x7f540c0b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:55.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.932+0000 7f5412400640 1 --2- 172.21.15.153:0/883880194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c0cdbc0 0x7f540c0b3f50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009870 tx=0x7f53f402b980 comp rx=0 tx=0).stop 2024-03-28T21:51:55.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.932+0000 7f5412400640 1 -- 172.21.15.153:0/883880194 shutdown_connections 2024-03-28T21:51:55.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.932+0000 7f5412400640 1 --2- 172.21.15.153:0/883880194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c0cdbc0 0x7f540c0b3f50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:55.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.932+0000 7f5412400640 1 --2- 172.21.15.153:0/883880194 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f540c15b060 0x7f540c0cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:55.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.932+0000 7f5412400640 1 -- 172.21.15.153:0/883880194 >> 172.21.15.153:0/883880194 conn(0x7f540c0b3430 msgr2=0x7f540c0d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:55.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.932+0000 7f5412400640 1 -- 172.21.15.153:0/883880194 shutdown_connections 2024-03-28T21:51:55.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.932+0000 7f5412400640 1 -- 172.21.15.153:0/883880194 wait complete. 2024-03-28T21:51:55.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.934+0000 7f5412400640 1 Processor -- start 2024-03-28T21:51:55.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.934+0000 7f5412400640 1 -- start start 2024-03-28T21:51:55.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.935+0000 7f5412400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f540c0b4490 0x7f540c0b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:55.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.935+0000 7f5412400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f540c0cdbc0 0x7f540c1f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:55.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.935+0000 7f5412400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c15b060 0x7f540c1f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:55.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.935+0000 7f5412400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f540c15b440 con 0x7f540c15b060 2024-03-28T21:51:55.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.935+0000 7f5412400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f540c0cf380 con 0x7f540c0cdbc0 2024-03-28T21:51:55.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.935+0000 7f5412400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f540c0b4920 con 0x7f540c0b4490 2024-03-28T21:51:55.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.935+0000 7f540be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c15b060 0x7f540c1f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:55.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.936+0000 7f540be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c15b060 0x7f540c1f63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54072/0 (socket says 172.21.15.153:54072) 2024-03-28T21:51:55.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.936+0000 7f540be00640 1 -- 172.21.15.153:0/4275966077 learned_addr learned my addr 172.21.15.153:0/4275966077 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:55.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.936+0000 7f540b400640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f540c0b4490 0x7f540c0b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.936+0000 7f540aa00640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f540c0cdbc0 0x7f540c1f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.936+0000 7f540be00640 1 -- 172.21.15.153:0/4275966077 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f540c0b4490 msgr2=0x7f540c0b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.936+0000 7f540be00640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f540c0b4490 0x7f540c0b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.936+0000 7f540be00640 1 -- 172.21.15.153:0/4275966077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f540c0cdbc0 msgr2=0x7f540c1f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.936+0000 7f540be00640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f540c0cdbc0 0x7f540c1f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.936+0000 7f540be00640 1 -- 172.21.15.153:0/4275966077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540c144d00 con 0x7f540c15b060 2024-03-28T21:51:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.936+0000 7f540aa00640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f540c0cdbc0 0x7f540c1f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:51:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.936+0000 7f540be00640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c15b060 0x7f540c1f63e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f540400c400 tx=0x7f540400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.936+0000 7f5403400640 1 -- 172.21.15.153:0/4275966077 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5404017070 con 0x7f540c15b060 2024-03-28T21:51:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.937+0000 7f5403400640 1 -- 172.21.15.153:0/4275966077 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54040052d0 con 0x7f540c15b060 2024-03-28T21:51:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.937+0000 7f5403400640 1 -- 172.21.15.153:0/4275966077 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5404003810 con 0x7f540c15b060 2024-03-28T21:51:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.937+0000 7f5412400640 1 -- 172.21.15.153:0/4275966077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540c144fa0 con 0x7f540c15b060 2024-03-28T21:51:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.937+0000 7f5412400640 1 -- 172.21.15.153:0/4275966077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f540c155e50 con 0x7f540c15b060 2024-03-28T21:51:55.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.938+0000 7f5412400640 1 -- 172.21.15.153:0/4275966077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f540c0681c0 con 0x7f540c15b060 2024-03-28T21:51:55.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.939+0000 7f5403400640 1 -- 172.21.15.153:0/4275966077 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f540401a070 con 0x7f540c15b060 2024-03-28T21:51:55.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.940+0000 7f5403400640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f53e806b4d0 0x7f53e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:55.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.940+0000 7f5403400640 1 -- 172.21.15.153:0/4275966077 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f5404089500 con 0x7f540c15b060 2024-03-28T21:51:55.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.940+0000 7f540b400640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f53e806b4d0 0x7f53e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:55.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.941+0000 7f540b400640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f53e806b4d0 0x7f53e806d990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0073f0 tx=0x7f53fc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:55.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:55.946+0000 7f5403400640 1 -- 172.21.15.153:0/4275966077 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f54040583e0 con 0x7f540c15b060 2024-03-28T21:51:56.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.166+0000 7f5412400640 1 -- 172.21.15.153:0/4275966077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f540c0ccc90 con 0x7f540c15b060 2024-03-28T21:51:56.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.720+0000 7f5403400640 1 -- 172.21.15.153:0/4275966077 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f5404057ce0 con 0x7f540c15b060 2024-03-28T21:51:56.728 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 2 and data pool 3 2024-03-28T21:51:56.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.727+0000 7f5412400640 1 -- 172.21.15.153:0/4275966077 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f53e806b4d0 msgr2=0x7f53e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:56.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.727+0000 7f5412400640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f53e806b4d0 0x7f53e806d990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0073f0 tx=0x7f53fc00b040 comp rx=0 tx=0).stop 2024-03-28T21:51:56.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.727+0000 7f5412400640 1 -- 172.21.15.153:0/4275966077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c15b060 msgr2=0x7f540c1f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:56.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.727+0000 7f5412400640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c15b060 0x7f540c1f63e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f540400c400 tx=0x7f540400c8c0 comp rx=0 tx=0).stop 2024-03-28T21:51:56.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.727+0000 7f5412400640 1 -- 172.21.15.153:0/4275966077 shutdown_connections 2024-03-28T21:51:56.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.727+0000 7f5412400640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f53e806b4d0 0x7f53e806d990 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0073f0 tx=0x7f53fc00b040 comp rx=0 tx=0).stop 2024-03-28T21:51:56.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.727+0000 7f5412400640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c15b060 0x7f540c1f63e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:56.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.727+0000 7f5412400640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f540c0cdbc0 0x7f540c1f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:56.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.727+0000 7f5412400640 1 --2- 172.21.15.153:0/4275966077 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f540c0b4490 0x7f540c0b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:56.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.727+0000 7f5412400640 1 -- 172.21.15.153:0/4275966077 >> 172.21.15.153:0/4275966077 conn(0x7f540c0b3430 msgr2=0x7f540c0b3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:56.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.728+0000 7f5412400640 1 -- 172.21.15.153:0/4275966077 shutdown_connections 2024-03-28T21:51:56.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.728+0000 7f5412400640 1 -- 172.21.15.153:0/4275966077 wait complete. 2024-03-28T21:51:56.767 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:51:56.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.940+0000 7fa57e200640 1 Processor -- start 2024-03-28T21:51:56.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.940+0000 7fa57e200640 1 -- start start 2024-03-28T21:51:56.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.941+0000 7fa57e200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5780ae8e0 0x7fa5780b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:56.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.941+0000 7fa57e200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780b4480 0x7fa57815ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:56.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.941+0000 7fa57e200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa57815ea70 con 0x7fa57815ade0 2024-03-28T21:51:56.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.941+0000 7fa57e200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa5780aee50 con 0x7fa5780ae8e0 2024-03-28T21:51:56.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.941+0000 7fa57e200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5780af130 con 0x7fa5780b4480 2024-03-28T21:51:56.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.942+0000 7fa576a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5780ae8e0 0x7fa5780b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:56.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.942+0000 7fa576a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5780ae8e0 0x7fa5780b3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54076/0 (socket says 172.21.15.153:54076) 2024-03-28T21:51:56.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.942+0000 7fa576a00640 1 -- 172.21.15.153:0/895719157 learned_addr learned my addr 172.21.15.153:0/895719157 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:56.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.942+0000 7fa577e00640 1 --2- 172.21.15.153:0/895719157 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780b4480 0x7fa57815ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:56.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.942+0000 7fa576a00640 1 -- 172.21.15.153:0/895719157 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780b4480 msgr2=0x7fa57815ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:56.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.942+0000 7fa576a00640 1 --2- 172.21.15.153:0/895719157 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780b4480 0x7fa57815ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:56.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.942+0000 7fa576a00640 1 -- 172.21.15.153:0/895719157 >> v1:172.21.15.153:6789/0 conn(0x7fa57815ade0 legacy=0x7fa5780acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:56.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.942+0000 7fa576a00640 1 -- 172.21.15.153:0/895719157 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5780af410 con 0x7fa5780ae8e0 2024-03-28T21:51:56.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.943+0000 7fa576a00640 1 --2- 172.21.15.153:0/895719157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5780ae8e0 0x7fa5780b3f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa560009870 tx=0x7fa56002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a6b057f66ecd0f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:56.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.943+0000 7fa576000640 1 -- 172.21.15.153:0/895719157 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560034070 con 0x7fa5780ae8e0 2024-03-28T21:51:56.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.943+0000 7fa576000640 1 -- 172.21.15.153:0/895719157 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa560030840 con 0x7fa5780ae8e0 2024-03-28T21:51:56.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.943+0000 7fa576000640 1 -- 172.21.15.153:0/895719157 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560030c10 con 0x7fa5780ae8e0 2024-03-28T21:51:56.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.944+0000 7fa57e200640 1 -- 172.21.15.153:0/895719157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5780ae8e0 msgr2=0x7fa5780b3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:56.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.944+0000 7fa57e200640 1 --2- 172.21.15.153:0/895719157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5780ae8e0 0x7fa5780b3f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa560009870 tx=0x7fa56002b980 comp rx=0 tx=0).stop 2024-03-28T21:51:56.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.944+0000 7fa57e200640 1 -- 172.21.15.153:0/895719157 shutdown_connections 2024-03-28T21:51:56.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.944+0000 7fa57e200640 1 --2- 172.21.15.153:0/895719157 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780b4480 0x7fa57815ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:56.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.944+0000 7fa57e200640 1 --2- 172.21.15.153:0/895719157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5780ae8e0 0x7fa5780b3f40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:56.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.944+0000 7fa57e200640 1 -- 172.21.15.153:0/895719157 >> 172.21.15.153:0/895719157 conn(0x7fa5780b1a30 msgr2=0x7fa5780b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:56.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.944+0000 7fa57e200640 1 -- 172.21.15.153:0/895719157 shutdown_connections 2024-03-28T21:51:56.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.944+0000 7fa57e200640 1 -- 172.21.15.153:0/895719157 wait complete. 2024-03-28T21:51:56.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.946+0000 7fa57e200640 1 Processor -- start 2024-03-28T21:51:56.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.946+0000 7fa57e200640 1 -- start start 2024-03-28T21:51:56.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.947+0000 7fa57e200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5780ae8e0 0x7fa578141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.947+0000 7fa57e200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780b4480 0x7fa57815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.947+0000 7fa57e200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa57815ade0 0x7fa57809baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.947+0000 7fa57e200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa57815b1c0 con 0x7fa57815ade0 2024-03-28T21:51:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.947+0000 7fa57e200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa57815f460 con 0x7fa5780ae8e0 2024-03-28T21:51:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.947+0000 7fa57e200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa57809b660 con 0x7fa5780b4480 2024-03-28T21:51:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.947+0000 7fa577e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa57815ade0 0x7fa57809baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.947+0000 7fa577e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa57815ade0 0x7fa57809baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54080/0 (socket says 172.21.15.153:54080) 2024-03-28T21:51:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.947+0000 7fa577e00640 1 -- 172.21.15.153:0/986848773 learned_addr learned my addr 172.21.15.153:0/986848773 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.947+0000 7fa577400640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5780ae8e0 0x7fa578141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.948+0000 7fa576a00640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780b4480 0x7fa57815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.948+0000 7fa577e00640 1 -- 172.21.15.153:0/986848773 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780b4480 msgr2=0x7fa57815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.948+0000 7fa577e00640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780b4480 0x7fa57815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.948+0000 7fa577e00640 1 -- 172.21.15.153:0/986848773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5780ae8e0 msgr2=0x7fa578141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:56.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.948+0000 7fa577e00640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5780ae8e0 0x7fa578141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:56.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.948+0000 7fa577e00640 1 -- 172.21.15.153:0/986848773 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa57809aa50 con 0x7fa57815ade0 2024-03-28T21:51:56.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.948+0000 7fa577400640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5780ae8e0 0x7fa578141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:51:56.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.948+0000 7fa577e00640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa57815ade0 0x7fa57809baf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa57000cd20 tx=0x7fa57000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:56.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.948+0000 7fa56f400640 1 -- 172.21.15.153:0/986848773 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570003b90 con 0x7fa57815ade0 2024-03-28T21:51:56.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.948+0000 7fa56f400640 1 -- 172.21.15.153:0/986848773 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa570003d30 con 0x7fa57815ade0 2024-03-28T21:51:56.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.948+0000 7fa56f400640 1 -- 172.21.15.153:0/986848773 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570004240 con 0x7fa57815ade0 2024-03-28T21:51:56.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.948+0000 7fa57e200640 1 -- 172.21.15.153:0/986848773 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa57809ad30 con 0x7fa57815ade0 2024-03-28T21:51:56.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.948+0000 7fa57e200640 1 -- 172.21.15.153:0/986848773 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa57809b2f0 con 0x7fa57815ade0 2024-03-28T21:51:56.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.950+0000 7fa57e200640 1 -- 172.21.15.153:0/986848773 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa57815ee90 con 0x7fa57815ade0 2024-03-28T21:51:56.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.950+0000 7fa56f400640 1 -- 172.21.15.153:0/986848773 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa5700043e0 con 0x7fa57815ade0 2024-03-28T21:51:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.952+0000 7fa56f400640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa55406b4d0 0x7fa55406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.952+0000 7fa56f400640 1 -- 172.21.15.153:0/986848773 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa57008ace0 con 0x7fa57815ade0 2024-03-28T21:51:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.952+0000 7fa577400640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa55406b4d0 0x7fa55406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.953+0000 7fa577400640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa55406b4d0 0x7fa55406d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa5680015e0 tx=0x7fa568009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:56.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:56.957+0000 7fa56f400640 1 -- 172.21.15.153:0/986848773 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa57815ee90 con 0x7fa57815ade0 2024-03-28T21:51:57.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.140+0000 7fa57e200640 1 -- 172.21.15.153:0/986848773 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa578068ff0 con 0x7fa57815ade0 2024-03-28T21:51:57.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.143+0000 7fa56f400640 1 -- 172.21.15.153:0/986848773 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16666 (secure 0 0 0) 0x7fa570059b60 con 0x7fa57815ade0 2024-03-28T21:51:57.146 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:51:57.146 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:56.168777+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:51:57.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.146+0000 7fa57e200640 1 -- 172.21.15.153:0/986848773 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa55406b4d0 msgr2=0x7fa55406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:57.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.146+0000 7fa57e200640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa55406b4d0 0x7fa55406d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa5680015e0 tx=0x7fa568009040 comp rx=0 tx=0).stop 2024-03-28T21:51:57.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.146+0000 7fa57e200640 1 -- 172.21.15.153:0/986848773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa57815ade0 msgr2=0x7fa57809baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:57.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.146+0000 7fa57e200640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa57815ade0 0x7fa57809baf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa57000cd20 tx=0x7fa57000a660 comp rx=0 tx=0).stop 2024-03-28T21:51:57.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.146+0000 7fa57e200640 1 -- 172.21.15.153:0/986848773 shutdown_connections 2024-03-28T21:51:57.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.146+0000 7fa57e200640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa55406b4d0 0x7fa55406d990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.146+0000 7fa57e200640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa57815ade0 0x7fa57809baf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.146+0000 7fa57e200640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780b4480 0x7fa57815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.146+0000 7fa57e200640 1 --2- 172.21.15.153:0/986848773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5780ae8e0 0x7fa578141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.146+0000 7fa57e200640 1 -- 172.21.15.153:0/986848773 >> 172.21.15.153:0/986848773 conn(0x7fa5780b1a30 msgr2=0x7fa57806e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:57.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.146+0000 7fa57e200640 1 -- 172.21.15.153:0/986848773 shutdown_connections 2024-03-28T21:51:57.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.146+0000 7fa57e200640 1 -- 172.21.15.153:0/986848773 wait complete. 2024-03-28T21:51:57.166 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:51:57.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.370+0000 7fb306a00640 1 Processor -- start 2024-03-28T21:51:57.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.370+0000 7fb306a00640 1 -- start start 2024-03-28T21:51:57.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.372+0000 7fb306a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb30014c040 0x7fb300071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:57.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.372+0000 7fb306a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb300072900 con 0x7fb3000d0110 2024-03-28T21:51:57.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.372+0000 7fb306a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb300072be0 con 0x7fb300072360 2024-03-28T21:51:57.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.372+0000 7fb306a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb3000b2b90 con 0x7fb30014c040 2024-03-28T21:51:57.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.372+0000 7fb305600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb30014c040 0x7fb300071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:57.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.372+0000 7fb306000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb3000d0110 0x7fb3000b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46786/0 (socket says 172.21.15.153:46786) 2024-03-28T21:51:57.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.372+0000 7fb306000640 1 -- 172.21.15.153:0/3649399009 learned_addr learned my addr 172.21.15.153:0/3649399009 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:51:57.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.373+0000 7fb2ffe00640 1 -- 172.21.15.153:0/3649399009 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2621202296 0 0) 0x7fb300072900 con 0x7fb3000d0110 2024-03-28T21:51:57.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.373+0000 7fb2ffe00640 1 -- 172.21.15.153:0/3649399009 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2e8003520 con 0x7fb3000d0110 2024-03-28T21:51:57.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.373+0000 7fb305600640 1 -- 172.21.15.153:0/3649399009 >> v1:172.21.15.165:6789/0 conn(0x7fb300072360 legacy=0x7fb3000cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:57.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.373+0000 7fb2ffe00640 1 -- 172.21.15.153:0/3649399009 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2480777350 0 0) 0x7fb2e8003520 con 0x7fb3000d0110 2024-03-28T21:51:57.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.373+0000 7fb305600640 1 -- 172.21.15.153:0/3649399009 >> v1:172.21.15.153:6789/0 conn(0x7fb3000d0110 legacy=0x7fb3000b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:57.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.373+0000 7fb305600640 1 -- 172.21.15.153:0/3649399009 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb300072ec0 con 0x7fb30014c040 2024-03-28T21:51:57.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.374+0000 7fb305600640 1 --2- 172.21.15.153:0/3649399009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb30014c040 0x7fb300071e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40097a0 tx=0x7fb2f402b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d3daae7a283cbf server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:57.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.375+0000 7fb2ffe00640 1 -- 172.21.15.153:0/3649399009 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4037070 con 0x7fb30014c040 2024-03-28T21:51:57.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.375+0000 7fb2ffe00640 1 -- 172.21.15.153:0/3649399009 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f4030510 con 0x7fb30014c040 2024-03-28T21:51:57.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.375+0000 7fb2ffe00640 1 -- 172.21.15.153:0/3649399009 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f80019f0 con 0x7fb30014c040 2024-03-28T21:51:57.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.375+0000 7fb306a00640 1 -- 172.21.15.153:0/3649399009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb30014c040 msgr2=0x7fb300071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:57.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.375+0000 7fb306a00640 1 --2- 172.21.15.153:0/3649399009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb30014c040 0x7fb300071e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40097a0 tx=0x7fb2f402b710 comp rx=0 tx=0).stop 2024-03-28T21:51:57.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.375+0000 7fb306a00640 1 -- 172.21.15.153:0/3649399009 shutdown_connections 2024-03-28T21:51:57.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.375+0000 7fb306a00640 1 --2- 172.21.15.153:0/3649399009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb30014c040 0x7fb300071e20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.375+0000 7fb306a00640 1 -- 172.21.15.153:0/3649399009 >> 172.21.15.153:0/3649399009 conn(0x7fb3000b1890 msgr2=0x7fb3000b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:57.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.375+0000 7fb306a00640 1 -- 172.21.15.153:0/3649399009 shutdown_connections 2024-03-28T21:51:57.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.375+0000 7fb306a00640 1 -- 172.21.15.153:0/3649399009 wait complete. 2024-03-28T21:51:57.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.377+0000 7fb306a00640 1 Processor -- start 2024-03-28T21:51:57.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.377+0000 7fb306a00640 1 -- start start 2024-03-28T21:51:57.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.378+0000 7fb306a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb300072360 0x7fb300146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:57.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.378+0000 7fb306a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3000d0110 0x7fb300164830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:57.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.378+0000 7fb306a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb30014c040 0x7fb30014ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:57.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.378+0000 7fb306a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb3000cf050 con 0x7fb3000d0110 2024-03-28T21:51:57.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.378+0000 7fb306a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb3000ceed0 con 0x7fb30014c040 2024-03-28T21:51:57.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.378+0000 7fb306a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb3000b3a10 con 0x7fb300072360 2024-03-28T21:51:57.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.378+0000 7fb304c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3000d0110 0x7fb300164830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:57.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.378+0000 7fb304c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3000d0110 0x7fb300164830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54110/0 (socket says 172.21.15.153:54110) 2024-03-28T21:51:57.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.378+0000 7fb304c00640 1 -- 172.21.15.153:0/3655063181 learned_addr learned my addr 172.21.15.153:0/3655063181 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:57.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.379+0000 7fb304c00640 1 -- 172.21.15.153:0/3655063181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb300072360 msgr2=0x7fb300146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:57.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.379+0000 7fb304c00640 1 --2- 172.21.15.153:0/3655063181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb300072360 0x7fb300146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.379+0000 7fb304c00640 1 -- 172.21.15.153:0/3655063181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb30014c040 msgr2=0x7fb30014ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:57.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.379+0000 7fb304c00640 1 --2- 172.21.15.153:0/3655063181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb30014c040 0x7fb30014ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.379+0000 7fb304c00640 1 -- 172.21.15.153:0/3655063181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb300145d00 con 0x7fb3000d0110 2024-03-28T21:51:57.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.379+0000 7fb304c00640 1 --2- 172.21.15.153:0/3655063181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3000d0110 0x7fb300164830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00c450 tx=0x7fb2ec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:57.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.379+0000 7fb2fd600640 1 -- 172.21.15.153:0/3655063181 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0052d0 con 0x7fb3000d0110 2024-03-28T21:51:57.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.379+0000 7fb2fd600640 1 -- 172.21.15.153:0/3655063181 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2ec005470 con 0x7fb3000d0110 2024-03-28T21:51:57.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.379+0000 7fb2fd600640 1 -- 172.21.15.153:0/3655063181 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec012870 con 0x7fb3000d0110 2024-03-28T21:51:57.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.379+0000 7fb306a00640 1 -- 172.21.15.153:0/3655063181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb300145fe0 con 0x7fb3000d0110 2024-03-28T21:51:57.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.380+0000 7fb306a00640 1 -- 172.21.15.153:0/3655063181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3001465a0 con 0x7fb3000d0110 2024-03-28T21:51:57.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.381+0000 7fb306a00640 1 -- 172.21.15.153:0/3655063181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3001467a0 con 0x7fb3000d0110 2024-03-28T21:51:57.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.381+0000 7fb2fd600640 1 -- 172.21.15.153:0/3655063181 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb2ec012a10 con 0x7fb3000d0110 2024-03-28T21:51:57.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.382+0000 7fb2fd600640 1 --2- 172.21.15.153:0/3655063181 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb2e006b4d0 0x7fb2e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:57.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.382+0000 7fb2fd600640 1 -- 172.21.15.153:0/3655063181 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb2ec089ee0 con 0x7fb3000d0110 2024-03-28T21:51:57.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.383+0000 7fb305600640 1 --2- 172.21.15.153:0/3655063181 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb2e006b4d0 0x7fb2e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:57.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.383+0000 7fb305600640 1 --2- 172.21.15.153:0/3655063181 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb2e006b4d0 0x7fb2e006d990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4034000 tx=0x7fb2f402f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:57.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.387+0000 7fb2fd600640 1 -- 172.21.15.153:0/3655063181 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb3001467a0 con 0x7fb3000d0110 2024-03-28T21:51:57.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.586+0000 7fb306a00640 1 -- 172.21.15.153:0/3655063181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb30004f520 con 0x7fb3000d0110 2024-03-28T21:51:57.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.589+0000 7fb2fd600640 1 -- 172.21.15.153:0/3655063181 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16666 (secure 0 0 0) 0x7fb2ec058cc0 con 0x7fb3000d0110 2024-03-28T21:51:57.592 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:51:57.592 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:56.168777+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:51:57.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.592+0000 7fb306a00640 1 -- 172.21.15.153:0/3655063181 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb2e006b4d0 msgr2=0x7fb2e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:57.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.592+0000 7fb306a00640 1 --2- 172.21.15.153:0/3655063181 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb2e006b4d0 0x7fb2e006d990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4034000 tx=0x7fb2f402f000 comp rx=0 tx=0).stop 2024-03-28T21:51:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.592+0000 7fb306a00640 1 -- 172.21.15.153:0/3655063181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3000d0110 msgr2=0x7fb300164830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.592+0000 7fb306a00640 1 --2- 172.21.15.153:0/3655063181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3000d0110 0x7fb300164830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00c450 tx=0x7fb2ec00c910 comp rx=0 tx=0).stop 2024-03-28T21:51:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.592+0000 7fb306a00640 1 -- 172.21.15.153:0/3655063181 shutdown_connections 2024-03-28T21:51:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.592+0000 7fb306a00640 1 --2- 172.21.15.153:0/3655063181 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb2e006b4d0 0x7fb2e006d990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.592+0000 7fb306a00640 1 --2- 172.21.15.153:0/3655063181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb30014c040 0x7fb30014ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.592+0000 7fb306a00640 1 --2- 172.21.15.153:0/3655063181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3000d0110 0x7fb300164830 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.592+0000 7fb306a00640 1 --2- 172.21.15.153:0/3655063181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb300072360 0x7fb300146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.592+0000 7fb306a00640 1 -- 172.21.15.153:0/3655063181 >> 172.21.15.153:0/3655063181 conn(0x7fb3000b1890 msgr2=0x7fb3000cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.592+0000 7fb306a00640 1 -- 172.21.15.153:0/3655063181 shutdown_connections 2024-03-28T21:51:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.592+0000 7fb306a00640 1 -- 172.21.15.153:0/3655063181 wait complete. 2024-03-28T21:51:57.612 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-28T21:51:57.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.834+0000 7fc3e3600640 1 Processor -- start 2024-03-28T21:51:57.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.834+0000 7fc3e3600640 1 -- start start 2024-03-28T21:51:57.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.836+0000 7fc3e3600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3dc06ffe0 0x7fc3dc0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:57.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.836+0000 7fc3e3600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc3dc0d0c20 0x7fc3dc0cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:57.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.836+0000 7fc3e3600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3dc15e8e0 con 0x7fc3dc15e500 2024-03-28T21:51:57.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.836+0000 7fc3e3600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc3dc0d1100 con 0x7fc3dc0d0c20 2024-03-28T21:51:57.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.836+0000 7fc3e3600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc3dc0d13e0 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.836+0000 7fc3dbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3dc06ffe0 0x7fc3dc0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:57.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.836+0000 7fc3dbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3dc06ffe0 0x7fc3dc0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:43404/0 (socket says 172.21.15.153:43404) 2024-03-28T21:51:57.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.836+0000 7fc3dbe00640 1 -- 172.21.15.153:0/173314938 learned_addr learned my addr 172.21.15.153:0/173314938 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:57.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.837+0000 7fc3e1600640 1 --2- 172.21.15.153:0/173314938 >> v2:172.21.15.165:3300/0 conn(0x7fc3dc0d0c20 0x7fc3dc0cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:57.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.837+0000 7fc3dbe00640 1 -- 172.21.15.153:0/173314938 >> v2:172.21.15.165:3300/0 conn(0x7fc3dc0d0c20 msgr2=0x7fc3dc0cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:57.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.837+0000 7fc3dbe00640 1 --2- 172.21.15.153:0/173314938 >> v2:172.21.15.165:3300/0 conn(0x7fc3dc0d0c20 0x7fc3dc0cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.837+0000 7fc3dbe00640 1 -- 172.21.15.153:0/173314938 >> v1:172.21.15.165:6789/0 conn(0x7fc3dc15e500 legacy=0x7fc3dc06f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:57.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.837+0000 7fc3dbe00640 1 -- 172.21.15.153:0/173314938 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3dc0cc700 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.839+0000 7fc3dbe00640 1 --2- 172.21.15.153:0/173314938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3dc06ffe0 0x7fc3dc0ccf00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009870 tx=0x7fc3c802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e9cf6fecbc495d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:57.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.839+0000 7fc3db400640 1 -- 172.21.15.153:0/173314938 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8034070 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.839+0000 7fc3db400640 1 -- 172.21.15.153:0/173314938 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c8030840 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.839+0000 7fc3db400640 1 -- 172.21.15.153:0/173314938 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8030c10 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.840+0000 7fc3e3600640 1 -- 172.21.15.153:0/173314938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3dc06ffe0 msgr2=0x7fc3dc0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:57.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.840+0000 7fc3e3600640 1 --2- 172.21.15.153:0/173314938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3dc06ffe0 0x7fc3dc0ccf00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009870 tx=0x7fc3c802b980 comp rx=0 tx=0).stop 2024-03-28T21:51:57.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.840+0000 7fc3e3600640 1 -- 172.21.15.153:0/173314938 shutdown_connections 2024-03-28T21:51:57.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.840+0000 7fc3e3600640 1 --2- 172.21.15.153:0/173314938 >> v2:172.21.15.165:3300/0 conn(0x7fc3dc0d0c20 0x7fc3dc0cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.840+0000 7fc3e3600640 1 --2- 172.21.15.153:0/173314938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3dc06ffe0 0x7fc3dc0ccf00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.840+0000 7fc3e3600640 1 -- 172.21.15.153:0/173314938 >> 172.21.15.153:0/173314938 conn(0x7fc3dc0d1f10 msgr2=0x7fc3dc0d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:57.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.840+0000 7fc3e3600640 1 -- 172.21.15.153:0/173314938 shutdown_connections 2024-03-28T21:51:57.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.840+0000 7fc3e3600640 1 -- 172.21.15.153:0/173314938 wait complete. 2024-03-28T21:51:57.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.841+0000 7fc3e3600640 1 Processor -- start 2024-03-28T21:51:57.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.842+0000 7fc3e3600640 1 -- start start 2024-03-28T21:51:57.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.842+0000 7fc3e3600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3dc06ffe0 0x7fc3dc14ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:57.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.842+0000 7fc3e3600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3dc0d0c20 0x7fc3dc14a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:57.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.843+0000 7fc3e3600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3dc15e500 0x7fc3dc06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:57.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.843+0000 7fc3e3600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc0d1d00 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.843+0000 7fc3e3600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc0d1b80 con 0x7fc3dc15e500 2024-03-28T21:51:57.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.843+0000 7fc3e3600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc3dc06f0d0 con 0x7fc3dc0d0c20 2024-03-28T21:51:57.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.843+0000 7fc3e0c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3dc06ffe0 0x7fc3dc14ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:57.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.843+0000 7fc3e0c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3dc06ffe0 0x7fc3dc14ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54114/0 (socket says 172.21.15.153:54114) 2024-03-28T21:51:57.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.843+0000 7fc3e0c00640 1 -- 172.21.15.153:0/1601664213 learned_addr learned my addr 172.21.15.153:0/1601664213 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:57.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.843+0000 7fc3dbe00640 1 --2- 172.21.15.153:0/1601664213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3dc0d0c20 0x7fc3dc14a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:57.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.843+0000 7fc3e1600640 1 --2- 172.21.15.153:0/1601664213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3dc15e500 0x7fc3dc06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:57.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.843+0000 7fc3e0c00640 1 -- 172.21.15.153:0/1601664213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3dc0d0c20 msgr2=0x7fc3dc14a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:57.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.843+0000 7fc3e0c00640 1 --2- 172.21.15.153:0/1601664213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3dc0d0c20 0x7fc3dc14a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.843+0000 7fc3e0c00640 1 -- 172.21.15.153:0/1601664213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3dc15e500 msgr2=0x7fc3dc06d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:57.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.843+0000 7fc3e0c00640 1 --2- 172.21.15.153:0/1601664213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3dc15e500 0x7fc3dc06d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:57.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.843+0000 7fc3e0c00640 1 -- 172.21.15.153:0/1601664213 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3dc14d580 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.844+0000 7fc3e0c00640 1 --2- 172.21.15.153:0/1601664213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3dc06ffe0 0x7fc3dc14ce10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000c400 tx=0x7fc3d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:57.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.844+0000 7fc3d8c00640 1 -- 172.21.15.153:0/1601664213 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0017070 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.844+0000 7fc3d8c00640 1 -- 172.21.15.153:0/1601664213 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d00052d0 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.844+0000 7fc3d8c00640 1 -- 172.21.15.153:0/1601664213 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0003830 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.844+0000 7fc3e3600640 1 -- 172.21.15.153:0/1601664213 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3dc14d860 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.844+0000 7fc3e3600640 1 -- 172.21.15.153:0/1601664213 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3dc14af20 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.846+0000 7fc3e3600640 1 -- 172.21.15.153:0/1601664213 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3dc0681c0 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.846+0000 7fc3d8c00640 1 -- 172.21.15.153:0/1601664213 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc3d001a070 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.847+0000 7fc3d8c00640 1 --2- 172.21.15.153:0/1601664213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc3bc06b4d0 0x7fc3bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:57.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.847+0000 7fc3d8c00640 1 -- 172.21.15.153:0/1601664213 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc3d0089640 con 0x7fc3dc06ffe0 2024-03-28T21:51:57.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.847+0000 7fc3dbe00640 1 --2- 172.21.15.153:0/1601664213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc3bc06b4d0 0x7fc3bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:57.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.848+0000 7fc3dbe00640 1 --2- 172.21.15.153:0/1601664213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc3bc06b4d0 0x7fc3bc06d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8036000 tx=0x7fc3c803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:57.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:57.852+0000 7fc3d8c00640 1 -- 172.21.15.153:0/1601664213 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc3d0058420 con 0x7fc3dc06ffe0 2024-03-28T21:51:58.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.092+0000 7fc3e3600640 1 -- 172.21.15.153:0/1601664213 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc3dc161d40 con 0x7fc3dc06ffe0 2024-03-28T21:51:58.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.729+0000 7fc3d8c00640 1 -- 172.21.15.153:0/1601664213 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fc3d0057d20 con 0x7fc3dc06ffe0 2024-03-28T21:51:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.733+0000 7fc3e3600640 1 -- 172.21.15.153:0/1601664213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc3bc06b4d0 msgr2=0x7fc3bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.733+0000 7fc3e3600640 1 --2- 172.21.15.153:0/1601664213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc3bc06b4d0 0x7fc3bc06d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8036000 tx=0x7fc3c803b040 comp rx=0 tx=0).stop 2024-03-28T21:51:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.733+0000 7fc3e3600640 1 -- 172.21.15.153:0/1601664213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3dc06ffe0 msgr2=0x7fc3dc14ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.733+0000 7fc3e3600640 1 --2- 172.21.15.153:0/1601664213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3dc06ffe0 0x7fc3dc14ce10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000c400 tx=0x7fc3d000c8c0 comp rx=0 tx=0).stop 2024-03-28T21:51:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.734+0000 7fc3e3600640 1 -- 172.21.15.153:0/1601664213 shutdown_connections 2024-03-28T21:51:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.734+0000 7fc3e3600640 1 --2- 172.21.15.153:0/1601664213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc3bc06b4d0 0x7fc3bc06d990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.734+0000 7fc3e3600640 1 --2- 172.21.15.153:0/1601664213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3dc15e500 0x7fc3dc06d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.734+0000 7fc3e3600640 1 --2- 172.21.15.153:0/1601664213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3dc0d0c20 0x7fc3dc14a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.734+0000 7fc3e3600640 1 --2- 172.21.15.153:0/1601664213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3dc06ffe0 0x7fc3dc14ce10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.734+0000 7fc3e3600640 1 -- 172.21.15.153:0/1601664213 >> 172.21.15.153:0/1601664213 conn(0x7fc3dc0d1f10 msgr2=0x7fc3dc0b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.734+0000 7fc3e3600640 1 -- 172.21.15.153:0/1601664213 shutdown_connections 2024-03-28T21:51:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.734+0000 7fc3e3600640 1 -- 172.21.15.153:0/1601664213 wait complete. 2024-03-28T21:51:58.756 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-28T21:51:58.757 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-28T21:51:58.791 INFO:tasks.ceph.mds.c.smithi153.stderr:2024-03-28T21:51:58.786+0000 7fcc00600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-28T21:51:58.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.959+0000 7fc3bd200640 1 Processor -- start 2024-03-28T21:51:58.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.959+0000 7fc3bd200640 1 -- start start 2024-03-28T21:51:58.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.961+0000 7fc3bd200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc3b8161760 0x7fc3b80d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:58.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.961+0000 7fc3bd200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3b80d1040 0x7fc3b80cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:58.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.961+0000 7fc3bd200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b80d2870 con 0x7fc3b80b3870 2024-03-28T21:51:58.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.961+0000 7fc3bd200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b80d2b50 con 0x7fc3b80d1040 2024-03-28T21:51:58.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.961+0000 7fc3bd200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b80d2e30 con 0x7fc3b8161760 2024-03-28T21:51:58.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.961+0000 7fc3b6800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3b80d1040 0x7fc3b80cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:58.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.962+0000 7fc3b6800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3b80d1040 0x7fc3b80cf170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54126/0 (socket says 172.21.15.153:54126) 2024-03-28T21:51:58.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.962+0000 7fc3b6800640 1 -- 172.21.15.153:0/1272079209 learned_addr learned my addr 172.21.15.153:0/1272079209 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:58.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.962+0000 7fc3b5e00640 1 --2- 172.21.15.153:0/1272079209 >> v2:172.21.15.165:3300/0 conn(0x7fc3b8161760 0x7fc3b80d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:58.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.962+0000 7fc3b6800640 1 -- 172.21.15.153:0/1272079209 >> v2:172.21.15.165:3300/0 conn(0x7fc3b8161760 msgr2=0x7fc3b80d4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:51:58.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.962+0000 7fc3b6800640 1 --2- 172.21.15.153:0/1272079209 >> v2:172.21.15.165:3300/0 conn(0x7fc3b8161760 0x7fc3b80d4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:58.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.962+0000 7fc3b6800640 1 -- 172.21.15.153:0/1272079209 >> v1:172.21.15.165:6789/0 conn(0x7fc3b80b3870 legacy=0x7fc3b80d0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:58.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.962+0000 7fc3b6800640 1 -- 172.21.15.153:0/1272079209 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b80d4d40 con 0x7fc3b80d1040 2024-03-28T21:51:58.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.962+0000 7fc3b5e00640 1 --2- 172.21.15.153:0/1272079209 >> v2:172.21.15.165:3300/0 conn(0x7fc3b8161760 0x7fc3b80d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:51:58.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.964+0000 7fc3b6800640 1 --2- 172.21.15.153:0/1272079209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b80d1040 0x7fc3b80cf170 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80b6c20 tx=0x7fc3b002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355876573021b5d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:58.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.965+0000 7fc3b5400640 1 -- 172.21.15.153:0/1272079209 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b002cb20 con 0x7fc3b80d1040 2024-03-28T21:51:58.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.965+0000 7fc3b5400640 1 -- 172.21.15.153:0/1272079209 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b002ccc0 con 0x7fc3b80d1040 2024-03-28T21:51:58.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.965+0000 7fc3b5400640 1 -- 172.21.15.153:0/1272079209 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0034610 con 0x7fc3b80d1040 2024-03-28T21:51:58.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.965+0000 7fc3bd200640 1 -- 172.21.15.153:0/1272079209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b80d1040 msgr2=0x7fc3b80cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:58.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.965+0000 7fc3bd200640 1 --2- 172.21.15.153:0/1272079209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b80d1040 0x7fc3b80cf170 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80b6c20 tx=0x7fc3b002bf80 comp rx=0 tx=0).stop 2024-03-28T21:51:58.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.965+0000 7fc3bd200640 1 -- 172.21.15.153:0/1272079209 shutdown_connections 2024-03-28T21:51:58.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.965+0000 7fc3bd200640 1 --2- 172.21.15.153:0/1272079209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b80d1040 0x7fc3b80cf170 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:58.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.965+0000 7fc3bd200640 1 --2- 172.21.15.153:0/1272079209 >> v2:172.21.15.165:3300/0 conn(0x7fc3b8161760 0x7fc3b80d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:58.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.966+0000 7fc3bd200640 1 -- 172.21.15.153:0/1272079209 >> 172.21.15.153:0/1272079209 conn(0x7fc3b809d3c0 msgr2=0x7fc3b80d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:58.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.966+0000 7fc3bd200640 1 -- 172.21.15.153:0/1272079209 shutdown_connections 2024-03-28T21:51:58.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.966+0000 7fc3bd200640 1 -- 172.21.15.153:0/1272079209 wait complete. 2024-03-28T21:51:58.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.967+0000 7fc3bd200640 1 Processor -- start 2024-03-28T21:51:58.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.967+0000 7fc3bd200640 1 -- start start 2024-03-28T21:51:58.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.968+0000 7fc3bd200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b80b3870 0x7fc3b814f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:58.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.968+0000 7fc3bd200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3b80d1040 0x7fc3b80c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:58.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.968+0000 7fc3bd200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b8161760 0x7fc3b80c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:58.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.968+0000 7fc3bd200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8161cc0 con 0x7fc3b8161760 2024-03-28T21:51:58.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.968+0000 7fc3bd200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8161b40 con 0x7fc3b80b3870 2024-03-28T21:51:58.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.968+0000 7fc3bd200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b80b4f00 con 0x7fc3b80d1040 2024-03-28T21:51:58.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.969+0000 7fc3b6800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b8161760 0x7fc3b80c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:58.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.969+0000 7fc3b6800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b8161760 0x7fc3b80c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54130/0 (socket says 172.21.15.153:54130) 2024-03-28T21:51:58.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.969+0000 7fc3b6800640 1 -- 172.21.15.153:0/2234276517 learned_addr learned my addr 172.21.15.153:0/2234276517 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:51:58.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.969+0000 7fc3b5e00640 1 --2- 172.21.15.153:0/2234276517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b80b3870 0x7fc3b814f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:58.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.969+0000 7fc3ad400640 1 --2- 172.21.15.153:0/2234276517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3b80d1040 0x7fc3b80c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:58.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.969+0000 7fc3b6800640 1 -- 172.21.15.153:0/2234276517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3b80d1040 msgr2=0x7fc3b80c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:58.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.969+0000 7fc3b6800640 1 --2- 172.21.15.153:0/2234276517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3b80d1040 0x7fc3b80c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:58.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.969+0000 7fc3b6800640 1 -- 172.21.15.153:0/2234276517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b80b3870 msgr2=0x7fc3b814f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:58.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.969+0000 7fc3b6800640 1 --2- 172.21.15.153:0/2234276517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b80b3870 0x7fc3b814f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:58.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.969+0000 7fc3b6800640 1 -- 172.21.15.153:0/2234276517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b80b8c20 con 0x7fc3b8161760 2024-03-28T21:51:58.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.970+0000 7fc3b6800640 1 --2- 172.21.15.153:0/2234276517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b8161760 0x7fc3b80c7eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0036040 tx=0x7fc3b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:58.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.970+0000 7fc3aea00640 1 -- 172.21.15.153:0/2234276517 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0043020 con 0x7fc3b8161760 2024-03-28T21:51:58.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.970+0000 7fc3aea00640 1 -- 172.21.15.153:0/2234276517 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b003e450 con 0x7fc3b8161760 2024-03-28T21:51:58.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.970+0000 7fc3bd200640 1 -- 172.21.15.153:0/2234276517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b80b8f00 con 0x7fc3b8161760 2024-03-28T21:51:58.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.970+0000 7fc3aea00640 1 -- 172.21.15.153:0/2234276517 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0009510 con 0x7fc3b8161760 2024-03-28T21:51:58.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.970+0000 7fc3bd200640 1 -- 172.21.15.153:0/2234276517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b80c85a0 con 0x7fc3b8161760 2024-03-28T21:51:58.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.971+0000 7fc3bd200640 1 -- 172.21.15.153:0/2234276517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b80681c0 con 0x7fc3b8161760 2024-03-28T21:51:58.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.973+0000 7fc3aea00640 1 -- 172.21.15.153:0/2234276517 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc3b0046020 con 0x7fc3b8161760 2024-03-28T21:51:58.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.974+0000 7fc3aea00640 1 --2- 172.21.15.153:0/2234276517 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc39406b4d0 0x7fc39406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:51:58.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.974+0000 7fc3aea00640 1 -- 172.21.15.153:0/2234276517 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc3b00acb80 con 0x7fc3b8161760 2024-03-28T21:51:58.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.974+0000 7fc3b5e00640 1 --2- 172.21.15.153:0/2234276517 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc39406b4d0 0x7fc39406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:51:58.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.975+0000 7fc3b5e00640 1 --2- 172.21.15.153:0/2234276517 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc39406b4d0 0x7fc39406d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800a950 tx=0x7fc3a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:51:58.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:58.978+0000 7fc3aea00640 1 -- 172.21.15.153:0/2234276517 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc3b004d030 con 0x7fc3b8161760 2024-03-28T21:51:59.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:59.216+0000 7fc3bd200640 1 -- 172.21.15.153:0/2234276517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc3b80b9fb0 con 0x7fc3b8161760 2024-03-28T21:51:59.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:59.739+0000 7fc3aea00640 1 -- 172.21.15.153:0/2234276517 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fc3b007b970 con 0x7fc3b8161760 2024-03-28T21:51:59.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:59.742+0000 7fc3bd200640 1 -- 172.21.15.153:0/2234276517 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc39406b4d0 msgr2=0x7fc39406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:59.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:59.742+0000 7fc3bd200640 1 --2- 172.21.15.153:0/2234276517 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc39406b4d0 0x7fc39406d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800a950 tx=0x7fc3a8008040 comp rx=0 tx=0).stop 2024-03-28T21:51:59.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:59.742+0000 7fc3bd200640 1 -- 172.21.15.153:0/2234276517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b8161760 msgr2=0x7fc3b80c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:51:59.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:59.742+0000 7fc3bd200640 1 --2- 172.21.15.153:0/2234276517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b8161760 0x7fc3b80c7eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0036040 tx=0x7fc3b0004a40 comp rx=0 tx=0).stop 2024-03-28T21:51:59.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:59.742+0000 7fc3bd200640 1 -- 172.21.15.153:0/2234276517 shutdown_connections 2024-03-28T21:51:59.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:59.742+0000 7fc3bd200640 1 --2- 172.21.15.153:0/2234276517 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc39406b4d0 0x7fc39406d990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:59.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:59.742+0000 7fc3bd200640 1 --2- 172.21.15.153:0/2234276517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b8161760 0x7fc3b80c7eb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:59.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:59.742+0000 7fc3bd200640 1 --2- 172.21.15.153:0/2234276517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3b80d1040 0x7fc3b80c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:59.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:59.742+0000 7fc3bd200640 1 --2- 172.21.15.153:0/2234276517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b80b3870 0x7fc3b814f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:51:59.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:59.742+0000 7fc3bd200640 1 -- 172.21.15.153:0/2234276517 >> 172.21.15.153:0/2234276517 conn(0x7fc3b809d3c0 msgr2=0x7fc3b80cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:51:59.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:59.742+0000 7fc3bd200640 1 -- 172.21.15.153:0/2234276517 shutdown_connections 2024-03-28T21:51:59.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:51:59.742+0000 7fc3bd200640 1 -- 172.21.15.153:0/2234276517 wait complete. 2024-03-28T21:51:59.773 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-28T21:51:59.773 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T21:52:00.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.018+0000 7f7645000640 1 Processor -- start 2024-03-28T21:52:00.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.018+0000 7f7645000640 1 -- start start 2024-03-28T21:52:00.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.019+0000 7f7645000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7640142720 0x7f764006e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.020+0000 7f7645000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f764006db60 con 0x7f764006ee20 2024-03-28T21:52:00.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.020+0000 7f7645000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7640071a80 con 0x7f7640072810 2024-03-28T21:52:00.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.020+0000 7f7645000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7640071d60 con 0x7f7640142720 2024-03-28T21:52:00.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.020+0000 7f763ea00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f764006ee20 0x7f7640072100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46792/0 (socket says 172.21.15.153:46792) 2024-03-28T21:52:00.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.020+0000 7f763ea00640 1 -- 172.21.15.153:0/3207429589 learned_addr learned my addr 172.21.15.153:0/3207429589 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:00.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.020+0000 7f763f400640 1 --2- 172.21.15.153:0/3207429589 >> v2:172.21.15.165:3300/0 conn(0x7f7640142720 0x7f764006e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.020+0000 7f763e000640 1 -- 172.21.15.153:0/3207429589 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596473092 0 0) 0x7f764006db60 con 0x7f764006ee20 2024-03-28T21:52:00.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.020+0000 7f763e000640 1 -- 172.21.15.153:0/3207429589 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7624003520 con 0x7f764006ee20 2024-03-28T21:52:00.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763e000640 1 -- 172.21.15.153:0/3207429589 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 259288656 0 0) 0x7f7624003520 con 0x7f764006ee20 2024-03-28T21:52:00.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763e000640 1 -- 172.21.15.153:0/3207429589 >> v2:172.21.15.165:3300/0 conn(0x7f7640142720 msgr2=0x7f764006e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:00.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763e000640 1 --2- 172.21.15.153:0/3207429589 >> v2:172.21.15.165:3300/0 conn(0x7f7640142720 0x7f764006e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763e000640 1 -- 172.21.15.153:0/3207429589 >> v1:172.21.15.165:6789/0 conn(0x7f7640072810 legacy=0x7f76400cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763e000640 1 -- 172.21.15.153:0/3207429589 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764006de00 con 0x7f764006ee20 2024-03-28T21:52:00.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763e000640 1 -- 172.21.15.153:0/3207429589 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f762c001690 con 0x7f764006ee20 2024-03-28T21:52:00.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763e000640 1 -- 172.21.15.153:0/3207429589 >> v1:172.21.15.153:6789/0 conn(0x7f764006ee20 legacy=0x7f7640072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763e000640 1 --2- 172.21.15.153:0/3207429589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7624003a20 0x7f7624003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763e000640 1 --2- 172.21.15.153:0/3207429589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7624004800 0x7f7624004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763e000640 1 --2- 172.21.15.153:0/3207429589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7624005230 0x7f762400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763e000640 1 -- 172.21.15.153:0/3207429589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f762400c160 con 0x7f7624004800 2024-03-28T21:52:00.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763e000640 1 -- 172.21.15.153:0/3207429589 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f762400c310 con 0x7f7624003a20 2024-03-28T21:52:00.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763e000640 1 -- 172.21.15.153:0/3207429589 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f762400c510 con 0x7f7624005230 2024-03-28T21:52:00.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763ea00640 1 --2- 172.21.15.153:0/3207429589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7624004800 0x7f7624004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763f400640 1 --2- 172.21.15.153:0/3207429589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7624003a20 0x7f7624003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763ea00640 1 -- 172.21.15.153:0/3207429589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7624005230 msgr2=0x7f762400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:00.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.021+0000 7f763ea00640 1 --2- 172.21.15.153:0/3207429589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7624005230 0x7f762400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.022+0000 7f763ea00640 1 -- 172.21.15.153:0/3207429589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7624003a20 msgr2=0x7f7624003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:00.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.022+0000 7f763ea00640 1 --2- 172.21.15.153:0/3207429589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7624003a20 0x7f7624003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.022+0000 7f763ea00640 1 -- 172.21.15.153:0/3207429589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7624003520 con 0x7f7624004800 2024-03-28T21:52:00.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.022+0000 7f763f400640 1 --2- 172.21.15.153:0/3207429589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7624003a20 0x7f7624003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:00.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.022+0000 7f763fe00640 1 -- 172.21.15.153:0/3207429589 reap_dead start 2024-03-28T21:52:00.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.023+0000 7f763ea00640 1 --2- 172.21.15.153:0/3207429589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7624004800 0x7f7624004c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f762c00c210 tx=0x7f7624005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d412e6e2f9a050a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:00.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.023+0000 7f763e000640 1 -- 172.21.15.153:0/3207429589 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c007d30 con 0x7f7624004800 2024-03-28T21:52:00.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.023+0000 7f763e000640 1 -- 172.21.15.153:0/3207429589 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f762c030070 con 0x7f7624004800 2024-03-28T21:52:00.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.023+0000 7f763e000640 1 -- 172.21.15.153:0/3207429589 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c005d30 con 0x7f7624004800 2024-03-28T21:52:00.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.023+0000 7f7645000640 1 -- 172.21.15.153:0/3207429589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7624004800 msgr2=0x7f7624004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.023+0000 7f7645000640 1 --2- 172.21.15.153:0/3207429589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7624004800 0x7f7624004c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f762c00c210 tx=0x7f7624005830 comp rx=0 tx=0).stop 2024-03-28T21:52:00.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.023+0000 7f7645000640 1 -- 172.21.15.153:0/3207429589 shutdown_connections 2024-03-28T21:52:00.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.023+0000 7f7645000640 1 --2- 172.21.15.153:0/3207429589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7624004800 0x7f7624004c80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.023+0000 7f7645000640 1 -- 172.21.15.153:0/3207429589 >> 172.21.15.153:0/3207429589 conn(0x7f76400b1890 msgr2=0x7f76400b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:00.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.024+0000 7f7645000640 1 -- 172.21.15.153:0/3207429589 shutdown_connections 2024-03-28T21:52:00.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.024+0000 7f7645000640 1 -- 172.21.15.153:0/3207429589 wait complete. 2024-03-28T21:52:00.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.025+0000 7f7645000640 1 Processor -- start 2024-03-28T21:52:00.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.025+0000 7f7645000640 1 -- start start 2024-03-28T21:52:00.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.026+0000 7f7645000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7624004800 0x7f764015da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.026+0000 7f7645000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f764015c4b0 0x7f76401e50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.026+0000 7f7645000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764015e970 0x7f764015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.026+0000 7f7645000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f764006e3c0 con 0x7f764015e970 2024-03-28T21:52:00.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.026+0000 7f7645000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7640142b00 con 0x7f7624004800 2024-03-28T21:52:00.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.026+0000 7f7645000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f764006e8e0 con 0x7f764015c4b0 2024-03-28T21:52:00.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.027+0000 7f763fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764015e970 0x7f764015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.027+0000 7f763fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764015e970 0x7f764015b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54140/0 (socket says 172.21.15.153:54140) 2024-03-28T21:52:00.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.027+0000 7f763fe00640 1 -- 172.21.15.153:0/3608090729 learned_addr learned my addr 172.21.15.153:0/3608090729 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:00.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.027+0000 7f763f400640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7624004800 0x7f764015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.027+0000 7f763ea00640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f764015c4b0 0x7f76401e50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.027+0000 7f763fe00640 1 -- 172.21.15.153:0/3608090729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f764015c4b0 msgr2=0x7f76401e50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.027+0000 7f763fe00640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f764015c4b0 0x7f76401e50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.027+0000 7f763fe00640 1 -- 172.21.15.153:0/3608090729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7624004800 msgr2=0x7f764015da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.027+0000 7f763fe00640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7624004800 0x7f764015da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.027+0000 7f763fe00640 1 -- 172.21.15.153:0/3608090729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764015c9b0 con 0x7f764015e970 2024-03-28T21:52:00.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.027+0000 7f763ea00640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f764015c4b0 0x7f76401e50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:00.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.027+0000 7f763fe00640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764015e970 0x7f764015b6e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7640068700 tx=0x7f763800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:00.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.028+0000 7f7637400640 1 -- 172.21.15.153:0/3608090729 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7638017070 con 0x7f764015e970 2024-03-28T21:52:00.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.028+0000 7f7637400640 1 -- 172.21.15.153:0/3608090729 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76380070d0 con 0x7f764015e970 2024-03-28T21:52:00.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.028+0000 7f7637400640 1 -- 172.21.15.153:0/3608090729 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76380074c0 con 0x7f764015e970 2024-03-28T21:52:00.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.028+0000 7f7645000640 1 -- 172.21.15.153:0/3608090729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f764015cc90 con 0x7f764015e970 2024-03-28T21:52:00.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.028+0000 7f7645000640 1 -- 172.21.15.153:0/3608090729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f764015d250 con 0x7f764015e970 2024-03-28T21:52:00.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.029+0000 7f7645000640 1 -- 172.21.15.153:0/3608090729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f764004f520 con 0x7f764015e970 2024-03-28T21:52:00.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.030+0000 7f7637400640 1 -- 172.21.15.153:0/3608090729 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f763801a070 con 0x7f764015e970 2024-03-28T21:52:00.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.031+0000 7f7637400640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f762006b4d0 0x7f762006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.031+0000 7f7637400640 1 -- 172.21.15.153:0/3608090729 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7638089380 con 0x7f764015e970 2024-03-28T21:52:00.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.032+0000 7f763f400640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f762006b4d0 0x7f762006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.032+0000 7f763f400640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f762006b4d0 0x7f762006d990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7630009b20 tx=0x7f7630008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:00.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.036+0000 7f7637400640 1 -- 172.21.15.153:0/3608090729 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7638058200 con 0x7f764015e970 2024-03-28T21:52:00.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.274+0000 7f7645000640 1 -- 172.21.15.153:0/3608090729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76400b2740 con 0x7f764015e970 2024-03-28T21:52:00.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.275+0000 7f7637400640 1 -- 172.21.15.153:0/3608090729 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f7638057b00 con 0x7f764015e970 2024-03-28T21:52:00.278 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:00.278 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/207550071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":207550071},{"type":"v1","addr":"172.21.15.165:6835","nonce":207550071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/900073633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":900073633},{"type":"v1","addr":"172.21.15.153:6837","nonce":900073633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3915706377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3915706377},{"type":"v1","addr":"172.21.15.165:6833","nonce":3915706377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T21:51:56.169625+0000","modified":"2024-03-28T21:51:59.218861+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6836/3516257974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3516257974},{"type":"v1","addr":"172.21.15.153:6836","nonce":3516257974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-03-28T21:52:00.278 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2024-03-28T21:52:00.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.277+0000 7f7645000640 1 -- 172.21.15.153:0/3608090729 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f762006b4d0 msgr2=0x7f762006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.277+0000 7f7645000640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f762006b4d0 0x7f762006d990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7630009b20 tx=0x7f7630008040 comp rx=0 tx=0).stop 2024-03-28T21:52:00.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.277+0000 7f7645000640 1 -- 172.21.15.153:0/3608090729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764015e970 msgr2=0x7f764015b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.277+0000 7f7645000640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764015e970 0x7f764015b6e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7640068700 tx=0x7f763800c960 comp rx=0 tx=0).stop 2024-03-28T21:52:00.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.278+0000 7f7645000640 1 -- 172.21.15.153:0/3608090729 shutdown_connections 2024-03-28T21:52:00.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.278+0000 7f7645000640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f762006b4d0 0x7f762006d990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.278+0000 7f7645000640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f764015e970 0x7f764015b6e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.278+0000 7f7645000640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f764015c4b0 0x7f76401e50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.278+0000 7f7645000640 1 --2- 172.21.15.153:0/3608090729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7624004800 0x7f764015da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.278+0000 7f7645000640 1 -- 172.21.15.153:0/3608090729 >> 172.21.15.153:0/3608090729 conn(0x7f76400b1890 msgr2=0x7f76400ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:00.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.278+0000 7f7645000640 1 -- 172.21.15.153:0/3608090729 shutdown_connections 2024-03-28T21:52:00.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.278+0000 7f7645000640 1 -- 172.21.15.153:0/3608090729 wait complete. 2024-03-28T21:52:00.299 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:00.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.490+0000 7fb070600640 1 Processor -- start 2024-03-28T21:52:00.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.490+0000 7fb070600640 1 -- start start 2024-03-28T21:52:00.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.491+0000 7fb070600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb068161990 0x7fb0680d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.491+0000 7fb070600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb0680d2ad0 0x7fb0680cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.491+0000 7fb070600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0680ceca0 con 0x7fb0680b3a60 2024-03-28T21:52:00.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.491+0000 7fb070600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb0680d1a20 con 0x7fb0680d2ad0 2024-03-28T21:52:00.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.491+0000 7fb070600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb0680d4810 con 0x7fb068161990 2024-03-28T21:52:00.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.492+0000 7fb06e600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb0680d2ad0 0x7fb0680cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.492+0000 7fb06e600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb0680d2ad0 0x7fb0680cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54150/0 (socket says 172.21.15.153:54150) 2024-03-28T21:52:00.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.492+0000 7fb06e600640 1 -- 172.21.15.153:0/2447437277 learned_addr learned my addr 172.21.15.153:0/2447437277 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:00.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.492+0000 7fb06dc00640 1 --2- 172.21.15.153:0/2447437277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb068161990 0x7fb0680d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.492+0000 7fb06e600640 1 -- 172.21.15.153:0/2447437277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb068161990 msgr2=0x7fb0680d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:00.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.492+0000 7fb06e600640 1 --2- 172.21.15.153:0/2447437277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb068161990 0x7fb0680d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.492+0000 7fb06e600640 1 -- 172.21.15.153:0/2447437277 >> v1:172.21.15.153:6789/0 conn(0x7fb0680b3a60 legacy=0x7fb0680d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.492+0000 7fb06e600640 1 -- 172.21.15.153:0/2447437277 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0680d4af0 con 0x7fb0680d2ad0 2024-03-28T21:52:00.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.494+0000 7fb06e600640 1 --2- 172.21.15.153:0/2447437277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0680d2ad0 0x7fb0680cf720 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb060009e50 tx=0x7fb06002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3f19a4925d9cdf server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:00.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.494+0000 7fb067e00640 1 -- 172.21.15.153:0/2447437277 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06002cb00 con 0x7fb0680d2ad0 2024-03-28T21:52:00.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.494+0000 7fb067e00640 1 -- 172.21.15.153:0/2447437277 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb06002cca0 con 0x7fb0680d2ad0 2024-03-28T21:52:00.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.494+0000 7fb067e00640 1 -- 172.21.15.153:0/2447437277 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060034610 con 0x7fb0680d2ad0 2024-03-28T21:52:00.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.495+0000 7fb070600640 1 -- 172.21.15.153:0/2447437277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0680d2ad0 msgr2=0x7fb0680cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.495+0000 7fb070600640 1 --2- 172.21.15.153:0/2447437277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0680d2ad0 0x7fb0680cf720 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb060009e50 tx=0x7fb06002bf60 comp rx=0 tx=0).stop 2024-03-28T21:52:00.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.495+0000 7fb070600640 1 -- 172.21.15.153:0/2447437277 shutdown_connections 2024-03-28T21:52:00.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.495+0000 7fb070600640 1 --2- 172.21.15.153:0/2447437277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0680d2ad0 0x7fb0680cf720 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.495+0000 7fb070600640 1 --2- 172.21.15.153:0/2447437277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb068161990 0x7fb0680d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.495+0000 7fb070600640 1 -- 172.21.15.153:0/2447437277 >> 172.21.15.153:0/2447437277 conn(0x7fb06809d430 msgr2=0x7fb0680d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:00.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.495+0000 7fb070600640 1 -- 172.21.15.153:0/2447437277 shutdown_connections 2024-03-28T21:52:00.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.495+0000 7fb070600640 1 -- 172.21.15.153:0/2447437277 wait complete. 2024-03-28T21:52:00.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.496+0000 7fb070600640 1 Processor -- start 2024-03-28T21:52:00.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.497+0000 7fb070600640 1 -- start start 2024-03-28T21:52:00.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.497+0000 7fb070600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0680b3a60 0x7fb0680b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.497+0000 7fb070600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0680d2ad0 0x7fb068157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb070600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb068161990 0x7fb068159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb070600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb0680cf200 con 0x7fb068161990 2024-03-28T21:52:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb070600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb0680cef20 con 0x7fb0680b3a60 2024-03-28T21:52:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb070600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb0680b3ec0 con 0x7fb0680d2ad0 2024-03-28T21:52:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb06e600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb068161990 0x7fb068159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb06e600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb068161990 0x7fb068159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54166/0 (socket says 172.21.15.153:54166) 2024-03-28T21:52:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb06e600640 1 -- 172.21.15.153:0/4188629338 learned_addr learned my addr 172.21.15.153:0/4188629338 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb06dc00640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0680b3a60 0x7fb0680b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb06d200640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0680d2ad0 0x7fb068157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb06e600640 1 -- 172.21.15.153:0/4188629338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0680d2ad0 msgr2=0x7fb068157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb06e600640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0680d2ad0 0x7fb068157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb06e600640 1 -- 172.21.15.153:0/4188629338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0680b3a60 msgr2=0x7fb0680b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb06e600640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0680b3a60 0x7fb0680b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb06e600640 1 -- 172.21.15.153:0/4188629338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06815aaa0 con 0x7fb068161990 2024-03-28T21:52:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.498+0000 7fb06d200640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0680d2ad0 0x7fb068157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.499+0000 7fb06e600640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb068161990 0x7fb068159b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb060009e50 tx=0x7fb060004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.499+0000 7fb065600640 1 -- 172.21.15.153:0/4188629338 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060043020 con 0x7fb068161990 2024-03-28T21:52:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.499+0000 7fb065600640 1 -- 172.21.15.153:0/4188629338 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb06002ce50 con 0x7fb068161990 2024-03-28T21:52:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.499+0000 7fb065600640 1 -- 172.21.15.153:0/4188629338 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060009510 con 0x7fb068161990 2024-03-28T21:52:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.499+0000 7fb070600640 1 -- 172.21.15.153:0/4188629338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06815ad80 con 0x7fb068161990 2024-03-28T21:52:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.499+0000 7fb070600640 1 -- 172.21.15.153:0/4188629338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb068159620 con 0x7fb068161990 2024-03-28T21:52:00.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.500+0000 7fb070600640 1 -- 172.21.15.153:0/4188629338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb068068ff0 con 0x7fb068161990 2024-03-28T21:52:00.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.501+0000 7fb065600640 1 -- 172.21.15.153:0/4188629338 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb060005d10 con 0x7fb068161990 2024-03-28T21:52:00.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.502+0000 7fb065600640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb04806b4d0 0x7fb04806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.502+0000 7fb065600640 1 -- 172.21.15.153:0/4188629338 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb0600acb20 con 0x7fb068161990 2024-03-28T21:52:00.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.502+0000 7fb06dc00640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb04806b4d0 0x7fb04806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.503+0000 7fb06dc00640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb04806b4d0 0x7fb04806d990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb05c006fd0 tx=0x7fb05c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:00.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.506+0000 7fb065600640 1 -- 172.21.15.153:0/4188629338 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb06007b990 con 0x7fb068161990 2024-03-28T21:52:00.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.700+0000 7fb070600640 1 -- 172.21.15.153:0/4188629338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0681597f0 con 0x7fb068161990 2024-03-28T21:52:00.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.702+0000 7fb065600640 1 -- 172.21.15.153:0/4188629338 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7fb06007b290 con 0x7fb068161990 2024-03-28T21:52:00.705 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:00.705 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:57.716531+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:00.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.704+0000 7fb070600640 1 -- 172.21.15.153:0/4188629338 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb04806b4d0 msgr2=0x7fb04806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.704+0000 7fb070600640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb04806b4d0 0x7fb04806d990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb05c006fd0 tx=0x7fb05c008040 comp rx=0 tx=0).stop 2024-03-28T21:52:00.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.704+0000 7fb070600640 1 -- 172.21.15.153:0/4188629338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb068161990 msgr2=0x7fb068159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.704+0000 7fb070600640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb068161990 0x7fb068159b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb060009e50 tx=0x7fb060004a40 comp rx=0 tx=0).stop 2024-03-28T21:52:00.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.705+0000 7fb070600640 1 -- 172.21.15.153:0/4188629338 shutdown_connections 2024-03-28T21:52:00.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.705+0000 7fb070600640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb04806b4d0 0x7fb04806d990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.705+0000 7fb070600640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb068161990 0x7fb068159b40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.705+0000 7fb070600640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0680d2ad0 0x7fb068157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.705+0000 7fb070600640 1 --2- 172.21.15.153:0/4188629338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0680b3a60 0x7fb0680b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.705+0000 7fb070600640 1 -- 172.21.15.153:0/4188629338 >> 172.21.15.153:0/4188629338 conn(0x7fb06809d430 msgr2=0x7fb0680b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:00.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.705+0000 7fb070600640 1 -- 172.21.15.153:0/4188629338 shutdown_connections 2024-03-28T21:52:00.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.705+0000 7fb070600640 1 -- 172.21.15.153:0/4188629338 wait complete. 2024-03-28T21:52:00.726 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-28T21:52:00.726 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T21:52:00.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.931+0000 7f0d4d800640 1 Processor -- start 2024-03-28T21:52:00.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.931+0000 7f0d4d800640 1 -- start start 2024-03-28T21:52:00.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.933+0000 7f0d4d800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0d48161900 0x7f0d480cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.933+0000 7f0d4d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d480d00b0 0x7f0d480b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.933+0000 7f0d4d800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d480d2610 con 0x7f0d480d4d60 2024-03-28T21:52:00.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.933+0000 7f0d4d800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0d480d2980 con 0x7f0d48161900 2024-03-28T21:52:00.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.933+0000 7f0d4d800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0d480d3190 con 0x7f0d480d00b0 2024-03-28T21:52:00.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.934+0000 7f0d3e000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d480d00b0 0x7f0d480b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.934+0000 7f0d3e000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d480d00b0 0x7f0d480b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:43460/0 (socket says 172.21.15.153:43460) 2024-03-28T21:52:00.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.934+0000 7f0d3e000640 1 -- 172.21.15.153:0/1136216245 learned_addr learned my addr 172.21.15.153:0/1136216245 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:00.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.934+0000 7f0d47400640 1 --1- 172.21.15.153:0/1136216245 >> v1:172.21.15.165:6789/0 conn(0x7f0d480d4d60 0x7f0d480d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:45948/0 (socket says 172.21.15.153:45948) 2024-03-28T21:52:00.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.934+0000 7f0d46a00640 1 --2- 172.21.15.153:0/1136216245 >> v2:172.21.15.165:3300/0 conn(0x7f0d48161900 0x7f0d480cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.934+0000 7f0d3e000640 1 -- 172.21.15.153:0/1136216245 >> v2:172.21.15.165:3300/0 conn(0x7f0d48161900 msgr2=0x7f0d480cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:00.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.934+0000 7f0d3e000640 1 --2- 172.21.15.153:0/1136216245 >> v2:172.21.15.165:3300/0 conn(0x7f0d48161900 0x7f0d480cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.934+0000 7f0d3e000640 1 -- 172.21.15.153:0/1136216245 >> v1:172.21.15.165:6789/0 conn(0x7f0d480d4d60 legacy=0x7f0d480d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.934+0000 7f0d3e000640 1 -- 172.21.15.153:0/1136216245 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d480d2bd0 con 0x7f0d480d00b0 2024-03-28T21:52:00.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.936+0000 7f0d3e000640 1 --2- 172.21.15.153:0/1136216245 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d480d00b0 0x7f0d480b3a60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009870 tx=0x7f0d3802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbdc86d966c3b962 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:00.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.936+0000 7f0d46000640 1 -- 172.21.15.153:0/1136216245 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d38034070 con 0x7f0d480d00b0 2024-03-28T21:52:00.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.936+0000 7f0d46000640 1 -- 172.21.15.153:0/1136216245 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d38030840 con 0x7f0d480d00b0 2024-03-28T21:52:00.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.936+0000 7f0d46000640 1 -- 172.21.15.153:0/1136216245 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d38030c10 con 0x7f0d480d00b0 2024-03-28T21:52:00.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.937+0000 7f0d4d800640 1 -- 172.21.15.153:0/1136216245 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d480d00b0 msgr2=0x7f0d480b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.937+0000 7f0d4d800640 1 --2- 172.21.15.153:0/1136216245 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d480d00b0 0x7f0d480b3a60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009870 tx=0x7f0d3802b980 comp rx=0 tx=0).stop 2024-03-28T21:52:00.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.937+0000 7f0d4d800640 1 -- 172.21.15.153:0/1136216245 shutdown_connections 2024-03-28T21:52:00.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.937+0000 7f0d4d800640 1 --2- 172.21.15.153:0/1136216245 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d480d00b0 0x7f0d480b3a60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.937+0000 7f0d4d800640 1 --2- 172.21.15.153:0/1136216245 >> v2:172.21.15.165:3300/0 conn(0x7f0d48161900 0x7f0d480cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.937+0000 7f0d4d800640 1 -- 172.21.15.153:0/1136216245 >> 172.21.15.153:0/1136216245 conn(0x7f0d4809d430 msgr2=0x7f0d480d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:00.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.937+0000 7f0d4d800640 1 -- 172.21.15.153:0/1136216245 shutdown_connections 2024-03-28T21:52:00.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.937+0000 7f0d4d800640 1 -- 172.21.15.153:0/1136216245 wait complete. 2024-03-28T21:52:00.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.938+0000 7f0d4d800640 1 Processor -- start 2024-03-28T21:52:00.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.939+0000 7f0d4d800640 1 -- start start 2024-03-28T21:52:00.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.939+0000 7f0d4d800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d480d4d60 0x7f0d4815d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.939+0000 7f0d4d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d48161900 0x7f0d481e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.939+0000 7f0d4d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d481e8320 0x7f0d480b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.939+0000 7f0d4d800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0d480d22a0 con 0x7f0d481e8320 2024-03-28T21:52:00.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.939+0000 7f0d4d800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0d48161ce0 con 0x7f0d480d4d60 2024-03-28T21:52:00.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.939+0000 7f0d4d800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0d480b3fa0 con 0x7f0d48161900 2024-03-28T21:52:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.940+0000 7f0d47400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d481e8320 0x7f0d480b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.940+0000 7f0d47400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d481e8320 0x7f0d480b6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54176/0 (socket says 172.21.15.153:54176) 2024-03-28T21:52:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.940+0000 7f0d47400640 1 -- 172.21.15.153:0/136551241 learned_addr learned my addr 172.21.15.153:0/136551241 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.940+0000 7f0d46a00640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d480d4d60 0x7f0d4815d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.940+0000 7f0d3e000640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d48161900 0x7f0d481e7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.940+0000 7f0d47400640 1 -- 172.21.15.153:0/136551241 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d48161900 msgr2=0x7f0d481e7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.940+0000 7f0d47400640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d48161900 0x7f0d481e7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.940+0000 7f0d47400640 1 -- 172.21.15.153:0/136551241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d480d4d60 msgr2=0x7f0d4815d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.940+0000 7f0d47400640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d480d4d60 0x7f0d4815d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.940+0000 7f0d47400640 1 -- 172.21.15.153:0/136551241 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d480b7d60 con 0x7f0d481e8320 2024-03-28T21:52:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.940+0000 7f0d3e000640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d48161900 0x7f0d481e7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.941+0000 7f0d47400640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d481e8320 0x7f0d480b6fd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000c780 tx=0x7f0d4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.941+0000 7f0d3f400640 1 -- 172.21.15.153:0/136551241 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d40017070 con 0x7f0d481e8320 2024-03-28T21:52:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.941+0000 7f0d3f400640 1 -- 172.21.15.153:0/136551241 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4000a640 con 0x7f0d481e8320 2024-03-28T21:52:00.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.941+0000 7f0d4d800640 1 -- 172.21.15.153:0/136551241 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d480b8040 con 0x7f0d481e8320 2024-03-28T21:52:00.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.941+0000 7f0d3f400640 1 -- 172.21.15.153:0/136551241 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000aa30 con 0x7f0d481e8320 2024-03-28T21:52:00.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.941+0000 7f0d4d800640 1 -- 172.21.15.153:0/136551241 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d480b8600 con 0x7f0d481e8320 2024-03-28T21:52:00.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.942+0000 7f0d4d800640 1 -- 172.21.15.153:0/136551241 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d48068ff0 con 0x7f0d481e8320 2024-03-28T21:52:00.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.943+0000 7f0d3f400640 1 -- 172.21.15.153:0/136551241 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0d4001a070 con 0x7f0d481e8320 2024-03-28T21:52:00.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.945+0000 7f0d3f400640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0d2406b4d0 0x7f0d2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:00.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.945+0000 7f0d3f400640 1 -- 172.21.15.153:0/136551241 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0d40089710 con 0x7f0d481e8320 2024-03-28T21:52:00.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.945+0000 7f0d46a00640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0d2406b4d0 0x7f0d2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:00.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.946+0000 7f0d46a00640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0d2406b4d0 0x7f0d2406d990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009aa0 tx=0x7f0d30009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:00.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:00.948+0000 7f0d3f400640 1 -- 172.21.15.153:0/136551241 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0d40057f40 con 0x7f0d481e8320 2024-03-28T21:52:01.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.141+0000 7f0d4d800640 1 -- 172.21.15.153:0/136551241 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d480ce5c0 con 0x7f0d2406b4d0 2024-03-28T21:52:01.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.152+0000 7f0d3f400640 1 -- 172.21.15.153:0/136551241 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f0d480ce5c0 con 0x7f0d2406b4d0 2024-03-28T21:52:01.159 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:01.160 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-03-28T21:52:01.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.157+0000 7f0d4d800640 1 -- 172.21.15.153:0/136551241 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0d2406b4d0 msgr2=0x7f0d2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:01.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.157+0000 7f0d4d800640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0d2406b4d0 0x7f0d2406d990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009aa0 tx=0x7f0d30009190 comp rx=0 tx=0).stop 2024-03-28T21:52:01.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.157+0000 7f0d4d800640 1 -- 172.21.15.153:0/136551241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d481e8320 msgr2=0x7f0d480b6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:01.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.157+0000 7f0d4d800640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d481e8320 0x7f0d480b6fd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000c780 tx=0x7f0d4000cc40 comp rx=0 tx=0).stop 2024-03-28T21:52:01.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.157+0000 7f0d4d800640 1 -- 172.21.15.153:0/136551241 shutdown_connections 2024-03-28T21:52:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.157+0000 7f0d4d800640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0d2406b4d0 0x7f0d2406d990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.157+0000 7f0d4d800640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d481e8320 0x7f0d480b6fd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.157+0000 7f0d4d800640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d48161900 0x7f0d481e7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.157+0000 7f0d4d800640 1 --2- 172.21.15.153:0/136551241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d480d4d60 0x7f0d4815d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.157+0000 7f0d4d800640 1 -- 172.21.15.153:0/136551241 >> 172.21.15.153:0/136551241 conn(0x7f0d4809d430 msgr2=0x7f0d4806d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.157+0000 7f0d4d800640 1 -- 172.21.15.153:0/136551241 shutdown_connections 2024-03-28T21:52:01.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.157+0000 7f0d4d800640 1 -- 172.21.15.153:0/136551241 wait complete. 2024-03-28T21:52:01.182 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-03-28T21:51:59.464728+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223492,"kb_used_data":2984,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751228,"statfs":{"total":773094113280,"available":772865257472,"internally_reserved":0,"allocated":3055616,"data_stored":1816228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.777479"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735977+0000","last_change":"2024-03-28T21:51:56.734116+0000","last_active":"2024-03-28T21:51:57.735977+0000","last_peered":"2024-03-28T21:51:57.735977+0000","last_clean":"2024-03-28T21:51:57.735977+0000","last_became_active":"2024-03-28T21:51:56.733812+0000","last_became_peered":"2024-03-28T21:51:56.733812+0000","last_unstale":"2024-03-28T21:51:57.735977+0000","last_undegraded":"2024-03-28T21:51:57.735977+0000","last_fullsized":"2024-03-28T21:51:57.735977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:55:29.475667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740119+0000","last_change":"2024-03-28T21:51:56.735553+0000","last_active":"2024-03-28T21:51:57.740119+0000","last_peered":"2024-03-28T21:51:57.740119+0000","last_clean":"2024-03-28T21:51:57.740119+0000","last_became_active":"2024-03-28T21:51:56.734024+0000","last_became_peered":"2024-03-28T21:51:56.734024+0000","last_unstale":"2024-03-28T21:51:57.740119+0000","last_undegraded":"2024-03-28T21:51:57.740119+0000","last_fullsized":"2024-03-28T21:51:57.740119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:11.932847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.329774+0000","last_change":"2024-03-28T21:51:56.737454+0000","last_active":"2024-03-28T21:51:58.329774+0000","last_peered":"2024-03-28T21:51:58.329774+0000","last_clean":"2024-03-28T21:51:58.329774+0000","last_became_active":"2024-03-28T21:51:56.737087+0000","last_became_peered":"2024-03-28T21:51:56.737087+0000","last_unstale":"2024-03-28T21:51:58.329774+0000","last_undegraded":"2024-03-28T21:51:58.329774+0000","last_fullsized":"2024-03-28T21:51:58.329774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:53:53.920816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331759+0000","last_change":"2024-03-28T21:51:56.736235+0000","last_active":"2024-03-28T21:51:58.331759+0000","last_peered":"2024-03-28T21:51:58.331759+0000","last_clean":"2024-03-28T21:51:58.331759+0000","last_became_active":"2024-03-28T21:51:56.735603+0000","last_became_peered":"2024-03-28T21:51:56.735603+0000","last_unstale":"2024-03-28T21:51:58.331759+0000","last_undegraded":"2024-03-28T21:51:58.331759+0000","last_fullsized":"2024-03-28T21:51:58.331759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:24.456985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735254+0000","last_change":"2024-03-28T21:51:56.739891+0000","last_active":"2024-03-28T21:51:57.735254+0000","last_peered":"2024-03-28T21:51:57.735254+0000","last_clean":"2024-03-28T21:51:57.735254+0000","last_became_active":"2024-03-28T21:51:56.739615+0000","last_became_peered":"2024-03-28T21:51:56.739615+0000","last_unstale":"2024-03-28T21:51:57.735254+0000","last_undegraded":"2024-03-28T21:51:57.735254+0000","last_fullsized":"2024-03-28T21:51:57.735254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:30.418711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331127+0000","last_change":"2024-03-28T21:51:56.742464+0000","last_active":"2024-03-28T21:51:58.331127+0000","last_peered":"2024-03-28T21:51:58.331127+0000","last_clean":"2024-03-28T21:51:58.331127+0000","last_became_active":"2024-03-28T21:51:56.741634+0000","last_became_peered":"2024-03-28T21:51:56.741634+0000","last_unstale":"2024-03-28T21:51:58.331127+0000","last_undegraded":"2024-03-28T21:51:58.331127+0000","last_fullsized":"2024-03-28T21:51:58.331127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:09:58.678525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735080+0000","last_change":"2024-03-28T21:51:56.743653+0000","last_active":"2024-03-28T21:51:57.735080+0000","last_peered":"2024-03-28T21:51:57.735080+0000","last_clean":"2024-03-28T21:51:57.735080+0000","last_became_active":"2024-03-28T21:51:56.742149+0000","last_became_peered":"2024-03-28T21:51:56.742149+0000","last_unstale":"2024-03-28T21:51:57.735080+0000","last_undegraded":"2024-03-28T21:51:57.735080+0000","last_fullsized":"2024-03-28T21:51:57.735080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:09:58.678525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828651+0000","last_change":"2024-03-28T21:51:56.752911+0000","last_active":"2024-03-28T21:51:57.828651+0000","last_peered":"2024-03-28T21:51:57.828651+0000","last_clean":"2024-03-28T21:51:57.828651+0000","last_became_active":"2024-03-28T21:51:56.748615+0000","last_became_peered":"2024-03-28T21:51:56.748615+0000","last_unstale":"2024-03-28T21:51:57.828651+0000","last_undegraded":"2024-03-28T21:51:57.828651+0000","last_fullsized":"2024-03-28T21:51:57.828651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:55.682963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736936+0000","last_change":"2024-03-28T21:51:56.741836+0000","last_active":"2024-03-28T21:51:57.736936+0000","last_peered":"2024-03-28T21:51:57.736936+0000","last_clean":"2024-03-28T21:51:57.736936+0000","last_became_active":"2024-03-28T21:51:56.741491+0000","last_became_peered":"2024-03-28T21:51:56.741491+0000","last_unstale":"2024-03-28T21:51:57.736936+0000","last_undegraded":"2024-03-28T21:51:57.736936+0000","last_fullsized":"2024-03-28T21:51:57.736936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:53:40.266285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739986+0000","last_change":"2024-03-28T21:51:56.749181+0000","last_active":"2024-03-28T21:51:57.739986+0000","last_peered":"2024-03-28T21:51:57.739986+0000","last_clean":"2024-03-28T21:51:57.739986+0000","last_became_active":"2024-03-28T21:51:56.748011+0000","last_became_peered":"2024-03-28T21:51:56.748011+0000","last_unstale":"2024-03-28T21:51:57.739986+0000","last_undegraded":"2024-03-28T21:51:57.739986+0000","last_fullsized":"2024-03-28T21:51:57.739986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:11.932847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739442+0000","last_change":"2024-03-28T21:51:56.735051+0000","last_active":"2024-03-28T21:51:57.739442+0000","last_peered":"2024-03-28T21:51:57.739442+0000","last_clean":"2024-03-28T21:51:57.739442+0000","last_became_active":"2024-03-28T21:51:56.734565+0000","last_became_peered":"2024-03-28T21:51:56.734565+0000","last_unstale":"2024-03-28T21:51:57.739442+0000","last_undegraded":"2024-03-28T21:51:57.739442+0000","last_fullsized":"2024-03-28T21:51:57.739442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:28.881798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737999+0000","last_change":"2024-03-28T21:51:56.725130+0000","last_active":"2024-03-28T21:51:57.737999+0000","last_peered":"2024-03-28T21:51:57.737999+0000","last_clean":"2024-03-28T21:51:57.737999+0000","last_became_active":"2024-03-28T21:51:56.724746+0000","last_became_peered":"2024-03-28T21:51:56.724746+0000","last_unstale":"2024-03-28T21:51:57.737999+0000","last_undegraded":"2024-03-28T21:51:57.737999+0000","last_fullsized":"2024-03-28T21:51:57.737999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:31:25.125095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829271+0000","last_change":"2024-03-28T21:51:56.732293+0000","last_active":"2024-03-28T21:51:57.829271+0000","last_peered":"2024-03-28T21:51:57.829271+0000","last_clean":"2024-03-28T21:51:57.829271+0000","last_became_active":"2024-03-28T21:51:56.732008+0000","last_became_peered":"2024-03-28T21:51:56.732008+0000","last_unstale":"2024-03-28T21:51:57.829271+0000","last_undegraded":"2024-03-28T21:51:57.829271+0000","last_fullsized":"2024-03-28T21:51:57.829271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:33:42.107550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330107+0000","last_change":"2024-03-28T21:51:56.732803+0000","last_active":"2024-03-28T21:51:58.330107+0000","last_peered":"2024-03-28T21:51:58.330107+0000","last_clean":"2024-03-28T21:51:58.330107+0000","last_became_active":"2024-03-28T21:51:56.732496+0000","last_became_peered":"2024-03-28T21:51:56.732496+0000","last_unstale":"2024-03-28T21:51:58.330107+0000","last_undegraded":"2024-03-28T21:51:58.330107+0000","last_fullsized":"2024-03-28T21:51:58.330107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:39:08.739432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739756+0000","last_change":"2024-03-28T21:51:56.732159+0000","last_active":"2024-03-28T21:51:57.739756+0000","last_peered":"2024-03-28T21:51:57.739756+0000","last_clean":"2024-03-28T21:51:57.739756+0000","last_became_active":"2024-03-28T21:51:56.731820+0000","last_became_peered":"2024-03-28T21:51:56.731820+0000","last_unstale":"2024-03-28T21:51:57.739756+0000","last_undegraded":"2024-03-28T21:51:57.739756+0000","last_fullsized":"2024-03-28T21:51:57.739756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:08:15.623597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331126+0000","last_change":"2024-03-28T21:51:56.741864+0000","last_active":"2024-03-28T21:51:58.331126+0000","last_peered":"2024-03-28T21:51:58.331126+0000","last_clean":"2024-03-28T21:51:58.331126+0000","last_became_active":"2024-03-28T21:51:56.741579+0000","last_became_peered":"2024-03-28T21:51:56.741579+0000","last_unstale":"2024-03-28T21:51:58.331126+0000","last_undegraded":"2024-03-28T21:51:58.331126+0000","last_fullsized":"2024-03-28T21:51:58.331126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:20:02.821931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332613+0000","last_change":"2024-03-28T21:51:56.739060+0000","last_active":"2024-03-28T21:51:58.332613+0000","last_peered":"2024-03-28T21:51:58.332613+0000","last_clean":"2024-03-28T21:51:58.332613+0000","last_became_active":"2024-03-28T21:51:56.738641+0000","last_became_peered":"2024-03-28T21:51:56.738641+0000","last_unstale":"2024-03-28T21:51:58.332613+0000","last_undegraded":"2024-03-28T21:51:58.332613+0000","last_fullsized":"2024-03-28T21:51:58.332613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:36:15.569229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.799302+0000","last_change":"2024-03-28T21:51:56.737872+0000","last_active":"2024-03-28T21:51:57.799302+0000","last_peered":"2024-03-28T21:51:57.799302+0000","last_clean":"2024-03-28T21:51:57.799302+0000","last_became_active":"2024-03-28T21:51:56.737566+0000","last_became_peered":"2024-03-28T21:51:56.737566+0000","last_unstale":"2024-03-28T21:51:57.799302+0000","last_undegraded":"2024-03-28T21:51:57.799302+0000","last_fullsized":"2024-03-28T21:51:57.799302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:42:21.430278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736646+0000","last_change":"2024-03-28T21:51:56.738430+0000","last_active":"2024-03-28T21:51:57.736646+0000","last_peered":"2024-03-28T21:51:57.736646+0000","last_clean":"2024-03-28T21:51:57.736646+0000","last_became_active":"2024-03-28T21:51:56.738084+0000","last_became_peered":"2024-03-28T21:51:56.738084+0000","last_unstale":"2024-03-28T21:51:57.736646+0000","last_undegraded":"2024-03-28T21:51:57.736646+0000","last_fullsized":"2024-03-28T21:51:57.736646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:21:00.155587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739051+0000","last_change":"2024-03-28T21:51:56.740987+0000","last_active":"2024-03-28T21:51:57.739051+0000","last_peered":"2024-03-28T21:51:57.739051+0000","last_clean":"2024-03-28T21:51:57.739051+0000","last_became_active":"2024-03-28T21:51:56.740456+0000","last_became_peered":"2024-03-28T21:51:56.740456+0000","last_unstale":"2024-03-28T21:51:57.739051+0000","last_undegraded":"2024-03-28T21:51:57.739051+0000","last_fullsized":"2024-03-28T21:51:57.739051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:08:15.623597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330303+0000","last_change":"2024-03-28T21:51:56.737666+0000","last_active":"2024-03-28T21:51:58.330303+0000","last_peered":"2024-03-28T21:51:58.330303+0000","last_clean":"2024-03-28T21:51:58.330303+0000","last_became_active":"2024-03-28T21:51:56.737409+0000","last_became_peered":"2024-03-28T21:51:56.737409+0000","last_unstale":"2024-03-28T21:51:58.330303+0000","last_undegraded":"2024-03-28T21:51:58.330303+0000","last_fullsized":"2024-03-28T21:51:58.330303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:43:56.754076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331510+0000","last_change":"2024-03-28T21:51:56.734651+0000","last_active":"2024-03-28T21:51:58.331510+0000","last_peered":"2024-03-28T21:51:58.331510+0000","last_clean":"2024-03-28T21:51:58.331510+0000","last_became_active":"2024-03-28T21:51:56.733779+0000","last_became_peered":"2024-03-28T21:51:56.733779+0000","last_unstale":"2024-03-28T21:51:58.331510+0000","last_undegraded":"2024-03-28T21:51:58.331510+0000","last_fullsized":"2024-03-28T21:51:58.331510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:27:25.577575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828725+0000","last_change":"2024-03-28T21:51:56.745483+0000","last_active":"2024-03-28T21:51:57.828725+0000","last_peered":"2024-03-28T21:51:57.828725+0000","last_clean":"2024-03-28T21:51:57.828725+0000","last_became_active":"2024-03-28T21:51:56.745196+0000","last_became_peered":"2024-03-28T21:51:56.745196+0000","last_unstale":"2024-03-28T21:51:57.828725+0000","last_undegraded":"2024-03-28T21:51:57.828725+0000","last_fullsized":"2024-03-28T21:51:57.828725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:28.881798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331406+0000","last_change":"2024-03-28T21:51:56.737805+0000","last_active":"2024-03-28T21:51:58.331406+0000","last_peered":"2024-03-28T21:51:58.331406+0000","last_clean":"2024-03-28T21:51:58.331406+0000","last_became_active":"2024-03-28T21:51:56.737549+0000","last_became_peered":"2024-03-28T21:51:56.737549+0000","last_unstale":"2024-03-28T21:51:58.331406+0000","last_undegraded":"2024-03-28T21:51:58.331406+0000","last_fullsized":"2024-03-28T21:51:58.331406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:30.418711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829532+0000","last_change":"2024-03-28T21:51:56.746355+0000","last_active":"2024-03-28T21:51:57.829532+0000","last_peered":"2024-03-28T21:51:57.829532+0000","last_clean":"2024-03-28T21:51:57.829532+0000","last_became_active":"2024-03-28T21:51:56.744993+0000","last_became_peered":"2024-03-28T21:51:56.744993+0000","last_unstale":"2024-03-28T21:51:57.829532+0000","last_undegraded":"2024-03-28T21:51:57.829532+0000","last_fullsized":"2024-03-28T21:51:57.829532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:09:58.678525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740180+0000","last_change":"2024-03-28T21:51:56.718719+0000","last_active":"2024-03-28T21:51:57.740180+0000","last_peered":"2024-03-28T21:51:57.740180+0000","last_clean":"2024-03-28T21:51:57.740180+0000","last_became_active":"2024-03-28T21:51:56.718298+0000","last_became_peered":"2024-03-28T21:51:56.718298+0000","last_unstale":"2024-03-28T21:51:57.740180+0000","last_undegraded":"2024-03-28T21:51:57.740180+0000","last_fullsized":"2024-03-28T21:51:57.740180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:33:42.107550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740391+0000","last_change":"2024-03-28T21:51:56.736179+0000","last_active":"2024-03-28T21:51:57.740391+0000","last_peered":"2024-03-28T21:51:57.740391+0000","last_clean":"2024-03-28T21:51:57.740391+0000","last_became_active":"2024-03-28T21:51:56.735901+0000","last_became_peered":"2024-03-28T21:51:56.735901+0000","last_unstale":"2024-03-28T21:51:57.740391+0000","last_undegraded":"2024-03-28T21:51:57.740391+0000","last_fullsized":"2024-03-28T21:51:57.740391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:33:42.107550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829438+0000","last_change":"2024-03-28T21:51:56.746834+0000","last_active":"2024-03-28T21:51:57.829438+0000","last_peered":"2024-03-28T21:51:57.829438+0000","last_clean":"2024-03-28T21:51:57.829438+0000","last_became_active":"2024-03-28T21:51:56.745939+0000","last_became_peered":"2024-03-28T21:51:56.745939+0000","last_unstale":"2024-03-28T21:51:57.829438+0000","last_undegraded":"2024-03-28T21:51:57.829438+0000","last_fullsized":"2024-03-28T21:51:57.829438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:20:02.821931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330314+0000","last_change":"2024-03-28T21:51:56.737457+0000","last_active":"2024-03-28T21:51:58.330314+0000","last_peered":"2024-03-28T21:51:58.330314+0000","last_clean":"2024-03-28T21:51:58.330314+0000","last_became_active":"2024-03-28T21:51:56.737113+0000","last_became_peered":"2024-03-28T21:51:56.737113+0000","last_unstale":"2024-03-28T21:51:58.330314+0000","last_undegraded":"2024-03-28T21:51:58.330314+0000","last_fullsized":"2024-03-28T21:51:58.330314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:11:32.340414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331592+0000","last_change":"2024-03-28T21:51:56.731405+0000","last_active":"2024-03-28T21:51:58.331592+0000","last_peered":"2024-03-28T21:51:58.331592+0000","last_clean":"2024-03-28T21:51:58.331592+0000","last_became_active":"2024-03-28T21:51:56.731108+0000","last_became_peered":"2024-03-28T21:51:56.731108+0000","last_unstale":"2024-03-28T21:51:58.331592+0000","last_undegraded":"2024-03-28T21:51:58.331592+0000","last_fullsized":"2024-03-28T21:51:58.331592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:59:08.185041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.798726+0000","last_change":"2024-03-28T21:51:56.747423+0000","last_active":"2024-03-28T21:51:57.798726+0000","last_peered":"2024-03-28T21:51:57.798726+0000","last_clean":"2024-03-28T21:51:57.798726+0000","last_became_active":"2024-03-28T21:51:56.746418+0000","last_became_peered":"2024-03-28T21:51:56.746418+0000","last_unstale":"2024-03-28T21:51:57.798726+0000","last_undegraded":"2024-03-28T21:51:57.798726+0000","last_fullsized":"2024-03-28T21:51:57.798726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:53:48.904039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738908+0000","last_change":"2024-03-28T21:51:56.737277+0000","last_active":"2024-03-28T21:51:57.738908+0000","last_peered":"2024-03-28T21:51:57.738908+0000","last_clean":"2024-03-28T21:51:57.738908+0000","last_became_active":"2024-03-28T21:51:56.736790+0000","last_became_peered":"2024-03-28T21:51:56.736790+0000","last_unstale":"2024-03-28T21:51:57.738908+0000","last_undegraded":"2024-03-28T21:51:57.738908+0000","last_fullsized":"2024-03-28T21:51:57.738908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:55.682963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736622+0000","last_change":"2024-03-28T21:51:56.724145+0000","last_active":"2024-03-28T21:51:57.736622+0000","last_peered":"2024-03-28T21:51:57.736622+0000","last_clean":"2024-03-28T21:51:57.736622+0000","last_became_active":"2024-03-28T21:51:56.723562+0000","last_became_peered":"2024-03-28T21:51:56.723562+0000","last_unstale":"2024-03-28T21:51:57.736622+0000","last_undegraded":"2024-03-28T21:51:57.736622+0000","last_fullsized":"2024-03-28T21:51:57.736622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:49:20.458598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829410+0000","last_change":"2024-03-28T21:51:55.736394+0000","last_active":"2024-03-28T21:51:57.829410+0000","last_peered":"2024-03-28T21:51:57.829410+0000","last_clean":"2024-03-28T21:51:57.829410+0000","last_became_active":"2024-03-28T21:51:55.735945+0000","last_became_peered":"2024-03-28T21:51:55.735945+0000","last_unstale":"2024-03-28T21:51:57.829410+0000","last_undegraded":"2024-03-28T21:51:57.829410+0000","last_fullsized":"2024-03-28T21:51:57.829410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:10:58.825950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330791+0000","last_change":"2024-03-28T21:51:56.750688+0000","last_active":"2024-03-28T21:51:58.330791+0000","last_peered":"2024-03-28T21:51:58.330791+0000","last_clean":"2024-03-28T21:51:58.330791+0000","last_became_active":"2024-03-28T21:51:56.750174+0000","last_became_peered":"2024-03-28T21:51:56.750174+0000","last_unstale":"2024-03-28T21:51:58.330791+0000","last_undegraded":"2024-03-28T21:51:58.330791+0000","last_fullsized":"2024-03-28T21:51:58.330791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:59:55.876132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738775+0000","last_change":"2024-03-28T21:51:55.730078+0000","last_active":"2024-03-28T21:51:57.738775+0000","last_peered":"2024-03-28T21:51:57.738775+0000","last_clean":"2024-03-28T21:51:57.738775+0000","last_became_active":"2024-03-28T21:51:55.729059+0000","last_became_peered":"2024-03-28T21:51:55.729059+0000","last_unstale":"2024-03-28T21:51:57.738775+0000","last_undegraded":"2024-03-28T21:51:57.738775+0000","last_fullsized":"2024-03-28T21:51:57.738775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:25:06.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828695+0000","last_change":"2024-03-28T21:51:55.724321+0000","last_active":"2024-03-28T21:51:57.828695+0000","last_peered":"2024-03-28T21:51:57.828695+0000","last_clean":"2024-03-28T21:51:57.828695+0000","last_became_active":"2024-03-28T21:51:55.723873+0000","last_became_peered":"2024-03-28T21:51:55.723873+0000","last_unstale":"2024-03-28T21:51:57.828695+0000","last_undegraded":"2024-03-28T21:51:57.828695+0000","last_fullsized":"2024-03-28T21:51:57.828695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:01:24.561519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828667+0000","last_change":"2024-03-28T21:51:56.738471+0000","last_active":"2024-03-28T21:51:57.828667+0000","last_peered":"2024-03-28T21:51:57.828667+0000","last_clean":"2024-03-28T21:51:57.828667+0000","last_became_active":"2024-03-28T21:51:56.738126+0000","last_became_peered":"2024-03-28T21:51:56.738126+0000","last_unstale":"2024-03-28T21:51:57.828667+0000","last_undegraded":"2024-03-28T21:51:57.828667+0000","last_fullsized":"2024-03-28T21:51:57.828667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:08:15.623597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331496+0000","last_change":"2024-03-28T21:51:55.730358+0000","last_active":"2024-03-28T21:51:58.331496+0000","last_peered":"2024-03-28T21:51:58.331496+0000","last_clean":"2024-03-28T21:51:58.331496+0000","last_became_active":"2024-03-28T21:51:55.730046+0000","last_became_peered":"2024-03-28T21:51:55.730046+0000","last_unstale":"2024-03-28T21:51:58.331496+0000","last_undegraded":"2024-03-28T21:51:58.331496+0000","last_fullsized":"2024-03-28T21:51:58.331496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:52.161365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739961+0000","last_change":"2024-03-28T21:51:56.728333+0000","last_active":"2024-03-28T21:51:57.739961+0000","last_peered":"2024-03-28T21:51:57.739961+0000","last_clean":"2024-03-28T21:51:57.739961+0000","last_became_active":"2024-03-28T21:51:56.728047+0000","last_became_peered":"2024-03-28T21:51:56.728047+0000","last_unstale":"2024-03-28T21:51:57.739961+0000","last_undegraded":"2024-03-28T21:51:57.739961+0000","last_fullsized":"2024-03-28T21:51:57.739961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:46.786652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739888+0000","last_change":"2024-03-28T21:51:55.736601+0000","last_active":"2024-03-28T21:51:57.739888+0000","last_peered":"2024-03-28T21:51:57.739888+0000","last_clean":"2024-03-28T21:51:57.739888+0000","last_became_active":"2024-03-28T21:51:55.735858+0000","last_became_peered":"2024-03-28T21:51:55.735858+0000","last_unstale":"2024-03-28T21:51:57.739888+0000","last_undegraded":"2024-03-28T21:51:57.739888+0000","last_fullsized":"2024-03-28T21:51:57.739888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:49.481854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332438+0000","last_change":"2024-03-28T21:51:56.736289+0000","last_active":"2024-03-28T21:51:58.332438+0000","last_peered":"2024-03-28T21:51:58.332438+0000","last_clean":"2024-03-28T21:51:58.332438+0000","last_became_active":"2024-03-28T21:51:56.735924+0000","last_became_peered":"2024-03-28T21:51:56.735924+0000","last_unstale":"2024-03-28T21:51:58.332438+0000","last_undegraded":"2024-03-28T21:51:58.332438+0000","last_fullsized":"2024-03-28T21:51:58.332438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:53:40.266285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332311+0000","last_change":"2024-03-28T21:51:55.735297+0000","last_active":"2024-03-28T21:51:58.332311+0000","last_peered":"2024-03-28T21:51:58.332311+0000","last_clean":"2024-03-28T21:51:58.332311+0000","last_became_active":"2024-03-28T21:51:55.735006+0000","last_became_peered":"2024-03-28T21:51:55.735006+0000","last_unstale":"2024-03-28T21:51:58.332311+0000","last_undegraded":"2024-03-28T21:51:58.332311+0000","last_fullsized":"2024-03-28T21:51:58.332311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:16.943146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330547+0000","last_change":"2024-03-28T21:51:56.750675+0000","last_active":"2024-03-28T21:51:58.330547+0000","last_peered":"2024-03-28T21:51:58.330547+0000","last_clean":"2024-03-28T21:51:58.330547+0000","last_became_active":"2024-03-28T21:51:56.747119+0000","last_became_peered":"2024-03-28T21:51:56.747119+0000","last_unstale":"2024-03-28T21:51:58.330547+0000","last_undegraded":"2024-03-28T21:51:58.330547+0000","last_fullsized":"2024-03-28T21:51:58.330547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:08:48.875187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740776+0000","last_change":"2024-03-28T21:51:55.737036+0000","last_active":"2024-03-28T21:51:57.740776+0000","last_peered":"2024-03-28T21:51:57.740776+0000","last_clean":"2024-03-28T21:51:57.740776+0000","last_became_active":"2024-03-28T21:51:55.736746+0000","last_became_peered":"2024-03-28T21:51:55.736746+0000","last_unstale":"2024-03-28T21:51:57.740776+0000","last_undegraded":"2024-03-28T21:51:57.740776+0000","last_fullsized":"2024-03-28T21:51:57.740776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:41:33.261221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738359+0000","last_change":"2024-03-28T21:51:56.734022+0000","last_active":"2024-03-28T21:51:57.738359+0000","last_peered":"2024-03-28T21:51:57.738359+0000","last_clean":"2024-03-28T21:51:57.738359+0000","last_became_active":"2024-03-28T21:51:56.731663+0000","last_became_peered":"2024-03-28T21:51:56.731663+0000","last_unstale":"2024-03-28T21:51:57.738359+0000","last_undegraded":"2024-03-28T21:51:57.738359+0000","last_fullsized":"2024-03-28T21:51:57.738359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:10:14.581056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739196+0000","last_change":"2024-03-28T21:51:55.730854+0000","last_active":"2024-03-28T21:51:57.739196+0000","last_peered":"2024-03-28T21:51:57.739196+0000","last_clean":"2024-03-28T21:51:57.739196+0000","last_became_active":"2024-03-28T21:51:55.729293+0000","last_became_peered":"2024-03-28T21:51:55.729293+0000","last_unstale":"2024-03-28T21:51:57.739196+0000","last_undegraded":"2024-03-28T21:51:57.739196+0000","last_fullsized":"2024-03-28T21:51:57.739196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:07:09.631543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735807+0000","last_change":"2024-03-28T21:51:56.739559+0000","last_active":"2024-03-28T21:51:57.735807+0000","last_peered":"2024-03-28T21:51:57.735807+0000","last_clean":"2024-03-28T21:51:57.735807+0000","last_became_active":"2024-03-28T21:51:56.739248+0000","last_became_peered":"2024-03-28T21:51:56.739248+0000","last_unstale":"2024-03-28T21:51:57.735807+0000","last_undegraded":"2024-03-28T21:51:57.735807+0000","last_fullsized":"2024-03-28T21:51:57.735807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:44:09.922647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330696+0000","last_change":"2024-03-28T21:51:55.722706+0000","last_active":"2024-03-28T21:51:58.330696+0000","last_peered":"2024-03-28T21:51:58.330696+0000","last_clean":"2024-03-28T21:51:58.330696+0000","last_became_active":"2024-03-28T21:51:55.722273+0000","last_became_peered":"2024-03-28T21:51:55.722273+0000","last_unstale":"2024-03-28T21:51:58.330696+0000","last_undegraded":"2024-03-28T21:51:58.330696+0000","last_fullsized":"2024-03-28T21:51:58.330696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:25:33.882861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.329913+0000","last_change":"2024-03-28T21:51:56.740785+0000","last_active":"2024-03-28T21:51:58.329913+0000","last_peered":"2024-03-28T21:51:58.329913+0000","last_clean":"2024-03-28T21:51:58.329913+0000","last_became_active":"2024-03-28T21:51:56.740524+0000","last_became_peered":"2024-03-28T21:51:56.740524+0000","last_unstale":"2024-03-28T21:51:58.329913+0000","last_undegraded":"2024-03-28T21:51:58.329913+0000","last_fullsized":"2024-03-28T21:51:58.329913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:00:37.304905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331836+0000","last_change":"2024-03-28T21:51:55.736963+0000","last_active":"2024-03-28T21:51:58.331836+0000","last_peered":"2024-03-28T21:51:58.331836+0000","last_clean":"2024-03-28T21:51:58.331836+0000","last_became_active":"2024-03-28T21:51:55.734830+0000","last_became_peered":"2024-03-28T21:51:55.734830+0000","last_unstale":"2024-03-28T21:51:58.331836+0000","last_undegraded":"2024-03-28T21:51:58.331836+0000","last_fullsized":"2024-03-28T21:51:58.331836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:27.412749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735343+0000","last_change":"2024-03-28T21:51:56.746398+0000","last_active":"2024-03-28T21:51:57.735343+0000","last_peered":"2024-03-28T21:51:57.735343+0000","last_clean":"2024-03-28T21:51:57.735343+0000","last_became_active":"2024-03-28T21:51:56.746126+0000","last_became_peered":"2024-03-28T21:51:56.746126+0000","last_unstale":"2024-03-28T21:51:57.735343+0000","last_undegraded":"2024-03-28T21:51:57.735343+0000","last_fullsized":"2024-03-28T21:51:57.735343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:27:25.577575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738980+0000","last_change":"2024-03-28T21:51:55.730767+0000","last_active":"2024-03-28T21:51:57.738980+0000","last_peered":"2024-03-28T21:51:57.738980+0000","last_clean":"2024-03-28T21:51:57.738980+0000","last_became_active":"2024-03-28T21:51:55.729015+0000","last_became_peered":"2024-03-28T21:51:55.729015+0000","last_unstale":"2024-03-28T21:51:57.738980+0000","last_undegraded":"2024-03-28T21:51:57.738980+0000","last_fullsized":"2024-03-28T21:51:57.738980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:38.624808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739619+0000","last_change":"2024-03-28T21:51:56.737060+0000","last_active":"2024-03-28T21:51:57.739619+0000","last_peered":"2024-03-28T21:51:57.739619+0000","last_clean":"2024-03-28T21:51:57.739619+0000","last_became_active":"2024-03-28T21:51:56.736452+0000","last_became_peered":"2024-03-28T21:51:56.736452+0000","last_unstale":"2024-03-28T21:51:57.739619+0000","last_undegraded":"2024-03-28T21:51:57.739619+0000","last_fullsized":"2024-03-28T21:51:57.739619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:46.786652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.798595+0000","last_change":"2024-03-28T21:51:55.728291+0000","last_active":"2024-03-28T21:51:57.798595+0000","last_peered":"2024-03-28T21:51:57.798595+0000","last_clean":"2024-03-28T21:51:57.798595+0000","last_became_active":"2024-03-28T21:51:55.727942+0000","last_became_peered":"2024-03-28T21:51:55.727942+0000","last_unstale":"2024-03-28T21:51:57.798595+0000","last_undegraded":"2024-03-28T21:51:57.798595+0000","last_fullsized":"2024-03-28T21:51:57.798595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:01:39.586196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735383+0000","last_change":"2024-03-28T21:51:56.746545+0000","last_active":"2024-03-28T21:51:57.735383+0000","last_peered":"2024-03-28T21:51:57.735383+0000","last_clean":"2024-03-28T21:51:57.735383+0000","last_became_active":"2024-03-28T21:51:56.743999+0000","last_became_peered":"2024-03-28T21:51:56.743999+0000","last_unstale":"2024-03-28T21:51:57.735383+0000","last_undegraded":"2024-03-28T21:51:57.735383+0000","last_fullsized":"2024-03-28T21:51:57.735383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:59:08.185041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738223+0000","last_change":"2024-03-28T21:51:55.727110+0000","last_active":"2024-03-28T21:51:57.738223+0000","last_peered":"2024-03-28T21:51:57.738223+0000","last_clean":"2024-03-28T21:51:57.738223+0000","last_became_active":"2024-03-28T21:51:55.726646+0000","last_became_peered":"2024-03-28T21:51:55.726646+0000","last_unstale":"2024-03-28T21:51:57.738223+0000","last_undegraded":"2024-03-28T21:51:57.738223+0000","last_fullsized":"2024-03-28T21:51:57.738223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:10:58.825950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737881+0000","last_change":"2024-03-28T21:51:56.747293+0000","last_active":"2024-03-28T21:51:57.737881+0000","last_peered":"2024-03-28T21:51:57.737881+0000","last_clean":"2024-03-28T21:51:57.737881+0000","last_became_active":"2024-03-28T21:51:56.743809+0000","last_became_peered":"2024-03-28T21:51:56.743809+0000","last_unstale":"2024-03-28T21:51:57.737881+0000","last_undegraded":"2024-03-28T21:51:57.737881+0000","last_fullsized":"2024-03-28T21:51:57.737881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:36:15.569229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.799403+0000","last_change":"2024-03-28T21:51:55.731064+0000","last_active":"2024-03-28T21:51:57.799403+0000","last_peered":"2024-03-28T21:51:57.799403+0000","last_clean":"2024-03-28T21:51:57.799403+0000","last_became_active":"2024-03-28T21:51:55.730784+0000","last_became_peered":"2024-03-28T21:51:55.730784+0000","last_unstale":"2024-03-28T21:51:57.799403+0000","last_undegraded":"2024-03-28T21:51:57.799403+0000","last_fullsized":"2024-03-28T21:51:57.799403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:14:12.770422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737269+0000","last_change":"2024-03-28T21:51:56.748869+0000","last_active":"2024-03-28T21:51:57.737269+0000","last_peered":"2024-03-28T21:51:57.737269+0000","last_clean":"2024-03-28T21:51:57.737269+0000","last_became_active":"2024-03-28T21:51:56.748640+0000","last_became_peered":"2024-03-28T21:51:56.748640+0000","last_unstale":"2024-03-28T21:51:57.737269+0000","last_undegraded":"2024-03-28T21:51:57.737269+0000","last_fullsized":"2024-03-28T21:51:57.737269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:14:34.083715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740696+0000","last_change":"2024-03-28T21:51:55.731550+0000","last_active":"2024-03-28T21:51:57.740696+0000","last_peered":"2024-03-28T21:51:57.740696+0000","last_clean":"2024-03-28T21:51:57.740696+0000","last_became_active":"2024-03-28T21:51:55.728370+0000","last_became_peered":"2024-03-28T21:51:55.728370+0000","last_unstale":"2024-03-28T21:51:57.740696+0000","last_undegraded":"2024-03-28T21:51:57.740696+0000","last_fullsized":"2024-03-28T21:51:57.740696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:49:18.989549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332462+0000","last_change":"2024-03-28T21:51:56.736531+0000","last_active":"2024-03-28T21:51:58.332462+0000","last_peered":"2024-03-28T21:51:58.332462+0000","last_clean":"2024-03-28T21:51:58.332462+0000","last_became_active":"2024-03-28T21:51:56.735968+0000","last_became_peered":"2024-03-28T21:51:56.735968+0000","last_unstale":"2024-03-28T21:51:58.332462+0000","last_undegraded":"2024-03-28T21:51:58.332462+0000","last_fullsized":"2024-03-28T21:51:58.332462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:14:34.083715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.799078+0000","last_change":"2024-03-28T21:51:55.735045+0000","last_active":"2024-03-28T21:51:57.799078+0000","last_peered":"2024-03-28T21:51:57.799078+0000","last_clean":"2024-03-28T21:51:57.799078+0000","last_became_active":"2024-03-28T21:51:55.734768+0000","last_became_peered":"2024-03-28T21:51:55.734768+0000","last_unstale":"2024-03-28T21:51:57.799078+0000","last_undegraded":"2024-03-28T21:51:57.799078+0000","last_fullsized":"2024-03-28T21:51:57.799078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:18:31.421582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735795+0000","last_change":"2024-03-28T21:51:56.745586+0000","last_active":"2024-03-28T21:51:57.735795+0000","last_peered":"2024-03-28T21:51:57.735795+0000","last_clean":"2024-03-28T21:51:57.735795+0000","last_became_active":"2024-03-28T21:51:56.745299+0000","last_became_peered":"2024-03-28T21:51:56.745299+0000","last_unstale":"2024-03-28T21:51:57.735795+0000","last_undegraded":"2024-03-28T21:51:57.735795+0000","last_fullsized":"2024-03-28T21:51:57.735795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:24.456985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.734439+0000","last_change":"2024-03-28T21:51:51.547812+0000","last_active":"2024-03-28T21:51:57.734439+0000","last_peered":"2024-03-28T21:51:57.734439+0000","last_clean":"2024-03-28T21:51:57.734439+0000","last_became_active":"2024-03-28T21:51:51.545783+0000","last_became_peered":"2024-03-28T21:51:51.545783+0000","last_unstale":"2024-03-28T21:51:57.734439+0000","last_undegraded":"2024-03-28T21:51:57.734439+0000","last_fullsized":"2024-03-28T21:51:57.734439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_clean_scrub_stamp":"2024-03-28T21:51:50.185942+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:08:34.531035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331207+0000","last_change":"2024-03-28T21:51:55.733897+0000","last_active":"2024-03-28T21:51:58.331207+0000","last_peered":"2024-03-28T21:51:58.331207+0000","last_clean":"2024-03-28T21:51:58.331207+0000","last_became_active":"2024-03-28T21:51:55.733569+0000","last_became_peered":"2024-03-28T21:51:55.733569+0000","last_unstale":"2024-03-28T21:51:58.331207+0000","last_undegraded":"2024-03-28T21:51:58.331207+0000","last_fullsized":"2024-03-28T21:51:58.331207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:54.213914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829113+0000","last_change":"2024-03-28T21:51:56.750936+0000","last_active":"2024-03-28T21:51:57.829113+0000","last_peered":"2024-03-28T21:51:57.829113+0000","last_clean":"2024-03-28T21:51:57.829113+0000","last_became_active":"2024-03-28T21:51:56.750615+0000","last_became_peered":"2024-03-28T21:51:56.750615+0000","last_unstale":"2024-03-28T21:51:57.829113+0000","last_undegraded":"2024-03-28T21:51:57.829113+0000","last_fullsized":"2024-03-28T21:51:57.829113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:11.932847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.734494+0000","last_change":"2024-03-28T21:51:55.740858+0000","last_active":"2024-03-28T21:51:57.734494+0000","last_peered":"2024-03-28T21:51:57.734494+0000","last_clean":"2024-03-28T21:51:57.734494+0000","last_became_active":"2024-03-28T21:51:55.740499+0000","last_became_peered":"2024-03-28T21:51:55.740499+0000","last_unstale":"2024-03-28T21:51:57.734494+0000","last_undegraded":"2024-03-28T21:51:57.734494+0000","last_fullsized":"2024-03-28T21:51:57.734494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:49:18.989549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.329802+0000","last_change":"2024-03-28T21:51:56.739979+0000","last_active":"2024-03-28T21:51:58.329802+0000","last_peered":"2024-03-28T21:51:58.329802+0000","last_clean":"2024-03-28T21:51:58.329802+0000","last_became_active":"2024-03-28T21:51:56.739738+0000","last_became_peered":"2024-03-28T21:51:56.739738+0000","last_unstale":"2024-03-28T21:51:58.329802+0000","last_undegraded":"2024-03-28T21:51:58.329802+0000","last_fullsized":"2024-03-28T21:51:58.329802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:03:08.464729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.798745+0000","last_change":"2024-03-28T21:51:55.727187+0000","last_active":"2024-03-28T21:51:57.798745+0000","last_peered":"2024-03-28T21:51:57.798745+0000","last_clean":"2024-03-28T21:51:57.798745+0000","last_became_active":"2024-03-28T21:51:55.725654+0000","last_became_peered":"2024-03-28T21:51:55.725654+0000","last_unstale":"2024-03-28T21:51:57.798745+0000","last_undegraded":"2024-03-28T21:51:57.798745+0000","last_fullsized":"2024-03-28T21:51:57.798745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:05:21.056498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739661+0000","last_change":"2024-03-28T21:51:56.731343+0000","last_active":"2024-03-28T21:51:57.739661+0000","last_peered":"2024-03-28T21:51:57.739661+0000","last_clean":"2024-03-28T21:51:57.739661+0000","last_became_active":"2024-03-28T21:51:56.731082+0000","last_became_peered":"2024-03-28T21:51:56.731082+0000","last_unstale":"2024-03-28T21:51:57.739661+0000","last_undegraded":"2024-03-28T21:51:57.739661+0000","last_fullsized":"2024-03-28T21:51:57.739661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:55.682963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331842+0000","last_change":"2024-03-28T21:51:55.737531+0000","last_active":"2024-03-28T21:51:58.331842+0000","last_peered":"2024-03-28T21:51:58.331842+0000","last_clean":"2024-03-28T21:51:58.331842+0000","last_became_active":"2024-03-28T21:51:55.736415+0000","last_became_peered":"2024-03-28T21:51:55.736415+0000","last_unstale":"2024-03-28T21:51:58.331842+0000","last_undegraded":"2024-03-28T21:51:58.331842+0000","last_fullsized":"2024-03-28T21:51:58.331842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:45.317603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737122+0000","last_change":"2024-03-28T21:51:56.742717+0000","last_active":"2024-03-28T21:51:57.737122+0000","last_peered":"2024-03-28T21:51:57.737122+0000","last_clean":"2024-03-28T21:51:57.737122+0000","last_became_active":"2024-03-28T21:51:56.742419+0000","last_became_peered":"2024-03-28T21:51:56.742419+0000","last_unstale":"2024-03-28T21:51:57.737122+0000","last_undegraded":"2024-03-28T21:51:57.737122+0000","last_fullsized":"2024-03-28T21:51:57.737122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:53.630414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739963+0000","last_change":"2024-03-28T21:51:55.729598+0000","last_active":"2024-03-28T21:51:57.739963+0000","last_peered":"2024-03-28T21:51:57.739963+0000","last_clean":"2024-03-28T21:51:57.739963+0000","last_became_active":"2024-03-28T21:51:55.729285+0000","last_became_peered":"2024-03-28T21:51:55.729285+0000","last_unstale":"2024-03-28T21:51:57.739963+0000","last_undegraded":"2024-03-28T21:51:57.739963+0000","last_fullsized":"2024-03-28T21:51:57.739963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:25:06.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332415+0000","last_change":"2024-03-28T21:51:56.738473+0000","last_active":"2024-03-28T21:51:58.332415+0000","last_peered":"2024-03-28T21:51:58.332415+0000","last_clean":"2024-03-28T21:51:58.332415+0000","last_became_active":"2024-03-28T21:51:56.738135+0000","last_became_peered":"2024-03-28T21:51:56.738135+0000","last_unstale":"2024-03-28T21:51:58.332415+0000","last_undegraded":"2024-03-28T21:51:58.332415+0000","last_fullsized":"2024-03-28T21:51:58.332415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:21:00.155587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736603+0000","last_change":"2024-03-28T21:51:55.738867+0000","last_active":"2024-03-28T21:51:57.736603+0000","last_peered":"2024-03-28T21:51:57.736603+0000","last_clean":"2024-03-28T21:51:57.736603+0000","last_became_active":"2024-03-28T21:51:55.738474+0000","last_became_peered":"2024-03-28T21:51:55.738474+0000","last_unstale":"2024-03-28T21:51:57.736603+0000","last_undegraded":"2024-03-28T21:51:57.736603+0000","last_fullsized":"2024-03-28T21:51:57.736603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:31:23.656046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739779+0000","last_change":"2024-03-28T21:51:56.744065+0000","last_active":"2024-03-28T21:51:57.739779+0000","last_peered":"2024-03-28T21:51:57.739779+0000","last_clean":"2024-03-28T21:51:57.739779+0000","last_became_active":"2024-03-28T21:51:56.743726+0000","last_became_peered":"2024-03-28T21:51:56.743726+0000","last_unstale":"2024-03-28T21:51:57.739779+0000","last_undegraded":"2024-03-28T21:51:57.739779+0000","last_fullsized":"2024-03-28T21:51:57.739779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:28.881798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.743030+0000","last_change":"2024-03-28T21:51:55.731606+0000","last_active":"2024-03-28T21:51:57.743030+0000","last_peered":"2024-03-28T21:51:57.743030+0000","last_clean":"2024-03-28T21:51:57.743030+0000","last_became_active":"2024-03-28T21:51:55.731290+0000","last_became_peered":"2024-03-28T21:51:55.731290+0000","last_unstale":"2024-03-28T21:51:57.743030+0000","last_undegraded":"2024-03-28T21:51:57.743030+0000","last_fullsized":"2024-03-28T21:51:57.743030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:52.161365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829855+0000","last_change":"2024-03-28T21:51:56.735361+0000","last_active":"2024-03-28T21:51:57.829855+0000","last_peered":"2024-03-28T21:51:57.829855+0000","last_clean":"2024-03-28T21:51:57.829855+0000","last_became_active":"2024-03-28T21:51:56.735118+0000","last_became_peered":"2024-03-28T21:51:56.735118+0000","last_unstale":"2024-03-28T21:51:57.829855+0000","last_undegraded":"2024-03-28T21:51:57.829855+0000","last_fullsized":"2024-03-28T21:51:57.829855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:27:25.577575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740008+0000","last_change":"2024-03-28T21:51:55.736672+0000","last_active":"2024-03-28T21:51:57.740008+0000","last_peered":"2024-03-28T21:51:57.740008+0000","last_clean":"2024-03-28T21:51:57.740008+0000","last_became_active":"2024-03-28T21:51:55.736295+0000","last_became_peered":"2024-03-28T21:51:55.736295+0000","last_unstale":"2024-03-28T21:51:57.740008+0000","last_undegraded":"2024-03-28T21:51:57.740008+0000","last_fullsized":"2024-03-28T21:51:57.740008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:41:33.261221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330657+0000","last_change":"2024-03-28T21:51:56.732809+0000","last_active":"2024-03-28T21:51:58.330657+0000","last_peered":"2024-03-28T21:51:58.330657+0000","last_clean":"2024-03-28T21:51:58.330657+0000","last_became_active":"2024-03-28T21:51:56.732535+0000","last_became_peered":"2024-03-28T21:51:56.732535+0000","last_unstale":"2024-03-28T21:51:58.330657+0000","last_undegraded":"2024-03-28T21:51:58.330657+0000","last_fullsized":"2024-03-28T21:51:58.330657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:14:33.230114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.734259+0000","last_change":"2024-03-28T21:51:55.738876+0000","last_active":"2024-03-28T21:51:57.734259+0000","last_peered":"2024-03-28T21:51:57.734259+0000","last_clean":"2024-03-28T21:51:57.734259+0000","last_became_active":"2024-03-28T21:51:55.738383+0000","last_became_peered":"2024-03-28T21:51:55.738383+0000","last_unstale":"2024-03-28T21:51:57.734259+0000","last_undegraded":"2024-03-28T21:51:57.734259+0000","last_fullsized":"2024-03-28T21:51:57.734259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:41:33.261221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737220+0000","last_change":"2024-03-28T21:51:56.737198+0000","last_active":"2024-03-28T21:51:57.737220+0000","last_peered":"2024-03-28T21:51:57.737220+0000","last_clean":"2024-03-28T21:51:57.737220+0000","last_became_active":"2024-03-28T21:51:56.736850+0000","last_became_peered":"2024-03-28T21:51:56.736850+0000","last_unstale":"2024-03-28T21:51:57.737220+0000","last_undegraded":"2024-03-28T21:51:57.737220+0000","last_fullsized":"2024-03-28T21:51:57.737220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:27:52.976796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739863+0000","last_change":"2024-03-28T21:51:55.735856+0000","last_active":"2024-03-28T21:51:57.739863+0000","last_peered":"2024-03-28T21:51:57.739863+0000","last_clean":"2024-03-28T21:51:57.739863+0000","last_became_active":"2024-03-28T21:51:55.735478+0000","last_became_peered":"2024-03-28T21:51:55.735478+0000","last_unstale":"2024-03-28T21:51:57.739863+0000","last_undegraded":"2024-03-28T21:51:57.739863+0000","last_fullsized":"2024-03-28T21:51:57.739863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:49.481854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828874+0000","last_change":"2024-03-28T21:51:56.731937+0000","last_active":"2024-03-28T21:51:57.828874+0000","last_peered":"2024-03-28T21:51:57.828874+0000","last_clean":"2024-03-28T21:51:57.828874+0000","last_became_active":"2024-03-28T21:51:56.730294+0000","last_became_peered":"2024-03-28T21:51:56.730294+0000","last_unstale":"2024-03-28T21:51:57.828874+0000","last_undegraded":"2024-03-28T21:51:57.828874+0000","last_fullsized":"2024-03-28T21:51:57.828874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:46.786652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739729+0000","last_change":"2024-03-28T21:51:55.733842+0000","last_active":"2024-03-28T21:51:57.739729+0000","last_peered":"2024-03-28T21:51:57.739729+0000","last_clean":"2024-03-28T21:51:57.739729+0000","last_became_active":"2024-03-28T21:51:55.732730+0000","last_became_peered":"2024-03-28T21:51:55.732730+0000","last_unstale":"2024-03-28T21:51:57.739729+0000","last_undegraded":"2024-03-28T21:51:57.739729+0000","last_fullsized":"2024-03-28T21:51:57.739729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:38.624808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829350+0000","last_change":"2024-03-28T21:51:56.741051+0000","last_active":"2024-03-28T21:51:57.829350+0000","last_peered":"2024-03-28T21:51:57.829350+0000","last_clean":"2024-03-28T21:51:57.829350+0000","last_became_active":"2024-03-28T21:51:56.740732+0000","last_became_peered":"2024-03-28T21:51:56.740732+0000","last_unstale":"2024-03-28T21:51:57.829350+0000","last_undegraded":"2024-03-28T21:51:57.829350+0000","last_fullsized":"2024-03-28T21:51:57.829350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:18.412195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735605+0000","last_change":"2024-03-28T21:51:55.741026+0000","last_active":"2024-03-28T21:51:57.735605+0000","last_peered":"2024-03-28T21:51:57.735605+0000","last_clean":"2024-03-28T21:51:57.735605+0000","last_became_active":"2024-03-28T21:51:55.740636+0000","last_became_peered":"2024-03-28T21:51:55.740636+0000","last_unstale":"2024-03-28T21:51:57.735605+0000","last_undegraded":"2024-03-28T21:51:57.735605+0000","last_fullsized":"2024-03-28T21:51:57.735605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:52.161365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738890+0000","last_change":"2024-03-28T21:51:56.738914+0000","last_active":"2024-03-28T21:51:57.738890+0000","last_peered":"2024-03-28T21:51:57.738890+0000","last_clean":"2024-03-28T21:51:57.738890+0000","last_became_active":"2024-03-28T21:51:56.738550+0000","last_became_peered":"2024-03-28T21:51:56.738550+0000","last_unstale":"2024-03-28T21:51:57.738890+0000","last_undegraded":"2024-03-28T21:51:57.738890+0000","last_fullsized":"2024-03-28T21:51:57.738890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:50:06.933438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331969+0000","last_change":"2024-03-28T21:51:56.733615+0000","last_active":"2024-03-28T21:51:58.331969+0000","last_peered":"2024-03-28T21:51:58.331969+0000","last_clean":"2024-03-28T21:51:58.331969+0000","last_became_active":"2024-03-28T21:51:56.732747+0000","last_became_peered":"2024-03-28T21:51:56.732747+0000","last_unstale":"2024-03-28T21:51:58.331969+0000","last_undegraded":"2024-03-28T21:51:58.331969+0000","last_fullsized":"2024-03-28T21:51:58.331969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:55:29.475667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735421+0000","last_change":"2024-03-28T21:51:55.743426+0000","last_active":"2024-03-28T21:51:57.735421+0000","last_peered":"2024-03-28T21:51:57.735421+0000","last_clean":"2024-03-28T21:51:57.735421+0000","last_became_active":"2024-03-28T21:51:55.743045+0000","last_became_peered":"2024-03-28T21:51:55.743045+0000","last_unstale":"2024-03-28T21:51:57.735421+0000","last_undegraded":"2024-03-28T21:51:57.735421+0000","last_fullsized":"2024-03-28T21:51:57.735421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:27:51.507747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331789+0000","last_change":"2024-03-28T21:51:56.737059+0000","last_active":"2024-03-28T21:51:58.331789+0000","last_peered":"2024-03-28T21:51:58.331789+0000","last_clean":"2024-03-28T21:51:58.331789+0000","last_became_active":"2024-03-28T21:51:56.736834+0000","last_became_peered":"2024-03-28T21:51:56.736834+0000","last_unstale":"2024-03-28T21:51:58.331789+0000","last_undegraded":"2024-03-28T21:51:58.331789+0000","last_fullsized":"2024-03-28T21:51:58.331789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:44:09.922647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736413+0000","last_change":"2024-03-28T21:51:55.739827+0000","last_active":"2024-03-28T21:51:57.736413+0000","last_peered":"2024-03-28T21:51:57.736413+0000","last_clean":"2024-03-28T21:51:57.736413+0000","last_became_active":"2024-03-28T21:51:55.739583+0000","last_became_peered":"2024-03-28T21:51:55.739583+0000","last_unstale":"2024-03-28T21:51:57.736413+0000","last_undegraded":"2024-03-28T21:51:57.736413+0000","last_fullsized":"2024-03-28T21:51:57.736413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:10:13.112007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330687+0000","last_change":"2024-03-28T21:51:56.745755+0000","last_active":"2024-03-28T21:51:58.330687+0000","last_peered":"2024-03-28T21:51:58.330687+0000","last_clean":"2024-03-28T21:51:58.330687+0000","last_became_active":"2024-03-28T21:51:56.745454+0000","last_became_peered":"2024-03-28T21:51:56.745454+0000","last_unstale":"2024-03-28T21:51:58.330687+0000","last_undegraded":"2024-03-28T21:51:58.330687+0000","last_fullsized":"2024-03-28T21:51:58.330687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:13:55.392143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829826+0000","last_change":"2024-03-28T21:51:55.726073+0000","last_active":"2024-03-28T21:51:57.829826+0000","last_peered":"2024-03-28T21:51:57.829826+0000","last_clean":"2024-03-28T21:51:57.829826+0000","last_became_active":"2024-03-28T21:51:55.725697+0000","last_became_peered":"2024-03-28T21:51:55.725697+0000","last_unstale":"2024-03-28T21:51:57.829826+0000","last_undegraded":"2024-03-28T21:51:57.829826+0000","last_fullsized":"2024-03-28T21:51:57.829826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:25:06.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829699+0000","last_change":"2024-03-28T21:51:56.732751+0000","last_active":"2024-03-28T21:51:57.829699+0000","last_peered":"2024-03-28T21:51:57.829699+0000","last_clean":"2024-03-28T21:51:57.829699+0000","last_became_active":"2024-03-28T21:51:56.732376+0000","last_became_peered":"2024-03-28T21:51:56.732376+0000","last_unstale":"2024-03-28T21:51:57.829699+0000","last_undegraded":"2024-03-28T21:51:57.829699+0000","last_fullsized":"2024-03-28T21:51:57.829699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:30.418711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330732+0000","last_change":"2024-03-28T21:51:55.736690+0000","last_active":"2024-03-28T21:51:58.330732+0000","last_peered":"2024-03-28T21:51:58.330732+0000","last_clean":"2024-03-28T21:51:58.330732+0000","last_became_active":"2024-03-28T21:51:55.736380+0000","last_became_peered":"2024-03-28T21:51:55.736380+0000","last_unstale":"2024-03-28T21:51:58.330732+0000","last_undegraded":"2024-03-28T21:51:58.330732+0000","last_fullsized":"2024-03-28T21:51:58.330732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:18:31.421582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":823296,"data_stored":669784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":78924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":78960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":78834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":831488,"data_stored":669840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T21:52:01.188 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T21:52:01.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.432+0000 7f104f000640 1 Processor -- start 2024-03-28T21:52:01.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.432+0000 7f104f000640 1 -- start start 2024-03-28T21:52:01.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.434+0000 7f104f000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104806b170 0x7f104806b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.434+0000 7f104f000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f104806e0a0 0x7f104806ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.434+0000 7f104f000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f104806e920 con 0x7f10480b3880 2024-03-28T21:52:01.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.434+0000 7f104f000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f104806bfd0 con 0x7f104806e0a0 2024-03-28T21:52:01.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.434+0000 7f104f000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f104806e640 con 0x7f104806b170 2024-03-28T21:52:01.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.434+0000 7f103fe00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f10480b3880 0x7f10480b4bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46804/0 (socket says 172.21.15.153:46804) 2024-03-28T21:52:01.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.434+0000 7f103fe00640 1 -- 172.21.15.153:0/1671097789 learned_addr learned my addr 172.21.15.153:0/1671097789 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:01.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.434+0000 7f1047e00640 1 --2- 172.21.15.153:0/1671097789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104806b170 0x7f104806b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:01.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.434+0000 7f104d000640 1 --2- 172.21.15.153:0/1671097789 >> v2:172.21.15.165:3300/0 conn(0x7f104806e0a0 0x7f104806ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:01.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 -- 172.21.15.153:0/1671097789 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148365378 0 0) 0x7f1030001110 con 0x7f10480b3880 2024-03-28T21:52:01.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 -- 172.21.15.153:0/1671097789 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f102c003520 con 0x7f10480b3880 2024-03-28T21:52:01.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 -- 172.21.15.153:0/1671097789 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2305074666 0 0) 0x7f102c003520 con 0x7f10480b3880 2024-03-28T21:52:01.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 -- 172.21.15.153:0/1671097789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104806b170 msgr2=0x7f104806b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:01.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 --2- 172.21.15.153:0/1671097789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104806b170 0x7f104806b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 -- 172.21.15.153:0/1671097789 >> v2:172.21.15.165:3300/0 conn(0x7f104806e0a0 msgr2=0x7f104806ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:01.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 --2- 172.21.15.153:0/1671097789 >> v2:172.21.15.165:3300/0 conn(0x7f104806e0a0 0x7f104806ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 -- 172.21.15.153:0/1671097789 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10480b40d0 con 0x7f10480b3880 2024-03-28T21:52:01.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 -- 172.21.15.153:0/1671097789 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f1030001840 con 0x7f10480b3880 2024-03-28T21:52:01.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 -- 172.21.15.153:0/1671097789 >> v1:172.21.15.153:6789/0 conn(0x7f10480b3880 legacy=0x7f10480b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:01.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 --2- 172.21.15.153:0/1671097789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104806b170 0x7f102c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 --2- 172.21.15.153:0/1671097789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f102c003f80 0x7f102c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 --2- 172.21.15.153:0/1671097789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f102c004d40 0x7f102c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 -- 172.21.15.153:0/1671097789 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f104806bfd0 con 0x7f102c004d40 2024-03-28T21:52:01.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 -- 172.21.15.153:0/1671097789 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f104806e640 con 0x7f102c003f80 2024-03-28T21:52:01.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f1047400640 1 -- 172.21.15.153:0/1671097789 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f102c00b9c0 con 0x7f104806b170 2024-03-28T21:52:01.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.435+0000 7f104d000640 1 --2- 172.21.15.153:0/1671097789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f102c004d40 0x7f102c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:01.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.436+0000 7f1047e00640 1 --2- 172.21.15.153:0/1671097789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104806b170 0x7f102c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:01.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.436+0000 7f104d000640 1 -- 172.21.15.153:0/1671097789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104806b170 msgr2=0x7f102c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:01.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.436+0000 7f104d000640 1 --2- 172.21.15.153:0/1671097789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104806b170 0x7f102c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.436+0000 7f104d000640 1 -- 172.21.15.153:0/1671097789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f102c003f80 msgr2=0x7f102c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:01.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.436+0000 7f104d000640 1 --2- 172.21.15.153:0/1671097789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f102c003f80 0x7f102c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.436+0000 7f104d000640 1 -- 172.21.15.153:0/1671097789 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102c003520 con 0x7f102c004d40 2024-03-28T21:52:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.437+0000 7f104d000640 1 --2- 172.21.15.153:0/1671097789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f102c004d40 0x7f102c0051c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f104000e170 tx=0x7f102c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c106869c2464f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.437+0000 7f1047400640 1 -- 172.21.15.153:0/1671097789 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040039070 con 0x7f102c004d40 2024-03-28T21:52:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.437+0000 7f1047400640 1 -- 172.21.15.153:0/1671097789 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104002cc20 con 0x7f102c004d40 2024-03-28T21:52:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.437+0000 7f1047400640 1 -- 172.21.15.153:0/1671097789 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040009c10 con 0x7f102c004d40 2024-03-28T21:52:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.438+0000 7f104f000640 1 -- 172.21.15.153:0/1671097789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f102c004d40 msgr2=0x7f102c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.438+0000 7f104f000640 1 --2- 172.21.15.153:0/1671097789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f102c004d40 0x7f102c0051c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f104000e170 tx=0x7f102c005830 comp rx=0 tx=0).stop 2024-03-28T21:52:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.438+0000 7f104d000640 1 -- 172.21.15.153:0/1671097789 reap_dead start 2024-03-28T21:52:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.438+0000 7f104f000640 1 -- 172.21.15.153:0/1671097789 shutdown_connections 2024-03-28T21:52:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.438+0000 7f104f000640 1 -- 172.21.15.153:0/1671097789 >> 172.21.15.153:0/1671097789 conn(0x7f10480d0540 msgr2=0x7f10480d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.438+0000 7f104f000640 1 -- 172.21.15.153:0/1671097789 shutdown_connections 2024-03-28T21:52:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.438+0000 7f104f000640 1 -- 172.21.15.153:0/1671097789 wait complete. 2024-03-28T21:52:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.440+0000 7f104f000640 1 Processor -- start 2024-03-28T21:52:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.440+0000 7f104f000640 1 -- start start 2024-03-28T21:52:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f104f000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f102c004d40 0x7f104814cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f104f000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104814fd70 0x7f10480aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f104f000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1048160520 0x7f10481609a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f104f000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10480afa90 con 0x7f1048160520 2024-03-28T21:52:01.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f104f000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10480b4690 con 0x7f102c004d40 2024-03-28T21:52:01.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f104f000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f10481629f0 con 0x7f104814fd70 2024-03-28T21:52:01.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f104d000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1048160520 0x7f10481609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:01.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f104d000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1048160520 0x7f10481609a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54192/0 (socket says 172.21.15.153:54192) 2024-03-28T21:52:01.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f104d000640 1 -- 172.21.15.153:0/1499540897 learned_addr learned my addr 172.21.15.153:0/1499540897 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:01.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f1047e00640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f102c004d40 0x7f104814cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:01.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f103fe00640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104814fd70 0x7f10480aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:01.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f104d000640 1 -- 172.21.15.153:0/1499540897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104814fd70 msgr2=0x7f10480aa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:01.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f104d000640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104814fd70 0x7f10480aa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f104d000640 1 -- 172.21.15.153:0/1499540897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f102c004d40 msgr2=0x7f104814cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f104d000640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f102c004d40 0x7f104814cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f104d000640 1 -- 172.21.15.153:0/1499540897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104814d650 con 0x7f1048160520 2024-03-28T21:52:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.441+0000 7f103fe00640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104814fd70 0x7f10480aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.442+0000 7f104d000640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1048160520 0x7f10481609a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f104000e290 tx=0x7f1040009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.442+0000 7f1044c00640 1 -- 172.21.15.153:0/1499540897 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040039070 con 0x7f1048160520 2024-03-28T21:52:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.442+0000 7f1044c00640 1 -- 172.21.15.153:0/1499540897 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1040044070 con 0x7f1048160520 2024-03-28T21:52:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.442+0000 7f1044c00640 1 -- 172.21.15.153:0/1499540897 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104003e850 con 0x7f1048160520 2024-03-28T21:52:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.442+0000 7f104f000640 1 -- 172.21.15.153:0/1499540897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104814d930 con 0x7f1048160520 2024-03-28T21:52:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.442+0000 7f104f000640 1 -- 172.21.15.153:0/1499540897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f104814def0 con 0x7f1048160520 2024-03-28T21:52:01.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.443+0000 7f104f000640 1 -- 172.21.15.153:0/1499540897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1048068ff0 con 0x7f1048160520 2024-03-28T21:52:01.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.444+0000 7f1044c00640 1 -- 172.21.15.153:0/1499540897 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f1040005d10 con 0x7f1048160520 2024-03-28T21:52:01.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.445+0000 7f1044c00640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f102406b4d0 0x7f102406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.445+0000 7f1044c00640 1 -- 172.21.15.153:0/1499540897 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f10400ac220 con 0x7f1048160520 2024-03-28T21:52:01.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.445+0000 7f1047e00640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f102406b4d0 0x7f102406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:01.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.446+0000 7f1047e00640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f102406b4d0 0x7f102406d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1038009a10 tx=0x7f1038008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:01.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.450+0000 7f1044c00640 1 -- 172.21.15.153:0/1499540897 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1048068ff0 con 0x7f1048160520 2024-03-28T21:52:01.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.642+0000 7f104f000640 1 -- 172.21.15.153:0/1499540897 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f10480b4a70 con 0x7f102406b4d0 2024-03-28T21:52:01.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.661+0000 7f1044c00640 1 -- 172.21.15.153:0/1499540897 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f10480b4a70 con 0x7f102406b4d0 2024-03-28T21:52:01.667 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:01.668 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-03-28T21:52:01.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.666+0000 7f104f000640 1 -- 172.21.15.153:0/1499540897 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f102406b4d0 msgr2=0x7f102406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:01.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.666+0000 7f104f000640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f102406b4d0 0x7f102406d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1038009a10 tx=0x7f1038008040 comp rx=0 tx=0).stop 2024-03-28T21:52:01.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.667+0000 7f104f000640 1 -- 172.21.15.153:0/1499540897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1048160520 msgr2=0x7f10481609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:01.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.667+0000 7f104f000640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1048160520 0x7f10481609a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f104000e290 tx=0x7f1040009750 comp rx=0 tx=0).stop 2024-03-28T21:52:01.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.667+0000 7f104f000640 1 -- 172.21.15.153:0/1499540897 shutdown_connections 2024-03-28T21:52:01.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.667+0000 7f104f000640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f102406b4d0 0x7f102406d990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.667+0000 7f104f000640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1048160520 0x7f10481609a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.667+0000 7f104f000640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104814fd70 0x7f10480aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.667+0000 7f104f000640 1 --2- 172.21.15.153:0/1499540897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f102c004d40 0x7f104814cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.667+0000 7f104f000640 1 -- 172.21.15.153:0/1499540897 >> 172.21.15.153:0/1499540897 conn(0x7f10480d0540 msgr2=0x7f104806c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:01.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.667+0000 7f104f000640 1 -- 172.21.15.153:0/1499540897 shutdown_connections 2024-03-28T21:52:01.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.667+0000 7f104f000640 1 -- 172.21.15.153:0/1499540897 wait complete. 2024-03-28T21:52:01.689 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-03-28T21:52:01.465461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223492,"kb_used_data":2984,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751228,"statfs":{"total":773094113280,"available":772865257472,"internally_reserved":0,"allocated":3055616,"data_stored":1816228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001742"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735977+0000","last_change":"2024-03-28T21:51:56.734116+0000","last_active":"2024-03-28T21:51:57.735977+0000","last_peered":"2024-03-28T21:51:57.735977+0000","last_clean":"2024-03-28T21:51:57.735977+0000","last_became_active":"2024-03-28T21:51:56.733812+0000","last_became_peered":"2024-03-28T21:51:56.733812+0000","last_unstale":"2024-03-28T21:51:57.735977+0000","last_undegraded":"2024-03-28T21:51:57.735977+0000","last_fullsized":"2024-03-28T21:51:57.735977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:55:29.475667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740119+0000","last_change":"2024-03-28T21:51:56.735553+0000","last_active":"2024-03-28T21:51:57.740119+0000","last_peered":"2024-03-28T21:51:57.740119+0000","last_clean":"2024-03-28T21:51:57.740119+0000","last_became_active":"2024-03-28T21:51:56.734024+0000","last_became_peered":"2024-03-28T21:51:56.734024+0000","last_unstale":"2024-03-28T21:51:57.740119+0000","last_undegraded":"2024-03-28T21:51:57.740119+0000","last_fullsized":"2024-03-28T21:51:57.740119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:11.932847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.329774+0000","last_change":"2024-03-28T21:51:56.737454+0000","last_active":"2024-03-28T21:51:58.329774+0000","last_peered":"2024-03-28T21:51:58.329774+0000","last_clean":"2024-03-28T21:51:58.329774+0000","last_became_active":"2024-03-28T21:51:56.737087+0000","last_became_peered":"2024-03-28T21:51:56.737087+0000","last_unstale":"2024-03-28T21:51:58.329774+0000","last_undegraded":"2024-03-28T21:51:58.329774+0000","last_fullsized":"2024-03-28T21:51:58.329774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:53:53.920816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331759+0000","last_change":"2024-03-28T21:51:56.736235+0000","last_active":"2024-03-28T21:51:58.331759+0000","last_peered":"2024-03-28T21:51:58.331759+0000","last_clean":"2024-03-28T21:51:58.331759+0000","last_became_active":"2024-03-28T21:51:56.735603+0000","last_became_peered":"2024-03-28T21:51:56.735603+0000","last_unstale":"2024-03-28T21:51:58.331759+0000","last_undegraded":"2024-03-28T21:51:58.331759+0000","last_fullsized":"2024-03-28T21:51:58.331759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:24.456985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735254+0000","last_change":"2024-03-28T21:51:56.739891+0000","last_active":"2024-03-28T21:51:57.735254+0000","last_peered":"2024-03-28T21:51:57.735254+0000","last_clean":"2024-03-28T21:51:57.735254+0000","last_became_active":"2024-03-28T21:51:56.739615+0000","last_became_peered":"2024-03-28T21:51:56.739615+0000","last_unstale":"2024-03-28T21:51:57.735254+0000","last_undegraded":"2024-03-28T21:51:57.735254+0000","last_fullsized":"2024-03-28T21:51:57.735254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:30.418711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331127+0000","last_change":"2024-03-28T21:51:56.742464+0000","last_active":"2024-03-28T21:51:58.331127+0000","last_peered":"2024-03-28T21:51:58.331127+0000","last_clean":"2024-03-28T21:51:58.331127+0000","last_became_active":"2024-03-28T21:51:56.741634+0000","last_became_peered":"2024-03-28T21:51:56.741634+0000","last_unstale":"2024-03-28T21:51:58.331127+0000","last_undegraded":"2024-03-28T21:51:58.331127+0000","last_fullsized":"2024-03-28T21:51:58.331127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:09:58.678525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735080+0000","last_change":"2024-03-28T21:51:56.743653+0000","last_active":"2024-03-28T21:51:57.735080+0000","last_peered":"2024-03-28T21:51:57.735080+0000","last_clean":"2024-03-28T21:51:57.735080+0000","last_became_active":"2024-03-28T21:51:56.742149+0000","last_became_peered":"2024-03-28T21:51:56.742149+0000","last_unstale":"2024-03-28T21:51:57.735080+0000","last_undegraded":"2024-03-28T21:51:57.735080+0000","last_fullsized":"2024-03-28T21:51:57.735080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:09:58.678525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828651+0000","last_change":"2024-03-28T21:51:56.752911+0000","last_active":"2024-03-28T21:51:57.828651+0000","last_peered":"2024-03-28T21:51:57.828651+0000","last_clean":"2024-03-28T21:51:57.828651+0000","last_became_active":"2024-03-28T21:51:56.748615+0000","last_became_peered":"2024-03-28T21:51:56.748615+0000","last_unstale":"2024-03-28T21:51:57.828651+0000","last_undegraded":"2024-03-28T21:51:57.828651+0000","last_fullsized":"2024-03-28T21:51:57.828651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:55.682963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736936+0000","last_change":"2024-03-28T21:51:56.741836+0000","last_active":"2024-03-28T21:51:57.736936+0000","last_peered":"2024-03-28T21:51:57.736936+0000","last_clean":"2024-03-28T21:51:57.736936+0000","last_became_active":"2024-03-28T21:51:56.741491+0000","last_became_peered":"2024-03-28T21:51:56.741491+0000","last_unstale":"2024-03-28T21:51:57.736936+0000","last_undegraded":"2024-03-28T21:51:57.736936+0000","last_fullsized":"2024-03-28T21:51:57.736936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:53:40.266285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739986+0000","last_change":"2024-03-28T21:51:56.749181+0000","last_active":"2024-03-28T21:51:57.739986+0000","last_peered":"2024-03-28T21:51:57.739986+0000","last_clean":"2024-03-28T21:51:57.739986+0000","last_became_active":"2024-03-28T21:51:56.748011+0000","last_became_peered":"2024-03-28T21:51:56.748011+0000","last_unstale":"2024-03-28T21:51:57.739986+0000","last_undegraded":"2024-03-28T21:51:57.739986+0000","last_fullsized":"2024-03-28T21:51:57.739986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:11.932847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739442+0000","last_change":"2024-03-28T21:51:56.735051+0000","last_active":"2024-03-28T21:51:57.739442+0000","last_peered":"2024-03-28T21:51:57.739442+0000","last_clean":"2024-03-28T21:51:57.739442+0000","last_became_active":"2024-03-28T21:51:56.734565+0000","last_became_peered":"2024-03-28T21:51:56.734565+0000","last_unstale":"2024-03-28T21:51:57.739442+0000","last_undegraded":"2024-03-28T21:51:57.739442+0000","last_fullsized":"2024-03-28T21:51:57.739442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:28.881798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737999+0000","last_change":"2024-03-28T21:51:56.725130+0000","last_active":"2024-03-28T21:51:57.737999+0000","last_peered":"2024-03-28T21:51:57.737999+0000","last_clean":"2024-03-28T21:51:57.737999+0000","last_became_active":"2024-03-28T21:51:56.724746+0000","last_became_peered":"2024-03-28T21:51:56.724746+0000","last_unstale":"2024-03-28T21:51:57.737999+0000","last_undegraded":"2024-03-28T21:51:57.737999+0000","last_fullsized":"2024-03-28T21:51:57.737999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:31:25.125095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829271+0000","last_change":"2024-03-28T21:51:56.732293+0000","last_active":"2024-03-28T21:51:57.829271+0000","last_peered":"2024-03-28T21:51:57.829271+0000","last_clean":"2024-03-28T21:51:57.829271+0000","last_became_active":"2024-03-28T21:51:56.732008+0000","last_became_peered":"2024-03-28T21:51:56.732008+0000","last_unstale":"2024-03-28T21:51:57.829271+0000","last_undegraded":"2024-03-28T21:51:57.829271+0000","last_fullsized":"2024-03-28T21:51:57.829271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:33:42.107550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330107+0000","last_change":"2024-03-28T21:51:56.732803+0000","last_active":"2024-03-28T21:51:58.330107+0000","last_peered":"2024-03-28T21:51:58.330107+0000","last_clean":"2024-03-28T21:51:58.330107+0000","last_became_active":"2024-03-28T21:51:56.732496+0000","last_became_peered":"2024-03-28T21:51:56.732496+0000","last_unstale":"2024-03-28T21:51:58.330107+0000","last_undegraded":"2024-03-28T21:51:58.330107+0000","last_fullsized":"2024-03-28T21:51:58.330107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:39:08.739432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739756+0000","last_change":"2024-03-28T21:51:56.732159+0000","last_active":"2024-03-28T21:51:57.739756+0000","last_peered":"2024-03-28T21:51:57.739756+0000","last_clean":"2024-03-28T21:51:57.739756+0000","last_became_active":"2024-03-28T21:51:56.731820+0000","last_became_peered":"2024-03-28T21:51:56.731820+0000","last_unstale":"2024-03-28T21:51:57.739756+0000","last_undegraded":"2024-03-28T21:51:57.739756+0000","last_fullsized":"2024-03-28T21:51:57.739756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:08:15.623597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331126+0000","last_change":"2024-03-28T21:51:56.741864+0000","last_active":"2024-03-28T21:51:58.331126+0000","last_peered":"2024-03-28T21:51:58.331126+0000","last_clean":"2024-03-28T21:51:58.331126+0000","last_became_active":"2024-03-28T21:51:56.741579+0000","last_became_peered":"2024-03-28T21:51:56.741579+0000","last_unstale":"2024-03-28T21:51:58.331126+0000","last_undegraded":"2024-03-28T21:51:58.331126+0000","last_fullsized":"2024-03-28T21:51:58.331126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:20:02.821931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332613+0000","last_change":"2024-03-28T21:51:56.739060+0000","last_active":"2024-03-28T21:51:58.332613+0000","last_peered":"2024-03-28T21:51:58.332613+0000","last_clean":"2024-03-28T21:51:58.332613+0000","last_became_active":"2024-03-28T21:51:56.738641+0000","last_became_peered":"2024-03-28T21:51:56.738641+0000","last_unstale":"2024-03-28T21:51:58.332613+0000","last_undegraded":"2024-03-28T21:51:58.332613+0000","last_fullsized":"2024-03-28T21:51:58.332613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:36:15.569229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.799302+0000","last_change":"2024-03-28T21:51:56.737872+0000","last_active":"2024-03-28T21:51:57.799302+0000","last_peered":"2024-03-28T21:51:57.799302+0000","last_clean":"2024-03-28T21:51:57.799302+0000","last_became_active":"2024-03-28T21:51:56.737566+0000","last_became_peered":"2024-03-28T21:51:56.737566+0000","last_unstale":"2024-03-28T21:51:57.799302+0000","last_undegraded":"2024-03-28T21:51:57.799302+0000","last_fullsized":"2024-03-28T21:51:57.799302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:42:21.430278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736646+0000","last_change":"2024-03-28T21:51:56.738430+0000","last_active":"2024-03-28T21:51:57.736646+0000","last_peered":"2024-03-28T21:51:57.736646+0000","last_clean":"2024-03-28T21:51:57.736646+0000","last_became_active":"2024-03-28T21:51:56.738084+0000","last_became_peered":"2024-03-28T21:51:56.738084+0000","last_unstale":"2024-03-28T21:51:57.736646+0000","last_undegraded":"2024-03-28T21:51:57.736646+0000","last_fullsized":"2024-03-28T21:51:57.736646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:21:00.155587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739051+0000","last_change":"2024-03-28T21:51:56.740987+0000","last_active":"2024-03-28T21:51:57.739051+0000","last_peered":"2024-03-28T21:51:57.739051+0000","last_clean":"2024-03-28T21:51:57.739051+0000","last_became_active":"2024-03-28T21:51:56.740456+0000","last_became_peered":"2024-03-28T21:51:56.740456+0000","last_unstale":"2024-03-28T21:51:57.739051+0000","last_undegraded":"2024-03-28T21:51:57.739051+0000","last_fullsized":"2024-03-28T21:51:57.739051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:08:15.623597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330303+0000","last_change":"2024-03-28T21:51:56.737666+0000","last_active":"2024-03-28T21:51:58.330303+0000","last_peered":"2024-03-28T21:51:58.330303+0000","last_clean":"2024-03-28T21:51:58.330303+0000","last_became_active":"2024-03-28T21:51:56.737409+0000","last_became_peered":"2024-03-28T21:51:56.737409+0000","last_unstale":"2024-03-28T21:51:58.330303+0000","last_undegraded":"2024-03-28T21:51:58.330303+0000","last_fullsized":"2024-03-28T21:51:58.330303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:43:56.754076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331510+0000","last_change":"2024-03-28T21:51:56.734651+0000","last_active":"2024-03-28T21:51:58.331510+0000","last_peered":"2024-03-28T21:51:58.331510+0000","last_clean":"2024-03-28T21:51:58.331510+0000","last_became_active":"2024-03-28T21:51:56.733779+0000","last_became_peered":"2024-03-28T21:51:56.733779+0000","last_unstale":"2024-03-28T21:51:58.331510+0000","last_undegraded":"2024-03-28T21:51:58.331510+0000","last_fullsized":"2024-03-28T21:51:58.331510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:27:25.577575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828725+0000","last_change":"2024-03-28T21:51:56.745483+0000","last_active":"2024-03-28T21:51:57.828725+0000","last_peered":"2024-03-28T21:51:57.828725+0000","last_clean":"2024-03-28T21:51:57.828725+0000","last_became_active":"2024-03-28T21:51:56.745196+0000","last_became_peered":"2024-03-28T21:51:56.745196+0000","last_unstale":"2024-03-28T21:51:57.828725+0000","last_undegraded":"2024-03-28T21:51:57.828725+0000","last_fullsized":"2024-03-28T21:51:57.828725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:28.881798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331406+0000","last_change":"2024-03-28T21:51:56.737805+0000","last_active":"2024-03-28T21:51:58.331406+0000","last_peered":"2024-03-28T21:51:58.331406+0000","last_clean":"2024-03-28T21:51:58.331406+0000","last_became_active":"2024-03-28T21:51:56.737549+0000","last_became_peered":"2024-03-28T21:51:56.737549+0000","last_unstale":"2024-03-28T21:51:58.331406+0000","last_undegraded":"2024-03-28T21:51:58.331406+0000","last_fullsized":"2024-03-28T21:51:58.331406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:30.418711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829532+0000","last_change":"2024-03-28T21:51:56.746355+0000","last_active":"2024-03-28T21:51:57.829532+0000","last_peered":"2024-03-28T21:51:57.829532+0000","last_clean":"2024-03-28T21:51:57.829532+0000","last_became_active":"2024-03-28T21:51:56.744993+0000","last_became_peered":"2024-03-28T21:51:56.744993+0000","last_unstale":"2024-03-28T21:51:57.829532+0000","last_undegraded":"2024-03-28T21:51:57.829532+0000","last_fullsized":"2024-03-28T21:51:57.829532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:09:58.678525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740180+0000","last_change":"2024-03-28T21:51:56.718719+0000","last_active":"2024-03-28T21:51:57.740180+0000","last_peered":"2024-03-28T21:51:57.740180+0000","last_clean":"2024-03-28T21:51:57.740180+0000","last_became_active":"2024-03-28T21:51:56.718298+0000","last_became_peered":"2024-03-28T21:51:56.718298+0000","last_unstale":"2024-03-28T21:51:57.740180+0000","last_undegraded":"2024-03-28T21:51:57.740180+0000","last_fullsized":"2024-03-28T21:51:57.740180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:33:42.107550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740391+0000","last_change":"2024-03-28T21:51:56.736179+0000","last_active":"2024-03-28T21:51:57.740391+0000","last_peered":"2024-03-28T21:51:57.740391+0000","last_clean":"2024-03-28T21:51:57.740391+0000","last_became_active":"2024-03-28T21:51:56.735901+0000","last_became_peered":"2024-03-28T21:51:56.735901+0000","last_unstale":"2024-03-28T21:51:57.740391+0000","last_undegraded":"2024-03-28T21:51:57.740391+0000","last_fullsized":"2024-03-28T21:51:57.740391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:33:42.107550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829438+0000","last_change":"2024-03-28T21:51:56.746834+0000","last_active":"2024-03-28T21:51:57.829438+0000","last_peered":"2024-03-28T21:51:57.829438+0000","last_clean":"2024-03-28T21:51:57.829438+0000","last_became_active":"2024-03-28T21:51:56.745939+0000","last_became_peered":"2024-03-28T21:51:56.745939+0000","last_unstale":"2024-03-28T21:51:57.829438+0000","last_undegraded":"2024-03-28T21:51:57.829438+0000","last_fullsized":"2024-03-28T21:51:57.829438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:20:02.821931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330314+0000","last_change":"2024-03-28T21:51:56.737457+0000","last_active":"2024-03-28T21:51:58.330314+0000","last_peered":"2024-03-28T21:51:58.330314+0000","last_clean":"2024-03-28T21:51:58.330314+0000","last_became_active":"2024-03-28T21:51:56.737113+0000","last_became_peered":"2024-03-28T21:51:56.737113+0000","last_unstale":"2024-03-28T21:51:58.330314+0000","last_undegraded":"2024-03-28T21:51:58.330314+0000","last_fullsized":"2024-03-28T21:51:58.330314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:11:32.340414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331592+0000","last_change":"2024-03-28T21:51:56.731405+0000","last_active":"2024-03-28T21:51:58.331592+0000","last_peered":"2024-03-28T21:51:58.331592+0000","last_clean":"2024-03-28T21:51:58.331592+0000","last_became_active":"2024-03-28T21:51:56.731108+0000","last_became_peered":"2024-03-28T21:51:56.731108+0000","last_unstale":"2024-03-28T21:51:58.331592+0000","last_undegraded":"2024-03-28T21:51:58.331592+0000","last_fullsized":"2024-03-28T21:51:58.331592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:59:08.185041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.798726+0000","last_change":"2024-03-28T21:51:56.747423+0000","last_active":"2024-03-28T21:51:57.798726+0000","last_peered":"2024-03-28T21:51:57.798726+0000","last_clean":"2024-03-28T21:51:57.798726+0000","last_became_active":"2024-03-28T21:51:56.746418+0000","last_became_peered":"2024-03-28T21:51:56.746418+0000","last_unstale":"2024-03-28T21:51:57.798726+0000","last_undegraded":"2024-03-28T21:51:57.798726+0000","last_fullsized":"2024-03-28T21:51:57.798726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:53:48.904039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738908+0000","last_change":"2024-03-28T21:51:56.737277+0000","last_active":"2024-03-28T21:51:57.738908+0000","last_peered":"2024-03-28T21:51:57.738908+0000","last_clean":"2024-03-28T21:51:57.738908+0000","last_became_active":"2024-03-28T21:51:56.736790+0000","last_became_peered":"2024-03-28T21:51:56.736790+0000","last_unstale":"2024-03-28T21:51:57.738908+0000","last_undegraded":"2024-03-28T21:51:57.738908+0000","last_fullsized":"2024-03-28T21:51:57.738908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:55.682963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736622+0000","last_change":"2024-03-28T21:51:56.724145+0000","last_active":"2024-03-28T21:51:57.736622+0000","last_peered":"2024-03-28T21:51:57.736622+0000","last_clean":"2024-03-28T21:51:57.736622+0000","last_became_active":"2024-03-28T21:51:56.723562+0000","last_became_peered":"2024-03-28T21:51:56.723562+0000","last_unstale":"2024-03-28T21:51:57.736622+0000","last_undegraded":"2024-03-28T21:51:57.736622+0000","last_fullsized":"2024-03-28T21:51:57.736622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:49:20.458598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829410+0000","last_change":"2024-03-28T21:51:55.736394+0000","last_active":"2024-03-28T21:51:57.829410+0000","last_peered":"2024-03-28T21:51:57.829410+0000","last_clean":"2024-03-28T21:51:57.829410+0000","last_became_active":"2024-03-28T21:51:55.735945+0000","last_became_peered":"2024-03-28T21:51:55.735945+0000","last_unstale":"2024-03-28T21:51:57.829410+0000","last_undegraded":"2024-03-28T21:51:57.829410+0000","last_fullsized":"2024-03-28T21:51:57.829410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:10:58.825950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330791+0000","last_change":"2024-03-28T21:51:56.750688+0000","last_active":"2024-03-28T21:51:58.330791+0000","last_peered":"2024-03-28T21:51:58.330791+0000","last_clean":"2024-03-28T21:51:58.330791+0000","last_became_active":"2024-03-28T21:51:56.750174+0000","last_became_peered":"2024-03-28T21:51:56.750174+0000","last_unstale":"2024-03-28T21:51:58.330791+0000","last_undegraded":"2024-03-28T21:51:58.330791+0000","last_fullsized":"2024-03-28T21:51:58.330791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:59:55.876132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738775+0000","last_change":"2024-03-28T21:51:55.730078+0000","last_active":"2024-03-28T21:51:57.738775+0000","last_peered":"2024-03-28T21:51:57.738775+0000","last_clean":"2024-03-28T21:51:57.738775+0000","last_became_active":"2024-03-28T21:51:55.729059+0000","last_became_peered":"2024-03-28T21:51:55.729059+0000","last_unstale":"2024-03-28T21:51:57.738775+0000","last_undegraded":"2024-03-28T21:51:57.738775+0000","last_fullsized":"2024-03-28T21:51:57.738775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:25:06.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828695+0000","last_change":"2024-03-28T21:51:55.724321+0000","last_active":"2024-03-28T21:51:57.828695+0000","last_peered":"2024-03-28T21:51:57.828695+0000","last_clean":"2024-03-28T21:51:57.828695+0000","last_became_active":"2024-03-28T21:51:55.723873+0000","last_became_peered":"2024-03-28T21:51:55.723873+0000","last_unstale":"2024-03-28T21:51:57.828695+0000","last_undegraded":"2024-03-28T21:51:57.828695+0000","last_fullsized":"2024-03-28T21:51:57.828695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:01:24.561519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828667+0000","last_change":"2024-03-28T21:51:56.738471+0000","last_active":"2024-03-28T21:51:57.828667+0000","last_peered":"2024-03-28T21:51:57.828667+0000","last_clean":"2024-03-28T21:51:57.828667+0000","last_became_active":"2024-03-28T21:51:56.738126+0000","last_became_peered":"2024-03-28T21:51:56.738126+0000","last_unstale":"2024-03-28T21:51:57.828667+0000","last_undegraded":"2024-03-28T21:51:57.828667+0000","last_fullsized":"2024-03-28T21:51:57.828667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:08:15.623597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331496+0000","last_change":"2024-03-28T21:51:55.730358+0000","last_active":"2024-03-28T21:51:58.331496+0000","last_peered":"2024-03-28T21:51:58.331496+0000","last_clean":"2024-03-28T21:51:58.331496+0000","last_became_active":"2024-03-28T21:51:55.730046+0000","last_became_peered":"2024-03-28T21:51:55.730046+0000","last_unstale":"2024-03-28T21:51:58.331496+0000","last_undegraded":"2024-03-28T21:51:58.331496+0000","last_fullsized":"2024-03-28T21:51:58.331496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:52.161365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739961+0000","last_change":"2024-03-28T21:51:56.728333+0000","last_active":"2024-03-28T21:51:57.739961+0000","last_peered":"2024-03-28T21:51:57.739961+0000","last_clean":"2024-03-28T21:51:57.739961+0000","last_became_active":"2024-03-28T21:51:56.728047+0000","last_became_peered":"2024-03-28T21:51:56.728047+0000","last_unstale":"2024-03-28T21:51:57.739961+0000","last_undegraded":"2024-03-28T21:51:57.739961+0000","last_fullsized":"2024-03-28T21:51:57.739961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:46.786652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739888+0000","last_change":"2024-03-28T21:51:55.736601+0000","last_active":"2024-03-28T21:51:57.739888+0000","last_peered":"2024-03-28T21:51:57.739888+0000","last_clean":"2024-03-28T21:51:57.739888+0000","last_became_active":"2024-03-28T21:51:55.735858+0000","last_became_peered":"2024-03-28T21:51:55.735858+0000","last_unstale":"2024-03-28T21:51:57.739888+0000","last_undegraded":"2024-03-28T21:51:57.739888+0000","last_fullsized":"2024-03-28T21:51:57.739888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:49.481854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332438+0000","last_change":"2024-03-28T21:51:56.736289+0000","last_active":"2024-03-28T21:51:58.332438+0000","last_peered":"2024-03-28T21:51:58.332438+0000","last_clean":"2024-03-28T21:51:58.332438+0000","last_became_active":"2024-03-28T21:51:56.735924+0000","last_became_peered":"2024-03-28T21:51:56.735924+0000","last_unstale":"2024-03-28T21:51:58.332438+0000","last_undegraded":"2024-03-28T21:51:58.332438+0000","last_fullsized":"2024-03-28T21:51:58.332438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:53:40.266285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332311+0000","last_change":"2024-03-28T21:51:55.735297+0000","last_active":"2024-03-28T21:51:58.332311+0000","last_peered":"2024-03-28T21:51:58.332311+0000","last_clean":"2024-03-28T21:51:58.332311+0000","last_became_active":"2024-03-28T21:51:55.735006+0000","last_became_peered":"2024-03-28T21:51:55.735006+0000","last_unstale":"2024-03-28T21:51:58.332311+0000","last_undegraded":"2024-03-28T21:51:58.332311+0000","last_fullsized":"2024-03-28T21:51:58.332311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:16.943146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330547+0000","last_change":"2024-03-28T21:51:56.750675+0000","last_active":"2024-03-28T21:51:58.330547+0000","last_peered":"2024-03-28T21:51:58.330547+0000","last_clean":"2024-03-28T21:51:58.330547+0000","last_became_active":"2024-03-28T21:51:56.747119+0000","last_became_peered":"2024-03-28T21:51:56.747119+0000","last_unstale":"2024-03-28T21:51:58.330547+0000","last_undegraded":"2024-03-28T21:51:58.330547+0000","last_fullsized":"2024-03-28T21:51:58.330547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:08:48.875187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740776+0000","last_change":"2024-03-28T21:51:55.737036+0000","last_active":"2024-03-28T21:51:57.740776+0000","last_peered":"2024-03-28T21:51:57.740776+0000","last_clean":"2024-03-28T21:51:57.740776+0000","last_became_active":"2024-03-28T21:51:55.736746+0000","last_became_peered":"2024-03-28T21:51:55.736746+0000","last_unstale":"2024-03-28T21:51:57.740776+0000","last_undegraded":"2024-03-28T21:51:57.740776+0000","last_fullsized":"2024-03-28T21:51:57.740776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:41:33.261221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738359+0000","last_change":"2024-03-28T21:51:56.734022+0000","last_active":"2024-03-28T21:51:57.738359+0000","last_peered":"2024-03-28T21:51:57.738359+0000","last_clean":"2024-03-28T21:51:57.738359+0000","last_became_active":"2024-03-28T21:51:56.731663+0000","last_became_peered":"2024-03-28T21:51:56.731663+0000","last_unstale":"2024-03-28T21:51:57.738359+0000","last_undegraded":"2024-03-28T21:51:57.738359+0000","last_fullsized":"2024-03-28T21:51:57.738359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:10:14.581056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739196+0000","last_change":"2024-03-28T21:51:55.730854+0000","last_active":"2024-03-28T21:51:57.739196+0000","last_peered":"2024-03-28T21:51:57.739196+0000","last_clean":"2024-03-28T21:51:57.739196+0000","last_became_active":"2024-03-28T21:51:55.729293+0000","last_became_peered":"2024-03-28T21:51:55.729293+0000","last_unstale":"2024-03-28T21:51:57.739196+0000","last_undegraded":"2024-03-28T21:51:57.739196+0000","last_fullsized":"2024-03-28T21:51:57.739196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:07:09.631543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735807+0000","last_change":"2024-03-28T21:51:56.739559+0000","last_active":"2024-03-28T21:51:57.735807+0000","last_peered":"2024-03-28T21:51:57.735807+0000","last_clean":"2024-03-28T21:51:57.735807+0000","last_became_active":"2024-03-28T21:51:56.739248+0000","last_became_peered":"2024-03-28T21:51:56.739248+0000","last_unstale":"2024-03-28T21:51:57.735807+0000","last_undegraded":"2024-03-28T21:51:57.735807+0000","last_fullsized":"2024-03-28T21:51:57.735807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:44:09.922647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330696+0000","last_change":"2024-03-28T21:51:55.722706+0000","last_active":"2024-03-28T21:51:58.330696+0000","last_peered":"2024-03-28T21:51:58.330696+0000","last_clean":"2024-03-28T21:51:58.330696+0000","last_became_active":"2024-03-28T21:51:55.722273+0000","last_became_peered":"2024-03-28T21:51:55.722273+0000","last_unstale":"2024-03-28T21:51:58.330696+0000","last_undegraded":"2024-03-28T21:51:58.330696+0000","last_fullsized":"2024-03-28T21:51:58.330696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:25:33.882861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.329913+0000","last_change":"2024-03-28T21:51:56.740785+0000","last_active":"2024-03-28T21:51:58.329913+0000","last_peered":"2024-03-28T21:51:58.329913+0000","last_clean":"2024-03-28T21:51:58.329913+0000","last_became_active":"2024-03-28T21:51:56.740524+0000","last_became_peered":"2024-03-28T21:51:56.740524+0000","last_unstale":"2024-03-28T21:51:58.329913+0000","last_undegraded":"2024-03-28T21:51:58.329913+0000","last_fullsized":"2024-03-28T21:51:58.329913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:00:37.304905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331836+0000","last_change":"2024-03-28T21:51:55.736963+0000","last_active":"2024-03-28T21:51:58.331836+0000","last_peered":"2024-03-28T21:51:58.331836+0000","last_clean":"2024-03-28T21:51:58.331836+0000","last_became_active":"2024-03-28T21:51:55.734830+0000","last_became_peered":"2024-03-28T21:51:55.734830+0000","last_unstale":"2024-03-28T21:51:58.331836+0000","last_undegraded":"2024-03-28T21:51:58.331836+0000","last_fullsized":"2024-03-28T21:51:58.331836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:27.412749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735343+0000","last_change":"2024-03-28T21:51:56.746398+0000","last_active":"2024-03-28T21:51:57.735343+0000","last_peered":"2024-03-28T21:51:57.735343+0000","last_clean":"2024-03-28T21:51:57.735343+0000","last_became_active":"2024-03-28T21:51:56.746126+0000","last_became_peered":"2024-03-28T21:51:56.746126+0000","last_unstale":"2024-03-28T21:51:57.735343+0000","last_undegraded":"2024-03-28T21:51:57.735343+0000","last_fullsized":"2024-03-28T21:51:57.735343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:27:25.577575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738980+0000","last_change":"2024-03-28T21:51:55.730767+0000","last_active":"2024-03-28T21:51:57.738980+0000","last_peered":"2024-03-28T21:51:57.738980+0000","last_clean":"2024-03-28T21:51:57.738980+0000","last_became_active":"2024-03-28T21:51:55.729015+0000","last_became_peered":"2024-03-28T21:51:55.729015+0000","last_unstale":"2024-03-28T21:51:57.738980+0000","last_undegraded":"2024-03-28T21:51:57.738980+0000","last_fullsized":"2024-03-28T21:51:57.738980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:38.624808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739619+0000","last_change":"2024-03-28T21:51:56.737060+0000","last_active":"2024-03-28T21:51:57.739619+0000","last_peered":"2024-03-28T21:51:57.739619+0000","last_clean":"2024-03-28T21:51:57.739619+0000","last_became_active":"2024-03-28T21:51:56.736452+0000","last_became_peered":"2024-03-28T21:51:56.736452+0000","last_unstale":"2024-03-28T21:51:57.739619+0000","last_undegraded":"2024-03-28T21:51:57.739619+0000","last_fullsized":"2024-03-28T21:51:57.739619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:46.786652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.798595+0000","last_change":"2024-03-28T21:51:55.728291+0000","last_active":"2024-03-28T21:51:57.798595+0000","last_peered":"2024-03-28T21:51:57.798595+0000","last_clean":"2024-03-28T21:51:57.798595+0000","last_became_active":"2024-03-28T21:51:55.727942+0000","last_became_peered":"2024-03-28T21:51:55.727942+0000","last_unstale":"2024-03-28T21:51:57.798595+0000","last_undegraded":"2024-03-28T21:51:57.798595+0000","last_fullsized":"2024-03-28T21:51:57.798595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:01:39.586196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735383+0000","last_change":"2024-03-28T21:51:56.746545+0000","last_active":"2024-03-28T21:51:57.735383+0000","last_peered":"2024-03-28T21:51:57.735383+0000","last_clean":"2024-03-28T21:51:57.735383+0000","last_became_active":"2024-03-28T21:51:56.743999+0000","last_became_peered":"2024-03-28T21:51:56.743999+0000","last_unstale":"2024-03-28T21:51:57.735383+0000","last_undegraded":"2024-03-28T21:51:57.735383+0000","last_fullsized":"2024-03-28T21:51:57.735383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:59:08.185041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738223+0000","last_change":"2024-03-28T21:51:55.727110+0000","last_active":"2024-03-28T21:51:57.738223+0000","last_peered":"2024-03-28T21:51:57.738223+0000","last_clean":"2024-03-28T21:51:57.738223+0000","last_became_active":"2024-03-28T21:51:55.726646+0000","last_became_peered":"2024-03-28T21:51:55.726646+0000","last_unstale":"2024-03-28T21:51:57.738223+0000","last_undegraded":"2024-03-28T21:51:57.738223+0000","last_fullsized":"2024-03-28T21:51:57.738223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:10:58.825950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737881+0000","last_change":"2024-03-28T21:51:56.747293+0000","last_active":"2024-03-28T21:51:57.737881+0000","last_peered":"2024-03-28T21:51:57.737881+0000","last_clean":"2024-03-28T21:51:57.737881+0000","last_became_active":"2024-03-28T21:51:56.743809+0000","last_became_peered":"2024-03-28T21:51:56.743809+0000","last_unstale":"2024-03-28T21:51:57.737881+0000","last_undegraded":"2024-03-28T21:51:57.737881+0000","last_fullsized":"2024-03-28T21:51:57.737881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:36:15.569229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.799403+0000","last_change":"2024-03-28T21:51:55.731064+0000","last_active":"2024-03-28T21:51:57.799403+0000","last_peered":"2024-03-28T21:51:57.799403+0000","last_clean":"2024-03-28T21:51:57.799403+0000","last_became_active":"2024-03-28T21:51:55.730784+0000","last_became_peered":"2024-03-28T21:51:55.730784+0000","last_unstale":"2024-03-28T21:51:57.799403+0000","last_undegraded":"2024-03-28T21:51:57.799403+0000","last_fullsized":"2024-03-28T21:51:57.799403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:14:12.770422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737269+0000","last_change":"2024-03-28T21:51:56.748869+0000","last_active":"2024-03-28T21:51:57.737269+0000","last_peered":"2024-03-28T21:51:57.737269+0000","last_clean":"2024-03-28T21:51:57.737269+0000","last_became_active":"2024-03-28T21:51:56.748640+0000","last_became_peered":"2024-03-28T21:51:56.748640+0000","last_unstale":"2024-03-28T21:51:57.737269+0000","last_undegraded":"2024-03-28T21:51:57.737269+0000","last_fullsized":"2024-03-28T21:51:57.737269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:14:34.083715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740696+0000","last_change":"2024-03-28T21:51:55.731550+0000","last_active":"2024-03-28T21:51:57.740696+0000","last_peered":"2024-03-28T21:51:57.740696+0000","last_clean":"2024-03-28T21:51:57.740696+0000","last_became_active":"2024-03-28T21:51:55.728370+0000","last_became_peered":"2024-03-28T21:51:55.728370+0000","last_unstale":"2024-03-28T21:51:57.740696+0000","last_undegraded":"2024-03-28T21:51:57.740696+0000","last_fullsized":"2024-03-28T21:51:57.740696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:49:18.989549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332462+0000","last_change":"2024-03-28T21:51:56.736531+0000","last_active":"2024-03-28T21:51:58.332462+0000","last_peered":"2024-03-28T21:51:58.332462+0000","last_clean":"2024-03-28T21:51:58.332462+0000","last_became_active":"2024-03-28T21:51:56.735968+0000","last_became_peered":"2024-03-28T21:51:56.735968+0000","last_unstale":"2024-03-28T21:51:58.332462+0000","last_undegraded":"2024-03-28T21:51:58.332462+0000","last_fullsized":"2024-03-28T21:51:58.332462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:14:34.083715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.799078+0000","last_change":"2024-03-28T21:51:55.735045+0000","last_active":"2024-03-28T21:51:57.799078+0000","last_peered":"2024-03-28T21:51:57.799078+0000","last_clean":"2024-03-28T21:51:57.799078+0000","last_became_active":"2024-03-28T21:51:55.734768+0000","last_became_peered":"2024-03-28T21:51:55.734768+0000","last_unstale":"2024-03-28T21:51:57.799078+0000","last_undegraded":"2024-03-28T21:51:57.799078+0000","last_fullsized":"2024-03-28T21:51:57.799078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:18:31.421582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735795+0000","last_change":"2024-03-28T21:51:56.745586+0000","last_active":"2024-03-28T21:51:57.735795+0000","last_peered":"2024-03-28T21:51:57.735795+0000","last_clean":"2024-03-28T21:51:57.735795+0000","last_became_active":"2024-03-28T21:51:56.745299+0000","last_became_peered":"2024-03-28T21:51:56.745299+0000","last_unstale":"2024-03-28T21:51:57.735795+0000","last_undegraded":"2024-03-28T21:51:57.735795+0000","last_fullsized":"2024-03-28T21:51:57.735795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:24.456985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.734439+0000","last_change":"2024-03-28T21:51:51.547812+0000","last_active":"2024-03-28T21:51:57.734439+0000","last_peered":"2024-03-28T21:51:57.734439+0000","last_clean":"2024-03-28T21:51:57.734439+0000","last_became_active":"2024-03-28T21:51:51.545783+0000","last_became_peered":"2024-03-28T21:51:51.545783+0000","last_unstale":"2024-03-28T21:51:57.734439+0000","last_undegraded":"2024-03-28T21:51:57.734439+0000","last_fullsized":"2024-03-28T21:51:57.734439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_clean_scrub_stamp":"2024-03-28T21:51:50.185942+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:08:34.531035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331207+0000","last_change":"2024-03-28T21:51:55.733897+0000","last_active":"2024-03-28T21:51:58.331207+0000","last_peered":"2024-03-28T21:51:58.331207+0000","last_clean":"2024-03-28T21:51:58.331207+0000","last_became_active":"2024-03-28T21:51:55.733569+0000","last_became_peered":"2024-03-28T21:51:55.733569+0000","last_unstale":"2024-03-28T21:51:58.331207+0000","last_undegraded":"2024-03-28T21:51:58.331207+0000","last_fullsized":"2024-03-28T21:51:58.331207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:54.213914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829113+0000","last_change":"2024-03-28T21:51:56.750936+0000","last_active":"2024-03-28T21:51:57.829113+0000","last_peered":"2024-03-28T21:51:57.829113+0000","last_clean":"2024-03-28T21:51:57.829113+0000","last_became_active":"2024-03-28T21:51:56.750615+0000","last_became_peered":"2024-03-28T21:51:56.750615+0000","last_unstale":"2024-03-28T21:51:57.829113+0000","last_undegraded":"2024-03-28T21:51:57.829113+0000","last_fullsized":"2024-03-28T21:51:57.829113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:11.932847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.734494+0000","last_change":"2024-03-28T21:51:55.740858+0000","last_active":"2024-03-28T21:51:57.734494+0000","last_peered":"2024-03-28T21:51:57.734494+0000","last_clean":"2024-03-28T21:51:57.734494+0000","last_became_active":"2024-03-28T21:51:55.740499+0000","last_became_peered":"2024-03-28T21:51:55.740499+0000","last_unstale":"2024-03-28T21:51:57.734494+0000","last_undegraded":"2024-03-28T21:51:57.734494+0000","last_fullsized":"2024-03-28T21:51:57.734494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:49:18.989549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.329802+0000","last_change":"2024-03-28T21:51:56.739979+0000","last_active":"2024-03-28T21:51:58.329802+0000","last_peered":"2024-03-28T21:51:58.329802+0000","last_clean":"2024-03-28T21:51:58.329802+0000","last_became_active":"2024-03-28T21:51:56.739738+0000","last_became_peered":"2024-03-28T21:51:56.739738+0000","last_unstale":"2024-03-28T21:51:58.329802+0000","last_undegraded":"2024-03-28T21:51:58.329802+0000","last_fullsized":"2024-03-28T21:51:58.329802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:03:08.464729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.798745+0000","last_change":"2024-03-28T21:51:55.727187+0000","last_active":"2024-03-28T21:51:57.798745+0000","last_peered":"2024-03-28T21:51:57.798745+0000","last_clean":"2024-03-28T21:51:57.798745+0000","last_became_active":"2024-03-28T21:51:55.725654+0000","last_became_peered":"2024-03-28T21:51:55.725654+0000","last_unstale":"2024-03-28T21:51:57.798745+0000","last_undegraded":"2024-03-28T21:51:57.798745+0000","last_fullsized":"2024-03-28T21:51:57.798745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:05:21.056498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739661+0000","last_change":"2024-03-28T21:51:56.731343+0000","last_active":"2024-03-28T21:51:57.739661+0000","last_peered":"2024-03-28T21:51:57.739661+0000","last_clean":"2024-03-28T21:51:57.739661+0000","last_became_active":"2024-03-28T21:51:56.731082+0000","last_became_peered":"2024-03-28T21:51:56.731082+0000","last_unstale":"2024-03-28T21:51:57.739661+0000","last_undegraded":"2024-03-28T21:51:57.739661+0000","last_fullsized":"2024-03-28T21:51:57.739661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:55.682963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331842+0000","last_change":"2024-03-28T21:51:55.737531+0000","last_active":"2024-03-28T21:51:58.331842+0000","last_peered":"2024-03-28T21:51:58.331842+0000","last_clean":"2024-03-28T21:51:58.331842+0000","last_became_active":"2024-03-28T21:51:55.736415+0000","last_became_peered":"2024-03-28T21:51:55.736415+0000","last_unstale":"2024-03-28T21:51:58.331842+0000","last_undegraded":"2024-03-28T21:51:58.331842+0000","last_fullsized":"2024-03-28T21:51:58.331842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:45.317603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737122+0000","last_change":"2024-03-28T21:51:56.742717+0000","last_active":"2024-03-28T21:51:57.737122+0000","last_peered":"2024-03-28T21:51:57.737122+0000","last_clean":"2024-03-28T21:51:57.737122+0000","last_became_active":"2024-03-28T21:51:56.742419+0000","last_became_peered":"2024-03-28T21:51:56.742419+0000","last_unstale":"2024-03-28T21:51:57.737122+0000","last_undegraded":"2024-03-28T21:51:57.737122+0000","last_fullsized":"2024-03-28T21:51:57.737122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:53.630414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739963+0000","last_change":"2024-03-28T21:51:55.729598+0000","last_active":"2024-03-28T21:51:57.739963+0000","last_peered":"2024-03-28T21:51:57.739963+0000","last_clean":"2024-03-28T21:51:57.739963+0000","last_became_active":"2024-03-28T21:51:55.729285+0000","last_became_peered":"2024-03-28T21:51:55.729285+0000","last_unstale":"2024-03-28T21:51:57.739963+0000","last_undegraded":"2024-03-28T21:51:57.739963+0000","last_fullsized":"2024-03-28T21:51:57.739963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:25:06.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332415+0000","last_change":"2024-03-28T21:51:56.738473+0000","last_active":"2024-03-28T21:51:58.332415+0000","last_peered":"2024-03-28T21:51:58.332415+0000","last_clean":"2024-03-28T21:51:58.332415+0000","last_became_active":"2024-03-28T21:51:56.738135+0000","last_became_peered":"2024-03-28T21:51:56.738135+0000","last_unstale":"2024-03-28T21:51:58.332415+0000","last_undegraded":"2024-03-28T21:51:58.332415+0000","last_fullsized":"2024-03-28T21:51:58.332415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:21:00.155587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736603+0000","last_change":"2024-03-28T21:51:55.738867+0000","last_active":"2024-03-28T21:51:57.736603+0000","last_peered":"2024-03-28T21:51:57.736603+0000","last_clean":"2024-03-28T21:51:57.736603+0000","last_became_active":"2024-03-28T21:51:55.738474+0000","last_became_peered":"2024-03-28T21:51:55.738474+0000","last_unstale":"2024-03-28T21:51:57.736603+0000","last_undegraded":"2024-03-28T21:51:57.736603+0000","last_fullsized":"2024-03-28T21:51:57.736603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:31:23.656046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739779+0000","last_change":"2024-03-28T21:51:56.744065+0000","last_active":"2024-03-28T21:51:57.739779+0000","last_peered":"2024-03-28T21:51:57.739779+0000","last_clean":"2024-03-28T21:51:57.739779+0000","last_became_active":"2024-03-28T21:51:56.743726+0000","last_became_peered":"2024-03-28T21:51:56.743726+0000","last_unstale":"2024-03-28T21:51:57.739779+0000","last_undegraded":"2024-03-28T21:51:57.739779+0000","last_fullsized":"2024-03-28T21:51:57.739779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:28.881798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.743030+0000","last_change":"2024-03-28T21:51:55.731606+0000","last_active":"2024-03-28T21:51:57.743030+0000","last_peered":"2024-03-28T21:51:57.743030+0000","last_clean":"2024-03-28T21:51:57.743030+0000","last_became_active":"2024-03-28T21:51:55.731290+0000","last_became_peered":"2024-03-28T21:51:55.731290+0000","last_unstale":"2024-03-28T21:51:57.743030+0000","last_undegraded":"2024-03-28T21:51:57.743030+0000","last_fullsized":"2024-03-28T21:51:57.743030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:52.161365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829855+0000","last_change":"2024-03-28T21:51:56.735361+0000","last_active":"2024-03-28T21:51:57.829855+0000","last_peered":"2024-03-28T21:51:57.829855+0000","last_clean":"2024-03-28T21:51:57.829855+0000","last_became_active":"2024-03-28T21:51:56.735118+0000","last_became_peered":"2024-03-28T21:51:56.735118+0000","last_unstale":"2024-03-28T21:51:57.829855+0000","last_undegraded":"2024-03-28T21:51:57.829855+0000","last_fullsized":"2024-03-28T21:51:57.829855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:27:25.577575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740008+0000","last_change":"2024-03-28T21:51:55.736672+0000","last_active":"2024-03-28T21:51:57.740008+0000","last_peered":"2024-03-28T21:51:57.740008+0000","last_clean":"2024-03-28T21:51:57.740008+0000","last_became_active":"2024-03-28T21:51:55.736295+0000","last_became_peered":"2024-03-28T21:51:55.736295+0000","last_unstale":"2024-03-28T21:51:57.740008+0000","last_undegraded":"2024-03-28T21:51:57.740008+0000","last_fullsized":"2024-03-28T21:51:57.740008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:41:33.261221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330657+0000","last_change":"2024-03-28T21:51:56.732809+0000","last_active":"2024-03-28T21:51:58.330657+0000","last_peered":"2024-03-28T21:51:58.330657+0000","last_clean":"2024-03-28T21:51:58.330657+0000","last_became_active":"2024-03-28T21:51:56.732535+0000","last_became_peered":"2024-03-28T21:51:56.732535+0000","last_unstale":"2024-03-28T21:51:58.330657+0000","last_undegraded":"2024-03-28T21:51:58.330657+0000","last_fullsized":"2024-03-28T21:51:58.330657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:14:33.230114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.734259+0000","last_change":"2024-03-28T21:51:55.738876+0000","last_active":"2024-03-28T21:51:57.734259+0000","last_peered":"2024-03-28T21:51:57.734259+0000","last_clean":"2024-03-28T21:51:57.734259+0000","last_became_active":"2024-03-28T21:51:55.738383+0000","last_became_peered":"2024-03-28T21:51:55.738383+0000","last_unstale":"2024-03-28T21:51:57.734259+0000","last_undegraded":"2024-03-28T21:51:57.734259+0000","last_fullsized":"2024-03-28T21:51:57.734259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:41:33.261221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737220+0000","last_change":"2024-03-28T21:51:56.737198+0000","last_active":"2024-03-28T21:51:57.737220+0000","last_peered":"2024-03-28T21:51:57.737220+0000","last_clean":"2024-03-28T21:51:57.737220+0000","last_became_active":"2024-03-28T21:51:56.736850+0000","last_became_peered":"2024-03-28T21:51:56.736850+0000","last_unstale":"2024-03-28T21:51:57.737220+0000","last_undegraded":"2024-03-28T21:51:57.737220+0000","last_fullsized":"2024-03-28T21:51:57.737220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:27:52.976796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739863+0000","last_change":"2024-03-28T21:51:55.735856+0000","last_active":"2024-03-28T21:51:57.739863+0000","last_peered":"2024-03-28T21:51:57.739863+0000","last_clean":"2024-03-28T21:51:57.739863+0000","last_became_active":"2024-03-28T21:51:55.735478+0000","last_became_peered":"2024-03-28T21:51:55.735478+0000","last_unstale":"2024-03-28T21:51:57.739863+0000","last_undegraded":"2024-03-28T21:51:57.739863+0000","last_fullsized":"2024-03-28T21:51:57.739863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:49.481854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828874+0000","last_change":"2024-03-28T21:51:56.731937+0000","last_active":"2024-03-28T21:51:57.828874+0000","last_peered":"2024-03-28T21:51:57.828874+0000","last_clean":"2024-03-28T21:51:57.828874+0000","last_became_active":"2024-03-28T21:51:56.730294+0000","last_became_peered":"2024-03-28T21:51:56.730294+0000","last_unstale":"2024-03-28T21:51:57.828874+0000","last_undegraded":"2024-03-28T21:51:57.828874+0000","last_fullsized":"2024-03-28T21:51:57.828874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:46.786652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739729+0000","last_change":"2024-03-28T21:51:55.733842+0000","last_active":"2024-03-28T21:51:57.739729+0000","last_peered":"2024-03-28T21:51:57.739729+0000","last_clean":"2024-03-28T21:51:57.739729+0000","last_became_active":"2024-03-28T21:51:55.732730+0000","last_became_peered":"2024-03-28T21:51:55.732730+0000","last_unstale":"2024-03-28T21:51:57.739729+0000","last_undegraded":"2024-03-28T21:51:57.739729+0000","last_fullsized":"2024-03-28T21:51:57.739729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:38.624808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829350+0000","last_change":"2024-03-28T21:51:56.741051+0000","last_active":"2024-03-28T21:51:57.829350+0000","last_peered":"2024-03-28T21:51:57.829350+0000","last_clean":"2024-03-28T21:51:57.829350+0000","last_became_active":"2024-03-28T21:51:56.740732+0000","last_became_peered":"2024-03-28T21:51:56.740732+0000","last_unstale":"2024-03-28T21:51:57.829350+0000","last_undegraded":"2024-03-28T21:51:57.829350+0000","last_fullsized":"2024-03-28T21:51:57.829350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:18.412195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735605+0000","last_change":"2024-03-28T21:51:55.741026+0000","last_active":"2024-03-28T21:51:57.735605+0000","last_peered":"2024-03-28T21:51:57.735605+0000","last_clean":"2024-03-28T21:51:57.735605+0000","last_became_active":"2024-03-28T21:51:55.740636+0000","last_became_peered":"2024-03-28T21:51:55.740636+0000","last_unstale":"2024-03-28T21:51:57.735605+0000","last_undegraded":"2024-03-28T21:51:57.735605+0000","last_fullsized":"2024-03-28T21:51:57.735605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:52.161365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738890+0000","last_change":"2024-03-28T21:51:56.738914+0000","last_active":"2024-03-28T21:51:57.738890+0000","last_peered":"2024-03-28T21:51:57.738890+0000","last_clean":"2024-03-28T21:51:57.738890+0000","last_became_active":"2024-03-28T21:51:56.738550+0000","last_became_peered":"2024-03-28T21:51:56.738550+0000","last_unstale":"2024-03-28T21:51:57.738890+0000","last_undegraded":"2024-03-28T21:51:57.738890+0000","last_fullsized":"2024-03-28T21:51:57.738890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:50:06.933438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331969+0000","last_change":"2024-03-28T21:51:56.733615+0000","last_active":"2024-03-28T21:51:58.331969+0000","last_peered":"2024-03-28T21:51:58.331969+0000","last_clean":"2024-03-28T21:51:58.331969+0000","last_became_active":"2024-03-28T21:51:56.732747+0000","last_became_peered":"2024-03-28T21:51:56.732747+0000","last_unstale":"2024-03-28T21:51:58.331969+0000","last_undegraded":"2024-03-28T21:51:58.331969+0000","last_fullsized":"2024-03-28T21:51:58.331969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:55:29.475667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735421+0000","last_change":"2024-03-28T21:51:55.743426+0000","last_active":"2024-03-28T21:51:57.735421+0000","last_peered":"2024-03-28T21:51:57.735421+0000","last_clean":"2024-03-28T21:51:57.735421+0000","last_became_active":"2024-03-28T21:51:55.743045+0000","last_became_peered":"2024-03-28T21:51:55.743045+0000","last_unstale":"2024-03-28T21:51:57.735421+0000","last_undegraded":"2024-03-28T21:51:57.735421+0000","last_fullsized":"2024-03-28T21:51:57.735421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:27:51.507747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331789+0000","last_change":"2024-03-28T21:51:56.737059+0000","last_active":"2024-03-28T21:51:58.331789+0000","last_peered":"2024-03-28T21:51:58.331789+0000","last_clean":"2024-03-28T21:51:58.331789+0000","last_became_active":"2024-03-28T21:51:56.736834+0000","last_became_peered":"2024-03-28T21:51:56.736834+0000","last_unstale":"2024-03-28T21:51:58.331789+0000","last_undegraded":"2024-03-28T21:51:58.331789+0000","last_fullsized":"2024-03-28T21:51:58.331789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:44:09.922647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736413+0000","last_change":"2024-03-28T21:51:55.739827+0000","last_active":"2024-03-28T21:51:57.736413+0000","last_peered":"2024-03-28T21:51:57.736413+0000","last_clean":"2024-03-28T21:51:57.736413+0000","last_became_active":"2024-03-28T21:51:55.739583+0000","last_became_peered":"2024-03-28T21:51:55.739583+0000","last_unstale":"2024-03-28T21:51:57.736413+0000","last_undegraded":"2024-03-28T21:51:57.736413+0000","last_fullsized":"2024-03-28T21:51:57.736413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:10:13.112007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330687+0000","last_change":"2024-03-28T21:51:56.745755+0000","last_active":"2024-03-28T21:51:58.330687+0000","last_peered":"2024-03-28T21:51:58.330687+0000","last_clean":"2024-03-28T21:51:58.330687+0000","last_became_active":"2024-03-28T21:51:56.745454+0000","last_became_peered":"2024-03-28T21:51:56.745454+0000","last_unstale":"2024-03-28T21:51:58.330687+0000","last_undegraded":"2024-03-28T21:51:58.330687+0000","last_fullsized":"2024-03-28T21:51:58.330687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:13:55.392143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829826+0000","last_change":"2024-03-28T21:51:55.726073+0000","last_active":"2024-03-28T21:51:57.829826+0000","last_peered":"2024-03-28T21:51:57.829826+0000","last_clean":"2024-03-28T21:51:57.829826+0000","last_became_active":"2024-03-28T21:51:55.725697+0000","last_became_peered":"2024-03-28T21:51:55.725697+0000","last_unstale":"2024-03-28T21:51:57.829826+0000","last_undegraded":"2024-03-28T21:51:57.829826+0000","last_fullsized":"2024-03-28T21:51:57.829826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:25:06.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829699+0000","last_change":"2024-03-28T21:51:56.732751+0000","last_active":"2024-03-28T21:51:57.829699+0000","last_peered":"2024-03-28T21:51:57.829699+0000","last_clean":"2024-03-28T21:51:57.829699+0000","last_became_active":"2024-03-28T21:51:56.732376+0000","last_became_peered":"2024-03-28T21:51:56.732376+0000","last_unstale":"2024-03-28T21:51:57.829699+0000","last_undegraded":"2024-03-28T21:51:57.829699+0000","last_fullsized":"2024-03-28T21:51:57.829699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:30.418711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330732+0000","last_change":"2024-03-28T21:51:55.736690+0000","last_active":"2024-03-28T21:51:58.330732+0000","last_peered":"2024-03-28T21:51:58.330732+0000","last_clean":"2024-03-28T21:51:58.330732+0000","last_became_active":"2024-03-28T21:51:55.736380+0000","last_became_peered":"2024-03-28T21:51:55.736380+0000","last_unstale":"2024-03-28T21:51:58.330732+0000","last_undegraded":"2024-03-28T21:51:58.330732+0000","last_fullsized":"2024-03-28T21:51:58.330732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:18:31.421582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":823296,"data_stored":669784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":78924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":78960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":78834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":831488,"data_stored":669840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T21:52:01.693 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-28T21:52:01.693 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-28T21:52:01.694 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-28T21:52:01.694 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-28T21:52:01.694 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-28T21:52:01.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.966+0000 7f9f5b200640 1 Processor -- start 2024-03-28T21:52:01.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.967+0000 7f9f5b200640 1 -- start start 2024-03-28T21:52:01.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.969+0000 7f9f5b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9f5c0b5e50 0x7f9f5c0d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.969+0000 7f9f5b200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9f5c0d2170 0x7f9f5c165bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.969+0000 7f9f5b200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f5c09b500 con 0x7f9f5c15c0c0 2024-03-28T21:52:01.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.969+0000 7f9f5b200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9f5c0d1a30 con 0x7f9f5c0d2170 2024-03-28T21:52:01.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.969+0000 7f9f5b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9f5c15c4a0 con 0x7f9f5c0b5e50 2024-03-28T21:52:01.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.969+0000 7f9f59e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9f5c15c0c0 0x7f9f5c0b3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46814/0 (socket says 172.21.15.153:46814) 2024-03-28T21:52:01.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.969+0000 7f9f59e00640 1 -- 172.21.15.153:0/2915740477 learned_addr learned my addr 172.21.15.153:0/2915740477 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:01.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.969+0000 7f9f5a800640 1 --2- 172.21.15.153:0/2915740477 >> v2:172.21.15.153:3300/0 conn(0x7f9f5c0d2170 0x7f9f5c165bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:01.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.969+0000 7f9f59400640 1 --2- 172.21.15.153:0/2915740477 >> v2:172.21.15.165:3300/0 conn(0x7f9f5c0b5e50 0x7f9f5c0d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:01.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.969+0000 7f9f58a00640 1 -- 172.21.15.153:0/2915740477 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1054638020 0 0) 0x7f9f5c09b500 con 0x7f9f5c15c0c0 2024-03-28T21:52:01.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.969+0000 7f9f58a00640 1 -- 172.21.15.153:0/2915740477 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f40003520 con 0x7f9f5c15c0c0 2024-03-28T21:52:01.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.970+0000 7f9f5a800640 1 -- 172.21.15.153:0/2915740477 >> v2:172.21.15.165:3300/0 conn(0x7f9f5c0b5e50 msgr2=0x7f9f5c0d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:01.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.970+0000 7f9f5a800640 1 --2- 172.21.15.153:0/2915740477 >> v2:172.21.15.165:3300/0 conn(0x7f9f5c0b5e50 0x7f9f5c0d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.970+0000 7f9f5a800640 1 -- 172.21.15.153:0/2915740477 >> v1:172.21.15.153:6789/0 conn(0x7f9f5c15c0c0 legacy=0x7f9f5c0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:01.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.970+0000 7f9f5a800640 1 -- 172.21.15.153:0/2915740477 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5c09b7e0 con 0x7f9f5c0d2170 2024-03-28T21:52:01.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.971+0000 7f9f5a800640 1 --2- 172.21.15.153:0/2915740477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f5c0d2170 0x7f9f5c165bd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0ce240 tx=0x7f9f5402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7baa9db40e067920 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:01.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.971+0000 7f9f58a00640 1 -- 172.21.15.153:0/2915740477 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54039070 con 0x7f9f5c0d2170 2024-03-28T21:52:01.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.971+0000 7f9f58a00640 1 -- 172.21.15.153:0/2915740477 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f5402cbd0 con 0x7f9f5c0d2170 2024-03-28T21:52:01.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.971+0000 7f9f58a00640 1 -- 172.21.15.153:0/2915740477 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54034440 con 0x7f9f5c0d2170 2024-03-28T21:52:01.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.972+0000 7f9f5b200640 1 -- 172.21.15.153:0/2915740477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f5c0d2170 msgr2=0x7f9f5c165bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:01.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.972+0000 7f9f5b200640 1 --2- 172.21.15.153:0/2915740477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f5c0d2170 0x7f9f5c165bd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0ce240 tx=0x7f9f5402be20 comp rx=0 tx=0).stop 2024-03-28T21:52:01.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.972+0000 7f9f5b200640 1 -- 172.21.15.153:0/2915740477 shutdown_connections 2024-03-28T21:52:01.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.972+0000 7f9f5b200640 1 --2- 172.21.15.153:0/2915740477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f5c0d2170 0x7f9f5c165bd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.972+0000 7f9f5b200640 1 --2- 172.21.15.153:0/2915740477 >> v2:172.21.15.165:3300/0 conn(0x7f9f5c0b5e50 0x7f9f5c0d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.972+0000 7f9f5b200640 1 -- 172.21.15.153:0/2915740477 >> 172.21.15.153:0/2915740477 conn(0x7f9f5c0b7380 msgr2=0x7f9f5c09aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:01.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.972+0000 7f9f5b200640 1 -- 172.21.15.153:0/2915740477 shutdown_connections 2024-03-28T21:52:01.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.972+0000 7f9f5b200640 1 -- 172.21.15.153:0/2915740477 wait complete. 2024-03-28T21:52:01.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.974+0000 7f9f5b200640 1 Processor -- start 2024-03-28T21:52:01.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.974+0000 7f9f5b200640 1 -- start start 2024-03-28T21:52:01.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.975+0000 7f9f5b200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f5c0b5e50 0x7f9f5c0ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.975+0000 7f9f5b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f5c0d2170 0x7f9f5c06d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.975+0000 7f9f5b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f5c15c0c0 0x7f9f5c14a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.975+0000 7f9f5b200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c0cf510 con 0x7f9f5c0b5e50 2024-03-28T21:52:01.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.975+0000 7f9f5b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c0cf230 con 0x7f9f5c15c0c0 2024-03-28T21:52:01.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.975+0000 7f9f5b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5c0d25a0 con 0x7f9f5c0d2170 2024-03-28T21:52:01.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.975+0000 7f9f59e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f5c0b5e50 0x7f9f5c0ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:01.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.975+0000 7f9f59e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f5c0b5e50 0x7f9f5c0ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54224/0 (socket says 172.21.15.153:54224) 2024-03-28T21:52:01.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.975+0000 7f9f59e00640 1 -- 172.21.15.153:0/3255246539 learned_addr learned my addr 172.21.15.153:0/3255246539 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:01.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.976+0000 7f9f59400640 1 --2- 172.21.15.153:0/3255246539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f5c0d2170 0x7f9f5c06d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:01.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.976+0000 7f9f59e00640 1 -- 172.21.15.153:0/3255246539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f5c0d2170 msgr2=0x7f9f5c06d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:01.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.976+0000 7f9f59e00640 1 --2- 172.21.15.153:0/3255246539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f5c0d2170 0x7f9f5c06d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.976+0000 7f9f5a800640 1 --2- 172.21.15.153:0/3255246539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f5c15c0c0 0x7f9f5c14a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:01.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.976+0000 7f9f59e00640 1 -- 172.21.15.153:0/3255246539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f5c15c0c0 msgr2=0x7f9f5c14a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:01.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.976+0000 7f9f59e00640 1 --2- 172.21.15.153:0/3255246539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f5c15c0c0 0x7f9f5c14a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:01.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.976+0000 7f9f59e00640 1 -- 172.21.15.153:0/3255246539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5c15e0c0 con 0x7f9f5c0b5e50 2024-03-28T21:52:01.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.976+0000 7f9f59e00640 1 --2- 172.21.15.153:0/3255246539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f5c0b5e50 0x7f9f5c0ce440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00c390 tx=0x7f9f4c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:01.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.976+0000 7f9f52000640 1 -- 172.21.15.153:0/3255246539 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c017070 con 0x7f9f5c0b5e50 2024-03-28T21:52:01.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.976+0000 7f9f52000640 1 -- 172.21.15.153:0/3255246539 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f4c005ce0 con 0x7f9f5c0b5e50 2024-03-28T21:52:01.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.976+0000 7f9f5b200640 1 -- 172.21.15.153:0/3255246539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f5c15e3a0 con 0x7f9f5c0b5e50 2024-03-28T21:52:01.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.976+0000 7f9f52000640 1 -- 172.21.15.153:0/3255246539 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c0072f0 con 0x7f9f5c0b5e50 2024-03-28T21:52:01.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.976+0000 7f9f5b200640 1 -- 172.21.15.153:0/3255246539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f5c06de30 con 0x7f9f5c0b5e50 2024-03-28T21:52:01.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.978+0000 7f9f5b200640 1 -- 172.21.15.153:0/3255246539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f5c0b49e0 con 0x7f9f5c0b5e50 2024-03-28T21:52:01.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.978+0000 7f9f52000640 1 -- 172.21.15.153:0/3255246539 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f9f4c01a070 con 0x7f9f5c0b5e50 2024-03-28T21:52:01.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.979+0000 7f9f52000640 1 --2- 172.21.15.153:0/3255246539 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9f3c06b4d0 0x7f9f3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:01.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.979+0000 7f9f52000640 1 -- 172.21.15.153:0/3255246539 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9f4c089630 con 0x7f9f5c0b5e50 2024-03-28T21:52:01.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.979+0000 7f9f59400640 1 --2- 172.21.15.153:0/3255246539 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9f3c06b4d0 0x7f9f3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:01.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.980+0000 7f9f59400640 1 --2- 172.21.15.153:0/3255246539 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9f3c06b4d0 0x7f9f3c06d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0686c0 tx=0x7f9f48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:01.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:01.984+0000 7f9f52000640 1 -- 172.21.15.153:0/3255246539 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9f5c0b49e0 con 0x7f9f5c0b5e50 2024-03-28T21:52:02.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.230+0000 7f9f5b200640 1 -- 172.21.15.153:0/3255246539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9f5c15e9f0 con 0x7f9f5c0b5e50 2024-03-28T21:52:02.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.237+0000 7f9f52000640 1 -- 172.21.15.153:0/3255246539 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+171792 (secure 0 0 0) 0x7f9f4c0584a0 con 0x7f9f5c0b5e50 2024-03-28T21:52:02.240 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:02.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.241+0000 7f9f5b200640 1 -- 172.21.15.153:0/3255246539 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9f3c06b4d0 msgr2=0x7f9f3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:02.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.241+0000 7f9f5b200640 1 --2- 172.21.15.153:0/3255246539 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9f3c06b4d0 0x7f9f3c06d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0686c0 tx=0x7f9f48008040 comp rx=0 tx=0).stop 2024-03-28T21:52:02.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.241+0000 7f9f5b200640 1 -- 172.21.15.153:0/3255246539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f5c0b5e50 msgr2=0x7f9f5c0ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:02.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.241+0000 7f9f5b200640 1 --2- 172.21.15.153:0/3255246539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f5c0b5e50 0x7f9f5c0ce440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00c390 tx=0x7f9f4c00c850 comp rx=0 tx=0).stop 2024-03-28T21:52:02.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.241+0000 7f9f5b200640 1 -- 172.21.15.153:0/3255246539 shutdown_connections 2024-03-28T21:52:02.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.241+0000 7f9f5b200640 1 --2- 172.21.15.153:0/3255246539 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9f3c06b4d0 0x7f9f3c06d990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.241+0000 7f9f5b200640 1 --2- 172.21.15.153:0/3255246539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f5c15c0c0 0x7f9f5c14a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.241+0000 7f9f5b200640 1 --2- 172.21.15.153:0/3255246539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f5c0d2170 0x7f9f5c06d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.241+0000 7f9f5b200640 1 --2- 172.21.15.153:0/3255246539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f5c0b5e50 0x7f9f5c0ce440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.241+0000 7f9f5b200640 1 -- 172.21.15.153:0/3255246539 >> 172.21.15.153:0/3255246539 conn(0x7f9f5c0b7380 msgr2=0x7f9f5c14b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:02.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.241+0000 7f9f5b200640 1 -- 172.21.15.153:0/3255246539 shutdown_connections 2024-03-28T21:52:02.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.241+0000 7f9f5b200640 1 -- 172.21.15.153:0/3255246539 wait complete. 2024-03-28T21:52:02.263 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1496390417},{"type":"v1","addr":"172.21.15.153:6833","nonce":1496390417}]},"active_addr":"172.21.15.153:6833/1496390417","active_change":"2024-03-28T21:51:41.442700+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":3105044786}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":2031261739}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":3313646767}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":1214652379}]}]} 2024-03-28T21:52:02.267 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-28T21:52:02.267 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-28T21:52:02.268 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:02.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.452+0000 7fb047200640 1 Processor -- start 2024-03-28T21:52:02.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.452+0000 7fb047200640 1 -- start start 2024-03-28T21:52:02.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.453+0000 7fb047200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb048161d80 0x7fb0480b5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.453+0000 7fb047200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0480b3820 0x7fb048162160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.453+0000 7fb047200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb048162b90 con 0x7fb0481626a0 2024-03-28T21:52:02.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.453+0000 7fb047200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb0480d2820 con 0x7fb048161d80 2024-03-28T21:52:02.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.453+0000 7fb047200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb0480d2b00 con 0x7fb0480b3820 2024-03-28T21:52:02.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.454+0000 7fb045e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb048161d80 0x7fb0480b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:02.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.454+0000 7fb045e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb048161d80 0x7fb0480b5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54238/0 (socket says 172.21.15.153:54238) 2024-03-28T21:52:02.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.454+0000 7fb045e00640 1 -- 172.21.15.153:0/4239947555 learned_addr learned my addr 172.21.15.153:0/4239947555 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:02.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.454+0000 7fb03d400640 1 --2- 172.21.15.153:0/4239947555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0480b3820 0x7fb048162160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:02.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.454+0000 7fb045e00640 1 -- 172.21.15.153:0/4239947555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0480b3820 msgr2=0x7fb048162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:02.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.454+0000 7fb045e00640 1 --2- 172.21.15.153:0/4239947555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0480b3820 0x7fb048162160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.454+0000 7fb045e00640 1 -- 172.21.15.153:0/4239947555 >> v1:172.21.15.165:6789/0 conn(0x7fb0481626a0 legacy=0x7fb0480cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:02.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.454+0000 7fb045e00640 1 -- 172.21.15.153:0/4239947555 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0480d2de0 con 0x7fb048161d80 2024-03-28T21:52:02.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.455+0000 7fb045e00640 1 --2- 172.21.15.153:0/4239947555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb048161d80 0x7fb0480b5340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb030009870 tx=0x7fb03002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed39efeb38ae12c server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:02.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.455+0000 7fb045400640 1 -- 172.21.15.153:0/4239947555 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300317c0 con 0x7fb048161d80 2024-03-28T21:52:02.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.456+0000 7fb045400640 1 -- 172.21.15.153:0/4239947555 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb030037070 con 0x7fb048161d80 2024-03-28T21:52:02.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.456+0000 7fb045400640 1 -- 172.21.15.153:0/4239947555 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030031b80 con 0x7fb048161d80 2024-03-28T21:52:02.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.456+0000 7fb047200640 1 -- 172.21.15.153:0/4239947555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb048161d80 msgr2=0x7fb0480b5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:02.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.456+0000 7fb047200640 1 --2- 172.21.15.153:0/4239947555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb048161d80 0x7fb0480b5340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb030009870 tx=0x7fb03002b860 comp rx=0 tx=0).stop 2024-03-28T21:52:02.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.456+0000 7fb047200640 1 -- 172.21.15.153:0/4239947555 shutdown_connections 2024-03-28T21:52:02.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.456+0000 7fb047200640 1 --2- 172.21.15.153:0/4239947555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0480b3820 0x7fb048162160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.456+0000 7fb047200640 1 --2- 172.21.15.153:0/4239947555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb048161d80 0x7fb0480b5340 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.456+0000 7fb047200640 1 -- 172.21.15.153:0/4239947555 >> 172.21.15.153:0/4239947555 conn(0x7fb0480d3f10 msgr2=0x7fb0480d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:02.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.457+0000 7fb047200640 1 -- 172.21.15.153:0/4239947555 shutdown_connections 2024-03-28T21:52:02.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.457+0000 7fb047200640 1 -- 172.21.15.153:0/4239947555 wait complete. 2024-03-28T21:52:02.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.459+0000 7fb047200640 1 Processor -- start 2024-03-28T21:52:02.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.459+0000 7fb047200640 1 -- start start 2024-03-28T21:52:02.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.460+0000 7fb047200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0480b3820 0x7fb0480c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.460+0000 7fb047200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb048161d80 0x7fb0480c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.460+0000 7fb047200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0481626a0 0x7fb0481531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.460+0000 7fb047200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb0480cec60 con 0x7fb0480b3820 2024-03-28T21:52:02.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.460+0000 7fb047200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb0480ceae0 con 0x7fb048161d80 2024-03-28T21:52:02.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.460+0000 7fb047200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb0480d02c0 con 0x7fb0481626a0 2024-03-28T21:52:02.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.460+0000 7fb045e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0480b3820 0x7fb0480c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:02.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.460+0000 7fb045e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0480b3820 0x7fb0480c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54240/0 (socket says 172.21.15.153:54240) 2024-03-28T21:52:02.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.460+0000 7fb045e00640 1 -- 172.21.15.153:0/2927872927 learned_addr learned my addr 172.21.15.153:0/2927872927 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:02.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.461+0000 7fb03d400640 1 --2- 172.21.15.153:0/2927872927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb048161d80 0x7fb0480c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:02.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.461+0000 7fb045e00640 1 -- 172.21.15.153:0/2927872927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0481626a0 msgr2=0x7fb0481531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:02.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.461+0000 7fb045e00640 1 --2- 172.21.15.153:0/2927872927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0481626a0 0x7fb0481531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.461+0000 7fb045e00640 1 -- 172.21.15.153:0/2927872927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb048161d80 msgr2=0x7fb0480c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:02.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.461+0000 7fb045e00640 1 --2- 172.21.15.153:0/2927872927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb048161d80 0x7fb0480c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.461+0000 7fb045e00640 1 -- 172.21.15.153:0/2927872927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0480c8920 con 0x7fb0480b3820 2024-03-28T21:52:02.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.461+0000 7fb045e00640 1 --2- 172.21.15.153:0/2927872927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0480b3820 0x7fb0480c8b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb03002b8a0 tx=0x7fb0300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:02.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.461+0000 7fb03ea00640 1 -- 172.21.15.153:0/2927872927 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030032860 con 0x7fb0480b3820 2024-03-28T21:52:02.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.461+0000 7fb03ea00640 1 -- 172.21.15.153:0/2927872927 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb030032a20 con 0x7fb0480b3820 2024-03-28T21:52:02.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.461+0000 7fb03ea00640 1 -- 172.21.15.153:0/2927872927 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030032e10 con 0x7fb0480b3820 2024-03-28T21:52:02.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.461+0000 7fb047200640 1 -- 172.21.15.153:0/2927872927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0480c9130 con 0x7fb0480b3820 2024-03-28T21:52:02.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.462+0000 7fb047200640 1 -- 172.21.15.153:0/2927872927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0480c96f0 con 0x7fb0480b3820 2024-03-28T21:52:02.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.463+0000 7fb047200640 1 -- 172.21.15.153:0/2927872927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb04804f520 con 0x7fb0480b3820 2024-03-28T21:52:02.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.464+0000 7fb03ea00640 1 -- 172.21.15.153:0/2927872927 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb03004c060 con 0x7fb0480b3820 2024-03-28T21:52:02.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.465+0000 7fb03ea00640 1 --2- 172.21.15.153:0/2927872927 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb02406b4d0 0x7fb02406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.465+0000 7fb03ea00640 1 -- 172.21.15.153:0/2927872927 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb0300abc00 con 0x7fb0480b3820 2024-03-28T21:52:02.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.465+0000 7fb03d400640 1 --2- 172.21.15.153:0/2927872927 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb02406b4d0 0x7fb02406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:02.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.466+0000 7fb03d400640 1 --2- 172.21.15.153:0/2927872927 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb02406b4d0 0x7fb02406d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb038006fd0 tx=0x7fb038008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:02.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.469+0000 7fb03ea00640 1 -- 172.21.15.153:0/2927872927 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb0300b2080 con 0x7fb0480b3820 2024-03-28T21:52:02.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.728+0000 7fb047200640 1 -- 172.21.15.153:0/2927872927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb04806b320 con 0x7fb0480b3820 2024-03-28T21:52:02.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.730+0000 7fb03ea00640 1 -- 172.21.15.153:0/2927872927 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7fb030040070 con 0x7fb0480b3820 2024-03-28T21:52:02.733 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:02.733 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:57.716531+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:02.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.732+0000 7fb047200640 1 -- 172.21.15.153:0/2927872927 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb02406b4d0 msgr2=0x7fb02406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:02.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.732+0000 7fb047200640 1 --2- 172.21.15.153:0/2927872927 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb02406b4d0 0x7fb02406d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb038006fd0 tx=0x7fb038008040 comp rx=0 tx=0).stop 2024-03-28T21:52:02.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.732+0000 7fb047200640 1 -- 172.21.15.153:0/2927872927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0480b3820 msgr2=0x7fb0480c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:02.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.732+0000 7fb047200640 1 --2- 172.21.15.153:0/2927872927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0480b3820 0x7fb0480c8b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb03002b8a0 tx=0x7fb0300046c0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.732+0000 7fb047200640 1 -- 172.21.15.153:0/2927872927 shutdown_connections 2024-03-28T21:52:02.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.732+0000 7fb047200640 1 --2- 172.21.15.153:0/2927872927 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb02406b4d0 0x7fb02406d990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.732+0000 7fb047200640 1 --2- 172.21.15.153:0/2927872927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0481626a0 0x7fb0481531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.732+0000 7fb047200640 1 --2- 172.21.15.153:0/2927872927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb048161d80 0x7fb0480c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.732+0000 7fb047200640 1 --2- 172.21.15.153:0/2927872927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0480b3820 0x7fb0480c8b50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.732+0000 7fb047200640 1 -- 172.21.15.153:0/2927872927 >> 172.21.15.153:0/2927872927 conn(0x7fb0480d3f10 msgr2=0x7fb04806c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:02.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.732+0000 7fb047200640 1 -- 172.21.15.153:0/2927872927 shutdown_connections 2024-03-28T21:52:02.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.732+0000 7fb047200640 1 -- 172.21.15.153:0/2927872927 wait complete. 2024-03-28T21:52:02.753 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-28T21:52:02.753 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:02.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.939+0000 7fa5cd800640 1 Processor -- start 2024-03-28T21:52:02.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.939+0000 7fa5cd800640 1 -- start start 2024-03-28T21:52:02.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.940+0000 7fa5cd800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5c806c4c0 0x7fa5c815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.940+0000 7fa5cd800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa5c806c8a0 0x7fa5c8161c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.940+0000 7fa5cd800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c815e760 con 0x7fa5c8162180 2024-03-28T21:52:02.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.940+0000 7fa5cd800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c81415e0 con 0x7fa5c806c8a0 2024-03-28T21:52:02.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.940+0000 7fa5cd800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c815ed40 con 0x7fa5c806c4c0 2024-03-28T21:52:02.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.941+0000 7fa5c7400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa5c8162180 0x7fa5c80b4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54532/0 (socket says 172.21.15.153:54532) 2024-03-28T21:52:02.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.941+0000 7fa5c7400640 1 -- 172.21.15.153:0/1341484373 learned_addr learned my addr 172.21.15.153:0/1341484373 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:02.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.941+0000 7fa5be000640 1 --2- 172.21.15.153:0/1341484373 >> v2:172.21.15.165:3300/0 conn(0x7fa5c806c8a0 0x7fa5c8161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:02.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.941+0000 7fa5c6a00640 1 --2- 172.21.15.153:0/1341484373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5c806c4c0 0x7fa5c815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:02.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.941+0000 7fa5c6000640 1 -- 172.21.15.153:0/1341484373 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3706401069 0 0) 0x7fa5c815e760 con 0x7fa5c8162180 2024-03-28T21:52:02.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.941+0000 7fa5c6000640 1 -- 172.21.15.153:0/1341484373 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5ac003520 con 0x7fa5c8162180 2024-03-28T21:52:02.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.941+0000 7fa5c6000640 1 -- 172.21.15.153:0/1341484373 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3807204601 0 0) 0x7fa5ac003520 con 0x7fa5c8162180 2024-03-28T21:52:02.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.941+0000 7fa5c6000640 1 -- 172.21.15.153:0/1341484373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5c806c4c0 msgr2=0x7fa5c815f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:02.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.941+0000 7fa5c6000640 1 --2- 172.21.15.153:0/1341484373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5c806c4c0 0x7fa5c815f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.941+0000 7fa5c6000640 1 -- 172.21.15.153:0/1341484373 >> v2:172.21.15.165:3300/0 conn(0x7fa5c806c8a0 msgr2=0x7fa5c8161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:02.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.941+0000 7fa5c6000640 1 --2- 172.21.15.153:0/1341484373 >> v2:172.21.15.165:3300/0 conn(0x7fa5c806c8a0 0x7fa5c8161c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.941+0000 7fa5c6000640 1 -- 172.21.15.153:0/1341484373 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c81627e0 con 0x7fa5c8162180 2024-03-28T21:52:02.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.941+0000 7fa5c6000640 1 -- 172.21.15.153:0/1341484373 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fa5c00019f0 con 0x7fa5c8162180 2024-03-28T21:52:02.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5c6000640 1 -- 172.21.15.153:0/1341484373 >> v1:172.21.15.153:6789/0 conn(0x7fa5c8162180 legacy=0x7fa5c80b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:02.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5c6000640 1 --2- 172.21.15.153:0/1341484373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5ac0039b0 0x7fa5ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5c6000640 1 --2- 172.21.15.153:0/1341484373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5c806c4c0 0x7fa5ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5c6000640 1 --2- 172.21.15.153:0/1341484373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5ac004d40 0x7fa5ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5c6000640 1 -- 172.21.15.153:0/1341484373 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c81415e0 con 0x7fa5ac004d40 2024-03-28T21:52:02.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5c6000640 1 -- 172.21.15.153:0/1341484373 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c815ed40 con 0x7fa5ac0039b0 2024-03-28T21:52:02.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5c6000640 1 -- 172.21.15.153:0/1341484373 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5ac00b9c0 con 0x7fa5c806c4c0 2024-03-28T21:52:02.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5c7400640 1 --2- 172.21.15.153:0/1341484373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5ac004d40 0x7fa5ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:02.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5be000640 1 --2- 172.21.15.153:0/1341484373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5c806c4c0 0x7fa5ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:02.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5c6a00640 1 --2- 172.21.15.153:0/1341484373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5ac0039b0 0x7fa5ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:02.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5c7400640 1 -- 172.21.15.153:0/1341484373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5c806c4c0 msgr2=0x7fa5ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:02.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5c7400640 1 --2- 172.21.15.153:0/1341484373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5c806c4c0 0x7fa5ac004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5c7400640 1 -- 172.21.15.153:0/1341484373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5ac0039b0 msgr2=0x7fa5ac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:02.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5c7400640 1 --2- 172.21.15.153:0/1341484373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5ac0039b0 0x7fa5ac003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.942+0000 7fa5c7400640 1 -- 172.21.15.153:0/1341484373 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ac003520 con 0x7fa5ac004d40 2024-03-28T21:52:02.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.943+0000 7fa5c7400640 1 --2- 172.21.15.153:0/1341484373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5ac004d40 0x7fa5ac0051c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000a7a0 tx=0x7fa5ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26075eff43be9d04 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:02.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.943+0000 7fa5c6000640 1 -- 172.21.15.153:0/1341484373 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000a3f0 con 0x7fa5ac004d40 2024-03-28T21:52:02.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.943+0000 7fa5c6000640 1 -- 172.21.15.153:0/1341484373 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c0034630 con 0x7fa5ac004d40 2024-03-28T21:52:02.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.943+0000 7fa5c6000640 1 -- 172.21.15.153:0/1341484373 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0034a40 con 0x7fa5ac004d40 2024-03-28T21:52:02.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.944+0000 7fa5cd800640 1 -- 172.21.15.153:0/1341484373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5ac004d40 msgr2=0x7fa5ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:02.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.944+0000 7fa5cd800640 1 --2- 172.21.15.153:0/1341484373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5ac004d40 0x7fa5ac0051c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000a7a0 tx=0x7fa5ac005830 comp rx=0 tx=0).stop 2024-03-28T21:52:02.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.944+0000 7fa5c7400640 1 -- 172.21.15.153:0/1341484373 reap_dead start 2024-03-28T21:52:02.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.944+0000 7fa5cd800640 1 -- 172.21.15.153:0/1341484373 shutdown_connections 2024-03-28T21:52:02.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.944+0000 7fa5cd800640 1 -- 172.21.15.153:0/1341484373 >> 172.21.15.153:0/1341484373 conn(0x7fa5c80b2710 msgr2=0x7fa5c80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:02.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.944+0000 7fa5cd800640 1 -- 172.21.15.153:0/1341484373 shutdown_connections 2024-03-28T21:52:02.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.944+0000 7fa5cd800640 1 -- 172.21.15.153:0/1341484373 wait complete. 2024-03-28T21:52:02.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.947+0000 7fa5cd800640 1 Processor -- start 2024-03-28T21:52:02.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.947+0000 7fa5cd800640 1 -- start start 2024-03-28T21:52:02.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.949+0000 7fa5cd800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5ac004d40 0x7fa5c81f6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.949+0000 7fa5cd800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5c815c540 0x7fa5c81596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.949+0000 7fa5cd800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5c8159c10 0x7fa5c815cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.949+0000 7fa5cd800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c8162ac0 con 0x7fa5ac004d40 2024-03-28T21:52:02.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.949+0000 7fa5cd800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c80b3910 con 0x7fa5c815c540 2024-03-28T21:52:02.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.949+0000 7fa5cd800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c80b4e10 con 0x7fa5c8159c10 2024-03-28T21:52:02.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.949+0000 7fa5c6a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5ac004d40 0x7fa5c81f6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:02.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.949+0000 7fa5c6a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5ac004d40 0x7fa5c81f6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45400/0 (socket says 172.21.15.153:45400) 2024-03-28T21:52:02.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.949+0000 7fa5c6a00640 1 -- 172.21.15.153:0/3320411951 learned_addr learned my addr 172.21.15.153:0/3320411951 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:02.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.949+0000 7fa5c6a00640 1 -- 172.21.15.153:0/3320411951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5c8159c10 msgr2=0x7fa5c815cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:02.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.949+0000 7fa5c6a00640 1 --2- 172.21.15.153:0/3320411951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5c8159c10 0x7fa5c815cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.949+0000 7fa5c6a00640 1 -- 172.21.15.153:0/3320411951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5c815c540 msgr2=0x7fa5c81596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:02.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.949+0000 7fa5c6a00640 1 --2- 172.21.15.153:0/3320411951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5c815c540 0x7fa5c81596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:02.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.949+0000 7fa5c6a00640 1 -- 172.21.15.153:0/3320411951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c815a100 con 0x7fa5ac004d40 2024-03-28T21:52:02.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.950+0000 7fa5c6a00640 1 --2- 172.21.15.153:0/3320411951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5ac004d40 0x7fa5c81f6db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0010860 tx=0x7fa5b0010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:02.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.950+0000 7fa5bf400640 1 -- 172.21.15.153:0/3320411951 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000f040 con 0x7fa5ac004d40 2024-03-28T21:52:02.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.950+0000 7fa5bf400640 1 -- 172.21.15.153:0/3320411951 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b000eae0 con 0x7fa5ac004d40 2024-03-28T21:52:02.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.950+0000 7fa5bf400640 1 -- 172.21.15.153:0/3320411951 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b001c400 con 0x7fa5ac004d40 2024-03-28T21:52:02.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.950+0000 7fa5cd800640 1 -- 172.21.15.153:0/3320411951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c815a3e0 con 0x7fa5ac004d40 2024-03-28T21:52:02.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.950+0000 7fa5cd800640 1 -- 172.21.15.153:0/3320411951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c815a9a0 con 0x7fa5ac004d40 2024-03-28T21:52:02.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.951+0000 7fa5cd800640 1 -- 172.21.15.153:0/3320411951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c8068ff0 con 0x7fa5ac004d40 2024-03-28T21:52:02.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.952+0000 7fa5bf400640 1 -- 172.21.15.153:0/3320411951 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa5b001c5a0 con 0x7fa5ac004d40 2024-03-28T21:52:02.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.953+0000 7fa5bf400640 1 --2- 172.21.15.153:0/3320411951 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa5a406b500 0x7fa5a406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:02.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.953+0000 7fa5bf400640 1 -- 172.21.15.153:0/3320411951 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa5b008a880 con 0x7fa5ac004d40 2024-03-28T21:52:02.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.953+0000 7fa5be000640 1 --2- 172.21.15.153:0/3320411951 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa5a406b500 0x7fa5a406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:02.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.954+0000 7fa5be000640 1 --2- 172.21.15.153:0/3320411951 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa5a406b500 0x7fa5a406d9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8154e90 tx=0x7fa5b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:02.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:02.957+0000 7fa5bf400640 1 -- 172.21.15.153:0/3320411951 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa5b0018030 con 0x7fa5ac004d40 2024-03-28T21:52:03.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.145+0000 7fa5cd800640 1 -- 172.21.15.153:0/3320411951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5c8154b50 con 0x7fa5ac004d40 2024-03-28T21:52:03.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.148+0000 7fa5bf400640 1 -- 172.21.15.153:0/3320411951 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7fa5b0059010 con 0x7fa5ac004d40 2024-03-28T21:52:03.150 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:03.150 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:57.716531+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:03.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.151+0000 7fa5cd800640 1 -- 172.21.15.153:0/3320411951 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa5a406b500 msgr2=0x7fa5a406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.151+0000 7fa5cd800640 1 --2- 172.21.15.153:0/3320411951 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa5a406b500 0x7fa5a406d9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8154e90 tx=0x7fa5b8008040 comp rx=0 tx=0).stop 2024-03-28T21:52:03.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.151+0000 7fa5cd800640 1 -- 172.21.15.153:0/3320411951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5ac004d40 msgr2=0x7fa5c81f6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.151+0000 7fa5cd800640 1 --2- 172.21.15.153:0/3320411951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5ac004d40 0x7fa5c81f6db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0010860 tx=0x7fa5b0010d20 comp rx=0 tx=0).stop 2024-03-28T21:52:03.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.151+0000 7fa5cd800640 1 -- 172.21.15.153:0/3320411951 shutdown_connections 2024-03-28T21:52:03.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.151+0000 7fa5cd800640 1 --2- 172.21.15.153:0/3320411951 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa5a406b500 0x7fa5a406d9c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.151+0000 7fa5cd800640 1 --2- 172.21.15.153:0/3320411951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5c8159c10 0x7fa5c815cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.151+0000 7fa5cd800640 1 --2- 172.21.15.153:0/3320411951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5c815c540 0x7fa5c81596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.151+0000 7fa5cd800640 1 --2- 172.21.15.153:0/3320411951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5ac004d40 0x7fa5c81f6db0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.151+0000 7fa5cd800640 1 -- 172.21.15.153:0/3320411951 >> 172.21.15.153:0/3320411951 conn(0x7fa5c80b2710 msgr2=0x7fa5c8160af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.151+0000 7fa5cd800640 1 -- 172.21.15.153:0/3320411951 shutdown_connections 2024-03-28T21:52:03.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.151+0000 7fa5cd800640 1 -- 172.21.15.153:0/3320411951 wait complete. 2024-03-28T21:52:03.171 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-28T21:52:03.171 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-28T21:52:03.172 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-28T21:52:03.172 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-28T21:52:03.173 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-28T21:52:03.173 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-28T21:52:03.173 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-28T21:52:03.174 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-28T21:52:03.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.481+0000 7f8881000640 1 Processor -- start 2024-03-28T21:52:03.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.481+0000 7f8881000640 1 -- start start 2024-03-28T21:52:03.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.483+0000 7f8881000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f887c0b4280 0x7f887c15fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.483+0000 7f8881000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f887c0cc760 con 0x7f887c15f3e0 2024-03-28T21:52:03.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.483+0000 7f8881000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f887c0d05a0 con 0x7f887c160770 2024-03-28T21:52:03.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.483+0000 7f8881000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f887c0d0880 con 0x7f887c0b4280 2024-03-28T21:52:03.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.484+0000 7f887aa00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f887c160770 0x7f887c0cd200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:33984/0 (socket says 172.21.15.153:33984) 2024-03-28T21:52:03.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.484+0000 7f887aa00640 1 -- 172.21.15.153:0/591523297 learned_addr learned my addr 172.21.15.153:0/591523297 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:03.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.484+0000 7f887be00640 1 --2- 172.21.15.153:0/591523297 >> v2:172.21.15.153:3300/0 conn(0x7f887c0b4280 0x7f887c15fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.486+0000 7f887be00640 1 -- 172.21.15.153:0/591523297 >> v1:172.21.15.165:6789/0 conn(0x7f887c160770 legacy=0x7f887c0cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.486+0000 7f887be00640 1 -- 172.21.15.153:0/591523297 >> v1:172.21.15.153:6789/0 conn(0x7f887c15f3e0 legacy=0x7f887c0b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.486+0000 7f887be00640 1 -- 172.21.15.153:0/591523297 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887c0cca00 con 0x7f887c0b4280 2024-03-28T21:52:03.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.488+0000 7f887be00640 1 --2- 172.21.15.153:0/591523297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887c0b4280 0x7f887c15fbd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f886c0097a0 tx=0x7f886c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d48f2fe0b6f7cf server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.488+0000 7f887a000640 1 -- 172.21.15.153:0/591523297 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c037070 con 0x7f887c0b4280 2024-03-28T21:52:03.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.490+0000 7f887a000640 1 -- 172.21.15.153:0/591523297 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f886c030710 con 0x7f887c0b4280 2024-03-28T21:52:03.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.490+0000 7f887a000640 1 -- 172.21.15.153:0/591523297 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c030b20 con 0x7f887c0b4280 2024-03-28T21:52:03.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.491+0000 7f8881000640 1 -- 172.21.15.153:0/591523297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887c0b4280 msgr2=0x7f887c15fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.491+0000 7f8881000640 1 --2- 172.21.15.153:0/591523297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887c0b4280 0x7f887c15fbd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f886c0097a0 tx=0x7f886c02b7b0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.491+0000 7f8881000640 1 -- 172.21.15.153:0/591523297 shutdown_connections 2024-03-28T21:52:03.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.492+0000 7f8881000640 1 --2- 172.21.15.153:0/591523297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887c0b4280 0x7f887c15fbd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.492+0000 7f8881000640 1 -- 172.21.15.153:0/591523297 >> 172.21.15.153:0/591523297 conn(0x7f887c0b3760 msgr2=0x7f887c0b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.492+0000 7f8881000640 1 -- 172.21.15.153:0/591523297 shutdown_connections 2024-03-28T21:52:03.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.492+0000 7f8881000640 1 -- 172.21.15.153:0/591523297 wait complete. 2024-03-28T21:52:03.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.495+0000 7f8881000640 1 Processor -- start 2024-03-28T21:52:03.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.495+0000 7f1de4a00640 1 Processor -- start 2024-03-28T21:52:03.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.496+0000 7f1de4a00640 1 -- start start 2024-03-28T21:52:03.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.496+0000 7f8881000640 1 -- start start 2024-03-28T21:52:03.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.498+0000 7f8881000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f887c0b4280 0x7f887c0c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.498+0000 7f8881000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887c15f3e0 0x7f887c15b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.498+0000 7fe3b7200640 1 Processor -- start 2024-03-28T21:52:03.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.499+0000 7f1de4a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1de015cc00 0x7f1de0165120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.499+0000 7f887b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f887c0b4280 0x7f887c0c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.499+0000 7f887b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f887c0b4280 0x7f887c0c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:42742/0 (socket says 172.21.15.153:42742) 2024-03-28T21:52:03.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.499+0000 7f1de4a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de015ab90 con 0x7f1de00cf730 2024-03-28T21:52:03.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.499+0000 7f1de4a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de015ae70 con 0x7f1de015a4a0 2024-03-28T21:52:03.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.499+0000 7f1ddde00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f1de015a4a0 0x7f1de00cf020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:33996/0 (socket says 172.21.15.153:33996) 2024-03-28T21:52:03.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.499+0000 7f1ddde00640 1 -- 172.21.15.153:0/3882361057 learned_addr learned my addr 172.21.15.153:0/3882361057 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:03.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.499+0000 7f1de4a00640 1 -- 172.21.15.153:0/3882361057 --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1de015b4c0 con 0x7f1de015cc00 2024-03-28T21:52:03.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.499+0000 7f887aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887c15f3e0 0x7f887c15b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.499+0000 7f887aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887c15f3e0 0x7f887c15b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45420/0 (socket says 172.21.15.153:45420) 2024-03-28T21:52:03.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.500+0000 7f887b400640 1 -- 172.21.15.153:0/3459649117 learned_addr learned my addr 172.21.15.153:0/3459649117 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:03.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.500+0000 7f8881000640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f887c160770 0x7f887c0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.500+0000 7f1dde800640 1 --2- 172.21.15.153:0/3882361057 >> v2:172.21.15.165:3300/0 conn(0x7f1de015cc00 0x7f1de0165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7f8881000640 1 -- 172.21.15.153:0/3459649117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f887c0d0230 con 0x7f887c15f3e0 2024-03-28T21:52:03.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7f1ddca00640 1 -- 172.21.15.153:0/3882361057 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013422701 0 0) 0x7f1de015ab90 con 0x7f1de00cf730 2024-03-28T21:52:03.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.499+0000 7fe3b7200640 1 -- start start 2024-03-28T21:52:03.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7fe3b7200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe3b0160090 0x7fe3b0071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7fe3b7200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b0160470 con 0x7fe3b006d480 2024-03-28T21:52:03.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7fe3b7200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b0071bf0 con 0x7fe3b0071650 2024-03-28T21:52:03.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7fe3b7200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe3b0071ed0 con 0x7fe3b0160090 2024-03-28T21:52:03.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7f1ddca00640 1 -- 172.21.15.153:0/3882361057 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dc4003520 con 0x7f1de00cf730 2024-03-28T21:52:03.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7f8881000640 1 -- 172.21.15.153:0/3459649117 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f887c0b5190 con 0x7f887c160770 2024-03-28T21:52:03.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7fe3afe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe3b0160090 0x7fe3b0071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7f887be00640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f887c160770 0x7f887c0cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7f8881000640 1 -- 172.21.15.153:0/3459649117 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f887c15f7c0 con 0x7f887c0b4280 2024-03-28T21:52:03.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7fe3afe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe3b0160090 0x7fe3b0071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45424/0 (socket says 172.21.15.153:45424) 2024-03-28T21:52:03.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.502+0000 7fe3af400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fe3b0071650 0x7fe3b006cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:34006/0 (socket says 172.21.15.153:34006) 2024-03-28T21:52:03.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.502+0000 7fe3af400640 1 -- 172.21.15.153:0/1752136362 learned_addr learned my addr 172.21.15.153:0/1752136362 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:03.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7f1dde800640 1 -- 172.21.15.153:0/3882361057 >> v1:172.21.15.165:6789/0 conn(0x7f1de015a4a0 legacy=0x7f1de00cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7f1dde800640 1 -- 172.21.15.153:0/3882361057 >> v1:172.21.15.153:6789/0 conn(0x7f1de00cf730 legacy=0x7f1de00b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.501+0000 7f1dde800640 1 -- 172.21.15.153:0/3882361057 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de015b150 con 0x7f1de015cc00 2024-03-28T21:52:03.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.503+0000 7fe3aea00640 1 -- 172.21.15.153:0/1752136362 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1590430193 0 0) 0x7fe3b0071bf0 con 0x7fe3b0071650 2024-03-28T21:52:03.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.503+0000 7fe3aea00640 1 -- 172.21.15.153:0/1752136362 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe394003520 con 0x7fe3b0071650 2024-03-28T21:52:03.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.502+0000 7f887aa00640 1 -- 172.21.15.153:0/3459649117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f887c0b4280 msgr2=0x7f887c0c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.503+0000 7f1dde800640 1 --2- 172.21.15.153:0/3882361057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1de015cc00 0x7f1de0165120 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8009d90 tx=0x7f1dd802e0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc65dd5cd5bc0672 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.502+0000 7f887aa00640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f887c0b4280 0x7f887c0c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.502+0000 7f887aa00640 1 -- 172.21.15.153:0/3459649117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f887c160770 msgr2=0x7f887c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.502+0000 7f887aa00640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f887c160770 0x7f887c0cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.502+0000 7f887aa00640 1 -- 172.21.15.153:0/3459649117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887c0c6430 con 0x7f887c15f3e0 2024-03-28T21:52:03.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.503+0000 7f887aa00640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887c15f3e0 0x7f887c15b430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8868001770 tx=0x7f8868001c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.503+0000 7fe3aea00640 1 -- 172.21.15.153:0/1752136362 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 391886529 0 0) 0x7fe3b0160470 con 0x7fe3b006d480 2024-03-28T21:52:03.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.503+0000 7f887be00640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f887c160770 0x7f887c0cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:03.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.503+0000 7f887b400640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f887c0b4280 0x7f887c0c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:03.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.504+0000 7f8873400640 1 -- 172.21.15.153:0/3459649117 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8868005ce0 con 0x7f887c15f3e0 2024-03-28T21:52:03.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.504+0000 7f1ddca00640 1 -- 172.21.15.153:0/3882361057 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd803b070 con 0x7f1de015cc00 2024-03-28T21:52:03.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.504+0000 7fe3afe00640 1 -- 172.21.15.153:0/1752136362 >> v1:172.21.15.165:6789/0 conn(0x7fe3b0071650 legacy=0x7fe3b006cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.504+0000 7f8881000640 1 -- 172.21.15.153:0/3459649117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887c0c6710 con 0x7f887c15f3e0 2024-03-28T21:52:03.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.504+0000 7f8881000640 1 -- 172.21.15.153:0/3459649117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f887c0c6cd0 con 0x7f887c15f3e0 2024-03-28T21:52:03.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.504+0000 7f8873400640 1 -- 172.21.15.153:0/3459649117 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8868010e50 con 0x7f887c15f3e0 2024-03-28T21:52:03.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.504+0000 7f8873400640 1 -- 172.21.15.153:0/3459649117 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8868007270 con 0x7f887c15f3e0 2024-03-28T21:52:03.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.504+0000 7fe3afe00640 1 -- 172.21.15.153:0/1752136362 >> v1:172.21.15.153:6789/0 conn(0x7fe3b006d480 legacy=0x7fe3b00b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.504+0000 7fe3afe00640 1 -- 172.21.15.153:0/1752136362 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b00721b0 con 0x7fe3b0160090 2024-03-28T21:52:03.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.504+0000 7f1ddca00640 1 -- 172.21.15.153:0/3882361057 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd8036440 con 0x7f1de015cc00 2024-03-28T21:52:03.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.504+0000 7f1ddca00640 1 -- 172.21.15.153:0/3882361057 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd80367f0 con 0x7f1de015cc00 2024-03-28T21:52:03.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.505+0000 7f1de4a00640 1 -- 172.21.15.153:0/3882361057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1de015cc00 msgr2=0x7f1de0165120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.505+0000 7f1de4a00640 1 --2- 172.21.15.153:0/3882361057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1de015cc00 0x7f1de0165120 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8009d90 tx=0x7f1dd802e0f0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.506+0000 7f8881000640 1 -- 172.21.15.153:0/3459649117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8854001030 con 0x7f887c15f3e0 2024-03-28T21:52:03.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.506+0000 7f1de4a00640 1 -- 172.21.15.153:0/3882361057 shutdown_connections 2024-03-28T21:52:03.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.506+0000 7f1de4a00640 1 --2- 172.21.15.153:0/3882361057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1de015cc00 0x7f1de0165120 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.506+0000 7f1de4a00640 1 -- 172.21.15.153:0/3882361057 >> 172.21.15.153:0/3882361057 conn(0x7f1de006b170 msgr2=0x7f1de006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.506+0000 7fe3afe00640 1 --2- 172.21.15.153:0/1752136362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3b0160090 0x7fe3b0071110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009d90 tx=0x7fe3a802bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89ab034c4e57cfe server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.507+0000 7fe3aea00640 1 -- 172.21.15.153:0/1752136362 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8039070 con 0x7fe3b0160090 2024-03-28T21:52:03.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.507+0000 7fe3aea00640 1 -- 172.21.15.153:0/1752136362 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3a802c8b0 con 0x7fe3b0160090 2024-03-28T21:52:03.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.507+0000 7fe3aea00640 1 -- 172.21.15.153:0/1752136362 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8039070 con 0x7fe3b0160090 2024-03-28T21:52:03.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.508+0000 7fe3b7200640 1 -- 172.21.15.153:0/1752136362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3b0160090 msgr2=0x7fe3b0071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.508+0000 7fe3b7200640 1 --2- 172.21.15.153:0/1752136362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3b0160090 0x7fe3b0071110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009d90 tx=0x7fe3a802bd80 comp rx=0 tx=0).stop 2024-03-28T21:52:03.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.508+0000 7fe3b7200640 1 -- 172.21.15.153:0/1752136362 shutdown_connections 2024-03-28T21:52:03.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.508+0000 7fe3b7200640 1 --2- 172.21.15.153:0/1752136362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3b0160090 0x7fe3b0071110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.508+0000 7fe3b7200640 1 -- 172.21.15.153:0/1752136362 >> 172.21.15.153:0/1752136362 conn(0x7fe3b00cfc00 msgr2=0x7fe3b00cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.509+0000 7fe3b7200640 1 -- 172.21.15.153:0/1752136362 shutdown_connections 2024-03-28T21:52:03.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.509+0000 7f1de4a00640 1 -- 172.21.15.153:0/3882361057 shutdown_connections 2024-03-28T21:52:03.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.509+0000 7fe3b7200640 1 -- 172.21.15.153:0/1752136362 wait complete. 2024-03-28T21:52:03.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.510+0000 7fcc79c00640 1 Processor -- start 2024-03-28T21:52:03.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.510+0000 7f8873400640 1 -- 172.21.15.153:0/3459649117 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f8868007410 con 0x7f887c15f3e0 2024-03-28T21:52:03.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.511+0000 7f8873400640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f885c06b4d0 0x7f885c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.511+0000 7f8873400640 1 -- 172.21.15.153:0/3459649117 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f886808dd60 con 0x7f887c15f3e0 2024-03-28T21:52:03.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.509+0000 7f1de4a00640 1 -- 172.21.15.153:0/3882361057 wait complete. 2024-03-28T21:52:03.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.510+0000 7fcc79c00640 1 -- start start 2024-03-28T21:52:03.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.511+0000 7fcc79c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcc7415e0e0 0x7fcc740b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.511+0000 7fcc79c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcc74162450 0x7fcc740d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.511+0000 7fcc79c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc740cf940 con 0x7fcc740b3d00 2024-03-28T21:52:03.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.511+0000 7fcc79c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcc740d1aa0 con 0x7fcc74162450 2024-03-28T21:52:03.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.511+0000 7fcc79c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcc740cfc20 con 0x7fcc7415e0e0 2024-03-28T21:52:03.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.511+0000 7f1de4a00640 1 Processor -- start 2024-03-28T21:52:03.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.512+0000 7fcc79200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcc74162450 0x7fcc740d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.512+0000 7fcc79200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcc74162450 0x7fcc740d24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45438/0 (socket says 172.21.15.153:45438) 2024-03-28T21:52:03.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.512+0000 7fcc79200640 1 -- 172.21.15.153:0/2634370422 learned_addr learned my addr 172.21.15.153:0/2634370422 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:03.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.512+0000 7fcc73e00640 1 --2- 172.21.15.153:0/2634370422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcc7415e0e0 0x7fcc740b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.513+0000 7fcc79200640 1 -- 172.21.15.153:0/2634370422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcc7415e0e0 msgr2=0x7fcc740b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:03.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.513+0000 7fcc79200640 1 --2- 172.21.15.153:0/2634370422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcc7415e0e0 0x7fcc740b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.513+0000 7fcc79200640 1 -- 172.21.15.153:0/2634370422 >> v1:172.21.15.165:6789/0 conn(0x7fcc740b3d00 legacy=0x7fcc74161d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.513+0000 7fcc79200640 1 -- 172.21.15.153:0/2634370422 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc740d1cf0 con 0x7fcc74162450 2024-03-28T21:52:03.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.513+0000 7fcc73e00640 1 --2- 172.21.15.153:0/2634370422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcc7415e0e0 0x7fcc740b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:03.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.512+0000 7f8873400640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.153:6816/3758921042,v1:172.21.15.153:6817/3758921042] conn(0x7f885c073670 0x7f885c075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.512+0000 7f8873400640 1 -- 172.21.15.153:0/3459649117 --> [v2:172.21.15.153:6816/3758921042,v1:172.21.15.153:6817/3758921042] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f885c076140 con 0x7f885c073670 2024-03-28T21:52:03.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.512+0000 7f887be00640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.153:6816/3758921042,v1:172.21.15.153:6817/3758921042] conn(0x7f885c073670 0x7f885c075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.513+0000 7f887b400640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f885c06b4d0 0x7f885c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.513+0000 7f887be00640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.153:6816/3758921042,v1:172.21.15.153:6817/3758921042] conn(0x7f885c073670 0x7f885c075a90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.514+0000 7f887b400640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f885c06b4d0 0x7f885c06d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8874007fd0 tx=0x7f8874009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.514+0000 7f8873400640 1 -- 172.21.15.153:0/3459649117 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f8868058770 con 0x7f887c15f3e0 2024-03-28T21:52:03.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.515+0000 7f8873400640 1 -- 172.21.15.153:0/3459649117 <== osd.0 v2:172.21.15.153:6816/3758921042 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f885c076140 con 0x7f885c073670 2024-03-28T21:52:03.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.514+0000 7fcc79200640 1 --2- 172.21.15.153:0/2634370422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc74162450 0x7fcc740d24f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00b1a0 tx=0x7fcc6c02c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f74a9924a816af4 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.515+0000 7fcc72a00640 1 -- 172.21.15.153:0/2634370422 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c02cac0 con 0x7fcc74162450 2024-03-28T21:52:03.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.515+0000 7fcc72a00640 1 -- 172.21.15.153:0/2634370422 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc6c02cc60 con 0x7fcc74162450 2024-03-28T21:52:03.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.515+0000 7fcc72a00640 1 -- 172.21.15.153:0/2634370422 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c034610 con 0x7fcc74162450 2024-03-28T21:52:03.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.514+0000 7f1de4a00640 1 -- start start 2024-03-28T21:52:03.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.515+0000 7f1de4a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1de00cf730 0x7f1de01f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.515+0000 7f1de4a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1de015a4a0 0x7f1de0154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.515+0000 7f1de4a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1de015cc00 0x7f1de00cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.515+0000 7f1de4a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1de006be10 con 0x7f1de015a4a0 2024-03-28T21:52:03.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.515+0000 7f1de4a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1de006bc90 con 0x7f1de015cc00 2024-03-28T21:52:03.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.515+0000 7f1de4a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1de00b43b0 con 0x7f1de00cf730 2024-03-28T21:52:03.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.516+0000 7f1ddde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1de00cf730 0x7f1de01f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.516+0000 7f1ddde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1de00cf730 0x7f1de01f90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:42760/0 (socket says 172.21.15.153:42760) 2024-03-28T21:52:03.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.516+0000 7f1ddde00640 1 -- 172.21.15.153:0/1529741383 learned_addr learned my addr 172.21.15.153:0/1529741383 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:03.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.516+0000 7f1ddd400640 1 --2- 172.21.15.153:0/1529741383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1de015a4a0 0x7f1de0154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.515+0000 7fe3b7200640 1 Processor -- start 2024-03-28T21:52:03.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.517+0000 7f1ddde00640 1 -- 172.21.15.153:0/1529741383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1de015cc00 msgr2=0x7f1de00cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.517+0000 7f1ddde00640 1 --2- 172.21.15.153:0/1529741383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1de015cc00 0x7f1de00cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.517+0000 7f1ddde00640 1 -- 172.21.15.153:0/1529741383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1de015a4a0 msgr2=0x7f1de0154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.517+0000 7f1ddde00640 1 --2- 172.21.15.153:0/1529741383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1de015a4a0 0x7f1de0154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.517+0000 7f1ddde00640 1 -- 172.21.15.153:0/1529741383 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de00cc2f0 con 0x7f1de00cf730 2024-03-28T21:52:03.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.516+0000 7fe3b7200640 1 -- start start 2024-03-28T21:52:03.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.517+0000 7f3d91800640 1 Processor -- start 2024-03-28T21:52:03.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.517+0000 7fcc79c00640 1 -- 172.21.15.153:0/2634370422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc74162450 msgr2=0x7fcc740d24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.518+0000 7fcc79c00640 1 --2- 172.21.15.153:0/2634370422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc74162450 0x7fcc740d24f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00b1a0 tx=0x7fcc6c02c120 comp rx=0 tx=0).stop 2024-03-28T21:52:03.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.518+0000 7fe3b7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3b006d480 0x7fe3b01f8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.519+0000 7fe3b7200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3b0071650 0x7fe3b0154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.519+0000 7fe3b7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3b0160090 0x7fe3b0154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.519+0000 7fe3b7200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b00b36f0 con 0x7fe3b0071650 2024-03-28T21:52:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.519+0000 7fe3b7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b0162db0 con 0x7fe3b0160090 2024-03-28T21:52:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.519+0000 7fe3b7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe3b00b3870 con 0x7fe3b006d480 2024-03-28T21:52:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.519+0000 7f1ddde00640 1 --2- 172.21.15.153:0/1529741383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1de00cf730 0x7f1de01f90c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00c4d0 tx=0x7f1dcc00c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.517+0000 7f3d91800640 1 -- start start 2024-03-28T21:52:03.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.519+0000 7fcc79c00640 1 -- 172.21.15.153:0/2634370422 shutdown_connections 2024-03-28T21:52:03.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.519+0000 7f1dd6000640 1 -- 172.21.15.153:0/1529741383 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc017070 con 0x7f1de00cf730 2024-03-28T21:52:03.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.519+0000 7f1dd6000640 1 -- 172.21.15.153:0/1529741383 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dcc005ce0 con 0x7f1de00cf730 2024-03-28T21:52:03.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.520+0000 7f1de4a00640 1 -- 172.21.15.153:0/1529741383 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de00cc5d0 con 0x7f1de00cf730 2024-03-28T21:52:03.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.520+0000 7fe3b5200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3b0160090 0x7fe3b0154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.520+0000 7fe3b5200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3b0160090 0x7fe3b0154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:45130/0 (socket says 172.21.15.153:45130) 2024-03-28T21:52:03.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.520+0000 7fe3b5200640 1 -- 172.21.15.153:0/9800130 learned_addr learned my addr 172.21.15.153:0/9800130 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:03.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.520+0000 7f3d91800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3d8c14bf50 0x7f3d8c06d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.519+0000 7f470b200640 1 Processor -- start 2024-03-28T21:52:03.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.519+0000 7f470b200640 1 -- start start 2024-03-28T21:52:03.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.520+0000 7f3d91800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d8c06dcc0 0x7f3d8c0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.520+0000 7f1dd6000640 1 -- 172.21.15.153:0/1529741383 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc007270 con 0x7f1de00cf730 2024-03-28T21:52:03.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.520+0000 7f3d91800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d8c073030 con 0x7f3d8c0b41e0 2024-03-28T21:52:03.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.520+0000 7fcc79c00640 1 --2- 172.21.15.153:0/2634370422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc74162450 0x7fcc740d24f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.520+0000 7fcc79c00640 1 --2- 172.21.15.153:0/2634370422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcc7415e0e0 0x7fcc740b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.520+0000 7fcc79c00640 1 -- 172.21.15.153:0/2634370422 >> 172.21.15.153:0/2634370422 conn(0x7fcc7409d1a0 msgr2=0x7fcc740d3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.520+0000 7fcc79c00640 1 -- 172.21.15.153:0/2634370422 shutdown_connections 2024-03-28T21:52:03.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.520+0000 7fcc79c00640 1 -- 172.21.15.153:0/2634370422 wait complete. 2024-03-28T21:52:03.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.520+0000 7f3d91800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3d8c071b90 con 0x7f3d8c14bf50 2024-03-28T21:52:03.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.521+0000 7f3d91800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8c06cea0 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.521+0000 7f3d8a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d8c06dcc0 0x7f3d8c0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.521+0000 7f3d8b400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f3d8c0b41e0 0x7f3d8c166160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:34024/0 (socket says 172.21.15.153:34024) 2024-03-28T21:52:03.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.521+0000 7f3d8b400640 1 -- 172.21.15.153:0/3257895415 learned_addr learned my addr 172.21.15.153:0/3257895415 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:03.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.521+0000 7fe3b5200640 1 -- 172.21.15.153:0/9800130 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3b006d480 msgr2=0x7fe3b01f8e60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-28T21:52:03.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.521+0000 7fe3b5200640 1 --2- 172.21.15.153:0/9800130 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3b006d480 0x7fe3b01f8e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.521+0000 7fe3b5200640 1 -- 172.21.15.153:0/9800130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3b0071650 msgr2=0x7fe3b0154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.521+0000 7fe3b5200640 1 --2- 172.21.15.153:0/9800130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3b0071650 0x7fe3b0154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.521+0000 7fe3b5200640 1 -- 172.21.15.153:0/9800130 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b0145fa0 con 0x7fe3b0160090 2024-03-28T21:52:03.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.522+0000 7f1de4a00640 1 -- 172.21.15.153:0/1529741383 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de00ccb90 con 0x7f1de00cf730 2024-03-28T21:52:03.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.522+0000 7f3d8aa00640 1 --2- 172.21.15.153:0/3257895415 >> v2:172.21.15.165:3300/0 conn(0x7f3d8c14bf50 0x7f3d8c06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.522+0000 7f3d89600640 1 -- 172.21.15.153:0/3257895415 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536334009 0 0) 0x7f3d8c073030 con 0x7f3d8c0b41e0 2024-03-28T21:52:03.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.522+0000 7f3d89600640 1 -- 172.21.15.153:0/3257895415 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d70003520 con 0x7f3d8c0b41e0 2024-03-28T21:52:03.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.522+0000 7fe3b5200640 1 --2- 172.21.15.153:0/9800130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3b0160090 0x7fe3b0154f80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00c430 tx=0x7fe39c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.523+0000 7fe3a7e00640 1 -- 172.21.15.153:0/9800130 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c017070 con 0x7fe3b0160090 2024-03-28T21:52:03.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.523+0000 7f826ec00640 1 Processor -- start 2024-03-28T21:52:03.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.523+0000 7f826ec00640 1 -- start start 2024-03-28T21:52:03.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.523+0000 7fe3a7e00640 1 -- 172.21.15.153:0/9800130 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39c0035f0 con 0x7fe3b0160090 2024-03-28T21:52:03.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.523+0000 7fe3a7e00640 1 -- 172.21.15.153:0/9800130 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0039e0 con 0x7fe3b0160090 2024-03-28T21:52:03.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.523+0000 7fe3b7200640 1 -- 172.21.15.153:0/9800130 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b0146280 con 0x7fe3b0160090 2024-03-28T21:52:03.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.523+0000 7fe3b7200640 1 -- 172.21.15.153:0/9800130 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b0156d40 con 0x7fe3b0160090 2024-03-28T21:52:03.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.523+0000 7f3d8a000640 1 -- 172.21.15.153:0/3257895415 >> v2:172.21.15.165:3300/0 conn(0x7f3d8c14bf50 msgr2=0x7f3d8c06d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:03.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.523+0000 7f3d8a000640 1 --2- 172.21.15.153:0/3257895415 >> v2:172.21.15.165:3300/0 conn(0x7f3d8c14bf50 0x7f3d8c06d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.523+0000 7f3d89600640 1 -- 172.21.15.153:0/3257895415 <== mon.1 v1:172.21.15.165:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3232458566 0 0) 0x7f3d70003520 con 0x7f3d8c0b41e0 2024-03-28T21:52:03.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.523+0000 7f3d8a000640 1 -- 172.21.15.153:0/3257895415 >> v1:172.21.15.165:6789/0 conn(0x7f3d8c0b41e0 legacy=0x7f3d8c166160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.523+0000 7f3d8a000640 1 -- 172.21.15.153:0/3257895415 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c06d180 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.523+0000 7f1de4a00640 1 -- 172.21.15.153:0/1529741383 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1de0068ff0 con 0x7f1de00cf730 2024-03-28T21:52:03.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.525+0000 7f1dd6000640 1 -- 172.21.15.153:0/1529741383 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f1dcc01a070 con 0x7f1de00cf730 2024-03-28T21:52:03.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.524+0000 7f470b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f47040b40e0 0x7f4704072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.524+0000 7f470b200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f470406cea0 con 0x7f470414bf50 2024-03-28T21:52:03.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.524+0000 7f470b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f470406d180 con 0x7f47040b3ca0 2024-03-28T21:52:03.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.524+0000 7f470b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4704071b90 con 0x7f47040b40e0 2024-03-28T21:52:03.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.525+0000 7fe3b7200640 1 -- 172.21.15.153:0/9800130 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe3b01f8a40 con 0x7fe3b0160090 2024-03-28T21:52:03.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.526+0000 7f3d8a000640 1 --2- 172.21.15.153:0/3257895415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d8c06dcc0 0x7f3d8c0b3ca0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d780097a0 tx=0x7f3d7802b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29c11440df2dcbeb server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f1dd6000640 1 --2- 172.21.15.153:0/1529741383 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1dc006b4d0 0x7f1dc006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7fcc79c00640 1 Processor -- start 2024-03-28T21:52:03.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.526+0000 7f4703400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f47040b3ca0 0x7f4704072020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:34030/0 (socket says 172.21.15.153:34030) 2024-03-28T21:52:03.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.526+0000 7f4703400640 1 -- 172.21.15.153:0/4190261825 learned_addr learned my addr 172.21.15.153:0/4190261825 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:03.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.526+0000 7f4709200640 1 --2- 172.21.15.153:0/4190261825 >> v2:172.21.15.165:3300/0 conn(0x7f47040b40e0 0x7f4704072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f4702a00640 1 -- 172.21.15.153:0/4190261825 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2544589854 0 0) 0x7f470406d180 con 0x7f47040b3ca0 2024-03-28T21:52:03.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f4702a00640 1 -- 172.21.15.153:0/4190261825 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46e8003520 con 0x7f47040b3ca0 2024-03-28T21:52:03.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7fcc79c00640 1 -- start start 2024-03-28T21:52:03.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f826ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82680cb360 0x7f826806b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f826ec00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f826806b6b0 0x7f8268157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f826ec00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f826815eab0 con 0x7f82680cd0b0 2024-03-28T21:52:03.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f826ec00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f826806bb20 con 0x7f826806b6b0 2024-03-28T21:52:03.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f826ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f826815ed90 con 0x7f82680cb360 2024-03-28T21:52:03.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.528+0000 7f3d89600640 1 -- 172.21.15.153:0/3257895415 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78037070 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.528+0000 7f8267e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f82680cd0b0 0x7f82680c72e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:34040/0 (socket says 172.21.15.153:34040) 2024-03-28T21:52:03.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.528+0000 7f8267e00640 1 -- 172.21.15.153:0/3043115956 learned_addr learned my addr 172.21.15.153:0/3043115956 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:03.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.528+0000 7f3d89600640 1 -- 172.21.15.153:0/3257895415 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d78030510 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.528+0000 7f3d89600640 1 -- 172.21.15.153:0/3257895415 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d840019f0 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.528+0000 7f8266a00640 1 -- 172.21.15.153:0/3043115956 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 122148248 0 0) 0x7f826815eab0 con 0x7f82680cd0b0 2024-03-28T21:52:03.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7f8266a00640 1 -- 172.21.15.153:0/3043115956 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f824c003520 con 0x7f82680cd0b0 2024-03-28T21:52:03.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f4709200640 1 -- 172.21.15.153:0/4190261825 >> v1:172.21.15.165:6789/0 conn(0x7f47040b3ca0 legacy=0x7f4704072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f4709200640 1 -- 172.21.15.153:0/4190261825 >> v1:172.21.15.153:6789/0 conn(0x7f470414bf50 legacy=0x7f470406d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f4709200640 1 -- 172.21.15.153:0/4190261825 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4704071820 con 0x7f47040b40e0 2024-03-28T21:52:03.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7f3d91800640 1 -- 172.21.15.153:0/3257895415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d8c06dcc0 msgr2=0x7f3d8c0b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7f3d91800640 1 --2- 172.21.15.153:0/3257895415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d8c06dcc0 0x7f3d8c0b3ca0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d780097a0 tx=0x7f3d7802b710 comp rx=0 tx=0).stop 2024-03-28T21:52:03.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7fcc79c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcc740b3d00 0x7fcc740cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7fcc79c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcc7415e0e0 0x7fcc740b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7fcc79c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc74162450 0x7fcc740b91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7fcc79c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcc740d2bb0 con 0x7fcc74162450 2024-03-28T21:52:03.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7fcc79c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcc740d2a30 con 0x7fcc7415e0e0 2024-03-28T21:52:03.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7fcc79c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcc740d2d30 con 0x7fcc740b3d00 2024-03-28T21:52:03.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f1dd6000640 1 -- 172.21.15.153:0/1529741383 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1dcc089480 con 0x7f1de00cf730 2024-03-28T21:52:03.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f1dd6000640 1 --2- 172.21.15.153:0/1529741383 >> [v2:172.21.15.165:6808/2527321544,v1:172.21.15.165:6809/2527321544] conn(0x7f1dc0073670 0x7f1dc0075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f1dd6000640 1 -- 172.21.15.153:0/1529741383 --> [v2:172.21.15.165:6808/2527321544,v1:172.21.15.165:6809/2527321544] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1dc0076140 con 0x7f1dc0073670 2024-03-28T21:52:03.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.527+0000 7f1dd6000640 1 -- 172.21.15.153:0/1529741383 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f1dcc090050 con 0x7f1de00cf730 2024-03-28T21:52:03.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7f8266a00640 1 -- 172.21.15.153:0/3043115956 <== mon.1 v1:172.21.15.165:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1300390681 0 0) 0x7f824c003520 con 0x7f82680cd0b0 2024-03-28T21:52:03.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7f3d91800640 1 -- 172.21.15.153:0/3257895415 shutdown_connections 2024-03-28T21:52:03.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7f8266a00640 1 -- 172.21.15.153:0/3043115956 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82680cb360 msgr2=0x7f826806b170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T21:52:03.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7f8266a00640 1 --2- 172.21.15.153:0/3043115956 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82680cb360 0x7f826806b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7f8266a00640 1 -- 172.21.15.153:0/3043115956 >> v2:172.21.15.165:3300/0 conn(0x7f826806b6b0 msgr2=0x7f8268157fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T21:52:03.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7f8266a00640 1 --2- 172.21.15.153:0/3043115956 >> v2:172.21.15.165:3300/0 conn(0x7f826806b6b0 0x7f8268157fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7f8266a00640 1 -- 172.21.15.153:0/3043115956 --> v1:172.21.15.165:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826815f070 con 0x7f82680cd0b0 2024-03-28T21:52:03.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7f3d91800640 1 --2- 172.21.15.153:0/3257895415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d8c06dcc0 0x7f3d8c0b3ca0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7f3d91800640 1 --2- 172.21.15.153:0/3257895415 >> v2:172.21.15.165:3300/0 conn(0x7f3d8c14bf50 0x7f3d8c06d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7f3d91800640 1 -- 172.21.15.153:0/3257895415 >> 172.21.15.153:0/3257895415 conn(0x7f3d8c06b170 msgr2=0x7f3d8c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7fcc79200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc74162450 0x7fcc740b91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7f4709200640 1 --2- 172.21.15.153:0/4190261825 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47040b40e0 0x7f4704072730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009d90 tx=0x7f46fc02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d82b4fcca6824d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7fcc79200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc74162450 0x7fcc740b91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45468/0 (socket says 172.21.15.153:45468) 2024-03-28T21:52:03.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7fcc79200640 1 -- 172.21.15.153:0/2496011268 learned_addr learned my addr 172.21.15.153:0/2496011268 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:03.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7f8266a00640 1 -- 172.21.15.153:0/3043115956 <== mon.1 v1:172.21.15.165:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f82600019d0 con 0x7f82680cd0b0 2024-03-28T21:52:03.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7f3d91800640 1 -- 172.21.15.153:0/3257895415 shutdown_connections 2024-03-28T21:52:03.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7f8266a00640 1 -- 172.21.15.153:0/3043115956 >> v1:172.21.15.165:6789/0 conn(0x7f82680cd0b0 legacy=0x7f82680c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7f1ddd400640 1 --2- 172.21.15.153:0/1529741383 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1dc006b4d0 0x7f1dc006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7fcc73e00640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcc740b3d00 0x7fcc740cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7f8266a00640 1 --2- 172.21.15.153:0/3043115956 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82680cb360 0x7f824c003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7fcc73400640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcc7415e0e0 0x7fcc740b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.529+0000 7fe3a7e00640 1 -- 172.21.15.153:0/9800130 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe39c01a070 con 0x7fe3b0160090 2024-03-28T21:52:03.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7fe3a7e00640 1 --2- 172.21.15.153:0/9800130 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe39006b5a0 0x7fe39006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7fe3a7e00640 1 -- 172.21.15.153:0/9800130 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe39c089d40 con 0x7fe3b0160090 2024-03-28T21:52:03.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.531+0000 7fe3a7e00640 1 --2- 172.21.15.153:0/9800130 >> [v2:172.21.15.153:6808/2932352417,v1:172.21.15.153:6809/2932352417] conn(0x7fe3900737c0 0x7fe390075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.531+0000 7fe3a7e00640 1 -- 172.21.15.153:0/9800130 --> [v2:172.21.15.153:6808/2932352417,v1:172.21.15.153:6809/2932352417] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe390076290 con 0x7fe3900737c0 2024-03-28T21:52:03.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.531+0000 7fe3a7e00640 1 -- 172.21.15.153:0/9800130 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe39c08a130 con 0x7fe3b0160090 2024-03-28T21:52:03.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7f8266a00640 1 --2- 172.21.15.153:0/3043115956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f824c004170 0x7f824c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7f8266a00640 1 --2- 172.21.15.153:0/3043115956 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c004e40 0x7f824c0052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7f8266a00640 1 -- 172.21.15.153:0/3043115956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f826806bb20 con 0x7f824c004170 2024-03-28T21:52:03.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7f8266a00640 1 -- 172.21.15.153:0/3043115956 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f826815ed90 con 0x7f824c004e40 2024-03-28T21:52:03.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7f8266a00640 1 -- 172.21.15.153:0/3043115956 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f824c00bdd0 con 0x7f82680cb360 2024-03-28T21:52:03.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.531+0000 7f4702a00640 1 -- 172.21.15.153:0/4190261825 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc039070 con 0x7f47040b40e0 2024-03-28T21:52:03.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.531+0000 7f4702a00640 1 -- 172.21.15.153:0/4190261825 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46fc02cc60 con 0x7f47040b40e0 2024-03-28T21:52:03.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.531+0000 7f4702a00640 1 -- 172.21.15.153:0/4190261825 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc034660 con 0x7f47040b40e0 2024-03-28T21:52:03.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.531+0000 7fcc79200640 1 -- 172.21.15.153:0/2496011268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcc740b3d00 msgr2=0x7fcc740cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.530+0000 7f3d91800640 1 -- 172.21.15.153:0/3257895415 wait complete. 2024-03-28T21:52:03.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.531+0000 7f8267e00640 1 --2- 172.21.15.153:0/3043115956 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82680cb360 0x7f824c003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.532+0000 7f826cc00640 1 --2- 172.21.15.153:0/3043115956 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c004e40 0x7f824c0052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.532+0000 7fe3afe00640 1 --2- 172.21.15.153:0/9800130 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe39006b5a0 0x7fe39006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.532+0000 7f8267400640 1 --2- 172.21.15.153:0/3043115956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f824c004170 0x7f824c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.532+0000 7fcc79200640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcc740b3d00 0x7fcc740cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.532+0000 7f826cc00640 1 -- 172.21.15.153:0/3043115956 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82680cb360 msgr2=0x7f824c003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:03.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.532+0000 7f826cc00640 1 --2- 172.21.15.153:0/3043115956 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82680cb360 0x7f824c003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.532+0000 7f826cc00640 1 -- 172.21.15.153:0/3043115956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f824c004170 msgr2=0x7f824c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:03.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.532+0000 7fcc79200640 1 -- 172.21.15.153:0/2496011268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcc7415e0e0 msgr2=0x7fcc740b8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.532+0000 7fe3af400640 1 --2- 172.21.15.153:0/9800130 >> [v2:172.21.15.153:6808/2932352417,v1:172.21.15.153:6809/2932352417] conn(0x7fe3900737c0 0x7fe390075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.532+0000 7f826cc00640 1 --2- 172.21.15.153:0/3043115956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f824c004170 0x7f824c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.533+0000 7f826cc00640 1 -- 172.21.15.153:0/3043115956 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824c003520 con 0x7f824c004e40 2024-03-28T21:52:03.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.533+0000 7f3d91800640 1 Processor -- start 2024-03-28T21:52:03.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.533+0000 7fe3afe00640 1 --2- 172.21.15.153:0/9800130 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe39006b5a0 0x7fe39006da60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8036000 tx=0x7fe3a8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.531+0000 7f1dde800640 1 --2- 172.21.15.153:0/1529741383 >> [v2:172.21.15.165:6808/2527321544,v1:172.21.15.165:6809/2527321544] conn(0x7f1dc0073670 0x7f1dc0075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.533+0000 7fcc79200640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcc7415e0e0 0x7fcc740b8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.533+0000 7fcc79200640 1 -- 172.21.15.153:0/2496011268 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc740ce040 con 0x7fcc74162450 2024-03-28T21:52:03.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.533+0000 7fcc73400640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcc7415e0e0 0x7fcc740b8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:03.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.534+0000 7fe3af400640 1 --2- 172.21.15.153:0/9800130 >> [v2:172.21.15.153:6808/2932352417,v1:172.21.15.153:6809/2932352417] conn(0x7fe3900737c0 0x7fe390075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.534+0000 7f470b200640 1 -- 172.21.15.153:0/4190261825 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47040b40e0 msgr2=0x7f4704072730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.534+0000 7f470b200640 1 --2- 172.21.15.153:0/4190261825 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47040b40e0 0x7f4704072730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009d90 tx=0x7f46fc02beb0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.534+0000 7f3d91800640 1 -- start start 2024-03-28T21:52:03.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.534+0000 7f8267400640 1 --2- 172.21.15.153:0/3043115956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f824c004170 0x7f824c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:03.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.534+0000 7fcc79200640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc74162450 0x7fcc740b91d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c036040 tx=0x7fcc6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.535+0000 7fcc6be00640 1 -- 172.21.15.153:0/2496011268 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c042020 con 0x7fcc74162450 2024-03-28T21:52:03.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.535+0000 7fcc6be00640 1 -- 172.21.15.153:0/2496011268 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc6c004580 con 0x7fcc74162450 2024-03-28T21:52:03.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.535+0000 7fcc6be00640 1 -- 172.21.15.153:0/2496011268 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c02cac0 con 0x7fcc74162450 2024-03-28T21:52:03.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.535+0000 7fcc79c00640 1 -- 172.21.15.153:0/2496011268 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc741fb740 con 0x7fcc74162450 2024-03-28T21:52:03.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.535+0000 7f3d91800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c06dcc0 0x7f3d8c1459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.535+0000 7f3d91800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d8c0b41e0 0x7f3d8c149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.535+0000 7f3d91800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d8c14bf50 0x7f3d8c1495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.535+0000 7f3d91800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c0b4980 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.535+0000 7f3d91800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c06d460 con 0x7f3d8c0b41e0 2024-03-28T21:52:03.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.535+0000 7f3d91800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8c0b4b00 con 0x7f3d8c14bf50 2024-03-28T21:52:03.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.535+0000 7fcc79c00640 1 -- 172.21.15.153:0/2496011268 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc740cd7a0 con 0x7fcc74162450 2024-03-28T21:52:03.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.536+0000 7f1dde800640 1 --2- 172.21.15.153:0/1529741383 >> [v2:172.21.15.165:6808/2527321544,v1:172.21.15.165:6809/2527321544] conn(0x7f1dc0073670 0x7f1dc0075a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.535+0000 7f826cc00640 1 --2- 172.21.15.153:0/3043115956 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c004e40 0x7f824c0052c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8254009860 tx=0x7f824c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5d9db966c5d068 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.536+0000 7f3d8aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c06dcc0 0x7f3d8c1459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.536+0000 7f8266a00640 1 -- 172.21.15.153:0/3043115956 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8254037070 con 0x7f824c004e40 2024-03-28T21:52:03.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.536+0000 7f1ddd400640 1 --2- 172.21.15.153:0/1529741383 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1dc006b4d0 0x7f1dc006d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1de006e3c0 tx=0x7f1dd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.536+0000 7f3d8aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c06dcc0 0x7f3d8c1459c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45490/0 (socket says 172.21.15.153:45490) 2024-03-28T21:52:03.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.536+0000 7f3d8aa00640 1 -- 172.21.15.153:0/895796924 learned_addr learned my addr 172.21.15.153:0/895796924 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:03.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.536+0000 7f8266a00640 1 -- 172.21.15.153:0/3043115956 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8254032620 con 0x7f824c004e40 2024-03-28T21:52:03.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.536+0000 7f3d8a000640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d8c0b41e0 0x7f3d8c149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.537+0000 7fe3a7e00640 1 -- 172.21.15.153:0/9800130 <== osd.1 v2:172.21.15.153:6808/2932352417 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe390076290 con 0x7fe3900737c0 2024-03-28T21:52:03.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.536+0000 7f8266a00640 1 -- 172.21.15.153:0/3043115956 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82540093b0 con 0x7f824c004e40 2024-03-28T21:52:03.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.536+0000 7f470b200640 1 -- 172.21.15.153:0/4190261825 shutdown_connections 2024-03-28T21:52:03.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.536+0000 7f470b200640 1 --2- 172.21.15.153:0/4190261825 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47040b40e0 0x7f4704072730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.537+0000 7f470b200640 1 -- 172.21.15.153:0/4190261825 >> 172.21.15.153:0/4190261825 conn(0x7f470406b170 msgr2=0x7f470406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.536+0000 7f3d8b400640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d8c14bf50 0x7f3d8c1495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.537+0000 7f3d8aa00640 1 -- 172.21.15.153:0/895796924 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d8c14bf50 msgr2=0x7f3d8c1495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.537+0000 7f3d8aa00640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d8c14bf50 0x7f3d8c1495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.537+0000 7f3d8aa00640 1 -- 172.21.15.153:0/895796924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d8c0b41e0 msgr2=0x7f3d8c149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.537+0000 7f3d8aa00640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d8c0b41e0 0x7f3d8c149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.537+0000 7f3d8aa00640 1 -- 172.21.15.153:0/895796924 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c1ecc00 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.537+0000 7f3d8b400640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d8c14bf50 0x7f3d8c1495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:03.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.537+0000 7f470b200640 1 -- 172.21.15.153:0/4190261825 shutdown_connections 2024-03-28T21:52:03.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.538+0000 7f1dd6000640 1 -- 172.21.15.153:0/1529741383 <== osd.4 v2:172.21.15.165:6808/2527321544 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1dc0076140 con 0x7f1dc0073670 2024-03-28T21:52:03.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.537+0000 7f470b200640 1 -- 172.21.15.153:0/4190261825 wait complete. 2024-03-28T21:52:03.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.540+0000 7f470b200640 1 Processor -- start 2024-03-28T21:52:03.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.540+0000 7f826ec00640 1 -- 172.21.15.153:0/3043115956 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c004e40 msgr2=0x7f824c0052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.540+0000 7f826ec00640 1 --2- 172.21.15.153:0/3043115956 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c004e40 0x7f824c0052c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8254009860 tx=0x7f824c005830 comp rx=0 tx=0).stop 2024-03-28T21:52:03.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.541+0000 7f826cc00640 1 -- 172.21.15.153:0/3043115956 reap_dead start 2024-03-28T21:52:03.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.541+0000 7f3d8aa00640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c06dcc0 0x7f3d8c1459c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00e870 tx=0x7f3d7c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.541+0000 7f3d82a00640 1 -- 172.21.15.153:0/895796924 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c017070 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.541+0000 7f3d82a00640 1 -- 172.21.15.153:0/895796924 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c00c940 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.541+0000 7f3d82a00640 1 -- 172.21.15.153:0/895796924 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00cd30 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.542+0000 7f3d91800640 1 -- 172.21.15.153:0/895796924 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8c1ecee0 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.542+0000 7f3d91800640 1 -- 172.21.15.153:0/895796924 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8c1ed4a0 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.542+0000 7f3d91800640 1 -- 172.21.15.153:0/895796924 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d8c163330 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.543+0000 7f470b200640 1 -- start start 2024-03-28T21:52:03.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.544+0000 7f826ec00640 1 -- 172.21.15.153:0/3043115956 shutdown_connections 2024-03-28T21:52:03.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.544+0000 7f826ec00640 1 -- 172.21.15.153:0/3043115956 >> 172.21.15.153:0/3043115956 conn(0x7f82680cd790 msgr2=0x7f82680cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.544+0000 7f826ec00640 1 -- 172.21.15.153:0/3043115956 shutdown_connections 2024-03-28T21:52:03.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.538+0000 7fcc79c00640 1 -- 172.21.15.153:0/2496011268 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc7404f4b0 con 0x7fcc74162450 2024-03-28T21:52:03.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.541+0000 7fcc6be00640 1 -- 172.21.15.153:0/2496011268 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fcc6c045020 con 0x7fcc74162450 2024-03-28T21:52:03.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.542+0000 7fcc6be00640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcc5406b5a0 0x7fcc5406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.542+0000 7fcc6be00640 1 -- 172.21.15.153:0/2496011268 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcc6c0ac520 con 0x7fcc74162450 2024-03-28T21:52:03.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.543+0000 7fcc6be00640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.165:6800/3469035609,v1:172.21.15.165:6801/3469035609] conn(0x7fcc54073820 0x7fcc54075c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.543+0000 7fcc6be00640 1 -- 172.21.15.153:0/2496011268 --> [v2:172.21.15.165:6800/3469035609,v1:172.21.15.165:6801/3469035609] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc540762f0 con 0x7fcc54073820 2024-03-28T21:52:03.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.543+0000 7fcc6be00640 1 -- 172.21.15.153:0/2496011268 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fcc6c0b3050 con 0x7fcc74162450 2024-03-28T21:52:03.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.544+0000 7f8881000640 1 -- 172.21.15.153:0/3459649117 --> [v2:172.21.15.153:6816/3758921042,v1:172.21.15.153:6817/3758921042] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8854002dd0 con 0x7f885c073670 2024-03-28T21:52:03.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.545+0000 7f8873400640 1 -- 172.21.15.153:0/3459649117 <== osd.0 v2:172.21.15.153:6816/3758921042 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8854002dd0 con 0x7f885c073670 2024-03-28T21:52:03.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.546+0000 7fcc73e00640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcc5406b5a0 0x7fcc5406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.546+0000 7fcc73e00640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcc5406b5a0 0x7fcc5406da60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcc60006fd0 tx=0x7fcc60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.546+0000 7f8881000640 1 -- 172.21.15.153:0/3459649117 >> [v2:172.21.15.153:6816/3758921042,v1:172.21.15.153:6817/3758921042] conn(0x7f885c073670 msgr2=0x7f885c075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.546+0000 7f8881000640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.153:6816/3758921042,v1:172.21.15.153:6817/3758921042] conn(0x7f885c073670 0x7f885c075a90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.547+0000 7f8881000640 1 -- 172.21.15.153:0/3459649117 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f885c06b4d0 msgr2=0x7f885c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.547+0000 7f8881000640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f885c06b4d0 0x7f885c06d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8874007fd0 tx=0x7f8874009040 comp rx=0 tx=0).stop 2024-03-28T21:52:03.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.547+0000 7f8881000640 1 -- 172.21.15.153:0/3459649117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887c15f3e0 msgr2=0x7f887c15b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.547+0000 7f8881000640 1 --2- 172.21.15.153:0/3459649117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887c15f3e0 0x7f887c15b430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8868001770 tx=0x7f8868001c30 comp rx=0 tx=0).stop 2024-03-28T21:52:03.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.547+0000 7f887be00640 1 -- 172.21.15.153:0/3459649117 reap_dead start 2024-03-28T21:52:03.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.547+0000 7fcc73400640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.165:6800/3469035609,v1:172.21.15.165:6801/3469035609] conn(0x7fcc54073820 0x7fcc54075c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.547+0000 7f8881000640 1 -- 172.21.15.153:0/3459649117 shutdown_connections 2024-03-28T21:52:03.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.547+0000 7f8881000640 1 -- 172.21.15.153:0/3459649117 >> 172.21.15.153:0/3459649117 conn(0x7f887c0b3760 msgr2=0x7f887c15e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.544+0000 7f826ec00640 1 -- 172.21.15.153:0/3043115956 wait complete. 2024-03-28T21:52:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.547+0000 7f3d82a00640 1 -- 172.21.15.153:0/895796924 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f3d7c01a070 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.548+0000 7fcc73400640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.165:6800/3469035609,v1:172.21.15.165:6801/3469035609] conn(0x7fcc54073820 0x7fcc54075c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.548+0000 7f8881000640 1 -- 172.21.15.153:0/3459649117 shutdown_connections 2024-03-28T21:52:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.548+0000 7f8881000640 1 -- 172.21.15.153:0/3459649117 wait complete. 2024-03-28T21:52:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.549+0000 7f3d82a00640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3d6c06b520 0x7f3d6c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.549+0000 7f3d82a00640 1 -- 172.21.15.153:0/895796924 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3d7c08a6e0 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.549+0000 7f3d82a00640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.165:6816/3540151132,v1:172.21.15.165:6817/3540151132] conn(0x7f3d6c073740 0x7f3d6c075b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.549+0000 7f3d82a00640 1 -- 172.21.15.153:0/895796924 --> [v2:172.21.15.165:6816/3540151132,v1:172.21.15.165:6817/3540151132] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d6c076210 con 0x7f3d6c073740 2024-03-28T21:52:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.549+0000 7f3d82a00640 1 -- 172.21.15.153:0/895796924 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3d7c08abc0 con 0x7f3d8c06dcc0 2024-03-28T21:52:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.549+0000 7f3d8a000640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3d6c06b520 0x7f3d6c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.548+0000 7f826ec00640 1 Processor -- start 2024-03-28T21:52:03.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.548+0000 7f826ec00640 1 -- start start 2024-03-28T21:52:03.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.548+0000 7f470b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47040b3ca0 0x7f47041451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.548+0000 7f470b200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47040b40e0 0x7f4704149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.548+0000 7f470b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470414bf50 0x7f470414a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.548+0000 7f470b200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f470406de90 con 0x7f47040b40e0 2024-03-28T21:52:03.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.548+0000 7f470b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f470406d460 con 0x7f47040b3ca0 2024-03-28T21:52:03.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.548+0000 7f470b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f47040b4980 con 0x7f470414bf50 2024-03-28T21:52:03.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.549+0000 7f4709200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470414bf50 0x7f470414a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.549+0000 7f4709200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470414bf50 0x7f470414a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:42802/0 (socket says 172.21.15.153:42802) 2024-03-28T21:52:03.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.549+0000 7f4709200640 1 -- 172.21.15.153:0/678240533 learned_addr learned my addr 172.21.15.153:0/678240533 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:03.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.549+0000 7f4709200640 1 -- 172.21.15.153:0/678240533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47040b3ca0 msgr2=0x7f47041451f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-28T21:52:03.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.549+0000 7f4709200640 1 --2- 172.21.15.153:0/678240533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47040b3ca0 0x7f47041451f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.549+0000 7f4709200640 1 -- 172.21.15.153:0/678240533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47040b40e0 msgr2=0x7f4704149ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-28T21:52:03.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.549+0000 7f4709200640 1 --2- 172.21.15.153:0/678240533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47040b40e0 0x7f4704149ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.549+0000 7f4709200640 1 -- 172.21.15.153:0/678240533 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4704146390 con 0x7f470414bf50 2024-03-28T21:52:03.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.550+0000 7f826ec00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f824c004e40 0x7f826806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.550+0000 7f4709200640 1 --2- 172.21.15.153:0/678240533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470414bf50 0x7f470414a430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009eb0 tx=0x7f46fc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.550+0000 7f3d8b400640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.165:6816/3540151132,v1:172.21.15.165:6817/3540151132] conn(0x7f3d6c073740 0x7f3d6c075b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.550+0000 7f826ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f826814d580 0x7f82680afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.550+0000 7f826ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82680b02f0 0x7f826814c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.550+0000 7f826ec00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82680c79f0 con 0x7f824c004e40 2024-03-28T21:52:03.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.550+0000 7f826ec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f826815e7a0 con 0x7f826814d580 2024-03-28T21:52:03.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.550+0000 7f826ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f82680c7b70 con 0x7f82680b02f0 2024-03-28T21:52:03.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.550+0000 7f8267e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f824c004e40 0x7f826806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.550+0000 7f8267e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f824c004e40 0x7f826806dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45492/0 (socket says 172.21.15.153:45492) 2024-03-28T21:52:03.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.550+0000 7f8267e00640 1 -- 172.21.15.153:0/4029956271 learned_addr learned my addr 172.21.15.153:0/4029956271 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:03.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.551+0000 7f46fbe00640 1 -- 172.21.15.153:0/678240533 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc044020 con 0x7f470414bf50 2024-03-28T21:52:03.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.551+0000 7f46fbe00640 1 -- 172.21.15.153:0/678240533 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46fc03f470 con 0x7f470414bf50 2024-03-28T21:52:03.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.551+0000 7f470b200640 1 -- 172.21.15.153:0/678240533 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4704145af0 con 0x7f470414bf50 2024-03-28T21:52:03.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.551+0000 7f826cc00640 1 --2- 172.21.15.153:0/4029956271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82680b02f0 0x7f826814c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.551+0000 7f8267e00640 1 -- 172.21.15.153:0/4029956271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82680b02f0 msgr2=0x7f826814c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.551+0000 7f8267e00640 1 --2- 172.21.15.153:0/4029956271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82680b02f0 0x7f826814c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.551+0000 7f8267e00640 1 -- 172.21.15.153:0/4029956271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f826814d580 msgr2=0x7f82680afdb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-28T21:52:03.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.551+0000 7f8267e00640 1 --2- 172.21.15.153:0/4029956271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f826814d580 0x7f82680afdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.551+0000 7f8267e00640 1 -- 172.21.15.153:0/4029956271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826806e7d0 con 0x7f824c004e40 2024-03-28T21:52:03.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.551+0000 7fcc6be00640 1 -- 172.21.15.153:0/2496011268 <== osd.6 v2:172.21.15.165:6800/3469035609 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc540762f0 con 0x7fcc54073820 2024-03-28T21:52:03.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.551+0000 7f470b200640 1 -- 172.21.15.153:0/678240533 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47041460b0 con 0x7f470414bf50 2024-03-28T21:52:03.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.551+0000 7f46fbe00640 1 -- 172.21.15.153:0/678240533 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc039040 con 0x7f470414bf50 2024-03-28T21:52:03.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.552+0000 7f8267e00640 1 --2- 172.21.15.153:0/4029956271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f824c004e40 0x7f826806dea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8260001db0 tx=0x7f826000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.553+0000 7f470b200640 1 -- 172.21.15.153:0/678240533 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46dc001030 con 0x7f470414bf50 2024-03-28T21:52:03.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.553+0000 7f825fe00640 1 -- 172.21.15.153:0/4029956271 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826000ec40 con 0x7f824c004e40 2024-03-28T21:52:03.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.553+0000 7f825fe00640 1 -- 172.21.15.153:0/4029956271 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8260018070 con 0x7f824c004e40 2024-03-28T21:52:03.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.553+0000 7f825fe00640 1 -- 172.21.15.153:0/4029956271 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260013420 con 0x7f824c004e40 2024-03-28T21:52:03.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.553+0000 7f826ec00640 1 -- 172.21.15.153:0/4029956271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826806eab0 con 0x7f824c004e40 2024-03-28T21:52:03.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.553+0000 7f826ec00640 1 -- 172.21.15.153:0/4029956271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f826806f070 con 0x7f824c004e40 2024-03-28T21:52:03.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.554+0000 7f3d8b400640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.165:6816/3540151132,v1:172.21.15.165:6817/3540151132] conn(0x7f3d6c073740 0x7f3d6c075b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.554+0000 7f3d8a000640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3d6c06b520 0x7f3d6c06d9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3d78034000 tx=0x7f3d78008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.556+0000 7f826ec00640 1 -- 172.21.15.153:0/4029956271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8268068ff0 con 0x7f824c004e40 2024-03-28T21:52:03.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.556+0000 7f46fbe00640 1 -- 172.21.15.153:0/678240533 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f46fc047020 con 0x7f470414bf50 2024-03-28T21:52:03.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.557+0000 7f46fbe00640 1 --2- 172.21.15.153:0/678240533 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f46e406b4d0 0x7f46e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.557+0000 7f825fe00640 1 -- 172.21.15.153:0/4029956271 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f82600135c0 con 0x7f824c004e40 2024-03-28T21:52:03.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.558+0000 7f3d82a00640 1 -- 172.21.15.153:0/895796924 <== osd.7 v2:172.21.15.165:6816/3540151132 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d6c076210 con 0x7f3d6c073740 2024-03-28T21:52:03.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.558+0000 7f46fbe00640 1 -- 172.21.15.153:0/678240533 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f46fc0ad6d0 con 0x7f470414bf50 2024-03-28T21:52:03.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.558+0000 7f46fbe00640 1 --2- 172.21.15.153:0/678240533 >> [v2:172.21.15.165:6820/3492880445,v1:172.21.15.165:6822/3492880445] conn(0x7f46e4073670 0x7f46e4075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.558+0000 7f46fbe00640 1 -- 172.21.15.153:0/678240533 --> [v2:172.21.15.165:6820/3492880445,v1:172.21.15.165:6822/3492880445] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46fc038e50 con 0x7f46e4073670 2024-03-28T21:52:03.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.558+0000 7f46fbe00640 1 -- 172.21.15.153:0/678240533 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f46fc0ada80 con 0x7f470414bf50 2024-03-28T21:52:03.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.559+0000 7f4703e00640 1 --2- 172.21.15.153:0/678240533 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f46e406b4d0 0x7f46e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.559+0000 7f4703400640 1 --2- 172.21.15.153:0/678240533 >> [v2:172.21.15.165:6820/3492880445,v1:172.21.15.165:6822/3492880445] conn(0x7f46e4073670 0x7f46e4075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.559+0000 7f825fe00640 1 --2- 172.21.15.153:0/4029956271 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f824806b5a0 0x7f824806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.560+0000 7f4703400640 1 --2- 172.21.15.153:0/678240533 >> [v2:172.21.15.165:6820/3492880445,v1:172.21.15.165:6822/3492880445] conn(0x7f46e4073670 0x7f46e4075a90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.560+0000 7f825fe00640 1 -- 172.21.15.153:0/4029956271 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f826008a550 con 0x7f824c004e40 2024-03-28T21:52:03.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.561+0000 7f4703e00640 1 --2- 172.21.15.153:0/678240533 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f46e406b4d0 0x7f46e406d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f46f4000f60 tx=0x7f46f40079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.561+0000 7f825fe00640 1 --2- 172.21.15.153:0/4029956271 >> [v2:172.21.15.153:6800/328922913,v1:172.21.15.153:6801/328922913] conn(0x7f82480737c0 0x7f8248075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.561+0000 7f8267400640 1 --2- 172.21.15.153:0/4029956271 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f824806b5a0 0x7f824806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.562+0000 7f825fe00640 1 -- 172.21.15.153:0/4029956271 --> [v2:172.21.15.153:6800/328922913,v1:172.21.15.153:6801/328922913] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8260017ec0 con 0x7f82480737c0 2024-03-28T21:52:03.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.562+0000 7f825fe00640 1 -- 172.21.15.153:0/4029956271 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f8260091050 con 0x7f824c004e40 2024-03-28T21:52:03.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.562+0000 7f8267400640 1 --2- 172.21.15.153:0/4029956271 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f824806b5a0 0x7f824806da60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8258006fd0 tx=0x7f8258008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.562+0000 7f826cc00640 1 --2- 172.21.15.153:0/4029956271 >> [v2:172.21.15.153:6800/328922913,v1:172.21.15.153:6801/328922913] conn(0x7f82480737c0 0x7f8248075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.563+0000 7f826cc00640 1 --2- 172.21.15.153:0/4029956271 >> [v2:172.21.15.153:6800/328922913,v1:172.21.15.153:6801/328922913] conn(0x7f82480737c0 0x7f8248075be0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.567+0000 7f46fbe00640 1 -- 172.21.15.153:0/678240533 <== osd.5 v2:172.21.15.165:6820/3492880445 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f46fc038e50 con 0x7f46e4073670 2024-03-28T21:52:03.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.567+0000 7f825fe00640 1 -- 172.21.15.153:0/4029956271 <== osd.2 v2:172.21.15.153:6800/328922913 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8260017ec0 con 0x7f82480737c0 2024-03-28T21:52:03.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.574+0000 7fa96c000640 1 Processor -- start 2024-03-28T21:52:03.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.574+0000 7fa96c000640 1 -- start start 2024-03-28T21:52:03.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.576+0000 7fa96c000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa96406e610 0x7fa96406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.576+0000 7fa96c000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9640b33c0 con 0x7fa96415c110 2024-03-28T21:52:03.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.576+0000 7fa96c000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9640b36a0 con 0x7fa964158a60 2024-03-28T21:52:03.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.576+0000 7fa96c000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa964158ed0 con 0x7fa96406e610 2024-03-28T21:52:03.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.577+0000 7fa968c00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fa964158a60 0x7fa9640712f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:34052/0 (socket says 172.21.15.153:34052) 2024-03-28T21:52:03.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.577+0000 7fa968c00640 1 -- 172.21.15.153:0/3615013922 learned_addr learned my addr 172.21.15.153:0/3615013922 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:03.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.577+0000 7fa96a000640 1 --2- 172.21.15.153:0/3615013922 >> v2:172.21.15.165:3300/0 conn(0x7fa96406e610 0x7fa96406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.577+0000 7f1de4a00640 1 -- 172.21.15.153:0/1529741383 --> [v2:172.21.15.165:6808/2527321544,v1:172.21.15.165:6809/2527321544] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1de006ec40 con 0x7f1dc0073670 2024-03-28T21:52:03.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.578+0000 7fa963e00640 1 -- 172.21.15.153:0/3615013922 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3625333057 0 0) 0x7fa9640b33c0 con 0x7fa96415c110 2024-03-28T21:52:03.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.578+0000 7f1dd6000640 1 -- 172.21.15.153:0/1529741383 <== osd.4 v2:172.21.15.165:6808/2527321544 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1de006ec40 con 0x7f1dc0073670 2024-03-28T21:52:03.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.579+0000 7fa96a000640 1 -- 172.21.15.153:0/3615013922 >> v1:172.21.15.165:6789/0 conn(0x7fa964158a60 legacy=0x7fa9640712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.579+0000 7fa96a000640 1 -- 172.21.15.153:0/3615013922 >> v1:172.21.15.153:6789/0 conn(0x7fa96415c110 legacy=0x7fa9640b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.580+0000 7fa96a000640 1 -- 172.21.15.153:0/3615013922 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa964161e40 con 0x7fa96406e610 2024-03-28T21:52:03.583 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2024-03-28T21:52:03.584 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-28T21:52:03.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.581+0000 7fa96a000640 1 --2- 172.21.15.153:0/3615013922 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa96406e610 0x7fa96406ea20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa950009720 tx=0x7fa95002b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=642ed9966ee4565d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.582+0000 7f1de4a00640 1 -- 172.21.15.153:0/1529741383 >> [v2:172.21.15.165:6808/2527321544,v1:172.21.15.165:6809/2527321544] conn(0x7f1dc0073670 msgr2=0x7f1dc0075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.582+0000 7f1de4a00640 1 --2- 172.21.15.153:0/1529741383 >> [v2:172.21.15.165:6808/2527321544,v1:172.21.15.165:6809/2527321544] conn(0x7f1dc0073670 0x7f1dc0075a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.582+0000 7fa963e00640 1 -- 172.21.15.153:0/3615013922 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa950037070 con 0x7fa96406e610 2024-03-28T21:52:03.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.582+0000 7fa963e00640 1 -- 172.21.15.153:0/3615013922 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa950030710 con 0x7fa96406e610 2024-03-28T21:52:03.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.582+0000 7fa963e00640 1 -- 172.21.15.153:0/3615013922 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa950030ae0 con 0x7fa96406e610 2024-03-28T21:52:03.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.583+0000 7f1de4a00640 1 -- 172.21.15.153:0/1529741383 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1dc006b4d0 msgr2=0x7f1dc006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.583+0000 7f1de4a00640 1 --2- 172.21.15.153:0/1529741383 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1dc006b4d0 0x7f1dc006d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1de006e3c0 tx=0x7f1dd0009040 comp rx=0 tx=0).stop 2024-03-28T21:52:03.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.583+0000 7f1de4a00640 1 -- 172.21.15.153:0/1529741383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1de00cf730 msgr2=0x7f1de01f90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.583+0000 7f1de4a00640 1 --2- 172.21.15.153:0/1529741383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1de00cf730 0x7f1de01f90c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00c4d0 tx=0x7f1dcc00c990 comp rx=0 tx=0).stop 2024-03-28T21:52:03.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.583+0000 7f1dde800640 1 -- 172.21.15.153:0/1529741383 reap_dead start 2024-03-28T21:52:03.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.583+0000 7fa96c000640 1 -- 172.21.15.153:0/3615013922 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa96406e610 msgr2=0x7fa96406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.583+0000 7fa96c000640 1 --2- 172.21.15.153:0/3615013922 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa96406e610 0x7fa96406ea20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa950009720 tx=0x7fa95002b6a0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.583+0000 7f1de4a00640 1 -- 172.21.15.153:0/1529741383 shutdown_connections 2024-03-28T21:52:03.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.583+0000 7f1de4a00640 1 -- 172.21.15.153:0/1529741383 >> 172.21.15.153:0/1529741383 conn(0x7f1de006b170 msgr2=0x7f1de00b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.584+0000 7fa96c000640 1 -- 172.21.15.153:0/3615013922 shutdown_connections 2024-03-28T21:52:03.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.584+0000 7fa96c000640 1 --2- 172.21.15.153:0/3615013922 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa96406e610 0x7fa96406ea20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.584+0000 7fa96c000640 1 -- 172.21.15.153:0/3615013922 >> 172.21.15.153:0/3615013922 conn(0x7fa9640cfc00 msgr2=0x7fa9640cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.587+0000 7fe3b7200640 1 -- 172.21.15.153:0/9800130 --> [v2:172.21.15.153:6808/2932352417,v1:172.21.15.153:6809/2932352417] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe3b01f8470 con 0x7fe3900737c0 2024-03-28T21:52:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.584+0000 7fa96c000640 1 -- 172.21.15.153:0/3615013922 shutdown_connections 2024-03-28T21:52:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.584+0000 7fa96c000640 1 -- 172.21.15.153:0/3615013922 wait complete. 2024-03-28T21:52:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.587+0000 7fa96c000640 1 Processor -- start 2024-03-28T21:52:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.585+0000 7f1de4a00640 1 -- 172.21.15.153:0/1529741383 shutdown_connections 2024-03-28T21:52:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.585+0000 7f1de4a00640 1 -- 172.21.15.153:0/1529741383 wait complete. 2024-03-28T21:52:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.584+0000 7fcc79c00640 1 -- 172.21.15.153:0/2496011268 --> [v2:172.21.15.165:6800/3469035609,v1:172.21.15.165:6801/3469035609] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcc7408df90 con 0x7fcc54073820 2024-03-28T21:52:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.585+0000 7fcc6be00640 1 -- 172.21.15.153:0/2496011268 <== osd.6 v2:172.21.15.165:6800/3469035609 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcc7408df90 con 0x7fcc54073820 2024-03-28T21:52:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.586+0000 7fcc79c00640 1 -- 172.21.15.153:0/2496011268 >> [v2:172.21.15.165:6800/3469035609,v1:172.21.15.165:6801/3469035609] conn(0x7fcc54073820 msgr2=0x7fcc54075c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.586+0000 7fcc79c00640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.165:6800/3469035609,v1:172.21.15.165:6801/3469035609] conn(0x7fcc54073820 0x7fcc54075c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.586+0000 7fcc79c00640 1 -- 172.21.15.153:0/2496011268 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcc5406b5a0 msgr2=0x7fcc5406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.586+0000 7fcc79c00640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcc5406b5a0 0x7fcc5406da60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcc60006fd0 tx=0x7fcc60008040 comp rx=0 tx=0).stop 2024-03-28T21:52:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.586+0000 7fcc79c00640 1 -- 172.21.15.153:0/2496011268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc74162450 msgr2=0x7fcc740b91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.586+0000 7fcc79c00640 1 --2- 172.21.15.153:0/2496011268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc74162450 0x7fcc740b91d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c036040 tx=0x7fcc6c004a40 comp rx=0 tx=0).stop 2024-03-28T21:52:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.586+0000 7fcc79200640 1 -- 172.21.15.153:0/2496011268 reap_dead start 2024-03-28T21:52:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.587+0000 7fcc79c00640 1 -- 172.21.15.153:0/2496011268 shutdown_connections 2024-03-28T21:52:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.587+0000 7fcc79c00640 1 -- 172.21.15.153:0/2496011268 >> 172.21.15.153:0/2496011268 conn(0x7fcc7409d1a0 msgr2=0x7fcc740b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.587+0000 7fcc79c00640 1 -- 172.21.15.153:0/2496011268 shutdown_connections 2024-03-28T21:52:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.587+0000 7fcc79c00640 1 -- 172.21.15.153:0/2496011268 wait complete. 2024-03-28T21:52:03.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.587+0000 7fa96c000640 1 -- start start 2024-03-28T21:52:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.589+0000 7fa96c000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa96406e610 0x7fa964161720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.589+0000 7fa96c000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa964158a60 0x7fa964156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.589+0000 7fa96c000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa96415c110 0x7fa9640cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.589+0000 7fa96c000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa9640b3c60 con 0x7fa964158a60 2024-03-28T21:52:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.589+0000 7fa96c000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa9640b3f40 con 0x7fa96415c110 2024-03-28T21:52:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.589+0000 7fa96c000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa96406ef60 con 0x7fa96406e610 2024-03-28T21:52:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.589+0000 7fa969600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa96406e610 0x7fa964161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.589+0000 7fa96a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa96415c110 0x7fa9640cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.590+0000 7fa96a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa96415c110 0x7fa9640cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:45218/0 (socket says 172.21.15.153:45218) 2024-03-28T21:52:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.590+0000 7fa96a000640 1 -- 172.21.15.153:0/1505601485 learned_addr learned my addr 172.21.15.153:0/1505601485 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:03.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.590+0000 7fa968c00640 1 --2- 172.21.15.153:0/1505601485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa964158a60 0x7fa964156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.590+0000 7fe3a7e00640 1 -- 172.21.15.153:0/9800130 <== osd.1 v2:172.21.15.153:6808/2932352417 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe3b01f8470 con 0x7fe3900737c0 2024-03-28T21:52:03.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.591+0000 7fa968c00640 1 -- 172.21.15.153:0/1505601485 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa96406e610 msgr2=0x7fa964161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.591+0000 7fa968c00640 1 --2- 172.21.15.153:0/1505601485 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa96406e610 0x7fa964161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.591+0000 7fa968c00640 1 -- 172.21.15.153:0/1505601485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa96415c110 msgr2=0x7fa9640cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.591+0000 7fa968c00640 1 --2- 172.21.15.153:0/1505601485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa96415c110 0x7fa9640cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.591+0000 7fa968c00640 1 -- 172.21.15.153:0/1505601485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa964144690 con 0x7fa964158a60 2024-03-28T21:52:03.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.591+0000 7fe3b7200640 1 -- 172.21.15.153:0/9800130 >> [v2:172.21.15.153:6808/2932352417,v1:172.21.15.153:6809/2932352417] conn(0x7fe3900737c0 msgr2=0x7fe390075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.591+0000 7fe3b7200640 1 --2- 172.21.15.153:0/9800130 >> [v2:172.21.15.153:6808/2932352417,v1:172.21.15.153:6809/2932352417] conn(0x7fe3900737c0 0x7fe390075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.592+0000 7fe3b7200640 1 -- 172.21.15.153:0/9800130 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe39006b5a0 msgr2=0x7fe39006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.592+0000 7fe3b7200640 1 --2- 172.21.15.153:0/9800130 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe39006b5a0 0x7fe39006da60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8036000 tx=0x7fe3a8030000 comp rx=0 tx=0).stop 2024-03-28T21:52:03.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.591+0000 7fa968c00640 1 --2- 172.21.15.153:0/1505601485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa964158a60 0x7fa964156190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa95400cb20 tx=0x7fa954002090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.592+0000 7fe3b7200640 1 -- 172.21.15.153:0/9800130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3b0160090 msgr2=0x7fe3b0154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.592+0000 7fe3b7200640 1 --2- 172.21.15.153:0/9800130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3b0160090 0x7fe3b0154f80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00c430 tx=0x7fe39c00c8f0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.592+0000 7fe3b5200640 1 -- 172.21.15.153:0/9800130 reap_dead start 2024-03-28T21:52:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.592+0000 7fe3b7200640 1 -- 172.21.15.153:0/9800130 shutdown_connections 2024-03-28T21:52:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.592+0000 7fe3b7200640 1 -- 172.21.15.153:0/9800130 >> 172.21.15.153:0/9800130 conn(0x7fe3b00cfc00 msgr2=0x7fe3b00b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.592+0000 7fa961600640 1 -- 172.21.15.153:0/1505601485 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa954018070 con 0x7fa964158a60 2024-03-28T21:52:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.592+0000 7fe3b7200640 1 -- 172.21.15.153:0/9800130 shutdown_connections 2024-03-28T21:52:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.593+0000 7fe3b7200640 1 -- 172.21.15.153:0/9800130 wait complete. 2024-03-28T21:52:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.592+0000 7fa961600640 1 -- 172.21.15.153:0/1505601485 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95400a700 con 0x7fa964158a60 2024-03-28T21:52:03.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.592+0000 7fa961600640 1 -- 172.21.15.153:0/1505601485 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95400aaf0 con 0x7fa964158a60 2024-03-28T21:52:03.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.593+0000 7fa96c000640 1 -- 172.21.15.153:0/1505601485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa964144970 con 0x7fa964158a60 2024-03-28T21:52:03.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.594+0000 7fa96c000640 1 -- 172.21.15.153:0/1505601485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9640cd700 con 0x7fa964158a60 2024-03-28T21:52:03.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.596+0000 7fa96c000640 1 -- 172.21.15.153:0/1505601485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa93c001030 con 0x7fa964158a60 2024-03-28T21:52:03.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.599+0000 7fa961600640 1 -- 172.21.15.153:0/1505601485 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa95401b070 con 0x7fa964158a60 2024-03-28T21:52:03.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.601+0000 7fa961600640 1 --2- 172.21.15.153:0/1505601485 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa94406b5a0 0x7fa94406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.601+0000 7f3d91800640 1 -- 172.21.15.153:0/895796924 --> [v2:172.21.15.165:6816/3540151132,v1:172.21.15.165:6817/3540151132] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d8c068ff0 con 0x7f3d6c073740 2024-03-28T21:52:03.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.601+0000 7fa961600640 1 -- 172.21.15.153:0/1505601485 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa954089970 con 0x7fa964158a60 2024-03-28T21:52:03.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.601+0000 7fa969600640 1 --2- 172.21.15.153:0/1505601485 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa94406b5a0 0x7fa94406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.601+0000 7f470b200640 1 -- 172.21.15.153:0/678240533 --> [v2:172.21.15.165:6820/3492880445,v1:172.21.15.165:6822/3492880445] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f46dc002dd0 con 0x7f46e4073670 2024-03-28T21:52:03.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.602+0000 7fa961600640 1 --2- 172.21.15.153:0/1505601485 >> [v2:172.21.15.153:6824/3058330116,v1:172.21.15.153:6825/3058330116] conn(0x7fa9440737c0 0x7fa944075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:03.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.602+0000 7f3d82a00640 1 -- 172.21.15.153:0/895796924 <== osd.7 v2:172.21.15.165:6816/3540151132 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3d8c068ff0 con 0x7f3d6c073740 2024-03-28T21:52:03.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.603+0000 7f46fbe00640 1 -- 172.21.15.153:0/678240533 <== osd.5 v2:172.21.15.165:6820/3492880445 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f46dc002dd0 con 0x7f46e4073670 2024-03-28T21:52:03.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.603+0000 7fa969600640 1 --2- 172.21.15.153:0/1505601485 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa94406b5a0 0x7fa94406da60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa95c000f60 tx=0x7fa95c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.603+0000 7fa961600640 1 -- 172.21.15.153:0/1505601485 --> [v2:172.21.15.153:6824/3058330116,v1:172.21.15.153:6825/3058330116] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa944076290 con 0x7fa9440737c0 2024-03-28T21:52:03.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.603+0000 7fa961600640 1 -- 172.21.15.153:0/1505601485 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa95408e2a0 con 0x7fa964158a60 2024-03-28T21:52:03.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.603+0000 7fa96a000640 1 --2- 172.21.15.153:0/1505601485 >> [v2:172.21.15.153:6824/3058330116,v1:172.21.15.153:6825/3058330116] conn(0x7fa9440737c0 0x7fa944075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:03.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.603+0000 7f3d91800640 1 -- 172.21.15.153:0/895796924 >> [v2:172.21.15.165:6816/3540151132,v1:172.21.15.165:6817/3540151132] conn(0x7f3d6c073740 msgr2=0x7f3d6c075b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.603+0000 7f3d91800640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.165:6816/3540151132,v1:172.21.15.165:6817/3540151132] conn(0x7f3d6c073740 0x7f3d6c075b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.604+0000 7fa96a000640 1 --2- 172.21.15.153:0/1505601485 >> [v2:172.21.15.153:6824/3058330116,v1:172.21.15.153:6825/3058330116] conn(0x7fa9440737c0 0x7fa944075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:03.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.605+0000 7f3d91800640 1 -- 172.21.15.153:0/895796924 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3d6c06b520 msgr2=0x7f3d6c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.605+0000 7f3d91800640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3d6c06b520 0x7f3d6c06d9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3d78034000 tx=0x7f3d78008030 comp rx=0 tx=0).stop 2024-03-28T21:52:03.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.605+0000 7f3d91800640 1 -- 172.21.15.153:0/895796924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c06dcc0 msgr2=0x7f3d8c1459c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.605+0000 7f3d91800640 1 --2- 172.21.15.153:0/895796924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d8c06dcc0 0x7f3d8c1459c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00e870 tx=0x7f3d7c00ed30 comp rx=0 tx=0).stop 2024-03-28T21:52:03.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.605+0000 7f3d8b400640 1 -- 172.21.15.153:0/895796924 reap_dead start 2024-03-28T21:52:03.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.605+0000 7fa961600640 1 -- 172.21.15.153:0/1505601485 <== osd.3 v2:172.21.15.153:6824/3058330116 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa944076290 con 0x7fa9440737c0 2024-03-28T21:52:03.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.606+0000 7f826ec00640 1 -- 172.21.15.153:0/4029956271 --> [v2:172.21.15.153:6800/328922913,v1:172.21.15.153:6801/328922913] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f82680ce6a0 con 0x7f82480737c0 2024-03-28T21:52:03.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.606+0000 7f3d91800640 1 -- 172.21.15.153:0/895796924 shutdown_connections 2024-03-28T21:52:03.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.606+0000 7f3d91800640 1 -- 172.21.15.153:0/895796924 >> 172.21.15.153:0/895796924 conn(0x7f3d8c06b170 msgr2=0x7f3d8c162c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.606+0000 7f3d91800640 1 -- 172.21.15.153:0/895796924 shutdown_connections 2024-03-28T21:52:03.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.606+0000 7f3d91800640 1 -- 172.21.15.153:0/895796924 wait complete. 2024-03-28T21:52:03.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.607+0000 7f825fe00640 1 -- 172.21.15.153:0/4029956271 <== osd.2 v2:172.21.15.153:6800/328922913 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f82680ce6a0 con 0x7f82480737c0 2024-03-28T21:52:03.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.607+0000 7f470b200640 1 -- 172.21.15.153:0/678240533 >> [v2:172.21.15.165:6820/3492880445,v1:172.21.15.165:6822/3492880445] conn(0x7f46e4073670 msgr2=0x7f46e4075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.607+0000 7f470b200640 1 --2- 172.21.15.153:0/678240533 >> [v2:172.21.15.165:6820/3492880445,v1:172.21.15.165:6822/3492880445] conn(0x7f46e4073670 0x7f46e4075a90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.607+0000 7f470b200640 1 -- 172.21.15.153:0/678240533 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f46e406b4d0 msgr2=0x7f46e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.608+0000 7f826ec00640 1 -- 172.21.15.153:0/4029956271 >> [v2:172.21.15.153:6800/328922913,v1:172.21.15.153:6801/328922913] conn(0x7f82480737c0 msgr2=0x7f8248075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.608+0000 7f826ec00640 1 --2- 172.21.15.153:0/4029956271 >> [v2:172.21.15.153:6800/328922913,v1:172.21.15.153:6801/328922913] conn(0x7f82480737c0 0x7f8248075be0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.607+0000 7f470b200640 1 --2- 172.21.15.153:0/678240533 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f46e406b4d0 0x7f46e406d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f46f4000f60 tx=0x7f46f40079b0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.607+0000 7f470b200640 1 -- 172.21.15.153:0/678240533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470414bf50 msgr2=0x7f470414a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.607+0000 7f470b200640 1 --2- 172.21.15.153:0/678240533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470414bf50 0x7f470414a430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009eb0 tx=0x7f46fc004a40 comp rx=0 tx=0).stop 2024-03-28T21:52:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.608+0000 7f4709200640 1 -- 172.21.15.153:0/678240533 reap_dead start 2024-03-28T21:52:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.608+0000 7f470b200640 1 -- 172.21.15.153:0/678240533 shutdown_connections 2024-03-28T21:52:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.608+0000 7f470b200640 1 -- 172.21.15.153:0/678240533 >> 172.21.15.153:0/678240533 conn(0x7f470406b170 msgr2=0x7f470414b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.609+0000 7f826ec00640 1 -- 172.21.15.153:0/4029956271 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f824806b5a0 msgr2=0x7f824806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.609+0000 7f826ec00640 1 --2- 172.21.15.153:0/4029956271 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f824806b5a0 0x7f824806da60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8258006fd0 tx=0x7f8258008040 comp rx=0 tx=0).stop 2024-03-28T21:52:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.609+0000 7f826ec00640 1 -- 172.21.15.153:0/4029956271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f824c004e40 msgr2=0x7f826806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.609+0000 7f826ec00640 1 --2- 172.21.15.153:0/4029956271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f824c004e40 0x7f826806dea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8260001db0 tx=0x7f826000e530 comp rx=0 tx=0).stop 2024-03-28T21:52:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.609+0000 7f826cc00640 1 -- 172.21.15.153:0/4029956271 reap_dead start 2024-03-28T21:52:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.609+0000 7f826ec00640 1 -- 172.21.15.153:0/4029956271 shutdown_connections 2024-03-28T21:52:03.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.609+0000 7f826ec00640 1 -- 172.21.15.153:0/4029956271 >> 172.21.15.153:0/4029956271 conn(0x7f82680cd790 msgr2=0x7f82680cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.610+0000 7f826ec00640 1 -- 172.21.15.153:0/4029956271 shutdown_connections 2024-03-28T21:52:03.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.610+0000 7f826ec00640 1 -- 172.21.15.153:0/4029956271 wait complete. 2024-03-28T21:52:03.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.613+0000 7f470b200640 1 -- 172.21.15.153:0/678240533 shutdown_connections 2024-03-28T21:52:03.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.613+0000 7f470b200640 1 -- 172.21.15.153:0/678240533 wait complete. 2024-03-28T21:52:03.618 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-03-28T21:52:03.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-28T21:52:03.623 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-03-28T21:52:03.623 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-28T21:52:03.628 INFO:teuthology.orchestra.run.smithi153.stdout:60129542151 2024-03-28T21:52:03.628 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-28T21:52:03.632 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-03-28T21:52:03.633 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-28T21:52:03.643 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2024-03-28T21:52:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.637+0000 7fa96c000640 1 -- 172.21.15.153:0/1505601485 --> [v2:172.21.15.153:6824/3058330116,v1:172.21.15.153:6825/3058330116] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa93c002dd0 con 0x7fa9440737c0 2024-03-28T21:52:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.639+0000 7fa961600640 1 -- 172.21.15.153:0/1505601485 <== osd.3 v2:172.21.15.153:6824/3058330116 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa93c002dd0 con 0x7fa9440737c0 2024-03-28T21:52:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.639+0000 7fa96c000640 1 -- 172.21.15.153:0/1505601485 >> [v2:172.21.15.153:6824/3058330116,v1:172.21.15.153:6825/3058330116] conn(0x7fa9440737c0 msgr2=0x7fa944075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.639+0000 7fa96c000640 1 --2- 172.21.15.153:0/1505601485 >> [v2:172.21.15.153:6824/3058330116,v1:172.21.15.153:6825/3058330116] conn(0x7fa9440737c0 0x7fa944075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.640+0000 7fa96c000640 1 -- 172.21.15.153:0/1505601485 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa94406b5a0 msgr2=0x7fa94406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.640+0000 7fa96c000640 1 --2- 172.21.15.153:0/1505601485 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa94406b5a0 0x7fa94406da60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa95c000f60 tx=0x7fa95c009040 comp rx=0 tx=0).stop 2024-03-28T21:52:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.640+0000 7fa96c000640 1 -- 172.21.15.153:0/1505601485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa964158a60 msgr2=0x7fa964156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.640+0000 7fa96c000640 1 --2- 172.21.15.153:0/1505601485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa964158a60 0x7fa964156190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa95400cb20 tx=0x7fa954002090 comp rx=0 tx=0).stop 2024-03-28T21:52:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.640+0000 7fa96a000640 1 -- 172.21.15.153:0/1505601485 reap_dead start 2024-03-28T21:52:03.645 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-28T21:52:03.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.640+0000 7fa96c000640 1 -- 172.21.15.153:0/1505601485 shutdown_connections 2024-03-28T21:52:03.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.640+0000 7fa96c000640 1 -- 172.21.15.153:0/1505601485 >> 172.21.15.153:0/1505601485 conn(0x7fa9640cfc00 msgr2=0x7fa96415e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:03.646 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-03-28T21:52:03.646 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-28T21:52:03.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.641+0000 7fa96c000640 1 -- 172.21.15.153:0/1505601485 shutdown_connections 2024-03-28T21:52:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.642+0000 7fa96c000640 1 -- 172.21.15.153:0/1505601485 wait complete. 2024-03-28T21:52:03.668 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-03-28T21:52:03.668 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-28T21:52:03.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.873+0000 7fccafe00640 1 Processor -- start 2024-03-28T21:52:04.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.873+0000 7fccafe00640 1 -- start start 2024-03-28T21:52:04.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.876+0000 7fccafe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca80589c0 0x7fcca8053530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.876+0000 7fccafe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcca8056ab0 0x7fcca8053a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.876+0000 7fccafe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcca8057d90 con 0x7fcca80e7710 2024-03-28T21:52:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.876+0000 7fccafe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcca8006260 con 0x7fcca8056ab0 2024-03-28T21:52:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.876+0000 7fccafe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcca8006540 con 0x7fcca80589c0 2024-03-28T21:52:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.877+0000 7fccaf400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcca8056ab0 0x7fcca8053a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.877+0000 7fccaf400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcca8056ab0 0x7fcca8053a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45516/0 (socket says 172.21.15.153:45516) 2024-03-28T21:52:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.877+0000 7fccae000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca80589c0 0x7fcca8053530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.877+0000 7fccae000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca80589c0 0x7fcca8053530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:42830/0 (socket says 172.21.15.153:42830) 2024-03-28T21:52:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.877+0000 7fccae000640 1 -- 172.21.15.153:0/3740077285 learned_addr learned my addr 172.21.15.153:0/3740077285 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.879+0000 7fccae000640 1 -- 172.21.15.153:0/3740077285 >> v2:172.21.15.153:3300/0 conn(0x7fcca8056ab0 msgr2=0x7fcca8053a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.879+0000 7fccae000640 1 --2- 172.21.15.153:0/3740077285 >> v2:172.21.15.153:3300/0 conn(0x7fcca8056ab0 0x7fcca8053a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.879+0000 7fccae000640 1 -- 172.21.15.153:0/3740077285 >> v1:172.21.15.153:6789/0 conn(0x7fcca80e7710 legacy=0x7fcca804ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.879+0000 7fccae000640 1 -- 172.21.15.153:0/3740077285 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca8006820 con 0x7fcca80589c0 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.885+0000 7fccae000640 1 --2- 172.21.15.153:0/3740077285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca80589c0 0x7fcca8053530 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009870 tx=0x7fcca002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a091c5580221c555 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.886+0000 7fccad600640 1 -- 172.21.15.153:0/3740077285 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca0035020 con 0x7fcca80589c0 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.886+0000 7fccad600640 1 -- 172.21.15.153:0/3740077285 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca0031640 con 0x7fcca80589c0 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.886+0000 7fccad600640 1 -- 172.21.15.153:0/3740077285 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca0035020 con 0x7fcca80589c0 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.889+0000 7fccafe00640 1 -- 172.21.15.153:0/3740077285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca80589c0 msgr2=0x7fcca8053530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.889+0000 7fccafe00640 1 --2- 172.21.15.153:0/3740077285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca80589c0 0x7fcca8053530 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009870 tx=0x7fcca002b8f0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.889+0000 7fccafe00640 1 -- 172.21.15.153:0/3740077285 shutdown_connections 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.889+0000 7fccafe00640 1 --2- 172.21.15.153:0/3740077285 >> v2:172.21.15.153:3300/0 conn(0x7fcca8056ab0 0x7fcca8053a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.889+0000 7fccafe00640 1 --2- 172.21.15.153:0/3740077285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca80589c0 0x7fcca8053530 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.889+0000 7fccafe00640 1 -- 172.21.15.153:0/3740077285 >> 172.21.15.153:0/3740077285 conn(0x7fcca8058ee0 msgr2=0x7fcca80592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.890+0000 7fccafe00640 1 -- 172.21.15.153:0/3740077285 shutdown_connections 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.890+0000 7fccafe00640 1 -- 172.21.15.153:0/3740077285 wait complete. 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.893+0000 7fccafe00640 1 Processor -- start 2024-03-28T21:52:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.894+0000 7fccafe00640 1 -- start start 2024-03-28T21:52:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.895+0000 7fccafe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca8056ab0 0x7fcca80ea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.895+0000 7fccafe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcca80589c0 0x7fcca80d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.895+0000 7fccafe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca80e7710 0x7fcca80d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.895+0000 7fccafe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcca8057b20 con 0x7fcca8056ab0 2024-03-28T21:52:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.895+0000 7fccafe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcca80579a0 con 0x7fcca80589c0 2024-03-28T21:52:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.895+0000 7fccafe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcca8007020 con 0x7fcca80e7710 2024-03-28T21:52:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.896+0000 7fccaf400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca80e7710 0x7fcca80d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.896+0000 7fccaf400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca80e7710 0x7fcca80d2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:42842/0 (socket says 172.21.15.153:42842) 2024-03-28T21:52:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.896+0000 7fccaf400640 1 -- 172.21.15.153:0/1094752617 learned_addr learned my addr 172.21.15.153:0/1094752617 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.896+0000 7fccae000640 1 --2- 172.21.15.153:0/1094752617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcca80589c0 0x7fcca80d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.897+0000 7fccaf400640 1 -- 172.21.15.153:0/1094752617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcca80589c0 msgr2=0x7fcca80d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.897+0000 7fccaf400640 1 --2- 172.21.15.153:0/1094752617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcca80589c0 0x7fcca80d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.897+0000 7fccaf400640 1 -- 172.21.15.153:0/1094752617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca8056ab0 msgr2=0x7fcca80ea2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.897+0000 7fccaf400640 1 --2- 172.21.15.153:0/1094752617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca8056ab0 0x7fcca80ea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.897+0000 7fccaf400640 1 -- 172.21.15.153:0/1094752617 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca80e7d40 con 0x7fcca80e7710 2024-03-28T21:52:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.898+0000 7fccaf400640 1 --2- 172.21.15.153:0/1094752617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca80e7710 0x7fcca80d2bc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fccb007a7f0 tx=0x7fccb0068ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.899+0000 7fcca6a00640 1 -- 172.21.15.153:0/1094752617 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0091070 con 0x7fcca80e7710 2024-03-28T21:52:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.899+0000 7fcca6a00640 1 -- 172.21.15.153:0/1094752617 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb006d040 con 0x7fcca80e7710 2024-03-28T21:52:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.900+0000 7fcca6a00640 1 -- 172.21.15.153:0/1094752617 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0091070 con 0x7fcca80e7710 2024-03-28T21:52:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.901+0000 7fccafe00640 1 -- 172.21.15.153:0/1094752617 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca80e8020 con 0x7fcca80e7710 2024-03-28T21:52:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.901+0000 7fccafe00640 1 -- 172.21.15.153:0/1094752617 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca80e8300 con 0x7fcca80e7710 2024-03-28T21:52:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.905+0000 7fccafe00640 1 -- 172.21.15.153:0/1094752617 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca8005390 con 0x7fcca80e7710 2024-03-28T21:52:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.905+0000 7fcca6a00640 1 -- 172.21.15.153:0/1094752617 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fccb0071740 con 0x7fcca80e7710 2024-03-28T21:52:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.906+0000 7fcca6a00640 1 --2- 172.21.15.153:0/1094752617 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcc9006b700 0x7fcc9006dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.906+0000 7fcca6a00640 1 -- 172.21.15.153:0/1094752617 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fccb0105360 con 0x7fcca80e7710 2024-03-28T21:52:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.912+0000 7fccaea00640 1 --2- 172.21.15.153:0/1094752617 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcc9006b700 0x7fcc9006dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.919+0000 7f9933400640 1 Processor -- start 2024-03-28T21:52:04.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.919+0000 7f9933400640 1 -- start start 2024-03-28T21:52:04.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.920+0000 7fd78fc00640 1 Processor -- start 2024-03-28T21:52:04.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.922+0000 7f9933400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f992c0723a0 0x7f992c1404a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.922+0000 7f9933400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f992c0b2240 0x7f992c0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.922+0000 7f9933400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f992c072b30 con 0x7f992c140db0 2024-03-28T21:52:04.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.922+0000 7f9933400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f992c1409e0 con 0x7f992c0723a0 2024-03-28T21:52:04.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.922+0000 7f9933400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f992c072850 con 0x7f992c0b2240 2024-03-28T21:52:04.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.920+0000 7fd78fc00640 1 -- start start 2024-03-28T21:52:04.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.922+0000 7fd78fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78815a4a0 0x7fd7880cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.922+0000 7fd78fc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd7880cf560 0x7fd7880b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.922+0000 7fd78fc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7880b4670 con 0x7fd7880b41e0 2024-03-28T21:52:04.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.923+0000 7fd78fc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd7880cf9c0 con 0x7fd7880cf560 2024-03-28T21:52:04.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.923+0000 7fd78fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd78815b4c0 con 0x7fd78815a4a0 2024-03-28T21:52:04.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.923+0000 7fd77fe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd7880cf560 0x7fd7880b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.923+0000 7fd77fe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd7880cf560 0x7fd7880b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45538/0 (socket says 172.21.15.153:45538) 2024-03-28T21:52:04.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.923+0000 7fd77fe00640 1 -- 172.21.15.153:0/901787151 learned_addr learned my addr 172.21.15.153:0/901787151 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.924+0000 7f9930a00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f992c140db0 0x7f992c071c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:34056/0 (socket says 172.21.15.153:34056) 2024-03-28T21:52:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.924+0000 7f9931400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f992c0b2240 0x7f992c0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.924+0000 7f9931400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f992c0b2240 0x7f992c0b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:42856/0 (socket says 172.21.15.153:42856) 2024-03-28T21:52:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.924+0000 7f9931400640 1 -- 172.21.15.153:0/3088547717 learned_addr learned my addr 172.21.15.153:0/3088547717 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.923+0000 7fccaea00640 1 --2- 172.21.15.153:0/1094752617 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcc9006b700 0x7fcc9006dbc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c000f60 tx=0x7fcc9c0079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.925+0000 7fcca6a00640 1 -- 172.21.15.153:0/1094752617 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fccb00d4170 con 0x7fcca80e7710 2024-03-28T21:52:04.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.923+0000 7fd78d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78815a4a0 0x7fd7880cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.924+0000 7f992be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f992c0723a0 0x7f992c1404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.925+0000 7fd77fe00640 1 -- 172.21.15.153:0/901787151 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78815a4a0 msgr2=0x7fd7880cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:04.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.925+0000 7fd77fe00640 1 --2- 172.21.15.153:0/901787151 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78815a4a0 0x7fd7880cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.926+0000 7fd77fe00640 1 -- 172.21.15.153:0/901787151 >> v1:172.21.15.165:6789/0 conn(0x7fd7880b41e0 legacy=0x7fd78815ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.927+0000 7fd77fe00640 1 -- 172.21.15.153:0/901787151 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78815ab90 con 0x7fd7880cf560 2024-03-28T21:52:04.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.927+0000 7f992be00640 1 -- 172.21.15.153:0/3088547717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f992c0b2240 msgr2=0x7f992c0b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:04.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.928+0000 7f992be00640 1 --2- 172.21.15.153:0/3088547717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f992c0b2240 0x7f992c0b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.928+0000 7f992be00640 1 -- 172.21.15.153:0/3088547717 >> v1:172.21.15.165:6789/0 conn(0x7f992c140db0 legacy=0x7f992c071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.928+0000 7f992be00640 1 -- 172.21.15.153:0/3088547717 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992c06cd20 con 0x7f992c0723a0 2024-03-28T21:52:04.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.929+0000 7fdf9d600640 1 Processor -- start 2024-03-28T21:52:04.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.929+0000 7f9931400640 1 --2- 172.21.15.153:0/3088547717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f992c0b2240 0x7f992c0b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:52:04.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.929+0000 7fdf9d600640 1 -- start start 2024-03-28T21:52:04.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.930+0000 7f992be00640 1 --2- 172.21.15.153:0/3088547717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0723a0 0x7f992c1404a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f99200097a0 tx=0x7f992002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d37be1fd868ab0e server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.930+0000 7fd78d200640 1 --2- 172.21.15.153:0/901787151 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78815a4a0 0x7fd7880cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:04.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.931+0000 7ff0f5200640 1 Processor -- start 2024-03-28T21:52:04.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.931+0000 7ff0f5200640 1 -- start start 2024-03-28T21:52:04.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.931+0000 7fd77fe00640 1 --2- 172.21.15.153:0/901787151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7880cf560 0x7fd7880b3ca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd770009870 tx=0x7fd77002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d917bd9c66e753e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.932+0000 7fd787e00640 1 -- 172.21.15.153:0/901787151 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770034070 con 0x7fd7880cf560 2024-03-28T21:52:04.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.932+0000 7f992b400640 1 -- 172.21.15.153:0/3088547717 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9920035020 con 0x7f992c0723a0 2024-03-28T21:52:04.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.932+0000 7fdf9d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf9815e400 0x7fdf980d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.932+0000 7fdf9d600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdf980d1d50 0x7fdf980d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.932+0000 7fdf9d600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf980d5080 con 0x7fdf980d2c80 2024-03-28T21:52:04.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.932+0000 7fdf9d600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdf980cfe90 con 0x7fdf980d1d50 2024-03-28T21:52:04.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.932+0000 7fdf9d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdf980d4da0 con 0x7fdf9815e400 2024-03-28T21:52:04.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.932+0000 7fd787e00640 1 -- 172.21.15.153:0/901787151 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd770030860 con 0x7fd7880cf560 2024-03-28T21:52:04.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.932+0000 7f992b400640 1 -- 172.21.15.153:0/3088547717 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9920031830 con 0x7f992c0723a0 2024-03-28T21:52:04.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.932+0000 7f992b400640 1 -- 172.21.15.153:0/3088547717 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9920031c40 con 0x7f992c0723a0 2024-03-28T21:52:04.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.932+0000 7fd787e00640 1 -- 172.21.15.153:0/901787151 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770030c70 con 0x7fd7880cf560 2024-03-28T21:52:04.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.933+0000 7ff0f5200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff0f01447e0 0x7ff0f006e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.933+0000 7ff0f5200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff0f015b9f0 0x7ff0f006d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.934+0000 7f9933400640 1 -- 172.21.15.153:0/3088547717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0723a0 msgr2=0x7f992c1404a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.933+0000 7fdf96a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf9815e400 0x7fdf980d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.934+0000 7fdf97400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fdf980d2c80 0x7fdf980d0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:34084/0 (socket says 172.21.15.153:34084) 2024-03-28T21:52:04.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.934+0000 7f9933400640 1 --2- 172.21.15.153:0/3088547717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0723a0 0x7f992c1404a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f99200097a0 tx=0x7f992002b8d0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.934+0000 7fdf97400640 1 -- 172.21.15.153:0/2135432749 learned_addr learned my addr 172.21.15.153:0/2135432749 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:04.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.934+0000 7f9933400640 1 -- 172.21.15.153:0/3088547717 shutdown_connections 2024-03-28T21:52:04.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.934+0000 7f9933400640 1 --2- 172.21.15.153:0/3088547717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f992c0b2240 0x7f992c0b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.934+0000 7f9933400640 1 --2- 172.21.15.153:0/3088547717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c0723a0 0x7f992c1404a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.934+0000 7ff0ede00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff0f01447e0 0x7ff0f006e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.934+0000 7f9933400640 1 -- 172.21.15.153:0/3088547717 >> 172.21.15.153:0/3088547717 conn(0x7f992c0b1720 msgr2=0x7f992c0b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.934+0000 7fdf96a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf9815e400 0x7fdf980d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:42868/0 (socket says 172.21.15.153:42868) 2024-03-28T21:52:04.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.934+0000 7ff0ede00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff0f01447e0 0x7ff0f006e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:45226/0 (socket says 172.21.15.153:45226) 2024-03-28T21:52:04.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.934+0000 7fd78fc00640 1 -- 172.21.15.153:0/901787151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7880cf560 msgr2=0x7fd7880b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.934+0000 7fd78fc00640 1 --2- 172.21.15.153:0/901787151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7880cf560 0x7fd7880b3ca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd770009870 tx=0x7fd77002b9a0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7f9933400640 1 -- 172.21.15.153:0/3088547717 shutdown_connections 2024-03-28T21:52:04.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7ff0ede00640 1 -- 172.21.15.153:0/967426005 learned_addr learned my addr 172.21.15.153:0/967426005 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:04.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7ff0f5200640 1 -- 172.21.15.153:0/967426005 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f00b3870 con 0x7ff0f00b33e0 2024-03-28T21:52:04.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7ff0f5200640 1 -- 172.21.15.153:0/967426005 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff0f00b3b10 con 0x7ff0f015b9f0 2024-03-28T21:52:04.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7f9933400640 1 -- 172.21.15.153:0/3088547717 wait complete. 2024-03-28T21:52:04.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7ff0ee800640 1 --2- 172.21.15.153:0/967426005 >> v2:172.21.15.153:3300/0 conn(0x7ff0f015b9f0 0x7ff0f006d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7ff0f5200640 1 -- 172.21.15.153:0/967426005 --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff0f00b3df0 con 0x7ff0f01447e0 2024-03-28T21:52:04.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7fdf95600640 1 -- 172.21.15.153:0/2135432749 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 867994703 0 0) 0x7fdf980d5080 con 0x7fdf980d2c80 2024-03-28T21:52:04.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7fdf95600640 1 -- 172.21.15.153:0/2135432749 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf7c003520 con 0x7fdf980d2c80 2024-03-28T21:52:04.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7fd78fc00640 1 -- 172.21.15.153:0/901787151 shutdown_connections 2024-03-28T21:52:04.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7fd78fc00640 1 --2- 172.21.15.153:0/901787151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7880cf560 0x7fd7880b3ca0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd770009870 tx=0x7fd77002b9a0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7fd78fc00640 1 --2- 172.21.15.153:0/901787151 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78815a4a0 0x7fd7880cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7fd78fc00640 1 -- 172.21.15.153:0/901787151 >> 172.21.15.153:0/901787151 conn(0x7fd78806b170 msgr2=0x7fd78806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.936+0000 7ff0ede00640 1 -- 172.21.15.153:0/967426005 >> v2:172.21.15.153:3300/0 conn(0x7ff0f015b9f0 msgr2=0x7ff0f006d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:04.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.936+0000 7ff0ede00640 1 --2- 172.21.15.153:0/967426005 >> v2:172.21.15.153:3300/0 conn(0x7ff0f015b9f0 0x7ff0f006d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.936+0000 7ff0ede00640 1 -- 172.21.15.153:0/967426005 >> v1:172.21.15.153:6789/0 conn(0x7ff0f00b33e0 legacy=0x7ff0f015b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:04.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7fdf96a00640 1 -- 172.21.15.153:0/2135432749 >> v2:172.21.15.153:3300/0 conn(0x7fdf980d1d50 msgr2=0x7fdf980d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:04.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7fdf96a00640 1 --2- 172.21.15.153:0/2135432749 >> v2:172.21.15.153:3300/0 conn(0x7fdf980d1d50 0x7fdf980d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7fdf96a00640 1 -- 172.21.15.153:0/2135432749 >> v1:172.21.15.165:6789/0 conn(0x7fdf980d2c80 legacy=0x7fdf980d0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.935+0000 7fdf96a00640 1 -- 172.21.15.153:0/2135432749 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf980cf840 con 0x7fdf9815e400 2024-03-28T21:52:04.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.937+0000 7ff0ede00640 1 -- 172.21.15.153:0/967426005 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f00b40d0 con 0x7ff0f01447e0 2024-03-28T21:52:04.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.937+0000 7fd78fc00640 1 -- 172.21.15.153:0/901787151 shutdown_connections 2024-03-28T21:52:04.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.937+0000 7fd78fc00640 1 -- 172.21.15.153:0/901787151 wait complete. 2024-03-28T21:52:04.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.939+0000 7f9933400640 1 Processor -- start 2024-03-28T21:52:04.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.939+0000 7ff0ede00640 1 --2- 172.21.15.153:0/967426005 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0f01447e0 0x7ff0f006e600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00cf9f0 tx=0x7ff0dc02b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5086f40a561f79f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.939+0000 7f9933400640 1 -- start start 2024-03-28T21:52:04.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.940+0000 7fd78fc00640 1 Processor -- start 2024-03-28T21:52:04.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.937+0000 7fdf96a00640 1 --2- 172.21.15.153:0/2135432749 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf9815e400 0x7fdf980d2200 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdf880097a0 tx=0x7fdf8802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b70ca92ce43db6f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.940+0000 7fdf95600640 1 -- 172.21.15.153:0/2135432749 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88034070 con 0x7fdf9815e400 2024-03-28T21:52:04.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.940+0000 7fdf95600640 1 -- 172.21.15.153:0/2135432749 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf88030610 con 0x7fdf9815e400 2024-03-28T21:52:04.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.940+0000 7fdf95600640 1 -- 172.21.15.153:0/2135432749 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88030a20 con 0x7fdf9815e400 2024-03-28T21:52:04.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.940+0000 7ff0eca00640 1 -- 172.21.15.153:0/967426005 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc038070 con 0x7ff0f01447e0 2024-03-28T21:52:04.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.940+0000 7ff0eca00640 1 -- 172.21.15.153:0/967426005 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc031520 con 0x7ff0f01447e0 2024-03-28T21:52:04.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.940+0000 7ff0eca00640 1 -- 172.21.15.153:0/967426005 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0318f0 con 0x7ff0f01447e0 2024-03-28T21:52:04.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.941+0000 7ff0f5200640 1 -- 172.21.15.153:0/967426005 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0f01447e0 msgr2=0x7ff0f006e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.941+0000 7ff0f5200640 1 --2- 172.21.15.153:0/967426005 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0f01447e0 0x7ff0f006e600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00cf9f0 tx=0x7ff0dc02b7c0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.941+0000 7fdf9d600640 1 -- 172.21.15.153:0/2135432749 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf9815e400 msgr2=0x7fdf980d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.941+0000 7fdf9d600640 1 --2- 172.21.15.153:0/2135432749 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf9815e400 0x7fdf980d2200 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdf880097a0 tx=0x7fdf8802b960 comp rx=0 tx=0).stop 2024-03-28T21:52:04.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.941+0000 7ff0f5200640 1 -- 172.21.15.153:0/967426005 shutdown_connections 2024-03-28T21:52:04.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.942+0000 7fdf9d600640 1 -- 172.21.15.153:0/2135432749 shutdown_connections 2024-03-28T21:52:04.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.942+0000 7fdf9d600640 1 --2- 172.21.15.153:0/2135432749 >> v2:172.21.15.153:3300/0 conn(0x7fdf980d1d50 0x7fdf980d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.942+0000 7fdf9d600640 1 --2- 172.21.15.153:0/2135432749 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf9815e400 0x7fdf980d2200 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.942+0000 7fdf9d600640 1 -- 172.21.15.153:0/2135432749 >> 172.21.15.153:0/2135432749 conn(0x7fdf9809d4c0 msgr2=0x7fdf980d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.941+0000 7ff0f5200640 1 --2- 172.21.15.153:0/967426005 >> v2:172.21.15.153:3300/0 conn(0x7ff0f015b9f0 0x7ff0f006d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.941+0000 7ff0f5200640 1 --2- 172.21.15.153:0/967426005 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0f01447e0 0x7ff0f006e600 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00cf9f0 tx=0x7ff0dc02b7c0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.941+0000 7ff0f5200640 1 -- 172.21.15.153:0/967426005 >> 172.21.15.153:0/967426005 conn(0x7ff0f00b1720 msgr2=0x7ff0f00b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.942+0000 7f9933400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f992c0723a0 0x7f992c16b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.942+0000 7fdf9d600640 1 -- 172.21.15.153:0/2135432749 shutdown_connections 2024-03-28T21:52:04.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.942+0000 7f9933400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f992c0b2240 0x7f992c150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.942+0000 7f9933400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c140db0 0x7f992c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.942+0000 7ff0f5200640 1 -- 172.21.15.153:0/967426005 shutdown_connections 2024-03-28T21:52:04.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.942+0000 7ff0f5200640 1 -- 172.21.15.153:0/967426005 wait complete. 2024-03-28T21:52:04.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.942+0000 7fdf9d600640 1 -- 172.21.15.153:0/2135432749 wait complete. 2024-03-28T21:52:04.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.943+0000 7f9930a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f992c0723a0 0x7f992c16b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.943+0000 7f992be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f992c0b2240 0x7f992c150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.943+0000 7f992be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f992c0b2240 0x7f992c150f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:42878/0 (socket says 172.21.15.153:42878) 2024-03-28T21:52:04.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.943+0000 7f9930a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f992c0723a0 0x7f992c16b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:45238/0 (socket says 172.21.15.153:45238) 2024-03-28T21:52:04.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.944+0000 7f9931400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c140db0 0x7f992c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.944+0000 7f9931400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c140db0 0x7f992c1514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45576/0 (socket says 172.21.15.153:45576) 2024-03-28T21:52:04.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.944+0000 7f9933400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f992c0b3270 con 0x7f992c140db0 2024-03-28T21:52:04.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.944+0000 7f9933400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f992c06d2e0 con 0x7f992c0723a0 2024-03-28T21:52:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.944+0000 7f9933400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f992c0b33f0 con 0x7f992c0b2240 2024-03-28T21:52:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.944+0000 7f992be00640 1 -- 172.21.15.153:0/1565159422 learned_addr learned my addr 172.21.15.153:0/1565159422 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.945+0000 7f992be00640 1 -- 172.21.15.153:0/1565159422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f992c0723a0 msgr2=0x7f992c16b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.945+0000 7f992be00640 1 --2- 172.21.15.153:0/1565159422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f992c0723a0 0x7f992c16b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.945+0000 7f992be00640 1 -- 172.21.15.153:0/1565159422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c140db0 msgr2=0x7f992c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.945+0000 7f992be00640 1 --2- 172.21.15.153:0/1565159422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c140db0 0x7f992c1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.945+0000 7f992be00640 1 -- 172.21.15.153:0/1565159422 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992c16be30 con 0x7f992c0b2240 2024-03-28T21:52:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.945+0000 7f9931400640 1 --2- 172.21.15.153:0/1565159422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c140db0 0x7f992c1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:52:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.945+0000 7fd78fc00640 1 -- start start 2024-03-28T21:52:04.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.945+0000 7f9930a00640 1 --2- 172.21.15.153:0/1565159422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f992c0723a0 0x7f992c16b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-03-28T21:52:04.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.946+0000 7f992be00640 1 --2- 172.21.15.153:0/1565159422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f992c0b2240 0x7f992c150f60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f99200098c0 tx=0x7f99200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.946+0000 7ff0f5200640 1 Processor -- start 2024-03-28T21:52:04.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.945+0000 7fdf9d600640 1 Processor -- start 2024-03-28T21:52:04.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.947+0000 7fd78fc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7880b41e0 0x7fd7881e64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.947+0000 7ff0f5200640 1 -- start start 2024-03-28T21:52:04.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.947+0000 7fd78fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78815a4a0 0x7fd7880aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.948+0000 7f9928c00640 1 -- 172.21.15.153:0/1565159422 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9920041070 con 0x7f992c0b2240 2024-03-28T21:52:04.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.948+0000 7f9933400640 1 -- 172.21.15.153:0/1565159422 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992c16c110 con 0x7f992c0b2240 2024-03-28T21:52:04.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.947+0000 7fd78fc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7881e36b0 0x7fd7881f0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.947+0000 7fd78fc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd78815a880 con 0x7fd7880b41e0 2024-03-28T21:52:04.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.948+0000 7f9933400640 1 -- 172.21.15.153:0/1565159422 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f992c133c80 con 0x7f992c0b2240 2024-03-28T21:52:04.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.948+0000 7f9928c00640 1 -- 172.21.15.153:0/1565159422 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992003b900 con 0x7f992c0b2240 2024-03-28T21:52:04.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.948+0000 7f9928c00640 1 -- 172.21.15.153:0/1565159422 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9920041070 con 0x7f992c0b2240 2024-03-28T21:52:04.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.947+0000 7fd78fc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd78815b150 con 0x7fd7881e36b0 2024-03-28T21:52:04.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.947+0000 7fd78fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd78806bc90 con 0x7fd78815a4a0 2024-03-28T21:52:04.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.948+0000 7fd77fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78815a4a0 0x7fd7880aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.948+0000 7fd77fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78815a4a0 0x7fd7880aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:42892/0 (socket says 172.21.15.153:42892) 2024-03-28T21:52:04.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.948+0000 7fd77fe00640 1 -- 172.21.15.153:0/3110879705 learned_addr learned my addr 172.21.15.153:0/3110879705 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:04.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.948+0000 7fdf9d600640 1 -- start start 2024-03-28T21:52:04.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.949+0000 7ff0f5200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f00b33e0 0x7ff0f00cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.949+0000 7ff0f5200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0f015b9f0 0x7ff0f0136690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.949+0000 7ff0f5200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0f0136bd0 0x7ff0f0138440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.950+0000 7ff0f5200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f006daf0 con 0x7ff0f00b33e0 2024-03-28T21:52:04.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.950+0000 7ff0f5200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f006d970 con 0x7ff0f0136bd0 2024-03-28T21:52:04.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.950+0000 7ff0f5200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f006dc70 con 0x7ff0f015b9f0 2024-03-28T21:52:04.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.950+0000 7ff0ede00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f00b33e0 0x7ff0f00cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.950+0000 7ff0ede00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f00b33e0 0x7ff0f00cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45586/0 (socket says 172.21.15.153:45586) 2024-03-28T21:52:04.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.950+0000 7ff0ee800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0f0136bd0 0x7ff0f0138440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.950+0000 7ff0ee800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0f0136bd0 0x7ff0f0138440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:45240/0 (socket says 172.21.15.153:45240) 2024-03-28T21:52:04.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.950+0000 7ff0ee800640 1 -- 172.21.15.153:0/874951261 learned_addr learned my addr 172.21.15.153:0/874951261 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:04.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.950+0000 7fd78dc00640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7881e36b0 0x7fd7881f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.950+0000 7fd77fe00640 1 -- 172.21.15.153:0/3110879705 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7881e36b0 msgr2=0x7fd7881f0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.951+0000 7fd78d200640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7880b41e0 0x7fd7881e64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.951+0000 7ff0ede00640 1 -- 172.21.15.153:0/874951261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0f015b9f0 msgr2=0x7ff0f0136690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.951+0000 7ff0ede00640 1 --2- 172.21.15.153:0/874951261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0f015b9f0 0x7ff0f0136690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.951+0000 7ff0ede00640 1 -- 172.21.15.153:0/874951261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0f0136bd0 msgr2=0x7ff0f0138440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.951+0000 7ff0ede00640 1 --2- 172.21.15.153:0/874951261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0f0136bd0 0x7ff0f0138440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.951+0000 7ff0ede00640 1 -- 172.21.15.153:0/874951261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f0143f30 con 0x7ff0f00b33e0 2024-03-28T21:52:04.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.951+0000 7fd77fe00640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7881e36b0 0x7fd7881f0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.951+0000 7fd77fe00640 1 -- 172.21.15.153:0/3110879705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7880b41e0 msgr2=0x7fd7881e64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.951+0000 7fd77fe00640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7880b41e0 0x7fd7881e64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.952+0000 7f9928c00640 1 -- 172.21.15.153:0/1565159422 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f992004c060 con 0x7f992c0b2240 2024-03-28T21:52:04.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.952+0000 7ff0ede00640 1 --2- 172.21.15.153:0/874951261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f00b33e0 0x7ff0f00cd2a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc033000 tx=0x7ff0dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.951+0000 7fd77fe00640 1 -- 172.21.15.153:0/3110879705 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7880af480 con 0x7fd78815a4a0 2024-03-28T21:52:04.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.953+0000 7fd78dc00640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7881e36b0 0x7fd7881f0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:04.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.953+0000 7fd78d200640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7880b41e0 0x7fd7881e64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:04.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.953+0000 7ff0e6000640 1 -- 172.21.15.153:0/874951261 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc042070 con 0x7ff0f00b33e0 2024-03-28T21:52:04.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.953+0000 7ff0f5200640 1 -- 172.21.15.153:0/874951261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f0135bb0 con 0x7ff0f00b33e0 2024-03-28T21:52:04.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.955+0000 7fdf9d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf980d1d50 0x7fdf981f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.954+0000 7fd77fe00640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78815a4a0 0x7fd7880aef40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd77002bf30 tx=0x7fd770004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.954+0000 7f9933400640 1 -- 172.21.15.153:0/1565159422 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9908005290 con 0x7f992c0b2240 2024-03-28T21:52:04.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.954+0000 7f9928c00640 1 --2- 172.21.15.153:0/1565159422 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f990c06b6d0 0x7f990c06db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.954+0000 7f9928c00640 1 -- 172.21.15.153:0/1565159422 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f99200ab610 con 0x7f992c0b2240 2024-03-28T21:52:04.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.955+0000 7f9930a00640 1 --2- 172.21.15.153:0/1565159422 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f990c06b6d0 0x7f990c06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.955+0000 7fd785600640 1 -- 172.21.15.153:0/3110879705 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770048070 con 0x7fd78815a4a0 2024-03-28T21:52:04.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.955+0000 7fd78fc00640 1 -- 172.21.15.153:0/3110879705 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7881e3ec0 con 0x7fd78815a4a0 2024-03-28T21:52:04.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.955+0000 7fd78fc00640 1 -- 172.21.15.153:0/3110879705 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7881e4480 con 0x7fd78815a4a0 2024-03-28T21:52:04.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.956+0000 7f9930a00640 1 --2- 172.21.15.153:0/1565159422 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f990c06b6d0 0x7f990c06db90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9918000f60 tx=0x7f9918009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.956+0000 7fdf9d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf980d2c80 0x7fdf9815b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.956+0000 7fdf96a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf980d1d50 0x7fdf981f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.956+0000 7fdf96a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf980d1d50 0x7fdf981f0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:42914/0 (socket says 172.21.15.153:42914) 2024-03-28T21:52:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.957+0000 7fdf9d600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf9815e400 0x7fdf981f1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.958+0000 7fdf97400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf9815e400 0x7fdf981f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.958+0000 7fdf96000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf980d2c80 0x7fdf9815b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.958+0000 7fdf96a00640 1 -- 172.21.15.153:0/3769898981 learned_addr learned my addr 172.21.15.153:0/3769898981 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.958+0000 7fdf9d600640 1 -- 172.21.15.153:0/3769898981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdf980cc360 con 0x7fdf9815e400 2024-03-28T21:52:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.958+0000 7fdf9d600640 1 -- 172.21.15.153:0/3769898981 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdf980d4a50 con 0x7fdf980d2c80 2024-03-28T21:52:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.958+0000 7fdf9d600640 1 -- 172.21.15.153:0/3769898981 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdf980cc4e0 con 0x7fdf980d1d50 2024-03-28T21:52:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.957+0000 7fd78fc00640 1 -- 172.21.15.153:0/3110879705 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd788068ff0 con 0x7fd78815a4a0 2024-03-28T21:52:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.953+0000 7ff0f5200640 1 -- 172.21.15.153:0/874951261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f0136170 con 0x7ff0f00b33e0 2024-03-28T21:52:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.955+0000 7ff0f5200640 1 -- 172.21.15.153:0/874951261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f015de20 con 0x7ff0f00b33e0 2024-03-28T21:52:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.957+0000 7ff0e6000640 1 -- 172.21.15.153:0/874951261 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc031520 con 0x7ff0f00b33e0 2024-03-28T21:52:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.957+0000 7ff0e6000640 1 -- 172.21.15.153:0/874951261 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc04c060 con 0x7ff0f00b33e0 2024-03-28T21:52:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.959+0000 7fdf97400640 1 -- 172.21.15.153:0/3769898981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf980d1d50 msgr2=0x7fdf981f0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.959+0000 7fdf97400640 1 --2- 172.21.15.153:0/3769898981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf980d1d50 0x7fdf981f0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.959+0000 7fdf97400640 1 -- 172.21.15.153:0/3769898981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf980d2c80 msgr2=0x7fdf9815b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.959+0000 7fdf97400640 1 --2- 172.21.15.153:0/3769898981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf980d2c80 0x7fdf9815b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.959+0000 7fdf97400640 1 -- 172.21.15.153:0/3769898981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9815a710 con 0x7fdf9815e400 2024-03-28T21:52:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.959+0000 7fdf96000640 1 --2- 172.21.15.153:0/3769898981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf980d2c80 0x7fdf9815b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.959+0000 7fdf97400640 1 --2- 172.21.15.153:0/3769898981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf9815e400 0x7fdf981f1310 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000c700 tx=0x7fdf9000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.960+0000 7fdf96a00640 1 --2- 172.21.15.153:0/3769898981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf980d1d50 0x7fdf981f0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.960+0000 7ff0e6000640 1 -- 172.21.15.153:0/874951261 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff0dc045070 con 0x7ff0f00b33e0 2024-03-28T21:52:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.961+0000 7ff0e6000640 1 --2- 172.21.15.153:0/874951261 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff0d006b4d0 0x7ff0d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.962+0000 7ff0ed400640 1 --2- 172.21.15.153:0/874951261 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff0d006b4d0 0x7ff0d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.963+0000 7ff0ed400640 1 --2- 172.21.15.153:0/874951261 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff0d006b4d0 0x7ff0d006d990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80043c0 tx=0x7ff0e8007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.963+0000 7ff0e6000640 1 -- 172.21.15.153:0/874951261 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff0dc078940 con 0x7ff0f00b33e0 2024-03-28T21:52:04.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.967+0000 7fdf8ea00640 1 -- 172.21.15.153:0/3769898981 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf90018070 con 0x7fdf9815e400 2024-03-28T21:52:04.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.967+0000 7fdf8ea00640 1 -- 172.21.15.153:0/3769898981 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf90004d60 con 0x7fdf9815e400 2024-03-28T21:52:04.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.967+0000 7fdf8ea00640 1 -- 172.21.15.153:0/3769898981 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9000a860 con 0x7fdf9815e400 2024-03-28T21:52:04.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.968+0000 7ff0e6000640 1 -- 172.21.15.153:0/874951261 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff0dc07a8a0 con 0x7ff0f00b33e0 2024-03-28T21:52:04.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.967+0000 7fdf9d600640 1 -- 172.21.15.153:0/3769898981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9815a9f0 con 0x7fdf9815e400 2024-03-28T21:52:04.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.968+0000 7fdf9d600640 1 -- 172.21.15.153:0/3769898981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf9815afb0 con 0x7fdf9815e400 2024-03-28T21:52:04.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.970+0000 7f9928c00640 1 -- 172.21.15.153:0/1565159422 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f992007a3f0 con 0x7f992c0b2240 2024-03-28T21:52:04.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.970+0000 7fd785600640 1 -- 172.21.15.153:0/3110879705 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd770009490 con 0x7fd78815a4a0 2024-03-28T21:52:04.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.971+0000 7fdf9d600640 1 -- 172.21.15.153:0/3769898981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf70005290 con 0x7fdf9815e400 2024-03-28T21:52:04.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.971+0000 7fd785600640 1 -- 172.21.15.153:0/3110879705 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770052060 con 0x7fd78815a4a0 2024-03-28T21:52:04.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.972+0000 7fd785600640 1 -- 172.21.15.153:0/3110879705 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fd77004b070 con 0x7fd78815a4a0 2024-03-28T21:52:04.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.977+0000 7fd785600640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd76406b4d0 0x7fd76406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.977+0000 7fd785600640 1 -- 172.21.15.153:0/3110879705 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd7700ac790 con 0x7fd78815a4a0 2024-03-28T21:52:04.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.977+0000 7fd78d200640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd76406b4d0 0x7fd76406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.973+0000 7fdf8ea00640 1 -- 172.21.15.153:0/3769898981 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fdf9001b070 con 0x7fdf9815e400 2024-03-28T21:52:04.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.975+0000 7fdf8ea00640 1 --2- 172.21.15.153:0/3769898981 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdf7806b5a0 0x7fdf7806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.975+0000 7fdf8ea00640 1 -- 172.21.15.153:0/3769898981 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdf90089670 con 0x7fdf9815e400 2024-03-28T21:52:04.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.979+0000 7fdf96a00640 1 --2- 172.21.15.153:0/3769898981 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdf7806b5a0 0x7fdf7806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.980+0000 7fdf96a00640 1 --2- 172.21.15.153:0/3769898981 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdf7806b5a0 0x7fdf7806da60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdf880097a0 tx=0x7fdf8803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.982+0000 7fd78d200640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd76406b4d0 0x7fd76406d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd778006fd0 tx=0x7fd778008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.984+0000 7fd785600640 1 -- 172.21.15.153:0/3110879705 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd77007afa0 con 0x7fd78815a4a0 2024-03-28T21:52:04.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.986+0000 7fdf8ea00640 1 -- 172.21.15.153:0/3769898981 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdf90057e80 con 0x7fdf9815e400 2024-03-28T21:52:04.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.995+0000 7efbffa00640 1 Processor -- start 2024-03-28T21:52:04.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.995+0000 7efbffa00640 1 -- start start 2024-03-28T21:52:04.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.997+0000 7efbffa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efbf8161760 0x7efbf80d4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.997+0000 7efbffa00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbf80d28e0 con 0x7efbf80b38e0 2024-03-28T21:52:04.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.997+0000 7efbffa00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbf80d2bc0 con 0x7efbf80d10b0 2024-03-28T21:52:04.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.997+0000 7efbffa00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7efbf80d2ea0 con 0x7efbf8161760 2024-03-28T21:52:04.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.998+0000 7efbfda00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7efbf80d10b0 0x7efbf80cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:34100/0 (socket says 172.21.15.153:34100) 2024-03-28T21:52:04.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.998+0000 7efbfda00640 1 -- 172.21.15.153:0/4190130640 learned_addr learned my addr 172.21.15.153:0/4190130640 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:04.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.999+0000 7efbf7400640 1 -- 172.21.15.153:0/4190130640 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097807571 0 0) 0x7efbf80d2bc0 con 0x7efbf80d10b0 2024-03-28T21:52:04.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.999+0000 7efbf7400640 1 -- 172.21.15.153:0/4190130640 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbdc003520 con 0x7efbf80d10b0 2024-03-28T21:52:04.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.999+0000 7efbf7400640 1 -- 172.21.15.153:0/4190130640 <== mon.1 v1:172.21.15.165:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4231319852 0 0) 0x7efbdc003520 con 0x7efbf80d10b0 2024-03-28T21:52:04.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.999+0000 7efbf7400640 1 -- 172.21.15.153:0/4190130640 >> v2:172.21.15.153:3300/0 conn(0x7efbf8161760 msgr2=0x7efbf80d4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:04.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.999+0000 7efbf7400640 1 --2- 172.21.15.153:0/4190130640 >> v2:172.21.15.153:3300/0 conn(0x7efbf8161760 0x7efbf80d4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.999+0000 7efbf7400640 1 -- 172.21.15.153:0/4190130640 >> v1:172.21.15.153:6789/0 conn(0x7efbf80b38e0 legacy=0x7efbf80d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:04.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.999+0000 7efbf7400640 1 -- 172.21.15.153:0/4190130640 --> v1:172.21.15.165:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf80d4db0 con 0x7efbf80d10b0 2024-03-28T21:52:04.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:03.999+0000 7efbf7400640 1 -- 172.21.15.153:0/4190130640 <== mon.1 v1:172.21.15.165:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7efbe4001670 con 0x7efbf80d10b0 2024-03-28T21:52:04.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.000+0000 7efbf7400640 1 -- 172.21.15.153:0/4190130640 >> v1:172.21.15.165:6789/0 conn(0x7efbf80d10b0 legacy=0x7efbf80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.000+0000 7efbf7400640 1 --2- 172.21.15.153:0/4190130640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbdc003a00 0x7efbdc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.000+0000 7efbf7400640 1 --2- 172.21.15.153:0/4190130640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efbdc004800 0x7efbdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.000+0000 7efbf7400640 1 --2- 172.21.15.153:0/4190130640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efbdc0052e0 0x7efbdc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.000+0000 7efbf7400640 1 -- 172.21.15.153:0/4190130640 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efbf80d2ea0 con 0x7efbdc003a00 2024-03-28T21:52:04.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.000+0000 7efbf7400640 1 -- 172.21.15.153:0/4190130640 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efbdc00c230 con 0x7efbdc004800 2024-03-28T21:52:04.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.000+0000 7efbf7400640 1 -- 172.21.15.153:0/4190130640 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efbdc00c430 con 0x7efbdc0052e0 2024-03-28T21:52:04.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.000+0000 7efbfda00640 1 --2- 172.21.15.153:0/4190130640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efbdc0052e0 0x7efbdc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.001+0000 7efbfd000640 1 --2- 172.21.15.153:0/4190130640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbdc003a00 0x7efbdc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.001+0000 7efbfda00640 1 -- 172.21.15.153:0/4190130640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efbdc004800 msgr2=0x7efbdc004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T21:52:04.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.001+0000 7efbfda00640 1 --2- 172.21.15.153:0/4190130640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efbdc004800 0x7efbdc004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.001+0000 7efbfda00640 1 -- 172.21.15.153:0/4190130640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbdc003a00 msgr2=0x7efbdc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:04.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.001+0000 7efbfda00640 1 --2- 172.21.15.153:0/4190130640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbdc003a00 0x7efbdc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.001+0000 7efbfda00640 1 -- 172.21.15.153:0/4190130640 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbdc003520 con 0x7efbdc0052e0 2024-03-28T21:52:04.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.003+0000 7efbfda00640 1 -- 172.21.15.153:0/4190130640 reap_dead start 2024-03-28T21:52:04.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.006+0000 7efbfda00640 1 --2- 172.21.15.153:0/4190130640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efbdc0052e0 0x7efbdc00b9c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efbe4001eb0 tx=0x7efbdc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80bfed186dd0208b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.010+0000 7efbf7400640 1 -- 172.21.15.153:0/4190130640 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe4007c80 con 0x7efbdc0052e0 2024-03-28T21:52:04.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.010+0000 7efbf7400640 1 -- 172.21.15.153:0/4190130640 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbe4030070 con 0x7efbdc0052e0 2024-03-28T21:52:04.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.010+0000 7efbf7400640 1 -- 172.21.15.153:0/4190130640 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe4005d30 con 0x7efbdc0052e0 2024-03-28T21:52:04.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.011+0000 7efbffa00640 1 -- 172.21.15.153:0/4190130640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efbdc0052e0 msgr2=0x7efbdc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.011+0000 7efbffa00640 1 --2- 172.21.15.153:0/4190130640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efbdc0052e0 0x7efbdc00b9c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efbe4001eb0 tx=0x7efbdc005830 comp rx=0 tx=0).stop 2024-03-28T21:52:04.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.014+0000 7efbffa00640 1 -- 172.21.15.153:0/4190130640 shutdown_connections 2024-03-28T21:52:04.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.014+0000 7efbffa00640 1 --2- 172.21.15.153:0/4190130640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efbdc0052e0 0x7efbdc00b9c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.014+0000 7efbffa00640 1 -- 172.21.15.153:0/4190130640 >> 172.21.15.153:0/4190130640 conn(0x7efbf809d430 msgr2=0x7efbf80d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.014+0000 7efbffa00640 1 -- 172.21.15.153:0/4190130640 shutdown_connections 2024-03-28T21:52:04.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.014+0000 7efbffa00640 1 -- 172.21.15.153:0/4190130640 wait complete. 2024-03-28T21:52:04.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.017+0000 7efbffa00640 1 Processor -- start 2024-03-28T21:52:04.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.020+0000 7efbffa00640 1 -- start start 2024-03-28T21:52:04.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.022+0000 7efbffa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efbdc0052e0 0x7efbf80b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.022+0000 7efbffa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbf80b9bb0 0x7efbf80cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.023+0000 7efbfd000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efbdc0052e0 0x7efbf80b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.023+0000 7efbfd000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efbdc0052e0 0x7efbf80b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:42934/0 (socket says 172.21.15.153:42934) 2024-03-28T21:52:04.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.023+0000 7efbfd000640 1 -- 172.21.15.153:0/443985084 learned_addr learned my addr 172.21.15.153:0/443985084 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:04.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.023+0000 7efbffa00640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efbf8200640 0x7efbf8200ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.023+0000 7efbffa00640 1 -- 172.21.15.153:0/443985084 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efbf8161cc0 con 0x7efbf80b9bb0 2024-03-28T21:52:04.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.023+0000 7efbffa00640 1 -- 172.21.15.153:0/443985084 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efbf8161b40 con 0x7efbf8200640 2024-03-28T21:52:04.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.024+0000 7efbffa00640 1 -- 172.21.15.153:0/443985084 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efbf8161e40 con 0x7efbdc0052e0 2024-03-28T21:52:04.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.024+0000 7efbfda00640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efbf8200640 0x7efbf8200ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.024+0000 7efbf7e00640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbf80b9bb0 0x7efbf80cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.024+0000 7efbfd000640 1 -- 172.21.15.153:0/443985084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efbf8200640 msgr2=0x7efbf8200ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.024+0000 7efbfd000640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efbf8200640 0x7efbf8200ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.024+0000 7efbfd000640 1 -- 172.21.15.153:0/443985084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbf80b9bb0 msgr2=0x7efbf80cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.026+0000 7efbfd000640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbf80b9bb0 0x7efbf80cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.026+0000 7efbfd000640 1 -- 172.21.15.153:0/443985084 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf80ba030 con 0x7efbdc0052e0 2024-03-28T21:52:04.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.026+0000 7efbf7e00640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbf80b9bb0 0x7efbf80cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:04.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.030+0000 7efbfd000640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efbdc0052e0 0x7efbf80b6d80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efbf000eee0 tx=0x7efbf000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.030+0000 7efbf4c00640 1 -- 172.21.15.153:0/443985084 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf0008030 con 0x7efbdc0052e0 2024-03-28T21:52:04.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.030+0000 7efbf4c00640 1 -- 172.21.15.153:0/443985084 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf0006e50 con 0x7efbdc0052e0 2024-03-28T21:52:04.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.030+0000 7efbf4c00640 1 -- 172.21.15.153:0/443985084 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf0003970 con 0x7efbdc0052e0 2024-03-28T21:52:04.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.031+0000 7efbffa00640 1 -- 172.21.15.153:0/443985084 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbf80cb3b0 con 0x7efbdc0052e0 2024-03-28T21:52:04.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.031+0000 7efbffa00640 1 -- 172.21.15.153:0/443985084 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efbf80cb950 con 0x7efbdc0052e0 2024-03-28T21:52:04.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.033+0000 7f0f6b800640 1 Processor -- start 2024-03-28T21:52:04.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.033+0000 7f0f6b800640 1 -- start start 2024-03-28T21:52:04.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.035+0000 7f0f6b800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0f6416bed0 0x7f0f64170340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.035+0000 7f0f6b800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6406e550 0x7f0f6406e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.035+0000 7f0f6b800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6408bdf0 con 0x7f0f6408b2e0 2024-03-28T21:52:04.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.035+0000 7f0f6b800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0f640b4140 con 0x7f0f6416bed0 2024-03-28T21:52:04.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.035+0000 7f0f6b800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6406c150 con 0x7f0f6406e550 2024-03-28T21:52:04.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.036+0000 7f0f68e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0f6416bed0 0x7f0f64170340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.036+0000 7f0f68e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0f6416bed0 0x7f0f64170340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:45274/0 (socket says 172.21.15.153:45274) 2024-03-28T21:52:04.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.036+0000 7f0f68e00640 1 -- 172.21.15.153:0/2766690826 learned_addr learned my addr 172.21.15.153:0/2766690826 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:04.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.037+0000 7f0f68e00640 1 -- 172.21.15.153:0/2766690826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6406e550 msgr2=0x7f0f6406e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:04.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.037+0000 7efbffa00640 1 -- 172.21.15.153:0/443985084 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbd0005290 con 0x7efbdc0052e0 2024-03-28T21:52:04.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.038+0000 7f0f63400640 1 -- 172.21.15.153:0/2766690826 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1456336982 0 0) 0x7f0f6408bdf0 con 0x7f0f6408b2e0 2024-03-28T21:52:04.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.038+0000 7efbf4c00640 1 -- 172.21.15.153:0/443985084 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7efbf001d020 con 0x7efbdc0052e0 2024-03-28T21:52:04.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.039+0000 7f0f69800640 1 --2- 172.21.15.153:0/2766690826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6406e550 0x7f0f6406e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.039+0000 7f0f68e00640 1 --2- 172.21.15.153:0/2766690826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6406e550 0x7f0f6406e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.039+0000 7f0f68e00640 1 -- 172.21.15.153:0/2766690826 >> v1:172.21.15.153:6789/0 conn(0x7f0f6408b2e0 legacy=0x7f0f640b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.039+0000 7f0f68e00640 1 -- 172.21.15.153:0/2766690826 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6408b830 con 0x7f0f6416bed0 2024-03-28T21:52:04.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.039+0000 7f0f69800640 1 --2- 172.21.15.153:0/2766690826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6406e550 0x7f0f6406e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:04.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.040+0000 7f1e40400640 1 Processor -- start 2024-03-28T21:52:04.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.040+0000 7f1e40400640 1 -- start start 2024-03-28T21:52:04.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.041+0000 7f0f68e00640 1 --2- 172.21.15.153:0/2766690826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6416bed0 0x7f0f64170340 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009870 tx=0x7f0f5002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d3762392946e547 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.041+0000 7f0f63400640 1 -- 172.21.15.153:0/2766690826 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50035020 con 0x7f0f6416bed0 2024-03-28T21:52:04.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.040+0000 7efbf4c00640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efbd806b4d0 0x7efbd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.042+0000 7efbf4c00640 1 -- 172.21.15.153:0/443985084 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efbf008a2c0 con 0x7efbdc0052e0 2024-03-28T21:52:04.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.042+0000 7efbf7e00640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efbd806b4d0 0x7efbd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.041+0000 7f0f63400640 1 -- 172.21.15.153:0/2766690826 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f50031640 con 0x7f0f6416bed0 2024-03-28T21:52:04.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.041+0000 7f0f63400640 1 -- 172.21.15.153:0/2766690826 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5002d040 con 0x7f0f6416bed0 2024-03-28T21:52:04.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.042+0000 7f1e40400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e300ead00 0x7f1e3004fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.043+0000 7f1e40400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e30053720 con 0x7f1e30006ea0 2024-03-28T21:52:04.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.043+0000 7f1e40400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e30053a00 con 0x7f1e3004ffd0 2024-03-28T21:52:04.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.043+0000 7f1e40400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1e30054330 con 0x7f1e300ead00 2024-03-28T21:52:04.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.042+0000 7f0f6b800640 1 -- 172.21.15.153:0/2766690826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6416bed0 msgr2=0x7f0f64170340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.042+0000 7f0f6b800640 1 --2- 172.21.15.153:0/2766690826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6416bed0 0x7f0f64170340 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009870 tx=0x7f0f5002b8f0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.043+0000 7f0f6b800640 1 -- 172.21.15.153:0/2766690826 shutdown_connections 2024-03-28T21:52:04.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.043+0000 7f0f6b800640 1 --2- 172.21.15.153:0/2766690826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6406e550 0x7f0f6406e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.043+0000 7f1e3e400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1e30006ea0 0x7f1e300382e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54616/0 (socket says 172.21.15.153:54616) 2024-03-28T21:52:04.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.043+0000 7f1e3e400640 1 -- 172.21.15.153:0/3580626871 learned_addr learned my addr 172.21.15.153:0/3580626871 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:04.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.043+0000 7f0f6b800640 1 --2- 172.21.15.153:0/2766690826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6416bed0 0x7f0f64170340 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.044+0000 7f1e37e00640 1 -- 172.21.15.153:0/3580626871 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3501918982 0 0) 0x7f1e30053720 con 0x7f1e30006ea0 2024-03-28T21:52:04.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.044+0000 7f1e37e00640 1 -- 172.21.15.153:0/3580626871 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e20003520 con 0x7f1e30006ea0 2024-03-28T21:52:04.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.044+0000 7f1e3da00640 1 --2- 172.21.15.153:0/3580626871 >> v2:172.21.15.153:3300/0 conn(0x7f1e300ead00 0x7f1e3004fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.045+0000 7f1e37e00640 1 -- 172.21.15.153:0/3580626871 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1907696553 0 0) 0x7f1e20003520 con 0x7f1e30006ea0 2024-03-28T21:52:04.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.045+0000 7f1e37e00640 1 -- 172.21.15.153:0/3580626871 >> v2:172.21.15.153:3300/0 conn(0x7f1e300ead00 msgr2=0x7f1e3004fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:04.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.046+0000 7f1e37e00640 1 --2- 172.21.15.153:0/3580626871 >> v2:172.21.15.153:3300/0 conn(0x7f1e300ead00 0x7f1e3004fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.046+0000 7f1e37e00640 1 -- 172.21.15.153:0/3580626871 >> v1:172.21.15.165:6789/0 conn(0x7f1e3004ffd0 legacy=0x7f1e30037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:04.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.046+0000 7f1e37e00640 1 -- 172.21.15.153:0/3580626871 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e30053ce0 con 0x7f1e30006ea0 2024-03-28T21:52:04.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.046+0000 7f1e3da00640 1 --2- 172.21.15.153:0/3580626871 >> v2:172.21.15.153:3300/0 conn(0x7f1e300ead00 0x7f1e3004fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:52:04.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.046+0000 7f1e37e00640 1 -- 172.21.15.153:0/3580626871 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f1e380755e0 con 0x7f1e30006ea0 2024-03-28T21:52:04.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.046+0000 7f1e37e00640 1 -- 172.21.15.153:0/3580626871 >> v1:172.21.15.153:6789/0 conn(0x7f1e30006ea0 legacy=0x7f1e300382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.045+0000 7efbf7e00640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efbd806b4d0 0x7efbd806d990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efbf8072870 tx=0x7efbe8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.046+0000 7f1e37e00640 1 --2- 172.21.15.153:0/3580626871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e200039b0 0x7f1e20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.046+0000 7f1e37e00640 1 --2- 172.21.15.153:0/3580626871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e20004350 0x7f1e20004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.046+0000 7f1e37e00640 1 --2- 172.21.15.153:0/3580626871 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e20004fd0 0x7f1e2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.046+0000 7f1e37e00640 1 -- 172.21.15.153:0/3580626871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1e30054330 con 0x7f1e20004350 2024-03-28T21:52:04.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.043+0000 7f0f6b800640 1 -- 172.21.15.153:0/2766690826 >> 172.21.15.153:0/2766690826 conn(0x7f0f6406b170 msgr2=0x7f0f6406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.043+0000 7f0f6b800640 1 -- 172.21.15.153:0/2766690826 shutdown_connections 2024-03-28T21:52:04.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.043+0000 7f0f6b800640 1 -- 172.21.15.153:0/2766690826 wait complete. 2024-03-28T21:52:04.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.046+0000 7f1e37e00640 1 -- 172.21.15.153:0/3580626871 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2000bfc0 con 0x7f1e200039b0 2024-03-28T21:52:04.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.046+0000 7f1e37e00640 1 -- 172.21.15.153:0/3580626871 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1e2000c1c0 con 0x7f1e20004fd0 2024-03-28T21:52:04.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.047+0000 7f1e3d000640 1 --2- 172.21.15.153:0/3580626871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e20004350 0x7f1e20004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.047+0000 7f1e3d000640 1 -- 172.21.15.153:0/3580626871 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e20004fd0 msgr2=0x7f1e2000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:04.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.047+0000 7f1e3da00640 1 --2- 172.21.15.153:0/3580626871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e200039b0 0x7f1e20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.047+0000 7f1e3e400640 1 --2- 172.21.15.153:0/3580626871 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e20004fd0 0x7f1e2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.047+0000 7f1e3d000640 1 --2- 172.21.15.153:0/3580626871 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e20004fd0 0x7f1e2000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.047+0000 7f1e3d000640 1 -- 172.21.15.153:0/3580626871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e200039b0 msgr2=0x7f1e20003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:04.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.047+0000 7f1e3d000640 1 --2- 172.21.15.153:0/3580626871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e200039b0 0x7f1e20003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.047+0000 7f1e3d000640 1 -- 172.21.15.153:0/3580626871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e30053ce0 con 0x7f1e20004350 2024-03-28T21:52:04.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.048+0000 7f1e3e400640 1 --2- 172.21.15.153:0/3580626871 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e20004fd0 0x7f1e2000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:04.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.048+0000 7f1e3e400640 1 -- 172.21.15.153:0/3580626871 reap_dead start 2024-03-28T21:52:04.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.049+0000 7f0f6b800640 1 Processor -- start 2024-03-28T21:52:04.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.050+0000 7f0f6b800640 1 -- start start 2024-03-28T21:52:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.049+0000 7f1e3d000640 1 --2- 172.21.15.153:0/3580626871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e20004350 0x7f1e20004820 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1e24001650 tx=0x7f1e20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c39f0f1cf1f164 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.050+0000 7f1e37e00640 1 -- 172.21.15.153:0/3580626871 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e24001220 con 0x7f1e20004350 2024-03-28T21:52:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.050+0000 7f1e37e00640 1 -- 172.21.15.153:0/3580626871 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e24005290 con 0x7f1e20004350 2024-03-28T21:52:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.050+0000 7f1e37e00640 1 -- 172.21.15.153:0/3580626871 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e24003850 con 0x7f1e20004350 2024-03-28T21:52:04.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.051+0000 7f1e40400640 1 -- 172.21.15.153:0/3580626871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e20004350 msgr2=0x7f1e20004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.051+0000 7f1e40400640 1 --2- 172.21.15.153:0/3580626871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e20004350 0x7f1e20004820 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1e24001650 tx=0x7f1e20005830 comp rx=0 tx=0).stop 2024-03-28T21:52:04.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.051+0000 7f1e40400640 1 -- 172.21.15.153:0/3580626871 shutdown_connections 2024-03-28T21:52:04.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.051+0000 7f1e40400640 1 --2- 172.21.15.153:0/3580626871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e20004350 0x7f1e20004820 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.051+0000 7f1e40400640 1 -- 172.21.15.153:0/3580626871 >> 172.21.15.153:0/3580626871 conn(0x7f1e30009fb0 msgr2=0x7f1e3000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.052+0000 7f0f6b800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f6406e550 0x7f0f6417b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.052+0000 7f0f6b800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6408b2e0 0x7f0f640ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.052+0000 7f0f68e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f6406e550 0x7f0f6417b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.053+0000 7f0f68e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f6406e550 0x7f0f6417b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45652/0 (socket says 172.21.15.153:45652) 2024-03-28T21:52:04.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.053+0000 7f0f68e00640 1 -- 172.21.15.153:0/2085961097 learned_addr learned my addr 172.21.15.153:0/2085961097 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:04.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.053+0000 7f0f63e00640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6408b2e0 0x7f0f640ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.053+0000 7f1e40400640 1 -- 172.21.15.153:0/3580626871 shutdown_connections 2024-03-28T21:52:04.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.054+0000 7f1e40400640 1 -- 172.21.15.153:0/3580626871 wait complete. 2024-03-28T21:52:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.054+0000 7f0f6b800640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6416bed0 0x7f0f6416cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.054+0000 7f0f6b800640 1 -- 172.21.15.153:0/2085961097 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6406cd70 con 0x7f0f6406e550 2024-03-28T21:52:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.054+0000 7f0f6b800640 1 -- 172.21.15.153:0/2085961097 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0f640b3dd0 con 0x7f0f6408b2e0 2024-03-28T21:52:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.054+0000 7f0f6b800640 1 -- 172.21.15.153:0/2085961097 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6406cef0 con 0x7f0f6416bed0 2024-03-28T21:52:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.054+0000 7f0f69800640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6416bed0 0x7f0f6416cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.055+0000 7f0f69800640 1 -- 172.21.15.153:0/2085961097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6408b2e0 msgr2=0x7f0f640ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.055+0000 7f0f69800640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6408b2e0 0x7f0f640ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.055+0000 7f0f69800640 1 -- 172.21.15.153:0/2085961097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f6406e550 msgr2=0x7f0f6417b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.055+0000 7f0f69800640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f6406e550 0x7f0f6417b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.055+0000 7f0f69800640 1 -- 172.21.15.153:0/2085961097 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f640cdae0 con 0x7f0f6416bed0 2024-03-28T21:52:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.056+0000 7f0f68e00640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f6406e550 0x7f0f6417b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.056+0000 7f0f63e00640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6408b2e0 0x7f0f640ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.056+0000 7f0f69800640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6416bed0 0x7f0f6416cfd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00cdf0 tx=0x7f0f5c00a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.057+0000 7f1e40400640 1 Processor -- start 2024-03-28T21:52:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.057+0000 7f1e40400640 1 -- start start 2024-03-28T21:52:04.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.058+0000 7efbf4c00640 1 -- 172.21.15.153:0/443985084 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7efbf0059130 con 0x7efbdc0052e0 2024-03-28T21:52:04.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.059+0000 7f1e40400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e20004350 0x7f1e300dafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.059+0000 7f1e40400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e30043680 0x7f1e3004bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.059+0000 7f1e3da00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e20004350 0x7f1e300dafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.060+0000 7f0f60c00640 1 -- 172.21.15.153:0/2085961097 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c01a070 con 0x7f0f6416bed0 2024-03-28T21:52:04.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.060+0000 7f1e3da00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e20004350 0x7f1e300dafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45654/0 (socket says 172.21.15.153:45654) 2024-03-28T21:52:04.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.060+0000 7f1e3da00640 1 -- 172.21.15.153:0/1593806141 learned_addr learned my addr 172.21.15.153:0/1593806141 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:04.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.060+0000 7f1e40400640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e30043b00 0x7f1e3004a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.060+0000 7f0f60c00640 1 -- 172.21.15.153:0/2085961097 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f5c00d840 con 0x7f0f6416bed0 2024-03-28T21:52:04.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.060+0000 7f0f60c00640 1 -- 172.21.15.153:0/2085961097 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00dc30 con 0x7f0f6416bed0 2024-03-28T21:52:04.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.060+0000 7f1e3d000640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e30043680 0x7f1e3004bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.061+0000 7f1e40400640 1 -- 172.21.15.153:0/1593806141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1e30054940 con 0x7f1e20004350 2024-03-28T21:52:04.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.061+0000 7f1e3e400640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e30043b00 0x7f1e3004a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.061+0000 7f1e40400640 1 -- 172.21.15.153:0/1593806141 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1e300547c0 con 0x7f1e30043680 2024-03-28T21:52:04.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.061+0000 7f1e40400640 1 -- 172.21.15.153:0/1593806141 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3004f550 con 0x7f1e30043b00 2024-03-28T21:52:04.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.063+0000 7f1e3da00640 1 -- 172.21.15.153:0/1593806141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e30043b00 msgr2=0x7f1e3004a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.063+0000 7f1e3da00640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e30043b00 0x7f1e3004a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.063+0000 7f1e3da00640 1 -- 172.21.15.153:0/1593806141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e30043680 msgr2=0x7f1e3004bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.063+0000 7f1e3da00640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e30043680 0x7f1e3004bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.063+0000 7f1e3da00640 1 -- 172.21.15.153:0/1593806141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e300db4e0 con 0x7f1e20004350 2024-03-28T21:52:04.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.064+0000 7f1e3e400640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e30043b00 0x7f1e3004a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:52:04.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.065+0000 7f0f6b800640 1 -- 172.21.15.153:0/2085961097 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f640cddc0 con 0x7f0f6416bed0 2024-03-28T21:52:04.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.065+0000 7f0f6b800640 1 -- 172.21.15.153:0/2085961097 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f640ce380 con 0x7f0f6416bed0 2024-03-28T21:52:04.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.065+0000 7f1e3da00640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e20004350 0x7f1e300dafa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0109d0 tx=0x7f1e2c010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.065+0000 7f1e35600640 1 -- 172.21.15.153:0/1593806141 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c00f040 con 0x7f1e20004350 2024-03-28T21:52:04.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.065+0000 7f1e35600640 1 -- 172.21.15.153:0/1593806141 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2c00ec80 con 0x7f1e20004350 2024-03-28T21:52:04.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.065+0000 7f1e35600640 1 -- 172.21.15.153:0/1593806141 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c01c400 con 0x7f1e20004350 2024-03-28T21:52:04.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.066+0000 7f1e40400640 1 -- 172.21.15.153:0/1593806141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e3004c610 con 0x7f1e20004350 2024-03-28T21:52:04.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.066+0000 7f1e40400640 1 -- 172.21.15.153:0/1593806141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e3004cbd0 con 0x7f1e20004350 2024-03-28T21:52:04.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.070+0000 7f1e2aa00640 1 -- 172.21.15.153:0/1593806141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e0c005290 con 0x7f1e20004350 2024-03-28T21:52:04.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.068+0000 7f0f6b800640 1 -- 172.21.15.153:0/2085961097 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f64068ff0 con 0x7f0f6416bed0 2024-03-28T21:52:04.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.071+0000 7f0f60c00640 1 -- 172.21.15.153:0/2085961097 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0f5c01d070 con 0x7f0f6416bed0 2024-03-28T21:52:04.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.076+0000 7f1e35600640 1 -- 172.21.15.153:0/1593806141 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f1e2c01c5a0 con 0x7f1e20004350 2024-03-28T21:52:04.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.076+0000 7f0f60c00640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0f4406b4d0 0x7f0f4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.077+0000 7f0f60c00640 1 -- 172.21.15.153:0/2085961097 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0f5c08a860 con 0x7f0f6416bed0 2024-03-28T21:52:04.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.079+0000 7f0f68e00640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0f4406b4d0 0x7f0f4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.081+0000 7f0f68e00640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0f4406b4d0 0x7f0f4406d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009630 tx=0x7f0f5003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.081+0000 7f1e35600640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1e1806b5d0 0x7f1e1806da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:04.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.081+0000 7f1e35600640 1 -- 172.21.15.153:0/1593806141 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1e2c08a8a0 con 0x7f1e20004350 2024-03-28T21:52:04.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.085+0000 7f1e3d000640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1e1806b5d0 0x7f1e1806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:04.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.087+0000 7f1e3d000640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1e1806b5d0 0x7f1e1806da90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1e24033000 tx=0x7f1e24009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:04.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.087+0000 7f0f60c00640 1 -- 172.21.15.153:0/2085961097 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0f5c059080 con 0x7f0f6416bed0 2024-03-28T21:52:04.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.087+0000 7f1e35600640 1 -- 172.21.15.153:0/1593806141 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1e2c018030 con 0x7f1e20004350 2024-03-28T21:52:04.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.315+0000 7fccafe00640 1 -- 172.21.15.153:0/1094752617 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcca803a500 con 0x7fcca80e7710 2024-03-28T21:52:04.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.318+0000 7fcca6a00640 1 -- 172.21.15.153:0/1094752617 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fccb00d3a70 con 0x7fcca80e7710 2024-03-28T21:52:04.324 INFO:teuthology.orchestra.run.smithi153.stdout:60129542147 2024-03-28T21:52:04.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.328+0000 7fccafe00640 1 -- 172.21.15.153:0/1094752617 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcc9006b700 msgr2=0x7fcc9006dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.328+0000 7fccafe00640 1 --2- 172.21.15.153:0/1094752617 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcc9006b700 0x7fcc9006dbc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c000f60 tx=0x7fcc9c0079b0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.328+0000 7fccafe00640 1 -- 172.21.15.153:0/1094752617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca80e7710 msgr2=0x7fcca80d2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.328+0000 7fccafe00640 1 --2- 172.21.15.153:0/1094752617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca80e7710 0x7fcca80d2bc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fccb007a7f0 tx=0x7fccb0068ca0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.331+0000 7fccafe00640 1 -- 172.21.15.153:0/1094752617 shutdown_connections 2024-03-28T21:52:04.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.331+0000 7fccafe00640 1 --2- 172.21.15.153:0/1094752617 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcc9006b700 0x7fcc9006dbc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.331+0000 7fccafe00640 1 --2- 172.21.15.153:0/1094752617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca80e7710 0x7fcca80d2bc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.331+0000 7fccafe00640 1 --2- 172.21.15.153:0/1094752617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcca80589c0 0x7fcca80d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.331+0000 7fccafe00640 1 --2- 172.21.15.153:0/1094752617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcca8056ab0 0x7fcca80ea2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.331+0000 7fccafe00640 1 -- 172.21.15.153:0/1094752617 >> 172.21.15.153:0/1094752617 conn(0x7fcca8058ee0 msgr2=0x7fcca80592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.331+0000 7fccafe00640 1 -- 172.21.15.153:0/1094752617 shutdown_connections 2024-03-28T21:52:04.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.331+0000 7fccafe00640 1 -- 172.21.15.153:0/1094752617 wait complete. 2024-03-28T21:52:04.387 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.0 2024-03-28T21:52:04.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.401+0000 7fd78fc00640 1 -- 172.21.15.153:0/3110879705 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd78806ec40 con 0x7fd78815a4a0 2024-03-28T21:52:04.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.402+0000 7fd785600640 1 -- 172.21.15.153:0/3110879705 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd77007f040 con 0x7fd78815a4a0 2024-03-28T21:52:04.410 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2024-03-28T21:52:04.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.406+0000 7fd78fc00640 1 -- 172.21.15.153:0/3110879705 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd76406b4d0 msgr2=0x7fd76406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.406+0000 7fd78fc00640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd76406b4d0 0x7fd76406d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd778006fd0 tx=0x7fd778008040 comp rx=0 tx=0).stop 2024-03-28T21:52:04.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.406+0000 7fd78fc00640 1 -- 172.21.15.153:0/3110879705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78815a4a0 msgr2=0x7fd7880aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.406+0000 7fd78fc00640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78815a4a0 0x7fd7880aef40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd77002bf30 tx=0x7fd770004730 comp rx=0 tx=0).stop 2024-03-28T21:52:04.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.406+0000 7fd78fc00640 1 -- 172.21.15.153:0/3110879705 shutdown_connections 2024-03-28T21:52:04.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.406+0000 7fd78fc00640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd76406b4d0 0x7fd76406d990 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd778006fd0 tx=0x7fd778008040 comp rx=0 tx=0).stop 2024-03-28T21:52:04.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.406+0000 7fd78fc00640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7881e36b0 0x7fd7881f0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.406+0000 7fd78fc00640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78815a4a0 0x7fd7880aef40 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd77002bf30 tx=0x7fd770004730 comp rx=0 tx=0).stop 2024-03-28T21:52:04.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.406+0000 7fd78fc00640 1 --2- 172.21.15.153:0/3110879705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7880b41e0 0x7fd7881e64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.406+0000 7fd78fc00640 1 -- 172.21.15.153:0/3110879705 >> 172.21.15.153:0/3110879705 conn(0x7fd78806b170 msgr2=0x7fd78815d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.407+0000 7fd78fc00640 1 -- 172.21.15.153:0/3110879705 shutdown_connections 2024-03-28T21:52:04.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.408+0000 7fd78fc00640 1 -- 172.21.15.153:0/3110879705 wait complete. 2024-03-28T21:52:04.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.431+0000 7fdf9d600640 1 -- 172.21.15.153:0/3769898981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fdf70005580 con 0x7fdf9815e400 2024-03-28T21:52:04.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.433+0000 7fdf8ea00640 1 -- 172.21.15.153:0/3769898981 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdf9005bf20 con 0x7fdf9815e400 2024-03-28T21:52:04.435 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2024-03-28T21:52:04.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.437+0000 7fdf9d600640 1 -- 172.21.15.153:0/3769898981 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdf7806b5a0 msgr2=0x7fdf7806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.437+0000 7fdf9d600640 1 --2- 172.21.15.153:0/3769898981 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdf7806b5a0 0x7fdf7806da60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdf880097a0 tx=0x7fdf8803b040 comp rx=0 tx=0).stop 2024-03-28T21:52:04.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.437+0000 7fdf9d600640 1 -- 172.21.15.153:0/3769898981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf9815e400 msgr2=0x7fdf981f1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.437+0000 7fdf9d600640 1 --2- 172.21.15.153:0/3769898981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf9815e400 0x7fdf981f1310 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000c700 tx=0x7fdf9000cbc0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.438+0000 7fdf9d600640 1 -- 172.21.15.153:0/3769898981 shutdown_connections 2024-03-28T21:52:04.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.438+0000 7fdf9d600640 1 --2- 172.21.15.153:0/3769898981 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdf7806b5a0 0x7fdf7806da60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.438+0000 7fdf9d600640 1 --2- 172.21.15.153:0/3769898981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf9815e400 0x7fdf981f1310 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.438+0000 7fdf9d600640 1 --2- 172.21.15.153:0/3769898981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf980d2c80 0x7fdf9815b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.438+0000 7fdf9d600640 1 --2- 172.21.15.153:0/3769898981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf980d1d50 0x7fdf981f0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.438+0000 7fdf9d600640 1 -- 172.21.15.153:0/3769898981 >> 172.21.15.153:0/3769898981 conn(0x7fdf9809d4c0 msgr2=0x7fdf9806bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.440+0000 7fdf9d600640 1 -- 172.21.15.153:0/3769898981 shutdown_connections 2024-03-28T21:52:04.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.440+0000 7fdf9d600640 1 -- 172.21.15.153:0/3769898981 wait complete. 2024-03-28T21:52:04.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.4 2024-03-28T21:52:04.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.447+0000 7f9933400640 1 -- 172.21.15.153:0/1565159422 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9908005580 con 0x7f992c0b2240 2024-03-28T21:52:04.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.448+0000 7f9928c00640 1 -- 172.21.15.153:0/1565159422 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9920079cf0 con 0x7f992c0b2240 2024-03-28T21:52:04.450 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2024-03-28T21:52:04.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.450+0000 7f9933400640 1 -- 172.21.15.153:0/1565159422 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f990c06b6d0 msgr2=0x7f990c06db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.450+0000 7f9933400640 1 --2- 172.21.15.153:0/1565159422 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f990c06b6d0 0x7f990c06db90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9918000f60 tx=0x7f9918009040 comp rx=0 tx=0).stop 2024-03-28T21:52:04.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.451+0000 7f9933400640 1 -- 172.21.15.153:0/1565159422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f992c0b2240 msgr2=0x7f992c150f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.451+0000 7f9933400640 1 --2- 172.21.15.153:0/1565159422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f992c0b2240 0x7f992c150f60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f99200098c0 tx=0x7f99200046c0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.451+0000 7f9933400640 1 -- 172.21.15.153:0/1565159422 shutdown_connections 2024-03-28T21:52:04.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.451+0000 7f9933400640 1 --2- 172.21.15.153:0/1565159422 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f990c06b6d0 0x7f990c06db90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.451+0000 7f9933400640 1 --2- 172.21.15.153:0/1565159422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f992c140db0 0x7f992c1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.451+0000 7f9933400640 1 --2- 172.21.15.153:0/1565159422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f992c0b2240 0x7f992c150f60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.451+0000 7f9933400640 1 --2- 172.21.15.153:0/1565159422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f992c0723a0 0x7f992c16b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.451+0000 7f9933400640 1 -- 172.21.15.153:0/1565159422 >> 172.21.15.153:0/1565159422 conn(0x7f992c0b1720 msgr2=0x7f992c13b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.451+0000 7f9933400640 1 -- 172.21.15.153:0/1565159422 shutdown_connections 2024-03-28T21:52:04.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.451+0000 7f9933400640 1 -- 172.21.15.153:0/1565159422 wait complete. 2024-03-28T21:52:04.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.457+0000 7ff0f5200640 1 -- 172.21.15.153:0/874951261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff0f004f520 con 0x7ff0f00b33e0 2024-03-28T21:52:04.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.457+0000 7ff0e6000640 1 -- 172.21.15.153:0/874951261 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff0dc07e940 con 0x7ff0f00b33e0 2024-03-28T21:52:04.460 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2024-03-28T21:52:04.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.461+0000 7ff0f5200640 1 -- 172.21.15.153:0/874951261 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff0d006b4d0 msgr2=0x7ff0d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.462+0000 7ff0f5200640 1 --2- 172.21.15.153:0/874951261 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff0d006b4d0 0x7ff0d006d990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80043c0 tx=0x7ff0e8007d30 comp rx=0 tx=0).stop 2024-03-28T21:52:04.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.462+0000 7ff0f5200640 1 -- 172.21.15.153:0/874951261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f00b33e0 msgr2=0x7ff0f00cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.462+0000 7ff0f5200640 1 --2- 172.21.15.153:0/874951261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f00b33e0 0x7ff0f00cd2a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc033000 tx=0x7ff0dc0046c0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.462+0000 7ff0f5200640 1 -- 172.21.15.153:0/874951261 shutdown_connections 2024-03-28T21:52:04.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.462+0000 7ff0f5200640 1 --2- 172.21.15.153:0/874951261 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff0d006b4d0 0x7ff0d006d990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.462+0000 7ff0f5200640 1 --2- 172.21.15.153:0/874951261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0f0136bd0 0x7ff0f0138440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.462+0000 7ff0f5200640 1 --2- 172.21.15.153:0/874951261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0f015b9f0 0x7ff0f0136690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.462+0000 7ff0f5200640 1 --2- 172.21.15.153:0/874951261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f00b33e0 0x7ff0f00cd2a0 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc033000 tx=0x7ff0dc0046c0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.462+0000 7ff0f5200640 1 -- 172.21.15.153:0/874951261 >> 172.21.15.153:0/874951261 conn(0x7ff0f00b1720 msgr2=0x7ff0f0070c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.462+0000 7efbffa00640 1 -- 172.21.15.153:0/443985084 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efbd0005580 con 0x7efbdc0052e0 2024-03-28T21:52:04.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.462+0000 7ff0f5200640 1 -- 172.21.15.153:0/874951261 shutdown_connections 2024-03-28T21:52:04.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.463+0000 7ff0f5200640 1 -- 172.21.15.153:0/874951261 wait complete. 2024-03-28T21:52:04.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.464+0000 7efbf4c00640 1 -- 172.21.15.153:0/443985084 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efbf0058a30 con 0x7efbdc0052e0 2024-03-28T21:52:04.469 INFO:teuthology.orchestra.run.smithi153.stdout:60129542147 2024-03-28T21:52:04.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.7 2024-03-28T21:52:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.466+0000 7efbffa00640 1 -- 172.21.15.153:0/443985084 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efbd806b4d0 msgr2=0x7efbd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.466+0000 7efbffa00640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efbd806b4d0 0x7efbd806d990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efbf8072870 tx=0x7efbe8009040 comp rx=0 tx=0).stop 2024-03-28T21:52:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.466+0000 7efbffa00640 1 -- 172.21.15.153:0/443985084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efbdc0052e0 msgr2=0x7efbf80b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.466+0000 7efbffa00640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efbdc0052e0 0x7efbf80b6d80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efbf000eee0 tx=0x7efbf000c3a0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.467+0000 7efbffa00640 1 -- 172.21.15.153:0/443985084 shutdown_connections 2024-03-28T21:52:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.467+0000 7efbffa00640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efbd806b4d0 0x7efbd806d990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.467+0000 7efbffa00640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efbf8200640 0x7efbf8200ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.467+0000 7efbffa00640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efbf80b9bb0 0x7efbf80cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.467+0000 7efbffa00640 1 --2- 172.21.15.153:0/443985084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efbdc0052e0 0x7efbf80b6d80 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efbf000eee0 tx=0x7efbf000c3a0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.467+0000 7efbffa00640 1 -- 172.21.15.153:0/443985084 >> 172.21.15.153:0/443985084 conn(0x7efbf809d430 msgr2=0x7efbf81609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.467+0000 7efbffa00640 1 -- 172.21.15.153:0/443985084 shutdown_connections 2024-03-28T21:52:04.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.467+0000 7efbffa00640 1 -- 172.21.15.153:0/443985084 wait complete. 2024-03-28T21:52:04.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.6 2024-03-28T21:52:04.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.1 2024-03-28T21:52:04.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.2 2024-03-28T21:52:04.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.490+0000 7f1e2aa00640 1 -- 172.21.15.153:0/1593806141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1e0c005580 con 0x7f1e20004350 2024-03-28T21:52:04.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.490+0000 7f1e35600640 1 -- 172.21.15.153:0/1593806141 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e2c0590b0 con 0x7f1e20004350 2024-03-28T21:52:04.493 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2024-03-28T21:52:04.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.492+0000 7f1e2aa00640 1 -- 172.21.15.153:0/1593806141 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1e1806b5d0 msgr2=0x7f1e1806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.492+0000 7f1e2aa00640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1e1806b5d0 0x7f1e1806da90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1e24033000 tx=0x7f1e24009030 comp rx=0 tx=0).stop 2024-03-28T21:52:04.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.492+0000 7f1e2aa00640 1 -- 172.21.15.153:0/1593806141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e20004350 msgr2=0x7f1e300dafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.492+0000 7f1e2aa00640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e20004350 0x7f1e300dafa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0109d0 tx=0x7f1e2c010e90 comp rx=0 tx=0).stop 2024-03-28T21:52:04.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.492+0000 7f1e2aa00640 1 -- 172.21.15.153:0/1593806141 shutdown_connections 2024-03-28T21:52:04.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.493+0000 7f1e2aa00640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1e1806b5d0 0x7f1e1806da90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.493+0000 7f1e2aa00640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e30043b00 0x7f1e3004a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.493+0000 7f1e2aa00640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e30043680 0x7f1e3004bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.493+0000 7f1e2aa00640 1 --2- 172.21.15.153:0/1593806141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e20004350 0x7f1e300dafa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.493+0000 7f1e2aa00640 1 -- 172.21.15.153:0/1593806141 >> 172.21.15.153:0/1593806141 conn(0x7f1e30009fb0 msgr2=0x7f1e30049640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.493+0000 7f1e2aa00640 1 -- 172.21.15.153:0/1593806141 shutdown_connections 2024-03-28T21:52:04.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.493+0000 7f1e2aa00640 1 -- 172.21.15.153:0/1593806141 wait complete. 2024-03-28T21:52:04.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.3 2024-03-28T21:52:04.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.544+0000 7f0f6b800640 1 -- 172.21.15.153:0/2085961097 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0f6415e2d0 con 0x7f0f6416bed0 2024-03-28T21:52:04.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.545+0000 7f0f60c00640 1 -- 172.21.15.153:0/2085961097 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0f5c05d120 con 0x7f0f6416bed0 2024-03-28T21:52:04.547 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2024-03-28T21:52:04.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.547+0000 7f0f6b800640 1 -- 172.21.15.153:0/2085961097 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0f4406b4d0 msgr2=0x7f0f4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.547+0000 7f0f6b800640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0f4406b4d0 0x7f0f4406d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009630 tx=0x7f0f5003c040 comp rx=0 tx=0).stop 2024-03-28T21:52:04.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.547+0000 7f0f6b800640 1 -- 172.21.15.153:0/2085961097 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6416bed0 msgr2=0x7f0f6416cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:04.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.547+0000 7f0f6b800640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6416bed0 0x7f0f6416cfd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00cdf0 tx=0x7f0f5c00a710 comp rx=0 tx=0).stop 2024-03-28T21:52:04.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.548+0000 7f0f6b800640 1 -- 172.21.15.153:0/2085961097 shutdown_connections 2024-03-28T21:52:04.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.548+0000 7f0f6b800640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0f4406b4d0 0x7f0f4406d990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.548+0000 7f0f6b800640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6416bed0 0x7f0f6416cfd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.548+0000 7f0f6b800640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6408b2e0 0x7f0f640ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.548+0000 7f0f6b800640 1 --2- 172.21.15.153:0/2085961097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f6406e550 0x7f0f6417b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:04.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.548+0000 7f0f6b800640 1 -- 172.21.15.153:0/2085961097 >> 172.21.15.153:0/2085961097 conn(0x7f0f6406b170 msgr2=0x7f0f6406b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:04.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.548+0000 7f0f6b800640 1 -- 172.21.15.153:0/2085961097 shutdown_connections 2024-03-28T21:52:04.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:04.548+0000 7f0f6b800640 1 -- 172.21.15.153:0/2085961097 wait complete. 2024-03-28T21:52:04.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.5 2024-03-28T21:52:05.388 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-28T21:52:05.444 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-28T21:52:05.470 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-28T21:52:05.481 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-28T21:52:05.492 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-28T21:52:05.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-28T21:52:05.515 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-28T21:52:05.569 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-28T21:52:05.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.646+0000 7f3280000640 1 Processor -- start 2024-03-28T21:52:05.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.648+0000 7f3280000640 1 -- start start 2024-03-28T21:52:05.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.650+0000 7f3280000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3278161990 0x7f32780d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.650+0000 7f3280000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32780d2ad0 0x7f32780cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.650+0000 7f3280000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32780ceca0 con 0x7f32780b3a60 2024-03-28T21:52:05.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.650+0000 7f3280000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f32780d1a20 con 0x7f3278161990 2024-03-28T21:52:05.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.650+0000 7f3280000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f32780d4810 con 0x7f32780d2ad0 2024-03-28T21:52:05.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.650+0000 7f327cc00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f32780b3a60 0x7f32780d23c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54626/0 (socket says 172.21.15.153:54626) 2024-03-28T21:52:05.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.650+0000 7f327cc00640 1 -- 172.21.15.153:0/2180217078 learned_addr learned my addr 172.21.15.153:0/2180217078 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:05.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.652+0000 7f327d600640 1 --2- 172.21.15.153:0/2180217078 >> v2:172.21.15.165:3300/0 conn(0x7f3278161990 0x7f32780d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.653+0000 7f327e000640 1 --2- 172.21.15.153:0/2180217078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32780d2ad0 0x7f32780cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.654+0000 7f327d600640 1 -- 172.21.15.153:0/2180217078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32780d2ad0 msgr2=0x7f32780cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:05.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.654+0000 7f327d600640 1 --2- 172.21.15.153:0/2180217078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32780d2ad0 0x7f32780cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.654+0000 7f327d600640 1 -- 172.21.15.153:0/2180217078 >> v1:172.21.15.153:6789/0 conn(0x7f32780b3a60 legacy=0x7f32780d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.654+0000 7f327d600640 1 -- 172.21.15.153:0/2180217078 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32780d4af0 con 0x7f3278161990 2024-03-28T21:52:05.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.657+0000 7f327d600640 1 --2- 172.21.15.153:0/2180217078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3278161990 0x7f32780d14e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f32680097a0 tx=0x7f326802b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53362bf2c6276932 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.658+0000 7f3277e00640 1 -- 172.21.15.153:0/2180217078 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3268037070 con 0x7f3278161990 2024-03-28T21:52:05.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.658+0000 7f3277e00640 1 -- 172.21.15.153:0/2180217078 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3268030710 con 0x7f3278161990 2024-03-28T21:52:05.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.658+0000 7f3277e00640 1 -- 172.21.15.153:0/2180217078 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3268030b20 con 0x7f3278161990 2024-03-28T21:52:05.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.660+0000 7f3280000640 1 -- 172.21.15.153:0/2180217078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3278161990 msgr2=0x7f32780d14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.660+0000 7f3280000640 1 --2- 172.21.15.153:0/2180217078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3278161990 0x7f32780d14e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f32680097a0 tx=0x7f326802b730 comp rx=0 tx=0).stop 2024-03-28T21:52:05.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.660+0000 7f3280000640 1 -- 172.21.15.153:0/2180217078 shutdown_connections 2024-03-28T21:52:05.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.660+0000 7f3280000640 1 --2- 172.21.15.153:0/2180217078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32780d2ad0 0x7f32780cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.660+0000 7f3280000640 1 --2- 172.21.15.153:0/2180217078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3278161990 0x7f32780d14e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.660+0000 7f3280000640 1 -- 172.21.15.153:0/2180217078 >> 172.21.15.153:0/2180217078 conn(0x7f327809d430 msgr2=0x7f32780d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:05.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.660+0000 7f3280000640 1 -- 172.21.15.153:0/2180217078 shutdown_connections 2024-03-28T21:52:05.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.661+0000 7f3280000640 1 -- 172.21.15.153:0/2180217078 wait complete. 2024-03-28T21:52:05.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.663+0000 7f3280000640 1 Processor -- start 2024-03-28T21:52:05.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.664+0000 7f3280000640 1 -- start start 2024-03-28T21:52:05.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.665+0000 7f3280000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32780b3a60 0x7f32780ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.665+0000 7f3280000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32780d2ad0 0x7f327815c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.666+0000 7f327cc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32780d2ad0 0x7f327815c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.666+0000 7f327cc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32780d2ad0 0x7f327815c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45670/0 (socket says 172.21.15.153:45670) 2024-03-28T21:52:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.666+0000 7f327d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32780b3a60 0x7f32780ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.666+0000 7f327d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32780b3a60 0x7f32780ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:45326/0 (socket says 172.21.15.153:45326) 2024-03-28T21:52:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.666+0000 7f3280000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3278161990 0x7f3278162310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.666+0000 7f327cc00640 1 -- 172.21.15.153:0/1317230613 learned_addr learned my addr 172.21.15.153:0/1317230613 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.666+0000 7f3280000640 1 -- 172.21.15.153:0/1317230613 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32780cf200 con 0x7f32780d2ad0 2024-03-28T21:52:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.666+0000 7f3280000640 1 -- 172.21.15.153:0/1317230613 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f32780cef20 con 0x7f32780b3a60 2024-03-28T21:52:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.666+0000 7f3280000640 1 -- 172.21.15.153:0/1317230613 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f32780b3ec0 con 0x7f3278161990 2024-03-28T21:52:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.667+0000 7f327e000640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3278161990 0x7f3278162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.667+0000 7f327d600640 1 -- 172.21.15.153:0/1317230613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3278161990 msgr2=0x7f3278162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.667+0000 7f327d600640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3278161990 0x7f3278162310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.667+0000 7f327d600640 1 -- 172.21.15.153:0/1317230613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32780d2ad0 msgr2=0x7f327815c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.667+0000 7f327d600640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32780d2ad0 0x7f327815c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.667+0000 7f327d600640 1 -- 172.21.15.153:0/1317230613 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32780b7660 con 0x7f32780b3a60 2024-03-28T21:52:05.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.667+0000 7f327e000640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3278161990 0x7f3278162310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:05.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.667+0000 7f327cc00640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32780d2ad0 0x7f327815c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:52:05.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.668+0000 7f327d600640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32780b3a60 0x7f32780ca640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3268032000 tx=0x7f32680046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.672+0000 7f3275600640 1 -- 172.21.15.153:0/1317230613 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3268042020 con 0x7f32780b3a60 2024-03-28T21:52:05.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.672+0000 7f3275600640 1 -- 172.21.15.153:0/1317230613 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32680329d0 con 0x7f32780b3a60 2024-03-28T21:52:05.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.672+0000 7f3275600640 1 -- 172.21.15.153:0/1317230613 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3268037040 con 0x7f32780b3a60 2024-03-28T21:52:05.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.672+0000 7f3280000640 1 -- 172.21.15.153:0/1317230613 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32780b7940 con 0x7f32780b3a60 2024-03-28T21:52:05.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.673+0000 7f3280000640 1 -- 172.21.15.153:0/1317230613 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32780b7f00 con 0x7f32780b3a60 2024-03-28T21:52:05.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.676+0000 7f3266a00640 1 -- 172.21.15.153:0/1317230613 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3278068ff0 con 0x7f32780b3a60 2024-03-28T21:52:05.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.679+0000 7f3275600640 1 -- 172.21.15.153:0/1317230613 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f3268045020 con 0x7f32780b3a60 2024-03-28T21:52:05.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.681+0000 7f3275600640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f325c06b4d0 0x7f325c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.681+0000 7f3275600640 1 -- 172.21.15.153:0/1317230613 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f32680ac760 con 0x7f32780b3a60 2024-03-28T21:52:05.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.682+0000 7f327cc00640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f325c06b4d0 0x7f325c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.684+0000 7f327cc00640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f325c06b4d0 0x7f325c06d990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3278160e10 tx=0x7f326c007eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.686+0000 7f1f7e600640 1 Processor -- start 2024-03-28T21:52:05.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.686+0000 7f1f7e600640 1 -- start start 2024-03-28T21:52:05.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.688+0000 7f1f7e600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f70005e90 0x7f1f700062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.688+0000 7f1f7e600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1f70006810 0x7f1f70006ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.688+0000 7f1f7e600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f70053720 con 0x7f1f700ead00 2024-03-28T21:52:05.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.688+0000 7f1f7e600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1f70054330 con 0x7f1f70006810 2024-03-28T21:52:05.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.688+0000 7f1f7e600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1f70053a00 con 0x7f1f70005e90 2024-03-28T21:52:05.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.689+0000 7f1f7d200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1f700ead00 0x7f1f7004fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54628/0 (socket says 172.21.15.153:54628) 2024-03-28T21:52:05.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.689+0000 7f1f7d200640 1 -- 172.21.15.153:0/990261520 learned_addr learned my addr 172.21.15.153:0/990261520 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:05.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.689+0000 7f1f77e00640 1 --2- 172.21.15.153:0/990261520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f70005e90 0x7f1f700062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.690+0000 7f1f7dc00640 1 --2- 172.21.15.153:0/990261520 >> v2:172.21.15.153:3300/0 conn(0x7f1f70006810 0x7f1f70006ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.691+0000 7f1f77e00640 1 -- 172.21.15.153:0/990261520 >> v2:172.21.15.153:3300/0 conn(0x7f1f70006810 msgr2=0x7f1f70006ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:05.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.691+0000 7f1f77e00640 1 --2- 172.21.15.153:0/990261520 >> v2:172.21.15.153:3300/0 conn(0x7f1f70006810 0x7f1f70006ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.691+0000 7f1f77e00640 1 -- 172.21.15.153:0/990261520 >> v1:172.21.15.153:6789/0 conn(0x7f1f700ead00 legacy=0x7f1f7004fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.691+0000 7f1f77e00640 1 -- 172.21.15.153:0/990261520 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f70053ce0 con 0x7f1f70005e90 2024-03-28T21:52:05.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.691+0000 7f1f7dc00640 1 --2- 172.21.15.153:0/990261520 >> v2:172.21.15.153:3300/0 conn(0x7f1f70006810 0x7f1f70006ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:05.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.693+0000 7f1f77e00640 1 --2- 172.21.15.153:0/990261520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f70005e90 0x7f1f700062d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1f640097a0 tx=0x7f1f6402b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e2931e2cc70fbcd server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.693+0000 7f1f77400640 1 -- 172.21.15.153:0/990261520 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64037070 con 0x7f1f70005e90 2024-03-28T21:52:05.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.693+0000 7f1f77400640 1 -- 172.21.15.153:0/990261520 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f64030710 con 0x7f1f70005e90 2024-03-28T21:52:05.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.693+0000 7f1f77400640 1 -- 172.21.15.153:0/990261520 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64030ae0 con 0x7f1f70005e90 2024-03-28T21:52:05.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.695+0000 7f1f7e600640 1 -- 172.21.15.153:0/990261520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f70005e90 msgr2=0x7f1f700062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.695+0000 7f1f7e600640 1 --2- 172.21.15.153:0/990261520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f70005e90 0x7f1f700062d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1f640097a0 tx=0x7f1f6402b710 comp rx=0 tx=0).stop 2024-03-28T21:52:05.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.696+0000 7f3275600640 1 -- 172.21.15.153:0/1317230613 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f326804c030 con 0x7f32780b3a60 2024-03-28T21:52:05.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.699+0000 7f1f7e600640 1 -- 172.21.15.153:0/990261520 shutdown_connections 2024-03-28T21:52:05.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.699+0000 7f1f7e600640 1 --2- 172.21.15.153:0/990261520 >> v2:172.21.15.153:3300/0 conn(0x7f1f70006810 0x7f1f70006ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.699+0000 7f1f7e600640 1 --2- 172.21.15.153:0/990261520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f70005e90 0x7f1f700062d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.699+0000 7f1f7e600640 1 -- 172.21.15.153:0/990261520 >> 172.21.15.153:0/990261520 conn(0x7f1f70009fb0 msgr2=0x7f1f7000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:05.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.699+0000 7f1f7e600640 1 -- 172.21.15.153:0/990261520 shutdown_connections 2024-03-28T21:52:05.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.699+0000 7f1f7e600640 1 -- 172.21.15.153:0/990261520 wait complete. 2024-03-28T21:52:05.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.702+0000 7f1f7e600640 1 Processor -- start 2024-03-28T21:52:05.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.702+0000 7f1f7e600640 1 -- start start 2024-03-28T21:52:05.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.704+0000 7f1f7e600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f70005e90 0x7f1f700d6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.705+0000 7f1f7e600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f70006810 0x7f1f7004d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.705+0000 7f1f7d200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f70005e90 0x7f1f700d6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.705+0000 7f1f7d200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f70005e90 0x7f1f700d6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45688/0 (socket says 172.21.15.153:45688) 2024-03-28T21:52:05.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.706+0000 7f1f7d200640 1 -- 172.21.15.153:0/640956932 learned_addr learned my addr 172.21.15.153:0/640956932 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:05.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.706+0000 7f1f7e600640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f700ead00 0x7f1f7004d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.706+0000 7f1f77e00640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f70006810 0x7f1f7004d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.706+0000 7f1f7e600640 1 -- 172.21.15.153:0/640956932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1f700547c0 con 0x7f1f70005e90 2024-03-28T21:52:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.706+0000 7f1f7e600640 1 -- 172.21.15.153:0/640956932 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1f700501a0 con 0x7f1f70006810 2024-03-28T21:52:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.707+0000 7f1f7dc00640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f700ead00 0x7f1f7004d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.707+0000 7f1f7e600640 1 -- 172.21.15.153:0/640956932 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1f70054940 con 0x7f1f700ead00 2024-03-28T21:52:05.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.708+0000 7f1f7dc00640 1 -- 172.21.15.153:0/640956932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f70006810 msgr2=0x7f1f7004d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.708+0000 7f1f7dc00640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f70006810 0x7f1f7004d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.708+0000 7f1f7dc00640 1 -- 172.21.15.153:0/640956932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f70005e90 msgr2=0x7f1f700d6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.708+0000 7f1f7dc00640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f70005e90 0x7f1f700d6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.708+0000 7f1f7dc00640 1 -- 172.21.15.153:0/640956932 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f700345a0 con 0x7f1f700ead00 2024-03-28T21:52:05.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.708+0000 7f1f7d200640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f70005e90 0x7f1f700d6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:52:05.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.709+0000 7f1f7dc00640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f700ead00 0x7f1f7004d860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1f78069fe0 tx=0x7f1f78068ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.710+0000 7f1f74c00640 1 -- 172.21.15.153:0/640956932 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7806c030 con 0x7f1f700ead00 2024-03-28T21:52:05.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.710+0000 7f1f7e600640 1 -- 172.21.15.153:0/640956932 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f70034880 con 0x7f1f700ead00 2024-03-28T21:52:05.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.710+0000 7f1f7e600640 1 -- 172.21.15.153:0/640956932 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f70034e40 con 0x7f1f700ead00 2024-03-28T21:52:05.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.710+0000 7f1f74c00640 1 -- 172.21.15.153:0/640956932 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7806d040 con 0x7f1f700ead00 2024-03-28T21:52:05.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.710+0000 7f1f74c00640 1 -- 172.21.15.153:0/640956932 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7806c030 con 0x7f1f700ead00 2024-03-28T21:52:05.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.712+0000 7f1f7e600640 1 -- 172.21.15.153:0/640956932 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f54005290 con 0x7f1f700ead00 2024-03-28T21:52:05.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.714+0000 7f1f74c00640 1 -- 172.21.15.153:0/640956932 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f1f7806f750 con 0x7f1f700ead00 2024-03-28T21:52:05.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.715+0000 7f1f74c00640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1f5806b6d0 0x7f1f5806db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.716+0000 7f1f74c00640 1 -- 172.21.15.153:0/640956932 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1f781056e0 con 0x7f1f700ead00 2024-03-28T21:52:05.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.717+0000 7f1f7d200640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1f5806b6d0 0x7f1f5806db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.718+0000 7f1f7d200640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1f5806b6d0 0x7f1f5806db90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c000f60 tx=0x7f1f6c000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.736+0000 7f1f74c00640 1 -- 172.21.15.153:0/640956932 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1f780d3f00 con 0x7f1f700ead00 2024-03-28T21:52:05.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.755+0000 7f38a6e00640 1 Processor -- start 2024-03-28T21:52:05.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.755+0000 7f38a6e00640 1 -- start start 2024-03-28T21:52:05.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.757+0000 7f38a6e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f38a015e180 0x7f38a00d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.757+0000 7f38a6e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38a00d4b80 con 0x7f38a00d4680 2024-03-28T21:52:05.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.757+0000 7f38a6e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38a00b34e0 con 0x7f38a00d1070 2024-03-28T21:52:05.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.757+0000 7f38a6e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f38a00d4e60 con 0x7f38a015e180 2024-03-28T21:52:05.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.758+0000 7f38a5a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f38a015e180 0x7f38a00d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.759+0000 7f38a5a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f38a015e180 0x7f38a00d2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:45348/0 (socket says 172.21.15.153:45348) 2024-03-28T21:52:05.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.759+0000 7f38a5a00640 1 -- 172.21.15.153:0/1946191674 learned_addr learned my addr 172.21.15.153:0/1946191674 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:05.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.758+0000 7f38a5000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f38a00d4680 0x7f38a00d0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54634/0 (socket says 172.21.15.153:54634) 2024-03-28T21:52:05.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.759+0000 7f284be00640 1 Processor -- start 2024-03-28T21:52:05.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.760+0000 7f389fe00640 1 -- 172.21.15.153:0/1946191674 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3053280780 0 0) 0x7f38a00d4b80 con 0x7f38a00d4680 2024-03-28T21:52:05.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.760+0000 7f284be00640 1 -- start start 2024-03-28T21:52:05.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.760+0000 7f389fe00640 1 -- 172.21.15.153:0/1946191674 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3884003520 con 0x7f38a00d4680 2024-03-28T21:52:05.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.760+0000 7f38a5a00640 1 -- 172.21.15.153:0/1946191674 >> v1:172.21.15.165:6789/0 conn(0x7f38a00d1070 legacy=0x7f38a00b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.760+0000 7f38a5a00640 1 -- 172.21.15.153:0/1946191674 >> v1:172.21.15.153:6789/0 conn(0x7f38a00d4680 legacy=0x7f38a00d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.760+0000 7f38a5a00640 1 -- 172.21.15.153:0/1946191674 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a00b37c0 con 0x7f38a015e180 2024-03-28T21:52:05.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.762+0000 7f38a5a00640 1 --2- 172.21.15.153:0/1946191674 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38a015e180 0x7f38a00d2c30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3898009870 tx=0x7f389802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d676f7e35f407ebd server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.762+0000 7f284be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28440e3160 0x7f28440e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.762+0000 7f284be00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2844058810 con 0x7f2844053cb0 2024-03-28T21:52:05.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.762+0000 7f284be00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2844058af0 con 0x7f284403c0a0 2024-03-28T21:52:05.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.762+0000 7f284be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2844007b70 con 0x7f28440e3160 2024-03-28T21:52:05.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.762+0000 7f389fe00640 1 -- 172.21.15.153:0/1946191674 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898035020 con 0x7f38a015e180 2024-03-28T21:52:05.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.763+0000 7f389fe00640 1 -- 172.21.15.153:0/1946191674 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3898031870 con 0x7f38a015e180 2024-03-28T21:52:05.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.763+0000 7f389fe00640 1 -- 172.21.15.153:0/1946191674 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898031c20 con 0x7f38a015e180 2024-03-28T21:52:05.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.763+0000 7f284a000640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f284403c0a0 0x7f2844058050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:34144/0 (socket says 172.21.15.153:34144) 2024-03-28T21:52:05.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.763+0000 7f284a000640 1 -- 172.21.15.153:0/596575454 learned_addr learned my addr 172.21.15.153:0/596575454 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:05.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.763+0000 7f2849600640 1 -- 172.21.15.153:0/596575454 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1652825349 0 0) 0x7f2844058af0 con 0x7f284403c0a0 2024-03-28T21:52:05.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.764+0000 7f2849600640 1 -- 172.21.15.153:0/596575454 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2830003520 con 0x7f284403c0a0 2024-03-28T21:52:05.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.764+0000 7f284aa00640 1 --2- 172.21.15.153:0/596575454 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28440e3160 0x7f28440e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.764+0000 7f2849600640 1 -- 172.21.15.153:0/596575454 <== mon.1 v1:172.21.15.165:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1171782955 0 0) 0x7f2830003520 con 0x7f284403c0a0 2024-03-28T21:52:05.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.764+0000 7f2849600640 1 -- 172.21.15.153:0/596575454 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28440e3160 msgr2=0x7f28440e7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:05.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.764+0000 7f2849600640 1 --2- 172.21.15.153:0/596575454 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28440e3160 0x7f28440e7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.764+0000 7f2849600640 1 -- 172.21.15.153:0/596575454 >> v1:172.21.15.153:6789/0 conn(0x7f2844053cb0 legacy=0x7f2844054120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.764+0000 7f2849600640 1 -- 172.21.15.153:0/596575454 --> v1:172.21.15.165:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2844006360 con 0x7f284403c0a0 2024-03-28T21:52:05.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.764+0000 7f38a6e00640 1 -- 172.21.15.153:0/1946191674 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38a015e180 msgr2=0x7f38a00d2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.764+0000 7f38a6e00640 1 --2- 172.21.15.153:0/1946191674 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38a015e180 0x7f38a00d2c30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3898009870 tx=0x7f389802b910 comp rx=0 tx=0).stop 2024-03-28T21:52:05.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.764+0000 7f2849600640 1 -- 172.21.15.153:0/596575454 <== mon.1 v1:172.21.15.165:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f284c04fd00 con 0x7f284403c0a0 2024-03-28T21:52:05.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.764+0000 7f2849600640 1 -- 172.21.15.153:0/596575454 >> v1:172.21.15.165:6789/0 conn(0x7f284403c0a0 legacy=0x7f2844058050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.765+0000 7f2849600640 1 --2- 172.21.15.153:0/596575454 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28300039b0 0x7f2830003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.765+0000 7f2849600640 1 --2- 172.21.15.153:0/596575454 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2830004800 0x7f2830004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.766+0000 7f38a6e00640 1 -- 172.21.15.153:0/1946191674 shutdown_connections 2024-03-28T21:52:05.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.766+0000 7f38a6e00640 1 --2- 172.21.15.153:0/1946191674 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38a015e180 0x7f38a00d2c30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.766+0000 7f38a6e00640 1 -- 172.21.15.153:0/1946191674 >> 172.21.15.153:0/1946191674 conn(0x7f38a009d1e0 msgr2=0x7f38a00d3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:05.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.765+0000 7f2849600640 1 --2- 172.21.15.153:0/596575454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28300051c0 0x7f28300141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.765+0000 7f2849600640 1 -- 172.21.15.153:0/596575454 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2830014740 con 0x7f28300051c0 2024-03-28T21:52:05.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.765+0000 7f2849600640 1 -- 172.21.15.153:0/596575454 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f28300148f0 con 0x7f2830004800 2024-03-28T21:52:05.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.765+0000 7f2849600640 1 -- 172.21.15.153:0/596575454 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2830014af0 con 0x7f28300039b0 2024-03-28T21:52:05.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.765+0000 7f284aa00640 1 --2- 172.21.15.153:0/596575454 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28300039b0 0x7f2830003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.766+0000 7f284b400640 1 --2- 172.21.15.153:0/596575454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28300051c0 0x7f28300141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.766+0000 7f284a000640 1 --2- 172.21.15.153:0/596575454 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2830004800 0x7f2830004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.766+0000 7f284aa00640 1 -- 172.21.15.153:0/596575454 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2830004800 msgr2=0x7f2830004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:05.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.766+0000 7f284aa00640 1 --2- 172.21.15.153:0/596575454 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2830004800 0x7f2830004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.766+0000 7f284aa00640 1 -- 172.21.15.153:0/596575454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28300051c0 msgr2=0x7f28300141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:05.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.766+0000 7f284aa00640 1 --2- 172.21.15.153:0/596575454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28300051c0 0x7f28300141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.767+0000 7f284aa00640 1 -- 172.21.15.153:0/596575454 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2844006360 con 0x7f28300039b0 2024-03-28T21:52:05.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.767+0000 7f38a6e00640 1 -- 172.21.15.153:0/1946191674 shutdown_connections 2024-03-28T21:52:05.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.767+0000 7f38a6e00640 1 -- 172.21.15.153:0/1946191674 wait complete. 2024-03-28T21:52:05.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.770+0000 7f38a6e00640 1 Processor -- start 2024-03-28T21:52:05.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.770+0000 7f38a6e00640 1 -- start start 2024-03-28T21:52:05.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.772+0000 7f38a6e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a00d1070 0x7f38a015cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.772+0000 7f284b400640 1 --2- 172.21.15.153:0/596575454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28300051c0 0x7f28300141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:52:05.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.773+0000 7f38a6e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38a00d4680 0x7f38a00b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.773+0000 7f38a6e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38a015e180 0x7f38a00b9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.773+0000 7f38a6e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38a00d1e70 con 0x7f38a00d1070 2024-03-28T21:52:05.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.773+0000 7f284aa00640 1 --2- 172.21.15.153:0/596575454 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28300039b0 0x7f2830003dd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f284400e300 tx=0x7f2830005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92941a33283a0da3 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.774+0000 7f38a6e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f38a00d1cf0 con 0x7f38a00d4680 2024-03-28T21:52:05.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.774+0000 7f38a5000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38a00d4680 0x7f38a00b92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.774+0000 7f38a5a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a00d1070 0x7f38a015cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.774+0000 7f38a5a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a00d1070 0x7f38a015cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45708/0 (socket says 172.21.15.153:45708) 2024-03-28T21:52:05.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.774+0000 7f38a5a00640 1 -- 172.21.15.153:0/3429153039 learned_addr learned my addr 172.21.15.153:0/3429153039 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:05.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.774+0000 7f2849600640 1 -- 172.21.15.153:0/596575454 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c00b550 con 0x7f28300039b0 2024-03-28T21:52:05.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.774+0000 7f2849600640 1 -- 172.21.15.153:0/596575454 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283c038070 con 0x7f28300039b0 2024-03-28T21:52:05.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.774+0000 7f2849600640 1 -- 172.21.15.153:0/596575454 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c033660 con 0x7f28300039b0 2024-03-28T21:52:05.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.774+0000 7f38a6400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38a015e180 0x7f38a00b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.774+0000 7f38a5000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38a00d4680 0x7f38a00b92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:45366/0 (socket says 172.21.15.153:45366) 2024-03-28T21:52:05.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.774+0000 7f38a6e00640 1 -- 172.21.15.153:0/3429153039 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f38a015e560 con 0x7f38a015e180 2024-03-28T21:52:05.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.775+0000 7f284be00640 1 -- 172.21.15.153:0/596575454 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28300039b0 msgr2=0x7f2830003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.775+0000 7f284be00640 1 --2- 172.21.15.153:0/596575454 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28300039b0 0x7f2830003dd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f284400e300 tx=0x7f2830005830 comp rx=0 tx=0).stop 2024-03-28T21:52:05.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.775+0000 7f284b400640 1 -- 172.21.15.153:0/596575454 reap_dead start 2024-03-28T21:52:05.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.776+0000 7f284be00640 1 -- 172.21.15.153:0/596575454 shutdown_connections 2024-03-28T21:52:05.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.776+0000 7f284be00640 1 -- 172.21.15.153:0/596575454 >> 172.21.15.153:0/596575454 conn(0x7f2844058ee0 msgr2=0x7f28440592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:05.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.777+0000 7f38a6400640 1 -- 172.21.15.153:0/3429153039 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38a00d4680 msgr2=0x7f38a00b92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.777+0000 7f38a6400640 1 --2- 172.21.15.153:0/3429153039 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38a00d4680 0x7f38a00b92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.777+0000 7f38a6400640 1 -- 172.21.15.153:0/3429153039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a00d1070 msgr2=0x7f38a015cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.776+0000 7f284be00640 1 -- 172.21.15.153:0/596575454 shutdown_connections 2024-03-28T21:52:05.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.776+0000 7f284be00640 1 -- 172.21.15.153:0/596575454 wait complete. 2024-03-28T21:52:05.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.780+0000 7f284be00640 1 Processor -- start 2024-03-28T21:52:05.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.780+0000 7f284be00640 1 -- start start 2024-03-28T21:52:05.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.783+0000 7f284be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28300039b0 0x7f28440e36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.783+0000 7f38a6400640 1 --2- 172.21.15.153:0/3429153039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a00d1070 0x7f38a015cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.783+0000 7f38a6400640 1 -- 172.21.15.153:0/3429153039 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a00c8310 con 0x7f38a015e180 2024-03-28T21:52:05.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.783+0000 7f38a5a00640 1 --2- 172.21.15.153:0/3429153039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a00d1070 0x7f38a015cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:05.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.783+0000 7f284be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2844052630 0x7f28440e5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.784+0000 7f38a6400640 1 --2- 172.21.15.153:0/3429153039 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38a015e180 0x7f38a00b9830 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f388800c3c0 tx=0x7f388800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.784+0000 7f284be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28440e6240 0x7f28440db680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.784+0000 7f389d600640 1 -- 172.21.15.153:0/3429153039 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38880052d0 con 0x7f38a015e180 2024-03-28T21:52:05.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.784+0000 7f389d600640 1 -- 172.21.15.153:0/3429153039 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3888005470 con 0x7f38a015e180 2024-03-28T21:52:05.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.784+0000 7f389d600640 1 -- 172.21.15.153:0/3429153039 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888007260 con 0x7f38a015e180 2024-03-28T21:52:05.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.784+0000 7f284be00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f28440e7780 con 0x7f28300039b0 2024-03-28T21:52:05.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.784+0000 7f284a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2844052630 0x7f28440e5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.784+0000 7f284be00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f28440e3540 con 0x7f28440e6240 2024-03-28T21:52:05.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.784+0000 7f284be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f28440e7900 con 0x7f2844052630 2024-03-28T21:52:05.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.784+0000 7f284a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2844052630 0x7f28440e5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:43016/0 (socket says 172.21.15.153:43016) 2024-03-28T21:52:05.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.784+0000 7f284a000640 1 -- 172.21.15.153:0/714833588 learned_addr learned my addr 172.21.15.153:0/714833588 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:05.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.785+0000 7f38a6e00640 1 -- 172.21.15.153:0/3429153039 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a00c85f0 con 0x7f38a015e180 2024-03-28T21:52:05.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.785+0000 7f38a6e00640 1 -- 172.21.15.153:0/3429153039 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a00c8000 con 0x7f38a015e180 2024-03-28T21:52:05.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.785+0000 7f284b400640 1 --2- 172.21.15.153:0/714833588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28440e6240 0x7f28440db680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.787+0000 7f284a000640 1 -- 172.21.15.153:0/714833588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28440e6240 msgr2=0x7f28440db680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.787+0000 7f284a000640 1 --2- 172.21.15.153:0/714833588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28440e6240 0x7f28440db680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.787+0000 7f284a000640 1 -- 172.21.15.153:0/714833588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28300039b0 msgr2=0x7f28440e36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.789+0000 7f389d600640 1 -- 172.21.15.153:0/3429153039 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f3888007400 con 0x7f38a015e180 2024-03-28T21:52:05.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.787+0000 7f284a000640 1 --2- 172.21.15.153:0/714833588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28300039b0 0x7f28440e36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.787+0000 7f284a000640 1 -- 172.21.15.153:0/714833588 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28440da900 con 0x7f2844052630 2024-03-28T21:52:05.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.791+0000 7f3896a00640 1 -- 172.21.15.153:0/3429153039 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38a004f520 con 0x7f38a015e180 2024-03-28T21:52:05.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.791+0000 7f284a000640 1 --2- 172.21.15.153:0/714833588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2844052630 0x7f28440e5d00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f284c02d700 tx=0x7f284c068ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.791+0000 7f389d600640 1 --2- 172.21.15.153:0/3429153039 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f387c06b550 0x7f387c06da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.792+0000 7f2842a00640 1 -- 172.21.15.153:0/714833588 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c06c050 con 0x7f2844052630 2024-03-28T21:52:05.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.792+0000 7f38a5a00640 1 --2- 172.21.15.153:0/3429153039 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f387c06b550 0x7f387c06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.792+0000 7f389d600640 1 -- 172.21.15.153:0/3429153039 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3888055d80 con 0x7f38a015e180 2024-03-28T21:52:05.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.793+0000 7f284be00640 1 -- 172.21.15.153:0/714833588 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28440daba0 con 0x7f2844052630 2024-03-28T21:52:05.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.793+0000 7f284be00640 1 -- 172.21.15.153:0/714833588 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2844052a50 con 0x7f2844052630 2024-03-28T21:52:05.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.794+0000 7f284be00640 1 -- 172.21.15.153:0/714833588 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2844005390 con 0x7f2844052630 2024-03-28T21:52:05.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.795+0000 7f38a5a00640 1 --2- 172.21.15.153:0/3429153039 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f387c06b550 0x7f387c06da10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38a00c7080 tx=0x7f3898008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.805+0000 7f2842a00640 1 -- 172.21.15.153:0/714833588 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c08f070 con 0x7f2844052630 2024-03-28T21:52:05.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.806+0000 7f2842a00640 1 -- 172.21.15.153:0/714833588 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c072ad0 con 0x7f2844052630 2024-03-28T21:52:05.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.806+0000 7f389d600640 1 -- 172.21.15.153:0/3429153039 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f38880583e0 con 0x7f38a015e180 2024-03-28T21:52:05.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.808+0000 7f2842a00640 1 -- 172.21.15.153:0/714833588 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f284c070070 con 0x7f2844052630 2024-03-28T21:52:05.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.810+0000 7f2842a00640 1 --2- 172.21.15.153:0/714833588 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f282c06b4d0 0x7f282c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.810+0000 7f2842a00640 1 -- 172.21.15.153:0/714833588 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f284c105ea0 con 0x7f2844052630 2024-03-28T21:52:05.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.811+0000 7f284aa00640 1 --2- 172.21.15.153:0/714833588 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f282c06b4d0 0x7f282c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.816+0000 7f284aa00640 1 --2- 172.21.15.153:0/714833588 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f282c06b4d0 0x7f282c06d990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2844038910 tx=0x7f283c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.821+0000 7f2842a00640 1 -- 172.21.15.153:0/714833588 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f284c0d4cf0 con 0x7f2844052630 2024-03-28T21:52:05.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.842+0000 7f373b800640 1 Processor -- start 2024-03-28T21:52:05.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.842+0000 7f373b800640 1 -- start start 2024-03-28T21:52:05.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.842+0000 7f7e81600640 1 Processor -- start 2024-03-28T21:52:05.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.843+0000 7f7e81600640 1 -- start start 2024-03-28T21:52:05.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.845+0000 7f7e81600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7e7c0d2960 0x7f7e7c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.845+0000 7f7e81600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e7c0d05b0 con 0x7f7e7c0d2d40 2024-03-28T21:52:05.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.845+0000 7f7e81600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e7c0cf510 con 0x7f7e7c166a60 2024-03-28T21:52:05.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.845+0000 7f7e81600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7e7c0cf7f0 con 0x7f7e7c0d2960 2024-03-28T21:52:05.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.844+0000 7f373b800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f37340d14e0 0x7f37340b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.845+0000 7f7e7a000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7e7c0d2d40 0x7f7e7c0ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54650/0 (socket says 172.21.15.153:54650) 2024-03-28T21:52:05.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.846+0000 7f7e7a000640 1 -- 172.21.15.153:0/1989140547 learned_addr learned my addr 172.21.15.153:0/1989140547 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:05.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.846+0000 7f373b800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3734161990 0x7f37340d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.846+0000 7f373b800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37340724b0 0x7f37340d2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.846+0000 7f373b800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f37340ceca0 con 0x7f37340724b0 2024-03-28T21:52:05.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.846+0000 7f373b800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f37340d4810 con 0x7f37340d14e0 2024-03-28T21:52:05.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.846+0000 7f373b800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f37340d4af0 con 0x7f3734161990 2024-03-28T21:52:05.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.846+0000 7f7e79600640 1 -- 172.21.15.153:0/1989140547 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1256920644 0 0) 0x7f7e7c0d05b0 con 0x7f7e7c0d2d40 2024-03-28T21:52:05.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.847+0000 7f7e79600640 1 -- 172.21.15.153:0/1989140547 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e60003520 con 0x7f7e7c0d2d40 2024-03-28T21:52:05.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.847+0000 7f3733e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3734161990 0x7f37340d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.847+0000 7f3733e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3734161990 0x7f37340d23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:43022/0 (socket says 172.21.15.153:43022) 2024-03-28T21:52:05.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.847+0000 7f3739800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37340724b0 0x7f37340d2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.847+0000 7f3733e00640 1 -- 172.21.15.153:0/3480509294 learned_addr learned my addr 172.21.15.153:0/3480509294 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:05.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.847+0000 7f3738e00640 1 --2- 172.21.15.153:0/3480509294 >> v2:172.21.15.165:3300/0 conn(0x7f37340d14e0 0x7f37340b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f3733e00640 1 -- 172.21.15.153:0/3480509294 >> v2:172.21.15.165:3300/0 conn(0x7f37340d14e0 msgr2=0x7f37340b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:05.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f3733e00640 1 --2- 172.21.15.153:0/3480509294 >> v2:172.21.15.165:3300/0 conn(0x7f37340d14e0 0x7f37340b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f3733e00640 1 -- 172.21.15.153:0/3480509294 >> v2:172.21.15.153:3300/0 conn(0x7f37340724b0 msgr2=0x7f37340d2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:05.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f3733e00640 1 --2- 172.21.15.153:0/3480509294 >> v2:172.21.15.153:3300/0 conn(0x7f37340724b0 0x7f37340d2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f3733e00640 1 -- 172.21.15.153:0/3480509294 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37340d4dd0 con 0x7f3734161990 2024-03-28T21:52:05.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.849+0000 7f3739800640 1 --2- 172.21.15.153:0/3480509294 >> v2:172.21.15.153:3300/0 conn(0x7f37340724b0 0x7f37340d2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:05.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.847+0000 7f7e79600640 1 -- 172.21.15.153:0/1989140547 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1040614629 0 0) 0x7f7e60003520 con 0x7f7e7c0d2d40 2024-03-28T21:52:05.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.852+0000 7f3733e00640 1 --2- 172.21.15.153:0/3480509294 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3734161990 0x7f37340d23c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f373408e1e0 tx=0x7f372002b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0748266806ad6e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.847+0000 7f7e79600640 1 -- 172.21.15.153:0/1989140547 >> v2:172.21.15.165:3300/0 conn(0x7f7e7c0d2960 msgr2=0x7f7e7c0b32e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T21:52:05.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.847+0000 7f7e79600640 1 --2- 172.21.15.153:0/1989140547 >> v2:172.21.15.165:3300/0 conn(0x7f7e7c0d2960 0x7f7e7c0b32e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.852+0000 7f3733400640 1 -- 172.21.15.153:0/3480509294 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720035020 con 0x7f3734161990 2024-03-28T21:52:05.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.852+0000 7f3733400640 1 -- 172.21.15.153:0/3480509294 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3720031880 con 0x7f3734161990 2024-03-28T21:52:05.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.847+0000 7f7e79600640 1 -- 172.21.15.153:0/1989140547 >> v1:172.21.15.165:6789/0 conn(0x7f7e7c166a60 legacy=0x7f7e7c166e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-28T21:52:05.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f7e79600640 1 -- 172.21.15.153:0/1989140547 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c0cfad0 con 0x7f7e7c0d2d40 2024-03-28T21:52:05.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f7e79600640 1 -- 172.21.15.153:0/1989140547 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f7e68001670 con 0x7f7e7c0d2d40 2024-03-28T21:52:05.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f7e79600640 1 -- 172.21.15.153:0/1989140547 >> v1:172.21.15.153:6789/0 conn(0x7f7e7c0d2d40 legacy=0x7f7e7c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f7e79600640 1 --2- 172.21.15.153:0/1989140547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e60003a00 0x7f7e60003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f7e79600640 1 --2- 172.21.15.153:0/1989140547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e60004800 0x7f7e60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f7e79600640 1 --2- 172.21.15.153:0/1989140547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e600052e0 0x7f7e6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f7e79600640 1 -- 172.21.15.153:0/1989140547 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c0cf7f0 con 0x7f7e60003a00 2024-03-28T21:52:05.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f7e79600640 1 -- 172.21.15.153:0/1989140547 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6000c230 con 0x7f7e600052e0 2024-03-28T21:52:05.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f7e79600640 1 -- 172.21.15.153:0/1989140547 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6000c430 con 0x7f7e60004800 2024-03-28T21:52:05.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.848+0000 7f7e7a000640 1 --2- 172.21.15.153:0/1989140547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e60004800 0x7f7e60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.849+0000 7f7e7a000640 1 -- 172.21.15.153:0/1989140547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e600052e0 msgr2=0x7f7e6000b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T21:52:05.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.849+0000 7f7e7a000640 1 --2- 172.21.15.153:0/1989140547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e600052e0 0x7f7e6000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.849+0000 7f7e7a000640 1 -- 172.21.15.153:0/1989140547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e60003a00 msgr2=0x7f7e60003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:05.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.849+0000 7f7e7a000640 1 --2- 172.21.15.153:0/1989140547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e60003a00 0x7f7e60003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.849+0000 7f7e7a000640 1 -- 172.21.15.153:0/1989140547 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e60003520 con 0x7f7e60004800 2024-03-28T21:52:05.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.851+0000 7f7e7b400640 1 -- 172.21.15.153:0/1989140547 reap_dead start 2024-03-28T21:52:05.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.852+0000 7f7e7a000640 1 --2- 172.21.15.153:0/1989140547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e60004800 0x7f7e60004c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0d31f0 tx=0x7f7e60005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2174f8cf07227e74 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.854+0000 7f3733400640 1 -- 172.21.15.153:0/3480509294 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720031c50 con 0x7f3734161990 2024-03-28T21:52:05.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.853+0000 7f7e79600640 1 -- 172.21.15.153:0/1989140547 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6804a070 con 0x7f7e60004800 2024-03-28T21:52:05.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.853+0000 7f7e79600640 1 -- 172.21.15.153:0/1989140547 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6803da30 con 0x7f7e60004800 2024-03-28T21:52:05.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.853+0000 7f7e79600640 1 -- 172.21.15.153:0/1989140547 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68018c70 con 0x7f7e60004800 2024-03-28T21:52:05.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.854+0000 7f7e81600640 1 -- 172.21.15.153:0/1989140547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e60004800 msgr2=0x7f7e60004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.854+0000 7f7e81600640 1 --2- 172.21.15.153:0/1989140547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e60004800 0x7f7e60004c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0d31f0 tx=0x7f7e60005830 comp rx=0 tx=0).stop 2024-03-28T21:52:05.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.855+0000 7f7e81600640 1 -- 172.21.15.153:0/1989140547 shutdown_connections 2024-03-28T21:52:05.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.855+0000 7f7e81600640 1 --2- 172.21.15.153:0/1989140547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e60004800 0x7f7e60004c80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.855+0000 7f7e81600640 1 -- 172.21.15.153:0/1989140547 >> 172.21.15.153:0/1989140547 conn(0x7f7e7c09d430 msgr2=0x7f7e7c0d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:05.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.855+0000 7f373b800640 1 -- 172.21.15.153:0/3480509294 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3734161990 msgr2=0x7f37340d23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.855+0000 7f373b800640 1 --2- 172.21.15.153:0/3480509294 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3734161990 0x7f37340d23c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f373408e1e0 tx=0x7f372002b920 comp rx=0 tx=0).stop 2024-03-28T21:52:05.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.856+0000 7f373b800640 1 -- 172.21.15.153:0/3480509294 shutdown_connections 2024-03-28T21:52:05.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.856+0000 7f373b800640 1 --2- 172.21.15.153:0/3480509294 >> v2:172.21.15.153:3300/0 conn(0x7f37340724b0 0x7f37340d2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.856+0000 7f373b800640 1 --2- 172.21.15.153:0/3480509294 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3734161990 0x7f37340d23c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.856+0000 7f373b800640 1 --2- 172.21.15.153:0/3480509294 >> v2:172.21.15.165:3300/0 conn(0x7f37340d14e0 0x7f37340b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.856+0000 7f7e81600640 1 -- 172.21.15.153:0/1989140547 shutdown_connections 2024-03-28T21:52:05.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.856+0000 7f373b800640 1 -- 172.21.15.153:0/3480509294 >> 172.21.15.153:0/3480509294 conn(0x7f373409d430 msgr2=0x7f37340d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:05.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.856+0000 7f7e81600640 1 -- 172.21.15.153:0/1989140547 wait complete. 2024-03-28T21:52:05.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.857+0000 7f373b800640 1 -- 172.21.15.153:0/3480509294 shutdown_connections 2024-03-28T21:52:05.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.857+0000 7f373b800640 1 -- 172.21.15.153:0/3480509294 wait complete. 2024-03-28T21:52:05.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.859+0000 7f7e81600640 1 Processor -- start 2024-03-28T21:52:05.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.859+0000 7f7e81600640 1 -- start start 2024-03-28T21:52:05.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.860+0000 7f373b800640 1 Processor -- start 2024-03-28T21:52:05.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.861+0000 7f7e81600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e60004800 0x7f7e7c157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.861+0000 7f373b800640 1 -- start start 2024-03-28T21:52:05.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.862+0000 7f373b800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37340d14e0 0x7f37340ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.862+0000 7f373b800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3734161990 0x7f373415aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.862+0000 7f373b800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f373415a4d0 0x7f37340c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.862+0000 7f373b800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37340b3fa0 con 0x7f37340d14e0 2024-03-28T21:52:05.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.862+0000 7f373b800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f37340cf200 con 0x7f3734161990 2024-03-28T21:52:05.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.862+0000 7f373b800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3734161df0 con 0x7f373415a4d0 2024-03-28T21:52:05.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.863+0000 7f3738e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37340d14e0 0x7f37340ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.863+0000 7f3739800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f373415a4d0 0x7f37340c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.863+0000 7f3739800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f373415a4d0 0x7f37340c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:43052/0 (socket says 172.21.15.153:43052) 2024-03-28T21:52:05.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.863+0000 7f3739800640 1 -- 172.21.15.153:0/2058476105 learned_addr learned my addr 172.21.15.153:0/2058476105 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:05.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.864+0000 7f3739800640 1 -- 172.21.15.153:0/2058476105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3734161990 msgr2=0x7f373415aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.864+0000 7f3739800640 1 --2- 172.21.15.153:0/2058476105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3734161990 0x7f373415aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.864+0000 7f3739800640 1 -- 172.21.15.153:0/2058476105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37340d14e0 msgr2=0x7f37340ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.864+0000 7f3739800640 1 --2- 172.21.15.153:0/2058476105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37340d14e0 0x7f37340ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.864+0000 7f3739800640 1 -- 172.21.15.153:0/2058476105 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37340ca2f0 con 0x7f373415a4d0 2024-03-28T21:52:05.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.865+0000 7f3739800640 1 --2- 172.21.15.153:0/2058476105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f373415a4d0 0x7f37340c8fe0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f372c007db0 tx=0x7f372c00d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.866+0000 7f3730c00640 1 -- 172.21.15.153:0/2058476105 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c01a070 con 0x7f373415a4d0 2024-03-28T21:52:05.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.866+0000 7f3730c00640 1 -- 172.21.15.153:0/2058476105 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372c003990 con 0x7f373415a4d0 2024-03-28T21:52:05.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.866+0000 7f3730c00640 1 -- 172.21.15.153:0/2058476105 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c003d60 con 0x7f373415a4d0 2024-03-28T21:52:05.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.867+0000 7f373b800640 1 -- 172.21.15.153:0/2058476105 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37340c9520 con 0x7f373415a4d0 2024-03-28T21:52:05.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.868+0000 7f373b800640 1 -- 172.21.15.153:0/2058476105 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f37340cb490 con 0x7f373415a4d0 2024-03-28T21:52:05.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.869+0000 7f373b800640 1 -- 172.21.15.153:0/2058476105 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3734068ff0 con 0x7f373415a4d0 2024-03-28T21:52:05.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.871+0000 7f7e81600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e7c155db0 0x7f7e7c154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.871+0000 7f7e81600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e7c1597d0 0x7f7e7c159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.871+0000 7f7e81600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c0b32e0 con 0x7f7e60004800 2024-03-28T21:52:05.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.871+0000 7f7e81600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c0d0090 con 0x7f7e7c1597d0 2024-03-28T21:52:05.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.871+0000 7f7e81600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7e7c0b3460 con 0x7f7e7c155db0 2024-03-28T21:52:05.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.872+0000 7f7e7a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e7c155db0 0x7f7e7c154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.872+0000 7f7e7b400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e7c1597d0 0x7f7e7c159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.872+0000 7f7e7a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e7c155db0 0x7f7e7c154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:43054/0 (socket says 172.21.15.153:43054) 2024-03-28T21:52:05.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.872+0000 7f7e7a000640 1 -- 172.21.15.153:0/3522568268 learned_addr learned my addr 172.21.15.153:0/3522568268 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:05.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.873+0000 7f7e7a000640 1 -- 172.21.15.153:0/3522568268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e7c1597d0 msgr2=0x7f7e7c159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.873+0000 7f7e7a000640 1 --2- 172.21.15.153:0/3522568268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e7c1597d0 0x7f7e7c159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.873+0000 7f7e7a000640 1 -- 172.21.15.153:0/3522568268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e60004800 msgr2=0x7f7e7c157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.873+0000 7f7e7aa00640 1 --2- 172.21.15.153:0/3522568268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e60004800 0x7f7e7c157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.874+0000 7f3730c00640 1 -- 172.21.15.153:0/2058476105 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f372c01d070 con 0x7f373415a4d0 2024-03-28T21:52:05.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.875+0000 7f3730c00640 1 --2- 172.21.15.153:0/2058476105 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f371406b500 0x7f371406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.875+0000 7f3730c00640 1 -- 172.21.15.153:0/2058476105 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f372c0570e0 con 0x7f373415a4d0 2024-03-28T21:52:05.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.876+0000 7f7e7a000640 1 --2- 172.21.15.153:0/3522568268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e60004800 0x7f7e7c157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.876+0000 7f7e7a000640 1 -- 172.21.15.153:0/3522568268 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c156320 con 0x7f7e7c155db0 2024-03-28T21:52:05.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.876+0000 7f7e7aa00640 1 --2- 172.21.15.153:0/3522568268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e60004800 0x7f7e7c157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:05.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.876+0000 7f3738e00640 1 --2- 172.21.15.153:0/2058476105 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f371406b500 0x7f371406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.877+0000 7f7e7a000640 1 --2- 172.21.15.153:0/3522568268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e7c155db0 0x7f7e7c154af0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7e68048040 tx=0x7f7e7c0cfca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.878+0000 7f3738e00640 1 --2- 172.21.15.153:0/2058476105 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f371406b500 0x7f371406d9c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3728009aa0 tx=0x7f3728009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.884+0000 7f7e72a00640 1 -- 172.21.15.153:0/3522568268 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6804a050 con 0x7f7e7c155db0 2024-03-28T21:52:05.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.884+0000 7f7e72a00640 1 -- 172.21.15.153:0/3522568268 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6804b040 con 0x7f7e7c155db0 2024-03-28T21:52:05.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.884+0000 7f3730c00640 1 -- 172.21.15.153:0/2058476105 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f372c024020 con 0x7f373415a4d0 2024-03-28T21:52:05.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.884+0000 7f7e72a00640 1 -- 172.21.15.153:0/3522568268 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68018c70 con 0x7f7e7c155db0 2024-03-28T21:52:05.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.884+0000 7f7e81600640 1 -- 172.21.15.153:0/3522568268 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7c156600 con 0x7f7e7c155db0 2024-03-28T21:52:05.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.885+0000 7f7e81600640 1 -- 172.21.15.153:0/3522568268 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e7c0c7dd0 con 0x7f7e7c155db0 2024-03-28T21:52:05.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.889+0000 7f7e81600640 1 -- 172.21.15.153:0/3522568268 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e7c068ff0 con 0x7f7e7c155db0 2024-03-28T21:52:05.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.891+0000 7f7e72a00640 1 -- 172.21.15.153:0/3522568268 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f7e68006480 con 0x7f7e7c155db0 2024-03-28T21:52:05.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.893+0000 7f7e72a00640 1 --2- 172.21.15.153:0/3522568268 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7e5c06b4d0 0x7f7e5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.893+0000 7f7e72a00640 1 -- 172.21.15.153:0/3522568268 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7e680bcf40 con 0x7f7e7c155db0 2024-03-28T21:52:05.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.895+0000 7f7e7aa00640 1 --2- 172.21.15.153:0/3522568268 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7e5c06b4d0 0x7f7e5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.897+0000 7f7e7aa00640 1 --2- 172.21.15.153:0/3522568268 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7e5c06b4d0 0x7f7e5c06d990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7e74007e10 tx=0x7f7e74007320 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.900+0000 7f9dd3200640 1 Processor -- start 2024-03-28T21:52:05.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.900+0000 7f9dd3200640 1 -- start start 2024-03-28T21:52:05.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.903+0000 7f9dd1e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9dcc140560 0x7f9dcc15dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54652/0 (socket says 172.21.15.153:54652) 2024-03-28T21:52:05.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.903+0000 7f9dd1e00640 1 -- 172.21.15.153:0/1150801359 learned_addr learned my addr 172.21.15.153:0/1150801359 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:05.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.904+0000 7f9dd3200640 1 --2- 172.21.15.153:0/1150801359 >> v2:172.21.15.153:3300/0 conn(0x7f9dcc0b4750 0x7f9dcc164f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.905+0000 7f9dd3200640 1 -- 172.21.15.153:0/1150801359 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dcc15e4b0 con 0x7f9dcc140560 2024-03-28T21:52:05.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.906+0000 7f9dd0a00640 1 -- 172.21.15.153:0/1150801359 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505720107 0 0) 0x7f9dcc15e4b0 con 0x7f9dcc140560 2024-03-28T21:52:05.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.906+0000 7f9dd3200640 1 -- 172.21.15.153:0/1150801359 --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dcc15e790 con 0x7f9dcc071720 2024-03-28T21:52:05.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.906+0000 7f9dd2800640 1 --2- 172.21.15.153:0/1150801359 >> v2:172.21.15.153:3300/0 conn(0x7f9dcc0b4750 0x7f9dcc164f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.906+0000 7f9dd3200640 1 -- 172.21.15.153:0/1150801359 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9dcc0b2f40 con 0x7f9dcc0b4750 2024-03-28T21:52:05.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.907+0000 7f9dd2800640 1 -- 172.21.15.153:0/1150801359 >> v1:172.21.15.165:6789/0 conn(0x7f9dcc071720 legacy=0x7f9dcc0cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.908+0000 7f9dd2800640 1 -- 172.21.15.153:0/1150801359 >> v1:172.21.15.153:6789/0 conn(0x7f9dcc140560 legacy=0x7f9dcc15dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.908+0000 7f9dd2800640 1 -- 172.21.15.153:0/1150801359 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc0b3220 con 0x7f9dcc0b4750 2024-03-28T21:52:05.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.910+0000 7f9dd2800640 1 --2- 172.21.15.153:0/1150801359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dcc0b4750 0x7f9dcc164f80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800b050 tx=0x7f9dc802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66abe82ea5829a80 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.912+0000 7f9dd0a00640 1 -- 172.21.15.153:0/1150801359 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8039070 con 0x7f9dcc0b4750 2024-03-28T21:52:05.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.912+0000 7f9dd0a00640 1 -- 172.21.15.153:0/1150801359 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc802cb30 con 0x7f9dcc0b4750 2024-03-28T21:52:05.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.912+0000 7f9dd0a00640 1 -- 172.21.15.153:0/1150801359 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8034440 con 0x7f9dcc0b4750 2024-03-28T21:52:05.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.913+0000 7f9dd3200640 1 -- 172.21.15.153:0/1150801359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dcc0b4750 msgr2=0x7f9dcc164f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.913+0000 7f9dd3200640 1 --2- 172.21.15.153:0/1150801359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dcc0b4750 0x7f9dcc164f80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800b050 tx=0x7f9dc802c010 comp rx=0 tx=0).stop 2024-03-28T21:52:05.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.914+0000 7f9dd3200640 1 -- 172.21.15.153:0/1150801359 shutdown_connections 2024-03-28T21:52:05.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.914+0000 7f9dd3200640 1 --2- 172.21.15.153:0/1150801359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dcc0b4750 0x7f9dcc164f80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.914+0000 7f9dd3200640 1 -- 172.21.15.153:0/1150801359 >> 172.21.15.153:0/1150801359 conn(0x7f9dcc06b170 msgr2=0x7f9dcc06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:05.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.915+0000 7f9dd3200640 1 -- 172.21.15.153:0/1150801359 shutdown_connections 2024-03-28T21:52:05.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.915+0000 7f9dd3200640 1 -- 172.21.15.153:0/1150801359 wait complete. 2024-03-28T21:52:05.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.916+0000 7f7e72a00640 1 -- 172.21.15.153:0/3522568268 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7e6808be50 con 0x7f7e7c155db0 2024-03-28T21:52:05.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.918+0000 7f9dd3200640 1 Processor -- start 2024-03-28T21:52:05.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.918+0000 7f9dd3200640 1 -- start start 2024-03-28T21:52:05.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.919+0000 7f9dd3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc071720 0x7f9dcc159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.920+0000 7f9dd3200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dcc0b4750 0x7f9dcc15a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.920+0000 7f9dd3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc140560 0x7f9dcc15ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.920+0000 7f9dd3200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc0d0570 con 0x7f9dcc0b4750 2024-03-28T21:52:05.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.920+0000 7f9dd3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc140940 con 0x7f9dcc071720 2024-03-28T21:52:05.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.920+0000 7f9dd3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9dcc0d06f0 con 0x7f9dcc140560 2024-03-28T21:52:05.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.921+0000 7f9dd1400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dcc0b4750 0x7f9dcc15a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.921+0000 7f9dd2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc140560 0x7f9dcc15ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.921+0000 7f9dd2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc140560 0x7f9dcc15ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:43070/0 (socket says 172.21.15.153:43070) 2024-03-28T21:52:05.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.921+0000 7f9dd2800640 1 -- 172.21.15.153:0/828625161 learned_addr learned my addr 172.21.15.153:0/828625161 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:05.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.922+0000 7f9dd1400640 1 -- 172.21.15.153:0/828625161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc140560 msgr2=0x7f9dcc15ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.922+0000 7f9dd1400640 1 --2- 172.21.15.153:0/828625161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc140560 0x7f9dcc15ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.923+0000 7f9dd1400640 1 -- 172.21.15.153:0/828625161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc071720 msgr2=0x7f9dcc159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.922+0000 7f9dd1e00640 1 --2- 172.21.15.153:0/828625161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc071720 0x7f9dcc159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.923+0000 7f9dd1400640 1 --2- 172.21.15.153:0/828625161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc071720 0x7f9dcc159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.923+0000 7f9dd1400640 1 -- 172.21.15.153:0/828625161 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc13f3f0 con 0x7f9dcc0b4750 2024-03-28T21:52:05.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.923+0000 7f9dd1e00640 1 --2- 172.21.15.153:0/828625161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc071720 0x7f9dcc159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:05.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.924+0000 7f9dd1400640 1 --2- 172.21.15.153:0/828625161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dcc0b4750 0x7f9dcc15a650 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00c4e0 tx=0x7f9dbc00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.924+0000 7f9dc6000640 1 -- 172.21.15.153:0/828625161 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc017070 con 0x7f9dcc0b4750 2024-03-28T21:52:05.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.925+0000 7f9dc6000640 1 -- 172.21.15.153:0/828625161 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dbc005480 con 0x7f9dcc0b4750 2024-03-28T21:52:05.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.925+0000 7f9dd3200640 1 -- 172.21.15.153:0/828625161 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dcc0cd230 con 0x7f9dcc0b4750 2024-03-28T21:52:05.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.925+0000 7f9dc6000640 1 -- 172.21.15.153:0/828625161 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc003830 con 0x7f9dcc0b4750 2024-03-28T21:52:05.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.928+0000 7f9dd3200640 1 -- 172.21.15.153:0/828625161 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dcc13f6d0 con 0x7f9dcc0b4750 2024-03-28T21:52:05.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.932+0000 7f9dc6000640 1 -- 172.21.15.153:0/828625161 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f9dbc01a070 con 0x7f9dcc0b4750 2024-03-28T21:52:05.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.933+0000 7f9dd3200640 1 -- 172.21.15.153:0/828625161 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dcc04f520 con 0x7f9dcc0b4750 2024-03-28T21:52:05.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.934+0000 7f9dc6000640 1 --2- 172.21.15.153:0/828625161 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9db006b4d0 0x7f9db006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.935+0000 7f9dc6000640 1 -- 172.21.15.153:0/828625161 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9dbc08e060 con 0x7f9dcc0b4750 2024-03-28T21:52:05.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.936+0000 7f9dd1e00640 1 --2- 172.21.15.153:0/828625161 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9db006b4d0 0x7f9db006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.937+0000 7f9dd1e00640 1 --2- 172.21.15.153:0/828625161 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9db006b4d0 0x7f9db006d990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0001030 tx=0x7f9dc0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.943+0000 7f9dc6000640 1 -- 172.21.15.153:0/828625161 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9dbc057bd0 con 0x7f9dcc0b4750 2024-03-28T21:52:05.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.951+0000 7f956f200640 1 Processor -- start 2024-03-28T21:52:05.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.952+0000 7f956f200640 1 -- start start 2024-03-28T21:52:05.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.954+0000 7f956f200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9570161d40 0x7f9570162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.954+0000 7f956f200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f95700d24f0 0x7f95700d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.954+0000 7f956f200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95700cf940 con 0x7f957015e0e0 2024-03-28T21:52:05.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.954+0000 7f956f200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f95700d1aa0 con 0x7f9570161d40 2024-03-28T21:52:05.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.954+0000 7f956f200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f95701626c0 con 0x7f95700d24f0 2024-03-28T21:52:05.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.955+0000 7f956e800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f95700d24f0 0x7f95700d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.955+0000 7f956d400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9570161d40 0x7f9570162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.955+0000 7f956d400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9570161d40 0x7f9570162180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45778/0 (socket says 172.21.15.153:45778) 2024-03-28T21:52:05.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.955+0000 7f956de00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f957015e0e0 0x7f95700b37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:34164/0 (socket says 172.21.15.153:34164) 2024-03-28T21:52:05.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.955+0000 7f956de00640 1 -- 172.21.15.153:0/1896581197 learned_addr learned my addr 172.21.15.153:0/1896581197 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:05.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.956+0000 7f956d400640 1 -- 172.21.15.153:0/1896581197 >> v2:172.21.15.165:3300/0 conn(0x7f95700d24f0 msgr2=0x7f95700d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:05.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.956+0000 7f956d400640 1 --2- 172.21.15.153:0/1896581197 >> v2:172.21.15.165:3300/0 conn(0x7f95700d24f0 0x7f95700d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.956+0000 7f956d400640 1 -- 172.21.15.153:0/1896581197 >> v1:172.21.15.165:6789/0 conn(0x7f957015e0e0 legacy=0x7f95700b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:05.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.957+0000 7f956d400640 1 -- 172.21.15.153:0/1896581197 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95700cfc20 con 0x7f9570161d40 2024-03-28T21:52:05.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.959+0000 7f956d400640 1 --2- 172.21.15.153:0/1896581197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9570161d40 0x7f9570162180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f95700cff00 tx=0x7f955c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8c68e85846a4e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.959+0000 7f956ca00640 1 -- 172.21.15.153:0/1896581197 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c038070 con 0x7f9570161d40 2024-03-28T21:52:05.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.960+0000 7f956ca00640 1 -- 172.21.15.153:0/1896581197 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955c031710 con 0x7f9570161d40 2024-03-28T21:52:05.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.960+0000 7f956ca00640 1 -- 172.21.15.153:0/1896581197 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c031ae0 con 0x7f9570161d40 2024-03-28T21:52:05.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.961+0000 7f956f200640 1 -- 172.21.15.153:0/1896581197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9570161d40 msgr2=0x7f9570162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.961+0000 7f956f200640 1 --2- 172.21.15.153:0/1896581197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9570161d40 0x7f9570162180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f95700cff00 tx=0x7f955c02b7b0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.961+0000 7f956f200640 1 -- 172.21.15.153:0/1896581197 shutdown_connections 2024-03-28T21:52:05.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.961+0000 7f956f200640 1 --2- 172.21.15.153:0/1896581197 >> v2:172.21.15.165:3300/0 conn(0x7f95700d24f0 0x7f95700d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.961+0000 7f956f200640 1 --2- 172.21.15.153:0/1896581197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9570161d40 0x7f9570162180 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.961+0000 7f956f200640 1 -- 172.21.15.153:0/1896581197 >> 172.21.15.153:0/1896581197 conn(0x7f957009d1a0 msgr2=0x7f95700d3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:05.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.964+0000 7f956f200640 1 -- 172.21.15.153:0/1896581197 shutdown_connections 2024-03-28T21:52:05.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.964+0000 7f956f200640 1 -- 172.21.15.153:0/1896581197 wait complete. 2024-03-28T21:52:05.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.966+0000 7f956f200640 1 Processor -- start 2024-03-28T21:52:05.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.966+0000 7f956f200640 1 -- start start 2024-03-28T21:52:05.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.968+0000 7f956f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95700d24f0 0x7f9570150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.968+0000 7f956f200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f957015e0e0 0x7f95700b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.968+0000 7f956f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9570161d40 0x7f95700b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.968+0000 7f956f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95700b3ed0 con 0x7f95700d24f0 2024-03-28T21:52:05.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.968+0000 7f956f200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f95700d2ec0 con 0x7f957015e0e0 2024-03-28T21:52:05.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.968+0000 7f956f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f957015e4c0 con 0x7f9570161d40 2024-03-28T21:52:05.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.969+0000 7f956e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9570161d40 0x7f95700b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.969+0000 7f956e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9570161d40 0x7f95700b1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:43086/0 (socket says 172.21.15.153:43086) 2024-03-28T21:52:05.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.969+0000 7f956e800640 1 -- 172.21.15.153:0/3998714471 learned_addr learned my addr 172.21.15.153:0/3998714471 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:05.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.969+0000 7f956de00640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95700d24f0 0x7f9570150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.969+0000 7f956d400640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f957015e0e0 0x7f95700b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.970+0000 7f956e800640 1 -- 172.21.15.153:0/3998714471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f957015e0e0 msgr2=0x7f95700b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.970+0000 7f956e800640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f957015e0e0 0x7f95700b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.970+0000 7f956e800640 1 -- 172.21.15.153:0/3998714471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95700d24f0 msgr2=0x7f9570150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:05.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.970+0000 7f956e800640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95700d24f0 0x7f9570150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:05.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.970+0000 7f956e800640 1 -- 172.21.15.153:0/3998714471 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95701e8520 con 0x7f9570161d40 2024-03-28T21:52:05.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.970+0000 7f956de00640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95700d24f0 0x7f9570150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:52:05.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.973+0000 7f956e800640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9570161d40 0x7f95700b1620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9568009dd0 tx=0x7f956800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:05.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.973+0000 7f9566000640 1 -- 172.21.15.153:0/3998714471 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568018020 con 0x7f9570161d40 2024-03-28T21:52:05.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.973+0000 7f9566000640 1 -- 172.21.15.153:0/3998714471 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9568014480 con 0x7f9570161d40 2024-03-28T21:52:05.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.973+0000 7f9566000640 1 -- 172.21.15.153:0/3998714471 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568014870 con 0x7f9570161d40 2024-03-28T21:52:05.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.974+0000 7f956f200640 1 -- 172.21.15.153:0/3998714471 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95701e8800 con 0x7f9570161d40 2024-03-28T21:52:05.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.974+0000 7f956f200640 1 -- 172.21.15.153:0/3998714471 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f95701e8dc0 con 0x7f9570161d40 2024-03-28T21:52:05.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.976+0000 7f956f200640 1 -- 172.21.15.153:0/3998714471 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f957004f4b0 con 0x7f9570161d40 2024-03-28T21:52:05.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.982+0000 7f9566000640 1 -- 172.21.15.153:0/3998714471 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f9568005d10 con 0x7f9570161d40 2024-03-28T21:52:05.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.983+0000 7f9566000640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f955006b4d0 0x7f955006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:05.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.983+0000 7f9566000640 1 -- 172.21.15.153:0/3998714471 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f956808ae40 con 0x7f9570161d40 2024-03-28T21:52:05.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.986+0000 7f956de00640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f955006b4d0 0x7f955006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:05.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.987+0000 7f956de00640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f955006b4d0 0x7f955006d990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9560007c90 tx=0x7f9560007be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:06.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:05.997+0000 7f9566000640 1 -- 172.21.15.153:0/3998714471 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9568022070 con 0x7f9570161d40 2024-03-28T21:52:06.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.117+0000 7f3266a00640 1 -- 172.21.15.153:0/1317230613 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3278072680 con 0x7f32780b3a60 2024-03-28T21:52:06.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.118+0000 7f3275600640 1 -- 172.21.15.153:0/1317230613 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f326807b6e0 con 0x7f32780b3a60 2024-03-28T21:52:06.123 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2024-03-28T21:52:06.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.122+0000 7f3266a00640 1 -- 172.21.15.153:0/1317230613 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f325c06b4d0 msgr2=0x7f325c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.122+0000 7f3266a00640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f325c06b4d0 0x7f325c06d990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3278160e10 tx=0x7f326c007eb0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.122+0000 7f3266a00640 1 -- 172.21.15.153:0/1317230613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32780b3a60 msgr2=0x7f32780ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.122+0000 7f3266a00640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32780b3a60 0x7f32780ca640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3268032000 tx=0x7f32680046c0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.123+0000 7f3266a00640 1 -- 172.21.15.153:0/1317230613 shutdown_connections 2024-03-28T21:52:06.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.123+0000 7f3266a00640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f325c06b4d0 0x7f325c06d990 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3278160e10 tx=0x7f326c007eb0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.123+0000 7f3266a00640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3278161990 0x7f3278162310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.123+0000 7f3266a00640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32780d2ad0 0x7f327815c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.123+0000 7f3266a00640 1 --2- 172.21.15.153:0/1317230613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32780b3a60 0x7f32780ca640 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3268032000 tx=0x7f32680046c0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.123+0000 7f3266a00640 1 -- 172.21.15.153:0/1317230613 >> 172.21.15.153:0/1317230613 conn(0x7f327809d430 msgr2=0x7f32780d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:06.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.126+0000 7f3266a00640 1 -- 172.21.15.153:0/1317230613 shutdown_connections 2024-03-28T21:52:06.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.126+0000 7f3266a00640 1 -- 172.21.15.153:0/1317230613 wait complete. 2024-03-28T21:52:06.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.139+0000 7f1f7e600640 1 -- 172.21.15.153:0/640956932 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1f54005580 con 0x7f1f700ead00 2024-03-28T21:52:06.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.143+0000 7f1f74c00640 1 -- 172.21.15.153:0/640956932 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1f780d7fa0 con 0x7f1f700ead00 2024-03-28T21:52:06.145 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-03-28T21:52:06.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.150+0000 7f1f7e600640 1 -- 172.21.15.153:0/640956932 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1f5806b6d0 msgr2=0x7f1f5806db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.150+0000 7f1f7e600640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1f5806b6d0 0x7f1f5806db90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c000f60 tx=0x7f1f6c000bc0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.150+0000 7f1f7e600640 1 -- 172.21.15.153:0/640956932 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f700ead00 msgr2=0x7f1f7004d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.150+0000 7f1f7e600640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f700ead00 0x7f1f7004d860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1f78069fe0 tx=0x7f1f78068ca0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.153+0000 7f1f7e600640 1 -- 172.21.15.153:0/640956932 shutdown_connections 2024-03-28T21:52:06.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.153+0000 7f1f7e600640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1f5806b6d0 0x7f1f5806db90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.153+0000 7f1f7e600640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f700ead00 0x7f1f7004d860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.153+0000 7f1f7e600640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f70006810 0x7f1f7004d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.153+0000 7f1f7e600640 1 --2- 172.21.15.153:0/640956932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f70005e90 0x7f1f700d6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.153+0000 7f1f7e600640 1 -- 172.21.15.153:0/640956932 >> 172.21.15.153:0/640956932 conn(0x7f1f70009fb0 msgr2=0x7f1f70004930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:06.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.153+0000 7f1f7e600640 1 -- 172.21.15.153:0/640956932 shutdown_connections 2024-03-28T21:52:06.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.153+0000 7f1f7e600640 1 -- 172.21.15.153:0/640956932 wait complete. 2024-03-28T21:52:06.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.0 2024-03-28T21:52:06.164 DEBUG:teuthology.parallel:result is None 2024-03-28T21:52:06.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-03-28T21:52:06.185 DEBUG:teuthology.parallel:result is None 2024-03-28T21:52:06.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.205+0000 7f3896a00640 1 -- 172.21.15.153:0/3429153039 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f38a00d0530 con 0x7f38a015e180 2024-03-28T21:52:06.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.206+0000 7f389d600640 1 -- 172.21.15.153:0/3429153039 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3888057ce0 con 0x7f38a015e180 2024-03-28T21:52:06.208 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-03-28T21:52:06.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.208+0000 7f3896a00640 1 -- 172.21.15.153:0/3429153039 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f387c06b550 msgr2=0x7f387c06da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.208+0000 7f3896a00640 1 --2- 172.21.15.153:0/3429153039 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f387c06b550 0x7f387c06da10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38a00c7080 tx=0x7f3898008030 comp rx=0 tx=0).stop 2024-03-28T21:52:06.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.209+0000 7f3896a00640 1 -- 172.21.15.153:0/3429153039 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38a015e180 msgr2=0x7f38a00b9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.209+0000 7f3896a00640 1 --2- 172.21.15.153:0/3429153039 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38a015e180 0x7f38a00b9830 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f388800c3c0 tx=0x7f388800c880 comp rx=0 tx=0).stop 2024-03-28T21:52:06.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.209+0000 7f3896a00640 1 -- 172.21.15.153:0/3429153039 shutdown_connections 2024-03-28T21:52:06.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.209+0000 7f3896a00640 1 --2- 172.21.15.153:0/3429153039 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f387c06b550 0x7f387c06da10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.209+0000 7f3896a00640 1 --2- 172.21.15.153:0/3429153039 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38a015e180 0x7f38a00b9830 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.209+0000 7f3896a00640 1 --2- 172.21.15.153:0/3429153039 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38a00d4680 0x7f38a00b92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.209+0000 7f3896a00640 1 --2- 172.21.15.153:0/3429153039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a00d1070 0x7f38a015cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.209+0000 7f3896a00640 1 -- 172.21.15.153:0/3429153039 >> 172.21.15.153:0/3429153039 conn(0x7f38a009d1e0 msgr2=0x7f38a00b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:06.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.209+0000 7f3896a00640 1 -- 172.21.15.153:0/3429153039 shutdown_connections 2024-03-28T21:52:06.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.209+0000 7f3896a00640 1 -- 172.21.15.153:0/3429153039 wait complete. 2024-03-28T21:52:06.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-03-28T21:52:06.227 DEBUG:teuthology.parallel:result is None 2024-03-28T21:52:06.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.244+0000 7f284be00640 1 -- 172.21.15.153:0/714833588 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2844056bf0 con 0x7f2844052630 2024-03-28T21:52:06.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.245+0000 7f2842a00640 1 -- 172.21.15.153:0/714833588 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f284c0d4cf0 con 0x7f2844052630 2024-03-28T21:52:06.247 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-03-28T21:52:06.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.248+0000 7f284be00640 1 -- 172.21.15.153:0/714833588 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f282c06b4d0 msgr2=0x7f282c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.248+0000 7f284be00640 1 --2- 172.21.15.153:0/714833588 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f282c06b4d0 0x7f282c06d990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2844038910 tx=0x7f283c032000 comp rx=0 tx=0).stop 2024-03-28T21:52:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.248+0000 7f284be00640 1 -- 172.21.15.153:0/714833588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2844052630 msgr2=0x7f28440e5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.248+0000 7f284be00640 1 --2- 172.21.15.153:0/714833588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2844052630 0x7f28440e5d00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f284c02d700 tx=0x7f284c068ca0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.248+0000 7f284be00640 1 -- 172.21.15.153:0/714833588 shutdown_connections 2024-03-28T21:52:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.248+0000 7f284be00640 1 --2- 172.21.15.153:0/714833588 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f282c06b4d0 0x7f282c06d990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.248+0000 7f284be00640 1 --2- 172.21.15.153:0/714833588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28440e6240 0x7f28440db680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.248+0000 7f284be00640 1 --2- 172.21.15.153:0/714833588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2844052630 0x7f28440e5d00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.248+0000 7f284be00640 1 --2- 172.21.15.153:0/714833588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28300039b0 0x7f28440e36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.248+0000 7f284be00640 1 -- 172.21.15.153:0/714833588 >> 172.21.15.153:0/714833588 conn(0x7f2844058ee0 msgr2=0x7f2844039160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.248+0000 7f284be00640 1 -- 172.21.15.153:0/714833588 shutdown_connections 2024-03-28T21:52:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.248+0000 7f284be00640 1 -- 172.21.15.153:0/714833588 wait complete. 2024-03-28T21:52:06.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-03-28T21:52:06.275 DEBUG:teuthology.parallel:result is None 2024-03-28T21:52:06.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.303+0000 7f373b800640 1 -- 172.21.15.153:0/2058476105 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f37340ca4c0 con 0x7f373415a4d0 2024-03-28T21:52:06.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.303+0000 7f3730c00640 1 -- 172.21.15.153:0/2058476105 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f372c010070 con 0x7f373415a4d0 2024-03-28T21:52:06.306 INFO:teuthology.orchestra.run.smithi153.stdout:60129542151 2024-03-28T21:52:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.306+0000 7f373b800640 1 -- 172.21.15.153:0/2058476105 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f371406b500 msgr2=0x7f371406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.306+0000 7f373b800640 1 --2- 172.21.15.153:0/2058476105 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f371406b500 0x7f371406d9c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3728009aa0 tx=0x7f3728009190 comp rx=0 tx=0).stop 2024-03-28T21:52:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.306+0000 7f373b800640 1 -- 172.21.15.153:0/2058476105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f373415a4d0 msgr2=0x7f37340c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.306+0000 7f373b800640 1 --2- 172.21.15.153:0/2058476105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f373415a4d0 0x7f37340c8fe0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f372c007db0 tx=0x7f372c00d4a0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.306+0000 7f373b800640 1 -- 172.21.15.153:0/2058476105 shutdown_connections 2024-03-28T21:52:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.306+0000 7f373b800640 1 --2- 172.21.15.153:0/2058476105 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f371406b500 0x7f371406d9c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.306+0000 7f373b800640 1 --2- 172.21.15.153:0/2058476105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f373415a4d0 0x7f37340c8fe0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.306+0000 7f373b800640 1 --2- 172.21.15.153:0/2058476105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3734161990 0x7f373415aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.306+0000 7f373b800640 1 --2- 172.21.15.153:0/2058476105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37340d14e0 0x7f37340ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.306+0000 7f373b800640 1 -- 172.21.15.153:0/2058476105 >> 172.21.15.153:0/2058476105 conn(0x7f373409d430 msgr2=0x7f37340b6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:06.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.307+0000 7f373b800640 1 -- 172.21.15.153:0/2058476105 shutdown_connections 2024-03-28T21:52:06.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.307+0000 7f373b800640 1 -- 172.21.15.153:0/2058476105 wait complete. 2024-03-28T21:52:06.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.1 2024-03-28T21:52:06.331 DEBUG:teuthology.parallel:result is None 2024-03-28T21:52:06.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.373+0000 7f956f200640 1 -- 172.21.15.153:0/3998714471 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f95700b5a60 con 0x7f9570161d40 2024-03-28T21:52:06.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.374+0000 7f9566000640 1 -- 172.21.15.153:0/3998714471 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9568010040 con 0x7f9570161d40 2024-03-28T21:52:06.376 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-03-28T21:52:06.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.376+0000 7f956f200640 1 -- 172.21.15.153:0/3998714471 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f955006b4d0 msgr2=0x7f955006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.376+0000 7f956f200640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f955006b4d0 0x7f955006d990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9560007c90 tx=0x7f9560007be0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.376+0000 7f956f200640 1 -- 172.21.15.153:0/3998714471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9570161d40 msgr2=0x7f95700b1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.376+0000 7f956f200640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9570161d40 0x7f95700b1620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9568009dd0 tx=0x7f956800c490 comp rx=0 tx=0).stop 2024-03-28T21:52:06.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.376+0000 7f956f200640 1 -- 172.21.15.153:0/3998714471 shutdown_connections 2024-03-28T21:52:06.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.376+0000 7f956f200640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f955006b4d0 0x7f955006d990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.376+0000 7f956f200640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9570161d40 0x7f95700b1620 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.376+0000 7f956f200640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f957015e0e0 0x7f95700b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.376+0000 7f956f200640 1 --2- 172.21.15.153:0/3998714471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95700d24f0 0x7f9570150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.376+0000 7f956f200640 1 -- 172.21.15.153:0/3998714471 >> 172.21.15.153:0/3998714471 conn(0x7f957009d1a0 msgr2=0x7f95700b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:06.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.376+0000 7f956f200640 1 -- 172.21.15.153:0/3998714471 shutdown_connections 2024-03-28T21:52:06.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.376+0000 7f956f200640 1 -- 172.21.15.153:0/3998714471 wait complete. 2024-03-28T21:52:06.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.386+0000 7f7e81600640 1 -- 172.21.15.153:0/3522568268 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7e7c09d8d0 con 0x7f7e7c155db0 2024-03-28T21:52:06.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.387+0000 7f7e72a00640 1 -- 172.21.15.153:0/3522568268 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7e6808b750 con 0x7f7e7c155db0 2024-03-28T21:52:06.390 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2024-03-28T21:52:06.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.390+0000 7f7e81600640 1 -- 172.21.15.153:0/3522568268 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7e5c06b4d0 msgr2=0x7f7e5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.390+0000 7f7e81600640 1 --2- 172.21.15.153:0/3522568268 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7e5c06b4d0 0x7f7e5c06d990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7e74007e10 tx=0x7f7e74007320 comp rx=0 tx=0).stop 2024-03-28T21:52:06.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.390+0000 7f7e81600640 1 -- 172.21.15.153:0/3522568268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e7c155db0 msgr2=0x7f7e7c154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.390+0000 7f7e81600640 1 --2- 172.21.15.153:0/3522568268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e7c155db0 0x7f7e7c154af0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7e68048040 tx=0x7f7e7c0cfca0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.391+0000 7f7e81600640 1 -- 172.21.15.153:0/3522568268 shutdown_connections 2024-03-28T21:52:06.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.391+0000 7f7e81600640 1 --2- 172.21.15.153:0/3522568268 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7e5c06b4d0 0x7f7e5c06d990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.391+0000 7f7e81600640 1 --2- 172.21.15.153:0/3522568268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e7c1597d0 0x7f7e7c159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.391+0000 7f7e81600640 1 --2- 172.21.15.153:0/3522568268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e7c155db0 0x7f7e7c154af0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.391+0000 7f7e81600640 1 --2- 172.21.15.153:0/3522568268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e60004800 0x7f7e7c157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.391+0000 7f7e81600640 1 -- 172.21.15.153:0/3522568268 >> 172.21.15.153:0/3522568268 conn(0x7f7e7c09d430 msgr2=0x7f7e7c0b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:06.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.391+0000 7f7e81600640 1 -- 172.21.15.153:0/3522568268 shutdown_connections 2024-03-28T21:52:06.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.391+0000 7f7e81600640 1 -- 172.21.15.153:0/3522568268 wait complete. 2024-03-28T21:52:06.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-03-28T21:52:06.397 DEBUG:teuthology.parallel:result is None 2024-03-28T21:52:06.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.398+0000 7f9dd3200640 1 -- 172.21.15.153:0/828625161 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9dcc06ea40 con 0x7f9dcc0b4750 2024-03-28T21:52:06.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.398+0000 7f9dc6000640 1 -- 172.21.15.153:0/828625161 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9dbc05bc70 con 0x7f9dcc0b4750 2024-03-28T21:52:06.400 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-03-28T21:52:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.400+0000 7f9dd3200640 1 -- 172.21.15.153:0/828625161 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9db006b4d0 msgr2=0x7f9db006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.400+0000 7f9dd3200640 1 --2- 172.21.15.153:0/828625161 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9db006b4d0 0x7f9db006d990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0001030 tx=0x7f9dc0009040 comp rx=0 tx=0).stop 2024-03-28T21:52:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.400+0000 7f9dd3200640 1 -- 172.21.15.153:0/828625161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dcc0b4750 msgr2=0x7f9dcc15a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.400+0000 7f9dd3200640 1 --2- 172.21.15.153:0/828625161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dcc0b4750 0x7f9dcc15a650 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00c4e0 tx=0x7f9dbc00c9a0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.401+0000 7f9dd3200640 1 -- 172.21.15.153:0/828625161 shutdown_connections 2024-03-28T21:52:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.401+0000 7f9dd3200640 1 --2- 172.21.15.153:0/828625161 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9db006b4d0 0x7f9db006d990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.401+0000 7f9dd3200640 1 --2- 172.21.15.153:0/828625161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc140560 0x7f9dcc15ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.401+0000 7f9dd3200640 1 --2- 172.21.15.153:0/828625161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dcc0b4750 0x7f9dcc15a650 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.401+0000 7f9dd3200640 1 --2- 172.21.15.153:0/828625161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc071720 0x7f9dcc159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.401+0000 7f9dd3200640 1 -- 172.21.15.153:0/828625161 >> 172.21.15.153:0/828625161 conn(0x7f9dcc06b170 msgr2=0x7f9dcc06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:06.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.401+0000 7f9dd3200640 1 -- 172.21.15.153:0/828625161 shutdown_connections 2024-03-28T21:52:06.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.401+0000 7f9dd3200640 1 -- 172.21.15.153:0/828625161 wait complete. 2024-03-28T21:52:06.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2024-03-28T21:52:06.411 DEBUG:teuthology.parallel:result is None 2024-03-28T21:52:06.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-03-28T21:52:06.421 DEBUG:teuthology.parallel:result is None 2024-03-28T21:52:06.421 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-28T21:52:06.421 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T21:52:06.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.651+0000 7f5c01200640 1 Processor -- start 2024-03-28T21:52:06.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.651+0000 7f5c01200640 1 -- start start 2024-03-28T21:52:06.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.652+0000 7f5c01200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bfc159a10 0x7f5bfc15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:06.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.652+0000 7f5c01200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5bfc0ad830 0x7f5bfc06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:06.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.653+0000 7f5c01200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bfc0b2e60 con 0x7f5bfc06e270 2024-03-28T21:52:06.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.653+0000 7f5c01200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5bfc0adc70 con 0x7f5bfc0ad830 2024-03-28T21:52:06.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.653+0000 7f5c01200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5bfc159df0 con 0x7f5bfc159a10 2024-03-28T21:52:06.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.653+0000 7f5bfa800640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5bfc06e270 0x7f5bfc15fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54666/0 (socket says 172.21.15.153:54666) 2024-03-28T21:52:06.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.653+0000 7f5bfa800640 1 -- 172.21.15.153:0/1933959913 learned_addr learned my addr 172.21.15.153:0/1933959913 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:06.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.653+0000 7f5bf9e00640 1 --2- 172.21.15.153:0/1933959913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bfc159a10 0x7f5bfc15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:06.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.653+0000 7f5bf9400640 1 --2- 172.21.15.153:0/1933959913 >> v2:172.21.15.165:3300/0 conn(0x7f5bfc0ad830 0x7f5bfc06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:06.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.653+0000 7f5bf8a00640 1 -- 172.21.15.153:0/1933959913 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3470398047 0 0) 0x7f5bfc0b2e60 con 0x7f5bfc06e270 2024-03-28T21:52:06.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.653+0000 7f5bf8a00640 1 -- 172.21.15.153:0/1933959913 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5be0003520 con 0x7f5bfc06e270 2024-03-28T21:52:06.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf8a00640 1 -- 172.21.15.153:0/1933959913 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1710321336 0 0) 0x7f5be0003520 con 0x7f5bfc06e270 2024-03-28T21:52:06.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf8a00640 1 -- 172.21.15.153:0/1933959913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bfc159a10 msgr2=0x7f5bfc15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:06.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf8a00640 1 --2- 172.21.15.153:0/1933959913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bfc159a10 0x7f5bfc15cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf8a00640 1 -- 172.21.15.153:0/1933959913 >> v2:172.21.15.165:3300/0 conn(0x7f5bfc0ad830 msgr2=0x7f5bfc06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:06.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf8a00640 1 --2- 172.21.15.153:0/1933959913 >> v2:172.21.15.165:3300/0 conn(0x7f5bfc0ad830 0x7f5bfc06dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf8a00640 1 -- 172.21.15.153:0/1933959913 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bfc0adf10 con 0x7f5bfc06e270 2024-03-28T21:52:06.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf8a00640 1 -- 172.21.15.153:0/1933959913 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f5bf40019f0 con 0x7f5bfc06e270 2024-03-28T21:52:06.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf8a00640 1 -- 172.21.15.153:0/1933959913 >> v1:172.21.15.153:6789/0 conn(0x7f5bfc06e270 legacy=0x7f5bfc15fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf8a00640 1 --2- 172.21.15.153:0/1933959913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bfc159a10 0x7f5be00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:06.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf8a00640 1 --2- 172.21.15.153:0/1933959913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5be0003f30 0x7f5be0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:06.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf8a00640 1 --2- 172.21.15.153:0/1933959913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be0004d40 0x7f5be00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:06.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf8a00640 1 -- 172.21.15.153:0/1933959913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc0adc70 con 0x7f5be0004d40 2024-03-28T21:52:06.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf8a00640 1 -- 172.21.15.153:0/1933959913 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc159df0 con 0x7f5be0003f30 2024-03-28T21:52:06.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf8a00640 1 -- 172.21.15.153:0/1933959913 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5be000ba10 con 0x7f5bfc159a10 2024-03-28T21:52:06.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bfa800640 1 --2- 172.21.15.153:0/1933959913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be0004d40 0x7f5be00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:06.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bf9e00640 1 --2- 172.21.15.153:0/1933959913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bfc159a10 0x7f5be00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:06.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bfa800640 1 -- 172.21.15.153:0/1933959913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bfc159a10 msgr2=0x7f5be00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:06.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bfa800640 1 --2- 172.21.15.153:0/1933959913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bfc159a10 0x7f5be00039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bfa800640 1 -- 172.21.15.153:0/1933959913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5be0003f30 msgr2=0x7f5be0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:06.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bfa800640 1 --2- 172.21.15.153:0/1933959913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5be0003f30 0x7f5be0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.654+0000 7f5bfa800640 1 -- 172.21.15.153:0/1933959913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be0003520 con 0x7f5be0004d40 2024-03-28T21:52:06.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.655+0000 7f5bfa800640 1 --2- 172.21.15.153:0/1933959913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be0004d40 0x7f5be00051c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400a8d0 tx=0x7f5be0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1d45e4a53b252f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:06.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.656+0000 7f5bf8a00640 1 -- 172.21.15.153:0/1933959913 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf400a4c0 con 0x7f5be0004d40 2024-03-28T21:52:06.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.656+0000 7f5bf8a00640 1 -- 172.21.15.153:0/1933959913 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf4034650 con 0x7f5be0004d40 2024-03-28T21:52:06.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.656+0000 7f5bf8a00640 1 -- 172.21.15.153:0/1933959913 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4034a80 con 0x7f5be0004d40 2024-03-28T21:52:06.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.656+0000 7f5c01200640 1 -- 172.21.15.153:0/1933959913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be0004d40 msgr2=0x7f5be00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.656+0000 7f5c01200640 1 --2- 172.21.15.153:0/1933959913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be0004d40 0x7f5be00051c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400a8d0 tx=0x7f5be0005830 comp rx=0 tx=0).stop 2024-03-28T21:52:06.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.656+0000 7f5bfa800640 1 -- 172.21.15.153:0/1933959913 reap_dead start 2024-03-28T21:52:06.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.656+0000 7f5c01200640 1 -- 172.21.15.153:0/1933959913 shutdown_connections 2024-03-28T21:52:06.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.656+0000 7f5c01200640 1 -- 172.21.15.153:0/1933959913 >> 172.21.15.153:0/1933959913 conn(0x7f5bfc0b1a30 msgr2=0x7f5bfc0b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:06.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.656+0000 7f5c01200640 1 -- 172.21.15.153:0/1933959913 shutdown_connections 2024-03-28T21:52:06.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.656+0000 7f5c01200640 1 -- 172.21.15.153:0/1933959913 wait complete. 2024-03-28T21:52:06.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.658+0000 7f5c01200640 1 Processor -- start 2024-03-28T21:52:06.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.658+0000 7f5c01200640 1 -- start start 2024-03-28T21:52:06.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.659+0000 7f5c01200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be0004d40 0x7f5bfc14d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:06.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.659+0000 7f5c01200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bfc156400 0x7f5bfc1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:06.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.659+0000 7f5c01200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bfc072070 0x7f5bfc0724f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:06.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.659+0000 7f5c01200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc0ae4d0 con 0x7f5be0004d40 2024-03-28T21:52:06.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.659+0000 7f5c01200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc0b3100 con 0x7f5bfc156400 2024-03-28T21:52:06.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.659+0000 7f5c01200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5bfc0b4630 con 0x7f5bfc072070 2024-03-28T21:52:06.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.659+0000 7f5bf9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be0004d40 0x7f5bfc14d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:06.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.659+0000 7f5bf9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be0004d40 0x7f5bfc14d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45808/0 (socket says 172.21.15.153:45808) 2024-03-28T21:52:06.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.659+0000 7f5bf9e00640 1 -- 172.21.15.153:0/3952580230 learned_addr learned my addr 172.21.15.153:0/3952580230 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:06.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.660+0000 7f5bf9400640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bfc156400 0x7f5bfc1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:06.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.660+0000 7f5bfa800640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bfc072070 0x7f5bfc0724f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:06.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.660+0000 7f5bf9e00640 1 -- 172.21.15.153:0/3952580230 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bfc072070 msgr2=0x7f5bfc0724f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.660+0000 7f5bf9e00640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bfc072070 0x7f5bfc0724f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.660+0000 7f5bf9e00640 1 -- 172.21.15.153:0/3952580230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bfc156400 msgr2=0x7f5bfc1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.660+0000 7f5bf9e00640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bfc156400 0x7f5bfc1588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.660+0000 7f5bf9e00640 1 -- 172.21.15.153:0/3952580230 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bfc1569a0 con 0x7f5be0004d40 2024-03-28T21:52:06.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.660+0000 7f5bf9400640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bfc156400 0x7f5bfc1588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:06.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.660+0000 7f5bf9e00640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be0004d40 0x7f5bfc14d530 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5bec010890 tx=0x7f5bec010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:06.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.660+0000 7f5bf2000640 1 -- 172.21.15.153:0/3952580230 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec00f040 con 0x7f5be0004d40 2024-03-28T21:52:06.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.660+0000 7f5bf2000640 1 -- 172.21.15.153:0/3952580230 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bec00eb60 con 0x7f5be0004d40 2024-03-28T21:52:06.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.660+0000 7f5bf2000640 1 -- 172.21.15.153:0/3952580230 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec01c400 con 0x7f5be0004d40 2024-03-28T21:52:06.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.660+0000 7f5c01200640 1 -- 172.21.15.153:0/3952580230 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bfc156c80 con 0x7f5be0004d40 2024-03-28T21:52:06.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.660+0000 7f5c01200640 1 -- 172.21.15.153:0/3952580230 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bfc157240 con 0x7f5be0004d40 2024-03-28T21:52:06.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.661+0000 7f5c01200640 1 -- 172.21.15.153:0/3952580230 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bfc068ff0 con 0x7f5be0004d40 2024-03-28T21:52:06.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.662+0000 7f5bf2000640 1 -- 172.21.15.153:0/3952580230 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f5bec01c5a0 con 0x7f5be0004d40 2024-03-28T21:52:06.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.664+0000 7f5bf2000640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5bd806b4d0 0x7f5bd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:06.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.664+0000 7f5bf2000640 1 -- 172.21.15.153:0/3952580230 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5bec08a870 con 0x7f5be0004d40 2024-03-28T21:52:06.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.664+0000 7f5bf9400640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5bd806b4d0 0x7f5bd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:06.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.664+0000 7f5bf9400640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5bd806b4d0 0x7f5bd806d990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc155910 tx=0x7f5be4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:06.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.668+0000 7f5bf2000640 1 -- 172.21.15.153:0/3952580230 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5bec018030 con 0x7f5be0004d40 2024-03-28T21:52:06.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.853+0000 7f5c01200640 1 -- 172.21.15.153:0/3952580230 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5bfc074500 con 0x7f5bd806b4d0 2024-03-28T21:52:06.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.870+0000 7f5bf2000640 1 -- 172.21.15.153:0/3952580230 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251838 (secure 0 0 0) 0x7f5bfc074500 con 0x7f5bd806b4d0 2024-03-28T21:52:06.877 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:06.878 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-03-28T21:52:06.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.876+0000 7f5c01200640 1 -- 172.21.15.153:0/3952580230 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5bd806b4d0 msgr2=0x7f5bd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.876+0000 7f5c01200640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5bd806b4d0 0x7f5bd806d990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc155910 tx=0x7f5be4008040 comp rx=0 tx=0).stop 2024-03-28T21:52:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.876+0000 7f5c01200640 1 -- 172.21.15.153:0/3952580230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be0004d40 msgr2=0x7f5bfc14d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.876+0000 7f5c01200640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be0004d40 0x7f5bfc14d530 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5bec010890 tx=0x7f5bec010d50 comp rx=0 tx=0).stop 2024-03-28T21:52:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.876+0000 7f5c01200640 1 -- 172.21.15.153:0/3952580230 shutdown_connections 2024-03-28T21:52:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.876+0000 7f5c01200640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5bd806b4d0 0x7f5bd806d990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.876+0000 7f5c01200640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bfc072070 0x7f5bfc0724f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.876+0000 7f5c01200640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bfc156400 0x7f5bfc1588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.876+0000 7f5c01200640 1 --2- 172.21.15.153:0/3952580230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be0004d40 0x7f5bfc14d530 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.876+0000 7f5c01200640 1 -- 172.21.15.153:0/3952580230 >> 172.21.15.153:0/3952580230 conn(0x7f5bfc0b1a30 msgr2=0x7f5bfc09ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.877+0000 7f5c01200640 1 -- 172.21.15.153:0/3952580230 shutdown_connections 2024-03-28T21:52:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:06.877+0000 7f5c01200640 1 -- 172.21.15.153:0/3952580230 wait complete. 2024-03-28T21:52:06.903 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-28T21:52:05.466354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223492,"kb_used_data":2984,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751228,"statfs":{"total":773094113280,"available":772865257472,"internally_reserved":0,"allocated":3055616,"data_stored":1816228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.769494"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735977+0000","last_change":"2024-03-28T21:51:56.734116+0000","last_active":"2024-03-28T21:51:57.735977+0000","last_peered":"2024-03-28T21:51:57.735977+0000","last_clean":"2024-03-28T21:51:57.735977+0000","last_became_active":"2024-03-28T21:51:56.733812+0000","last_became_peered":"2024-03-28T21:51:56.733812+0000","last_unstale":"2024-03-28T21:51:57.735977+0000","last_undegraded":"2024-03-28T21:51:57.735977+0000","last_fullsized":"2024-03-28T21:51:57.735977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:55:29.475667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740119+0000","last_change":"2024-03-28T21:51:56.735553+0000","last_active":"2024-03-28T21:51:57.740119+0000","last_peered":"2024-03-28T21:51:57.740119+0000","last_clean":"2024-03-28T21:51:57.740119+0000","last_became_active":"2024-03-28T21:51:56.734024+0000","last_became_peered":"2024-03-28T21:51:56.734024+0000","last_unstale":"2024-03-28T21:51:57.740119+0000","last_undegraded":"2024-03-28T21:51:57.740119+0000","last_fullsized":"2024-03-28T21:51:57.740119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:11.932847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.329774+0000","last_change":"2024-03-28T21:51:56.737454+0000","last_active":"2024-03-28T21:51:58.329774+0000","last_peered":"2024-03-28T21:51:58.329774+0000","last_clean":"2024-03-28T21:51:58.329774+0000","last_became_active":"2024-03-28T21:51:56.737087+0000","last_became_peered":"2024-03-28T21:51:56.737087+0000","last_unstale":"2024-03-28T21:51:58.329774+0000","last_undegraded":"2024-03-28T21:51:58.329774+0000","last_fullsized":"2024-03-28T21:51:58.329774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:53:53.920816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331759+0000","last_change":"2024-03-28T21:51:56.736235+0000","last_active":"2024-03-28T21:51:58.331759+0000","last_peered":"2024-03-28T21:51:58.331759+0000","last_clean":"2024-03-28T21:51:58.331759+0000","last_became_active":"2024-03-28T21:51:56.735603+0000","last_became_peered":"2024-03-28T21:51:56.735603+0000","last_unstale":"2024-03-28T21:51:58.331759+0000","last_undegraded":"2024-03-28T21:51:58.331759+0000","last_fullsized":"2024-03-28T21:51:58.331759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:24.456985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735254+0000","last_change":"2024-03-28T21:51:56.739891+0000","last_active":"2024-03-28T21:51:57.735254+0000","last_peered":"2024-03-28T21:51:57.735254+0000","last_clean":"2024-03-28T21:51:57.735254+0000","last_became_active":"2024-03-28T21:51:56.739615+0000","last_became_peered":"2024-03-28T21:51:56.739615+0000","last_unstale":"2024-03-28T21:51:57.735254+0000","last_undegraded":"2024-03-28T21:51:57.735254+0000","last_fullsized":"2024-03-28T21:51:57.735254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:30.418711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331127+0000","last_change":"2024-03-28T21:51:56.742464+0000","last_active":"2024-03-28T21:51:58.331127+0000","last_peered":"2024-03-28T21:51:58.331127+0000","last_clean":"2024-03-28T21:51:58.331127+0000","last_became_active":"2024-03-28T21:51:56.741634+0000","last_became_peered":"2024-03-28T21:51:56.741634+0000","last_unstale":"2024-03-28T21:51:58.331127+0000","last_undegraded":"2024-03-28T21:51:58.331127+0000","last_fullsized":"2024-03-28T21:51:58.331127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:09:58.678525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735080+0000","last_change":"2024-03-28T21:51:56.743653+0000","last_active":"2024-03-28T21:51:57.735080+0000","last_peered":"2024-03-28T21:51:57.735080+0000","last_clean":"2024-03-28T21:51:57.735080+0000","last_became_active":"2024-03-28T21:51:56.742149+0000","last_became_peered":"2024-03-28T21:51:56.742149+0000","last_unstale":"2024-03-28T21:51:57.735080+0000","last_undegraded":"2024-03-28T21:51:57.735080+0000","last_fullsized":"2024-03-28T21:51:57.735080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:09:58.678525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828651+0000","last_change":"2024-03-28T21:51:56.752911+0000","last_active":"2024-03-28T21:51:57.828651+0000","last_peered":"2024-03-28T21:51:57.828651+0000","last_clean":"2024-03-28T21:51:57.828651+0000","last_became_active":"2024-03-28T21:51:56.748615+0000","last_became_peered":"2024-03-28T21:51:56.748615+0000","last_unstale":"2024-03-28T21:51:57.828651+0000","last_undegraded":"2024-03-28T21:51:57.828651+0000","last_fullsized":"2024-03-28T21:51:57.828651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:55.682963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736936+0000","last_change":"2024-03-28T21:51:56.741836+0000","last_active":"2024-03-28T21:51:57.736936+0000","last_peered":"2024-03-28T21:51:57.736936+0000","last_clean":"2024-03-28T21:51:57.736936+0000","last_became_active":"2024-03-28T21:51:56.741491+0000","last_became_peered":"2024-03-28T21:51:56.741491+0000","last_unstale":"2024-03-28T21:51:57.736936+0000","last_undegraded":"2024-03-28T21:51:57.736936+0000","last_fullsized":"2024-03-28T21:51:57.736936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:53:40.266285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739986+0000","last_change":"2024-03-28T21:51:56.749181+0000","last_active":"2024-03-28T21:51:57.739986+0000","last_peered":"2024-03-28T21:51:57.739986+0000","last_clean":"2024-03-28T21:51:57.739986+0000","last_became_active":"2024-03-28T21:51:56.748011+0000","last_became_peered":"2024-03-28T21:51:56.748011+0000","last_unstale":"2024-03-28T21:51:57.739986+0000","last_undegraded":"2024-03-28T21:51:57.739986+0000","last_fullsized":"2024-03-28T21:51:57.739986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:11.932847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739442+0000","last_change":"2024-03-28T21:51:56.735051+0000","last_active":"2024-03-28T21:51:57.739442+0000","last_peered":"2024-03-28T21:51:57.739442+0000","last_clean":"2024-03-28T21:51:57.739442+0000","last_became_active":"2024-03-28T21:51:56.734565+0000","last_became_peered":"2024-03-28T21:51:56.734565+0000","last_unstale":"2024-03-28T21:51:57.739442+0000","last_undegraded":"2024-03-28T21:51:57.739442+0000","last_fullsized":"2024-03-28T21:51:57.739442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:28.881798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737999+0000","last_change":"2024-03-28T21:51:56.725130+0000","last_active":"2024-03-28T21:51:57.737999+0000","last_peered":"2024-03-28T21:51:57.737999+0000","last_clean":"2024-03-28T21:51:57.737999+0000","last_became_active":"2024-03-28T21:51:56.724746+0000","last_became_peered":"2024-03-28T21:51:56.724746+0000","last_unstale":"2024-03-28T21:51:57.737999+0000","last_undegraded":"2024-03-28T21:51:57.737999+0000","last_fullsized":"2024-03-28T21:51:57.737999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:31:25.125095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829271+0000","last_change":"2024-03-28T21:51:56.732293+0000","last_active":"2024-03-28T21:51:57.829271+0000","last_peered":"2024-03-28T21:51:57.829271+0000","last_clean":"2024-03-28T21:51:57.829271+0000","last_became_active":"2024-03-28T21:51:56.732008+0000","last_became_peered":"2024-03-28T21:51:56.732008+0000","last_unstale":"2024-03-28T21:51:57.829271+0000","last_undegraded":"2024-03-28T21:51:57.829271+0000","last_fullsized":"2024-03-28T21:51:57.829271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:33:42.107550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330107+0000","last_change":"2024-03-28T21:51:56.732803+0000","last_active":"2024-03-28T21:51:58.330107+0000","last_peered":"2024-03-28T21:51:58.330107+0000","last_clean":"2024-03-28T21:51:58.330107+0000","last_became_active":"2024-03-28T21:51:56.732496+0000","last_became_peered":"2024-03-28T21:51:56.732496+0000","last_unstale":"2024-03-28T21:51:58.330107+0000","last_undegraded":"2024-03-28T21:51:58.330107+0000","last_fullsized":"2024-03-28T21:51:58.330107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:39:08.739432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739756+0000","last_change":"2024-03-28T21:51:56.732159+0000","last_active":"2024-03-28T21:51:57.739756+0000","last_peered":"2024-03-28T21:51:57.739756+0000","last_clean":"2024-03-28T21:51:57.739756+0000","last_became_active":"2024-03-28T21:51:56.731820+0000","last_became_peered":"2024-03-28T21:51:56.731820+0000","last_unstale":"2024-03-28T21:51:57.739756+0000","last_undegraded":"2024-03-28T21:51:57.739756+0000","last_fullsized":"2024-03-28T21:51:57.739756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:08:15.623597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331126+0000","last_change":"2024-03-28T21:51:56.741864+0000","last_active":"2024-03-28T21:51:58.331126+0000","last_peered":"2024-03-28T21:51:58.331126+0000","last_clean":"2024-03-28T21:51:58.331126+0000","last_became_active":"2024-03-28T21:51:56.741579+0000","last_became_peered":"2024-03-28T21:51:56.741579+0000","last_unstale":"2024-03-28T21:51:58.331126+0000","last_undegraded":"2024-03-28T21:51:58.331126+0000","last_fullsized":"2024-03-28T21:51:58.331126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:20:02.821931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332613+0000","last_change":"2024-03-28T21:51:56.739060+0000","last_active":"2024-03-28T21:51:58.332613+0000","last_peered":"2024-03-28T21:51:58.332613+0000","last_clean":"2024-03-28T21:51:58.332613+0000","last_became_active":"2024-03-28T21:51:56.738641+0000","last_became_peered":"2024-03-28T21:51:56.738641+0000","last_unstale":"2024-03-28T21:51:58.332613+0000","last_undegraded":"2024-03-28T21:51:58.332613+0000","last_fullsized":"2024-03-28T21:51:58.332613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:36:15.569229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.799302+0000","last_change":"2024-03-28T21:51:56.737872+0000","last_active":"2024-03-28T21:51:57.799302+0000","last_peered":"2024-03-28T21:51:57.799302+0000","last_clean":"2024-03-28T21:51:57.799302+0000","last_became_active":"2024-03-28T21:51:56.737566+0000","last_became_peered":"2024-03-28T21:51:56.737566+0000","last_unstale":"2024-03-28T21:51:57.799302+0000","last_undegraded":"2024-03-28T21:51:57.799302+0000","last_fullsized":"2024-03-28T21:51:57.799302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:42:21.430278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736646+0000","last_change":"2024-03-28T21:51:56.738430+0000","last_active":"2024-03-28T21:51:57.736646+0000","last_peered":"2024-03-28T21:51:57.736646+0000","last_clean":"2024-03-28T21:51:57.736646+0000","last_became_active":"2024-03-28T21:51:56.738084+0000","last_became_peered":"2024-03-28T21:51:56.738084+0000","last_unstale":"2024-03-28T21:51:57.736646+0000","last_undegraded":"2024-03-28T21:51:57.736646+0000","last_fullsized":"2024-03-28T21:51:57.736646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:21:00.155587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739051+0000","last_change":"2024-03-28T21:51:56.740987+0000","last_active":"2024-03-28T21:51:57.739051+0000","last_peered":"2024-03-28T21:51:57.739051+0000","last_clean":"2024-03-28T21:51:57.739051+0000","last_became_active":"2024-03-28T21:51:56.740456+0000","last_became_peered":"2024-03-28T21:51:56.740456+0000","last_unstale":"2024-03-28T21:51:57.739051+0000","last_undegraded":"2024-03-28T21:51:57.739051+0000","last_fullsized":"2024-03-28T21:51:57.739051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:08:15.623597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330303+0000","last_change":"2024-03-28T21:51:56.737666+0000","last_active":"2024-03-28T21:51:58.330303+0000","last_peered":"2024-03-28T21:51:58.330303+0000","last_clean":"2024-03-28T21:51:58.330303+0000","last_became_active":"2024-03-28T21:51:56.737409+0000","last_became_peered":"2024-03-28T21:51:56.737409+0000","last_unstale":"2024-03-28T21:51:58.330303+0000","last_undegraded":"2024-03-28T21:51:58.330303+0000","last_fullsized":"2024-03-28T21:51:58.330303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:43:56.754076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331510+0000","last_change":"2024-03-28T21:51:56.734651+0000","last_active":"2024-03-28T21:51:58.331510+0000","last_peered":"2024-03-28T21:51:58.331510+0000","last_clean":"2024-03-28T21:51:58.331510+0000","last_became_active":"2024-03-28T21:51:56.733779+0000","last_became_peered":"2024-03-28T21:51:56.733779+0000","last_unstale":"2024-03-28T21:51:58.331510+0000","last_undegraded":"2024-03-28T21:51:58.331510+0000","last_fullsized":"2024-03-28T21:51:58.331510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:27:25.577575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828725+0000","last_change":"2024-03-28T21:51:56.745483+0000","last_active":"2024-03-28T21:51:57.828725+0000","last_peered":"2024-03-28T21:51:57.828725+0000","last_clean":"2024-03-28T21:51:57.828725+0000","last_became_active":"2024-03-28T21:51:56.745196+0000","last_became_peered":"2024-03-28T21:51:56.745196+0000","last_unstale":"2024-03-28T21:51:57.828725+0000","last_undegraded":"2024-03-28T21:51:57.828725+0000","last_fullsized":"2024-03-28T21:51:57.828725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:28.881798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331406+0000","last_change":"2024-03-28T21:51:56.737805+0000","last_active":"2024-03-28T21:51:58.331406+0000","last_peered":"2024-03-28T21:51:58.331406+0000","last_clean":"2024-03-28T21:51:58.331406+0000","last_became_active":"2024-03-28T21:51:56.737549+0000","last_became_peered":"2024-03-28T21:51:56.737549+0000","last_unstale":"2024-03-28T21:51:58.331406+0000","last_undegraded":"2024-03-28T21:51:58.331406+0000","last_fullsized":"2024-03-28T21:51:58.331406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:30.418711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829532+0000","last_change":"2024-03-28T21:51:56.746355+0000","last_active":"2024-03-28T21:51:57.829532+0000","last_peered":"2024-03-28T21:51:57.829532+0000","last_clean":"2024-03-28T21:51:57.829532+0000","last_became_active":"2024-03-28T21:51:56.744993+0000","last_became_peered":"2024-03-28T21:51:56.744993+0000","last_unstale":"2024-03-28T21:51:57.829532+0000","last_undegraded":"2024-03-28T21:51:57.829532+0000","last_fullsized":"2024-03-28T21:51:57.829532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:09:58.678525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740180+0000","last_change":"2024-03-28T21:51:56.718719+0000","last_active":"2024-03-28T21:51:57.740180+0000","last_peered":"2024-03-28T21:51:57.740180+0000","last_clean":"2024-03-28T21:51:57.740180+0000","last_became_active":"2024-03-28T21:51:56.718298+0000","last_became_peered":"2024-03-28T21:51:56.718298+0000","last_unstale":"2024-03-28T21:51:57.740180+0000","last_undegraded":"2024-03-28T21:51:57.740180+0000","last_fullsized":"2024-03-28T21:51:57.740180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:33:42.107550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740391+0000","last_change":"2024-03-28T21:51:56.736179+0000","last_active":"2024-03-28T21:51:57.740391+0000","last_peered":"2024-03-28T21:51:57.740391+0000","last_clean":"2024-03-28T21:51:57.740391+0000","last_became_active":"2024-03-28T21:51:56.735901+0000","last_became_peered":"2024-03-28T21:51:56.735901+0000","last_unstale":"2024-03-28T21:51:57.740391+0000","last_undegraded":"2024-03-28T21:51:57.740391+0000","last_fullsized":"2024-03-28T21:51:57.740391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:33:42.107550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829438+0000","last_change":"2024-03-28T21:51:56.746834+0000","last_active":"2024-03-28T21:51:57.829438+0000","last_peered":"2024-03-28T21:51:57.829438+0000","last_clean":"2024-03-28T21:51:57.829438+0000","last_became_active":"2024-03-28T21:51:56.745939+0000","last_became_peered":"2024-03-28T21:51:56.745939+0000","last_unstale":"2024-03-28T21:51:57.829438+0000","last_undegraded":"2024-03-28T21:51:57.829438+0000","last_fullsized":"2024-03-28T21:51:57.829438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:20:02.821931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330314+0000","last_change":"2024-03-28T21:51:56.737457+0000","last_active":"2024-03-28T21:51:58.330314+0000","last_peered":"2024-03-28T21:51:58.330314+0000","last_clean":"2024-03-28T21:51:58.330314+0000","last_became_active":"2024-03-28T21:51:56.737113+0000","last_became_peered":"2024-03-28T21:51:56.737113+0000","last_unstale":"2024-03-28T21:51:58.330314+0000","last_undegraded":"2024-03-28T21:51:58.330314+0000","last_fullsized":"2024-03-28T21:51:58.330314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:11:32.340414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331592+0000","last_change":"2024-03-28T21:51:56.731405+0000","last_active":"2024-03-28T21:51:58.331592+0000","last_peered":"2024-03-28T21:51:58.331592+0000","last_clean":"2024-03-28T21:51:58.331592+0000","last_became_active":"2024-03-28T21:51:56.731108+0000","last_became_peered":"2024-03-28T21:51:56.731108+0000","last_unstale":"2024-03-28T21:51:58.331592+0000","last_undegraded":"2024-03-28T21:51:58.331592+0000","last_fullsized":"2024-03-28T21:51:58.331592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:59:08.185041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.798726+0000","last_change":"2024-03-28T21:51:56.747423+0000","last_active":"2024-03-28T21:51:57.798726+0000","last_peered":"2024-03-28T21:51:57.798726+0000","last_clean":"2024-03-28T21:51:57.798726+0000","last_became_active":"2024-03-28T21:51:56.746418+0000","last_became_peered":"2024-03-28T21:51:56.746418+0000","last_unstale":"2024-03-28T21:51:57.798726+0000","last_undegraded":"2024-03-28T21:51:57.798726+0000","last_fullsized":"2024-03-28T21:51:57.798726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:53:48.904039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738908+0000","last_change":"2024-03-28T21:51:56.737277+0000","last_active":"2024-03-28T21:51:57.738908+0000","last_peered":"2024-03-28T21:51:57.738908+0000","last_clean":"2024-03-28T21:51:57.738908+0000","last_became_active":"2024-03-28T21:51:56.736790+0000","last_became_peered":"2024-03-28T21:51:56.736790+0000","last_unstale":"2024-03-28T21:51:57.738908+0000","last_undegraded":"2024-03-28T21:51:57.738908+0000","last_fullsized":"2024-03-28T21:51:57.738908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:55.682963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736622+0000","last_change":"2024-03-28T21:51:56.724145+0000","last_active":"2024-03-28T21:51:57.736622+0000","last_peered":"2024-03-28T21:51:57.736622+0000","last_clean":"2024-03-28T21:51:57.736622+0000","last_became_active":"2024-03-28T21:51:56.723562+0000","last_became_peered":"2024-03-28T21:51:56.723562+0000","last_unstale":"2024-03-28T21:51:57.736622+0000","last_undegraded":"2024-03-28T21:51:57.736622+0000","last_fullsized":"2024-03-28T21:51:57.736622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:49:20.458598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829410+0000","last_change":"2024-03-28T21:51:55.736394+0000","last_active":"2024-03-28T21:51:57.829410+0000","last_peered":"2024-03-28T21:51:57.829410+0000","last_clean":"2024-03-28T21:51:57.829410+0000","last_became_active":"2024-03-28T21:51:55.735945+0000","last_became_peered":"2024-03-28T21:51:55.735945+0000","last_unstale":"2024-03-28T21:51:57.829410+0000","last_undegraded":"2024-03-28T21:51:57.829410+0000","last_fullsized":"2024-03-28T21:51:57.829410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:10:58.825950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330791+0000","last_change":"2024-03-28T21:51:56.750688+0000","last_active":"2024-03-28T21:51:58.330791+0000","last_peered":"2024-03-28T21:51:58.330791+0000","last_clean":"2024-03-28T21:51:58.330791+0000","last_became_active":"2024-03-28T21:51:56.750174+0000","last_became_peered":"2024-03-28T21:51:56.750174+0000","last_unstale":"2024-03-28T21:51:58.330791+0000","last_undegraded":"2024-03-28T21:51:58.330791+0000","last_fullsized":"2024-03-28T21:51:58.330791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:59:55.876132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738775+0000","last_change":"2024-03-28T21:51:55.730078+0000","last_active":"2024-03-28T21:51:57.738775+0000","last_peered":"2024-03-28T21:51:57.738775+0000","last_clean":"2024-03-28T21:51:57.738775+0000","last_became_active":"2024-03-28T21:51:55.729059+0000","last_became_peered":"2024-03-28T21:51:55.729059+0000","last_unstale":"2024-03-28T21:51:57.738775+0000","last_undegraded":"2024-03-28T21:51:57.738775+0000","last_fullsized":"2024-03-28T21:51:57.738775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:25:06.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828695+0000","last_change":"2024-03-28T21:51:55.724321+0000","last_active":"2024-03-28T21:51:57.828695+0000","last_peered":"2024-03-28T21:51:57.828695+0000","last_clean":"2024-03-28T21:51:57.828695+0000","last_became_active":"2024-03-28T21:51:55.723873+0000","last_became_peered":"2024-03-28T21:51:55.723873+0000","last_unstale":"2024-03-28T21:51:57.828695+0000","last_undegraded":"2024-03-28T21:51:57.828695+0000","last_fullsized":"2024-03-28T21:51:57.828695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:01:24.561519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828667+0000","last_change":"2024-03-28T21:51:56.738471+0000","last_active":"2024-03-28T21:51:57.828667+0000","last_peered":"2024-03-28T21:51:57.828667+0000","last_clean":"2024-03-28T21:51:57.828667+0000","last_became_active":"2024-03-28T21:51:56.738126+0000","last_became_peered":"2024-03-28T21:51:56.738126+0000","last_unstale":"2024-03-28T21:51:57.828667+0000","last_undegraded":"2024-03-28T21:51:57.828667+0000","last_fullsized":"2024-03-28T21:51:57.828667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:08:15.623597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331496+0000","last_change":"2024-03-28T21:51:55.730358+0000","last_active":"2024-03-28T21:51:58.331496+0000","last_peered":"2024-03-28T21:51:58.331496+0000","last_clean":"2024-03-28T21:51:58.331496+0000","last_became_active":"2024-03-28T21:51:55.730046+0000","last_became_peered":"2024-03-28T21:51:55.730046+0000","last_unstale":"2024-03-28T21:51:58.331496+0000","last_undegraded":"2024-03-28T21:51:58.331496+0000","last_fullsized":"2024-03-28T21:51:58.331496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:52.161365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739961+0000","last_change":"2024-03-28T21:51:56.728333+0000","last_active":"2024-03-28T21:51:57.739961+0000","last_peered":"2024-03-28T21:51:57.739961+0000","last_clean":"2024-03-28T21:51:57.739961+0000","last_became_active":"2024-03-28T21:51:56.728047+0000","last_became_peered":"2024-03-28T21:51:56.728047+0000","last_unstale":"2024-03-28T21:51:57.739961+0000","last_undegraded":"2024-03-28T21:51:57.739961+0000","last_fullsized":"2024-03-28T21:51:57.739961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:46.786652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739888+0000","last_change":"2024-03-28T21:51:55.736601+0000","last_active":"2024-03-28T21:51:57.739888+0000","last_peered":"2024-03-28T21:51:57.739888+0000","last_clean":"2024-03-28T21:51:57.739888+0000","last_became_active":"2024-03-28T21:51:55.735858+0000","last_became_peered":"2024-03-28T21:51:55.735858+0000","last_unstale":"2024-03-28T21:51:57.739888+0000","last_undegraded":"2024-03-28T21:51:57.739888+0000","last_fullsized":"2024-03-28T21:51:57.739888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:49.481854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332438+0000","last_change":"2024-03-28T21:51:56.736289+0000","last_active":"2024-03-28T21:51:58.332438+0000","last_peered":"2024-03-28T21:51:58.332438+0000","last_clean":"2024-03-28T21:51:58.332438+0000","last_became_active":"2024-03-28T21:51:56.735924+0000","last_became_peered":"2024-03-28T21:51:56.735924+0000","last_unstale":"2024-03-28T21:51:58.332438+0000","last_undegraded":"2024-03-28T21:51:58.332438+0000","last_fullsized":"2024-03-28T21:51:58.332438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:53:40.266285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332311+0000","last_change":"2024-03-28T21:51:55.735297+0000","last_active":"2024-03-28T21:51:58.332311+0000","last_peered":"2024-03-28T21:51:58.332311+0000","last_clean":"2024-03-28T21:51:58.332311+0000","last_became_active":"2024-03-28T21:51:55.735006+0000","last_became_peered":"2024-03-28T21:51:55.735006+0000","last_unstale":"2024-03-28T21:51:58.332311+0000","last_undegraded":"2024-03-28T21:51:58.332311+0000","last_fullsized":"2024-03-28T21:51:58.332311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:16.943146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330547+0000","last_change":"2024-03-28T21:51:56.750675+0000","last_active":"2024-03-28T21:51:58.330547+0000","last_peered":"2024-03-28T21:51:58.330547+0000","last_clean":"2024-03-28T21:51:58.330547+0000","last_became_active":"2024-03-28T21:51:56.747119+0000","last_became_peered":"2024-03-28T21:51:56.747119+0000","last_unstale":"2024-03-28T21:51:58.330547+0000","last_undegraded":"2024-03-28T21:51:58.330547+0000","last_fullsized":"2024-03-28T21:51:58.330547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:08:48.875187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740776+0000","last_change":"2024-03-28T21:51:55.737036+0000","last_active":"2024-03-28T21:51:57.740776+0000","last_peered":"2024-03-28T21:51:57.740776+0000","last_clean":"2024-03-28T21:51:57.740776+0000","last_became_active":"2024-03-28T21:51:55.736746+0000","last_became_peered":"2024-03-28T21:51:55.736746+0000","last_unstale":"2024-03-28T21:51:57.740776+0000","last_undegraded":"2024-03-28T21:51:57.740776+0000","last_fullsized":"2024-03-28T21:51:57.740776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:41:33.261221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738359+0000","last_change":"2024-03-28T21:51:56.734022+0000","last_active":"2024-03-28T21:51:57.738359+0000","last_peered":"2024-03-28T21:51:57.738359+0000","last_clean":"2024-03-28T21:51:57.738359+0000","last_became_active":"2024-03-28T21:51:56.731663+0000","last_became_peered":"2024-03-28T21:51:56.731663+0000","last_unstale":"2024-03-28T21:51:57.738359+0000","last_undegraded":"2024-03-28T21:51:57.738359+0000","last_fullsized":"2024-03-28T21:51:57.738359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:10:14.581056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739196+0000","last_change":"2024-03-28T21:51:55.730854+0000","last_active":"2024-03-28T21:51:57.739196+0000","last_peered":"2024-03-28T21:51:57.739196+0000","last_clean":"2024-03-28T21:51:57.739196+0000","last_became_active":"2024-03-28T21:51:55.729293+0000","last_became_peered":"2024-03-28T21:51:55.729293+0000","last_unstale":"2024-03-28T21:51:57.739196+0000","last_undegraded":"2024-03-28T21:51:57.739196+0000","last_fullsized":"2024-03-28T21:51:57.739196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:07:09.631543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735807+0000","last_change":"2024-03-28T21:51:56.739559+0000","last_active":"2024-03-28T21:51:57.735807+0000","last_peered":"2024-03-28T21:51:57.735807+0000","last_clean":"2024-03-28T21:51:57.735807+0000","last_became_active":"2024-03-28T21:51:56.739248+0000","last_became_peered":"2024-03-28T21:51:56.739248+0000","last_unstale":"2024-03-28T21:51:57.735807+0000","last_undegraded":"2024-03-28T21:51:57.735807+0000","last_fullsized":"2024-03-28T21:51:57.735807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:44:09.922647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330696+0000","last_change":"2024-03-28T21:51:55.722706+0000","last_active":"2024-03-28T21:51:58.330696+0000","last_peered":"2024-03-28T21:51:58.330696+0000","last_clean":"2024-03-28T21:51:58.330696+0000","last_became_active":"2024-03-28T21:51:55.722273+0000","last_became_peered":"2024-03-28T21:51:55.722273+0000","last_unstale":"2024-03-28T21:51:58.330696+0000","last_undegraded":"2024-03-28T21:51:58.330696+0000","last_fullsized":"2024-03-28T21:51:58.330696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:25:33.882861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.329913+0000","last_change":"2024-03-28T21:51:56.740785+0000","last_active":"2024-03-28T21:51:58.329913+0000","last_peered":"2024-03-28T21:51:58.329913+0000","last_clean":"2024-03-28T21:51:58.329913+0000","last_became_active":"2024-03-28T21:51:56.740524+0000","last_became_peered":"2024-03-28T21:51:56.740524+0000","last_unstale":"2024-03-28T21:51:58.329913+0000","last_undegraded":"2024-03-28T21:51:58.329913+0000","last_fullsized":"2024-03-28T21:51:58.329913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:00:37.304905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331836+0000","last_change":"2024-03-28T21:51:55.736963+0000","last_active":"2024-03-28T21:51:58.331836+0000","last_peered":"2024-03-28T21:51:58.331836+0000","last_clean":"2024-03-28T21:51:58.331836+0000","last_became_active":"2024-03-28T21:51:55.734830+0000","last_became_peered":"2024-03-28T21:51:55.734830+0000","last_unstale":"2024-03-28T21:51:58.331836+0000","last_undegraded":"2024-03-28T21:51:58.331836+0000","last_fullsized":"2024-03-28T21:51:58.331836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:27.412749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735343+0000","last_change":"2024-03-28T21:51:56.746398+0000","last_active":"2024-03-28T21:51:57.735343+0000","last_peered":"2024-03-28T21:51:57.735343+0000","last_clean":"2024-03-28T21:51:57.735343+0000","last_became_active":"2024-03-28T21:51:56.746126+0000","last_became_peered":"2024-03-28T21:51:56.746126+0000","last_unstale":"2024-03-28T21:51:57.735343+0000","last_undegraded":"2024-03-28T21:51:57.735343+0000","last_fullsized":"2024-03-28T21:51:57.735343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:27:25.577575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738980+0000","last_change":"2024-03-28T21:51:55.730767+0000","last_active":"2024-03-28T21:51:57.738980+0000","last_peered":"2024-03-28T21:51:57.738980+0000","last_clean":"2024-03-28T21:51:57.738980+0000","last_became_active":"2024-03-28T21:51:55.729015+0000","last_became_peered":"2024-03-28T21:51:55.729015+0000","last_unstale":"2024-03-28T21:51:57.738980+0000","last_undegraded":"2024-03-28T21:51:57.738980+0000","last_fullsized":"2024-03-28T21:51:57.738980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:38.624808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739619+0000","last_change":"2024-03-28T21:51:56.737060+0000","last_active":"2024-03-28T21:51:57.739619+0000","last_peered":"2024-03-28T21:51:57.739619+0000","last_clean":"2024-03-28T21:51:57.739619+0000","last_became_active":"2024-03-28T21:51:56.736452+0000","last_became_peered":"2024-03-28T21:51:56.736452+0000","last_unstale":"2024-03-28T21:51:57.739619+0000","last_undegraded":"2024-03-28T21:51:57.739619+0000","last_fullsized":"2024-03-28T21:51:57.739619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:46.786652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.798595+0000","last_change":"2024-03-28T21:51:55.728291+0000","last_active":"2024-03-28T21:51:57.798595+0000","last_peered":"2024-03-28T21:51:57.798595+0000","last_clean":"2024-03-28T21:51:57.798595+0000","last_became_active":"2024-03-28T21:51:55.727942+0000","last_became_peered":"2024-03-28T21:51:55.727942+0000","last_unstale":"2024-03-28T21:51:57.798595+0000","last_undegraded":"2024-03-28T21:51:57.798595+0000","last_fullsized":"2024-03-28T21:51:57.798595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:01:39.586196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735383+0000","last_change":"2024-03-28T21:51:56.746545+0000","last_active":"2024-03-28T21:51:57.735383+0000","last_peered":"2024-03-28T21:51:57.735383+0000","last_clean":"2024-03-28T21:51:57.735383+0000","last_became_active":"2024-03-28T21:51:56.743999+0000","last_became_peered":"2024-03-28T21:51:56.743999+0000","last_unstale":"2024-03-28T21:51:57.735383+0000","last_undegraded":"2024-03-28T21:51:57.735383+0000","last_fullsized":"2024-03-28T21:51:57.735383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:59:08.185041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738223+0000","last_change":"2024-03-28T21:51:55.727110+0000","last_active":"2024-03-28T21:51:57.738223+0000","last_peered":"2024-03-28T21:51:57.738223+0000","last_clean":"2024-03-28T21:51:57.738223+0000","last_became_active":"2024-03-28T21:51:55.726646+0000","last_became_peered":"2024-03-28T21:51:55.726646+0000","last_unstale":"2024-03-28T21:51:57.738223+0000","last_undegraded":"2024-03-28T21:51:57.738223+0000","last_fullsized":"2024-03-28T21:51:57.738223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:10:58.825950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737881+0000","last_change":"2024-03-28T21:51:56.747293+0000","last_active":"2024-03-28T21:51:57.737881+0000","last_peered":"2024-03-28T21:51:57.737881+0000","last_clean":"2024-03-28T21:51:57.737881+0000","last_became_active":"2024-03-28T21:51:56.743809+0000","last_became_peered":"2024-03-28T21:51:56.743809+0000","last_unstale":"2024-03-28T21:51:57.737881+0000","last_undegraded":"2024-03-28T21:51:57.737881+0000","last_fullsized":"2024-03-28T21:51:57.737881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:36:15.569229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.799403+0000","last_change":"2024-03-28T21:51:55.731064+0000","last_active":"2024-03-28T21:51:57.799403+0000","last_peered":"2024-03-28T21:51:57.799403+0000","last_clean":"2024-03-28T21:51:57.799403+0000","last_became_active":"2024-03-28T21:51:55.730784+0000","last_became_peered":"2024-03-28T21:51:55.730784+0000","last_unstale":"2024-03-28T21:51:57.799403+0000","last_undegraded":"2024-03-28T21:51:57.799403+0000","last_fullsized":"2024-03-28T21:51:57.799403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:14:12.770422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737269+0000","last_change":"2024-03-28T21:51:56.748869+0000","last_active":"2024-03-28T21:51:57.737269+0000","last_peered":"2024-03-28T21:51:57.737269+0000","last_clean":"2024-03-28T21:51:57.737269+0000","last_became_active":"2024-03-28T21:51:56.748640+0000","last_became_peered":"2024-03-28T21:51:56.748640+0000","last_unstale":"2024-03-28T21:51:57.737269+0000","last_undegraded":"2024-03-28T21:51:57.737269+0000","last_fullsized":"2024-03-28T21:51:57.737269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:14:34.083715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740696+0000","last_change":"2024-03-28T21:51:55.731550+0000","last_active":"2024-03-28T21:51:57.740696+0000","last_peered":"2024-03-28T21:51:57.740696+0000","last_clean":"2024-03-28T21:51:57.740696+0000","last_became_active":"2024-03-28T21:51:55.728370+0000","last_became_peered":"2024-03-28T21:51:55.728370+0000","last_unstale":"2024-03-28T21:51:57.740696+0000","last_undegraded":"2024-03-28T21:51:57.740696+0000","last_fullsized":"2024-03-28T21:51:57.740696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:49:18.989549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332462+0000","last_change":"2024-03-28T21:51:56.736531+0000","last_active":"2024-03-28T21:51:58.332462+0000","last_peered":"2024-03-28T21:51:58.332462+0000","last_clean":"2024-03-28T21:51:58.332462+0000","last_became_active":"2024-03-28T21:51:56.735968+0000","last_became_peered":"2024-03-28T21:51:56.735968+0000","last_unstale":"2024-03-28T21:51:58.332462+0000","last_undegraded":"2024-03-28T21:51:58.332462+0000","last_fullsized":"2024-03-28T21:51:58.332462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:14:34.083715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.799078+0000","last_change":"2024-03-28T21:51:55.735045+0000","last_active":"2024-03-28T21:51:57.799078+0000","last_peered":"2024-03-28T21:51:57.799078+0000","last_clean":"2024-03-28T21:51:57.799078+0000","last_became_active":"2024-03-28T21:51:55.734768+0000","last_became_peered":"2024-03-28T21:51:55.734768+0000","last_unstale":"2024-03-28T21:51:57.799078+0000","last_undegraded":"2024-03-28T21:51:57.799078+0000","last_fullsized":"2024-03-28T21:51:57.799078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:18:31.421582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735795+0000","last_change":"2024-03-28T21:51:56.745586+0000","last_active":"2024-03-28T21:51:57.735795+0000","last_peered":"2024-03-28T21:51:57.735795+0000","last_clean":"2024-03-28T21:51:57.735795+0000","last_became_active":"2024-03-28T21:51:56.745299+0000","last_became_peered":"2024-03-28T21:51:56.745299+0000","last_unstale":"2024-03-28T21:51:57.735795+0000","last_undegraded":"2024-03-28T21:51:57.735795+0000","last_fullsized":"2024-03-28T21:51:57.735795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:24.456985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.734439+0000","last_change":"2024-03-28T21:51:51.547812+0000","last_active":"2024-03-28T21:51:57.734439+0000","last_peered":"2024-03-28T21:51:57.734439+0000","last_clean":"2024-03-28T21:51:57.734439+0000","last_became_active":"2024-03-28T21:51:51.545783+0000","last_became_peered":"2024-03-28T21:51:51.545783+0000","last_unstale":"2024-03-28T21:51:57.734439+0000","last_undegraded":"2024-03-28T21:51:57.734439+0000","last_fullsized":"2024-03-28T21:51:57.734439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_clean_scrub_stamp":"2024-03-28T21:51:50.185942+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:08:34.531035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331207+0000","last_change":"2024-03-28T21:51:55.733897+0000","last_active":"2024-03-28T21:51:58.331207+0000","last_peered":"2024-03-28T21:51:58.331207+0000","last_clean":"2024-03-28T21:51:58.331207+0000","last_became_active":"2024-03-28T21:51:55.733569+0000","last_became_peered":"2024-03-28T21:51:55.733569+0000","last_unstale":"2024-03-28T21:51:58.331207+0000","last_undegraded":"2024-03-28T21:51:58.331207+0000","last_fullsized":"2024-03-28T21:51:58.331207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:54.213914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829113+0000","last_change":"2024-03-28T21:51:56.750936+0000","last_active":"2024-03-28T21:51:57.829113+0000","last_peered":"2024-03-28T21:51:57.829113+0000","last_clean":"2024-03-28T21:51:57.829113+0000","last_became_active":"2024-03-28T21:51:56.750615+0000","last_became_peered":"2024-03-28T21:51:56.750615+0000","last_unstale":"2024-03-28T21:51:57.829113+0000","last_undegraded":"2024-03-28T21:51:57.829113+0000","last_fullsized":"2024-03-28T21:51:57.829113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:11.932847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.734494+0000","last_change":"2024-03-28T21:51:55.740858+0000","last_active":"2024-03-28T21:51:57.734494+0000","last_peered":"2024-03-28T21:51:57.734494+0000","last_clean":"2024-03-28T21:51:57.734494+0000","last_became_active":"2024-03-28T21:51:55.740499+0000","last_became_peered":"2024-03-28T21:51:55.740499+0000","last_unstale":"2024-03-28T21:51:57.734494+0000","last_undegraded":"2024-03-28T21:51:57.734494+0000","last_fullsized":"2024-03-28T21:51:57.734494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:49:18.989549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.329802+0000","last_change":"2024-03-28T21:51:56.739979+0000","last_active":"2024-03-28T21:51:58.329802+0000","last_peered":"2024-03-28T21:51:58.329802+0000","last_clean":"2024-03-28T21:51:58.329802+0000","last_became_active":"2024-03-28T21:51:56.739738+0000","last_became_peered":"2024-03-28T21:51:56.739738+0000","last_unstale":"2024-03-28T21:51:58.329802+0000","last_undegraded":"2024-03-28T21:51:58.329802+0000","last_fullsized":"2024-03-28T21:51:58.329802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:03:08.464729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.798745+0000","last_change":"2024-03-28T21:51:55.727187+0000","last_active":"2024-03-28T21:51:57.798745+0000","last_peered":"2024-03-28T21:51:57.798745+0000","last_clean":"2024-03-28T21:51:57.798745+0000","last_became_active":"2024-03-28T21:51:55.725654+0000","last_became_peered":"2024-03-28T21:51:55.725654+0000","last_unstale":"2024-03-28T21:51:57.798745+0000","last_undegraded":"2024-03-28T21:51:57.798745+0000","last_fullsized":"2024-03-28T21:51:57.798745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:05:21.056498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739661+0000","last_change":"2024-03-28T21:51:56.731343+0000","last_active":"2024-03-28T21:51:57.739661+0000","last_peered":"2024-03-28T21:51:57.739661+0000","last_clean":"2024-03-28T21:51:57.739661+0000","last_became_active":"2024-03-28T21:51:56.731082+0000","last_became_peered":"2024-03-28T21:51:56.731082+0000","last_unstale":"2024-03-28T21:51:57.739661+0000","last_undegraded":"2024-03-28T21:51:57.739661+0000","last_fullsized":"2024-03-28T21:51:57.739661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:55.682963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331842+0000","last_change":"2024-03-28T21:51:55.737531+0000","last_active":"2024-03-28T21:51:58.331842+0000","last_peered":"2024-03-28T21:51:58.331842+0000","last_clean":"2024-03-28T21:51:58.331842+0000","last_became_active":"2024-03-28T21:51:55.736415+0000","last_became_peered":"2024-03-28T21:51:55.736415+0000","last_unstale":"2024-03-28T21:51:58.331842+0000","last_undegraded":"2024-03-28T21:51:58.331842+0000","last_fullsized":"2024-03-28T21:51:58.331842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:45.317603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737122+0000","last_change":"2024-03-28T21:51:56.742717+0000","last_active":"2024-03-28T21:51:57.737122+0000","last_peered":"2024-03-28T21:51:57.737122+0000","last_clean":"2024-03-28T21:51:57.737122+0000","last_became_active":"2024-03-28T21:51:56.742419+0000","last_became_peered":"2024-03-28T21:51:56.742419+0000","last_unstale":"2024-03-28T21:51:57.737122+0000","last_undegraded":"2024-03-28T21:51:57.737122+0000","last_fullsized":"2024-03-28T21:51:57.737122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:53.630414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739963+0000","last_change":"2024-03-28T21:51:55.729598+0000","last_active":"2024-03-28T21:51:57.739963+0000","last_peered":"2024-03-28T21:51:57.739963+0000","last_clean":"2024-03-28T21:51:57.739963+0000","last_became_active":"2024-03-28T21:51:55.729285+0000","last_became_peered":"2024-03-28T21:51:55.729285+0000","last_unstale":"2024-03-28T21:51:57.739963+0000","last_undegraded":"2024-03-28T21:51:57.739963+0000","last_fullsized":"2024-03-28T21:51:57.739963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:25:06.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332415+0000","last_change":"2024-03-28T21:51:56.738473+0000","last_active":"2024-03-28T21:51:58.332415+0000","last_peered":"2024-03-28T21:51:58.332415+0000","last_clean":"2024-03-28T21:51:58.332415+0000","last_became_active":"2024-03-28T21:51:56.738135+0000","last_became_peered":"2024-03-28T21:51:56.738135+0000","last_unstale":"2024-03-28T21:51:58.332415+0000","last_undegraded":"2024-03-28T21:51:58.332415+0000","last_fullsized":"2024-03-28T21:51:58.332415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:21:00.155587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736603+0000","last_change":"2024-03-28T21:51:55.738867+0000","last_active":"2024-03-28T21:51:57.736603+0000","last_peered":"2024-03-28T21:51:57.736603+0000","last_clean":"2024-03-28T21:51:57.736603+0000","last_became_active":"2024-03-28T21:51:55.738474+0000","last_became_peered":"2024-03-28T21:51:55.738474+0000","last_unstale":"2024-03-28T21:51:57.736603+0000","last_undegraded":"2024-03-28T21:51:57.736603+0000","last_fullsized":"2024-03-28T21:51:57.736603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:31:23.656046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739779+0000","last_change":"2024-03-28T21:51:56.744065+0000","last_active":"2024-03-28T21:51:57.739779+0000","last_peered":"2024-03-28T21:51:57.739779+0000","last_clean":"2024-03-28T21:51:57.739779+0000","last_became_active":"2024-03-28T21:51:56.743726+0000","last_became_peered":"2024-03-28T21:51:56.743726+0000","last_unstale":"2024-03-28T21:51:57.739779+0000","last_undegraded":"2024-03-28T21:51:57.739779+0000","last_fullsized":"2024-03-28T21:51:57.739779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:28.881798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.743030+0000","last_change":"2024-03-28T21:51:55.731606+0000","last_active":"2024-03-28T21:51:57.743030+0000","last_peered":"2024-03-28T21:51:57.743030+0000","last_clean":"2024-03-28T21:51:57.743030+0000","last_became_active":"2024-03-28T21:51:55.731290+0000","last_became_peered":"2024-03-28T21:51:55.731290+0000","last_unstale":"2024-03-28T21:51:57.743030+0000","last_undegraded":"2024-03-28T21:51:57.743030+0000","last_fullsized":"2024-03-28T21:51:57.743030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:52.161365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829855+0000","last_change":"2024-03-28T21:51:56.735361+0000","last_active":"2024-03-28T21:51:57.829855+0000","last_peered":"2024-03-28T21:51:57.829855+0000","last_clean":"2024-03-28T21:51:57.829855+0000","last_became_active":"2024-03-28T21:51:56.735118+0000","last_became_peered":"2024-03-28T21:51:56.735118+0000","last_unstale":"2024-03-28T21:51:57.829855+0000","last_undegraded":"2024-03-28T21:51:57.829855+0000","last_fullsized":"2024-03-28T21:51:57.829855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:27:25.577575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740008+0000","last_change":"2024-03-28T21:51:55.736672+0000","last_active":"2024-03-28T21:51:57.740008+0000","last_peered":"2024-03-28T21:51:57.740008+0000","last_clean":"2024-03-28T21:51:57.740008+0000","last_became_active":"2024-03-28T21:51:55.736295+0000","last_became_peered":"2024-03-28T21:51:55.736295+0000","last_unstale":"2024-03-28T21:51:57.740008+0000","last_undegraded":"2024-03-28T21:51:57.740008+0000","last_fullsized":"2024-03-28T21:51:57.740008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:41:33.261221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330657+0000","last_change":"2024-03-28T21:51:56.732809+0000","last_active":"2024-03-28T21:51:58.330657+0000","last_peered":"2024-03-28T21:51:58.330657+0000","last_clean":"2024-03-28T21:51:58.330657+0000","last_became_active":"2024-03-28T21:51:56.732535+0000","last_became_peered":"2024-03-28T21:51:56.732535+0000","last_unstale":"2024-03-28T21:51:58.330657+0000","last_undegraded":"2024-03-28T21:51:58.330657+0000","last_fullsized":"2024-03-28T21:51:58.330657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:14:33.230114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.734259+0000","last_change":"2024-03-28T21:51:55.738876+0000","last_active":"2024-03-28T21:51:57.734259+0000","last_peered":"2024-03-28T21:51:57.734259+0000","last_clean":"2024-03-28T21:51:57.734259+0000","last_became_active":"2024-03-28T21:51:55.738383+0000","last_became_peered":"2024-03-28T21:51:55.738383+0000","last_unstale":"2024-03-28T21:51:57.734259+0000","last_undegraded":"2024-03-28T21:51:57.734259+0000","last_fullsized":"2024-03-28T21:51:57.734259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:41:33.261221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737220+0000","last_change":"2024-03-28T21:51:56.737198+0000","last_active":"2024-03-28T21:51:57.737220+0000","last_peered":"2024-03-28T21:51:57.737220+0000","last_clean":"2024-03-28T21:51:57.737220+0000","last_became_active":"2024-03-28T21:51:56.736850+0000","last_became_peered":"2024-03-28T21:51:56.736850+0000","last_unstale":"2024-03-28T21:51:57.737220+0000","last_undegraded":"2024-03-28T21:51:57.737220+0000","last_fullsized":"2024-03-28T21:51:57.737220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:27:52.976796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739863+0000","last_change":"2024-03-28T21:51:55.735856+0000","last_active":"2024-03-28T21:51:57.739863+0000","last_peered":"2024-03-28T21:51:57.739863+0000","last_clean":"2024-03-28T21:51:57.739863+0000","last_became_active":"2024-03-28T21:51:55.735478+0000","last_became_peered":"2024-03-28T21:51:55.735478+0000","last_unstale":"2024-03-28T21:51:57.739863+0000","last_undegraded":"2024-03-28T21:51:57.739863+0000","last_fullsized":"2024-03-28T21:51:57.739863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:49.481854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828874+0000","last_change":"2024-03-28T21:51:56.731937+0000","last_active":"2024-03-28T21:51:57.828874+0000","last_peered":"2024-03-28T21:51:57.828874+0000","last_clean":"2024-03-28T21:51:57.828874+0000","last_became_active":"2024-03-28T21:51:56.730294+0000","last_became_peered":"2024-03-28T21:51:56.730294+0000","last_unstale":"2024-03-28T21:51:57.828874+0000","last_undegraded":"2024-03-28T21:51:57.828874+0000","last_fullsized":"2024-03-28T21:51:57.828874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:46.786652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739729+0000","last_change":"2024-03-28T21:51:55.733842+0000","last_active":"2024-03-28T21:51:57.739729+0000","last_peered":"2024-03-28T21:51:57.739729+0000","last_clean":"2024-03-28T21:51:57.739729+0000","last_became_active":"2024-03-28T21:51:55.732730+0000","last_became_peered":"2024-03-28T21:51:55.732730+0000","last_unstale":"2024-03-28T21:51:57.739729+0000","last_undegraded":"2024-03-28T21:51:57.739729+0000","last_fullsized":"2024-03-28T21:51:57.739729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:38.624808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829350+0000","last_change":"2024-03-28T21:51:56.741051+0000","last_active":"2024-03-28T21:51:57.829350+0000","last_peered":"2024-03-28T21:51:57.829350+0000","last_clean":"2024-03-28T21:51:57.829350+0000","last_became_active":"2024-03-28T21:51:56.740732+0000","last_became_peered":"2024-03-28T21:51:56.740732+0000","last_unstale":"2024-03-28T21:51:57.829350+0000","last_undegraded":"2024-03-28T21:51:57.829350+0000","last_fullsized":"2024-03-28T21:51:57.829350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:18.412195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735605+0000","last_change":"2024-03-28T21:51:55.741026+0000","last_active":"2024-03-28T21:51:57.735605+0000","last_peered":"2024-03-28T21:51:57.735605+0000","last_clean":"2024-03-28T21:51:57.735605+0000","last_became_active":"2024-03-28T21:51:55.740636+0000","last_became_peered":"2024-03-28T21:51:55.740636+0000","last_unstale":"2024-03-28T21:51:57.735605+0000","last_undegraded":"2024-03-28T21:51:57.735605+0000","last_fullsized":"2024-03-28T21:51:57.735605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:52.161365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738890+0000","last_change":"2024-03-28T21:51:56.738914+0000","last_active":"2024-03-28T21:51:57.738890+0000","last_peered":"2024-03-28T21:51:57.738890+0000","last_clean":"2024-03-28T21:51:57.738890+0000","last_became_active":"2024-03-28T21:51:56.738550+0000","last_became_peered":"2024-03-28T21:51:56.738550+0000","last_unstale":"2024-03-28T21:51:57.738890+0000","last_undegraded":"2024-03-28T21:51:57.738890+0000","last_fullsized":"2024-03-28T21:51:57.738890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:50:06.933438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331969+0000","last_change":"2024-03-28T21:51:56.733615+0000","last_active":"2024-03-28T21:51:58.331969+0000","last_peered":"2024-03-28T21:51:58.331969+0000","last_clean":"2024-03-28T21:51:58.331969+0000","last_became_active":"2024-03-28T21:51:56.732747+0000","last_became_peered":"2024-03-28T21:51:56.732747+0000","last_unstale":"2024-03-28T21:51:58.331969+0000","last_undegraded":"2024-03-28T21:51:58.331969+0000","last_fullsized":"2024-03-28T21:51:58.331969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:55:29.475667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735421+0000","last_change":"2024-03-28T21:51:55.743426+0000","last_active":"2024-03-28T21:51:57.735421+0000","last_peered":"2024-03-28T21:51:57.735421+0000","last_clean":"2024-03-28T21:51:57.735421+0000","last_became_active":"2024-03-28T21:51:55.743045+0000","last_became_peered":"2024-03-28T21:51:55.743045+0000","last_unstale":"2024-03-28T21:51:57.735421+0000","last_undegraded":"2024-03-28T21:51:57.735421+0000","last_fullsized":"2024-03-28T21:51:57.735421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:27:51.507747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331789+0000","last_change":"2024-03-28T21:51:56.737059+0000","last_active":"2024-03-28T21:51:58.331789+0000","last_peered":"2024-03-28T21:51:58.331789+0000","last_clean":"2024-03-28T21:51:58.331789+0000","last_became_active":"2024-03-28T21:51:56.736834+0000","last_became_peered":"2024-03-28T21:51:56.736834+0000","last_unstale":"2024-03-28T21:51:58.331789+0000","last_undegraded":"2024-03-28T21:51:58.331789+0000","last_fullsized":"2024-03-28T21:51:58.331789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:44:09.922647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736413+0000","last_change":"2024-03-28T21:51:55.739827+0000","last_active":"2024-03-28T21:51:57.736413+0000","last_peered":"2024-03-28T21:51:57.736413+0000","last_clean":"2024-03-28T21:51:57.736413+0000","last_became_active":"2024-03-28T21:51:55.739583+0000","last_became_peered":"2024-03-28T21:51:55.739583+0000","last_unstale":"2024-03-28T21:51:57.736413+0000","last_undegraded":"2024-03-28T21:51:57.736413+0000","last_fullsized":"2024-03-28T21:51:57.736413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:10:13.112007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330687+0000","last_change":"2024-03-28T21:51:56.745755+0000","last_active":"2024-03-28T21:51:58.330687+0000","last_peered":"2024-03-28T21:51:58.330687+0000","last_clean":"2024-03-28T21:51:58.330687+0000","last_became_active":"2024-03-28T21:51:56.745454+0000","last_became_peered":"2024-03-28T21:51:56.745454+0000","last_unstale":"2024-03-28T21:51:58.330687+0000","last_undegraded":"2024-03-28T21:51:58.330687+0000","last_fullsized":"2024-03-28T21:51:58.330687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:13:55.392143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829826+0000","last_change":"2024-03-28T21:51:55.726073+0000","last_active":"2024-03-28T21:51:57.829826+0000","last_peered":"2024-03-28T21:51:57.829826+0000","last_clean":"2024-03-28T21:51:57.829826+0000","last_became_active":"2024-03-28T21:51:55.725697+0000","last_became_peered":"2024-03-28T21:51:55.725697+0000","last_unstale":"2024-03-28T21:51:57.829826+0000","last_undegraded":"2024-03-28T21:51:57.829826+0000","last_fullsized":"2024-03-28T21:51:57.829826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:25:06.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829699+0000","last_change":"2024-03-28T21:51:56.732751+0000","last_active":"2024-03-28T21:51:57.829699+0000","last_peered":"2024-03-28T21:51:57.829699+0000","last_clean":"2024-03-28T21:51:57.829699+0000","last_became_active":"2024-03-28T21:51:56.732376+0000","last_became_peered":"2024-03-28T21:51:56.732376+0000","last_unstale":"2024-03-28T21:51:57.829699+0000","last_undegraded":"2024-03-28T21:51:57.829699+0000","last_fullsized":"2024-03-28T21:51:57.829699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:30.418711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330732+0000","last_change":"2024-03-28T21:51:55.736690+0000","last_active":"2024-03-28T21:51:58.330732+0000","last_peered":"2024-03-28T21:51:58.330732+0000","last_clean":"2024-03-28T21:51:58.330732+0000","last_became_active":"2024-03-28T21:51:55.736380+0000","last_became_peered":"2024-03-28T21:51:55.736380+0000","last_unstale":"2024-03-28T21:51:58.330732+0000","last_undegraded":"2024-03-28T21:51:58.330732+0000","last_fullsized":"2024-03-28T21:51:58.330732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:18:31.421582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":823296,"data_stored":669784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":78924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":78960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":78834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":831488,"data_stored":669840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T21:52:06.908 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T21:52:07.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.140+0000 7f87b4c00640 1 Processor -- start 2024-03-28T21:52:07.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.140+0000 7f87b4c00640 1 -- start start 2024-03-28T21:52:07.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.141+0000 7f87b4c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f87b013e040 0x7f87b01406c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:07.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.142+0000 7f87b4c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87b015bf80 0x7f87b0070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:07.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.142+0000 7f87b4c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b015c3b0 con 0x7f87b013dc60 2024-03-28T21:52:07.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.142+0000 7f87b4c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f87b013ed80 con 0x7f87b013e040 2024-03-28T21:52:07.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.142+0000 7f87b4c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f87b0140ce0 con 0x7f87b015bf80 2024-03-28T21:52:07.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.142+0000 7f87afe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87b015bf80 0x7f87b0070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.142+0000 7f87afe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87b015bf80 0x7f87b0070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:43122/0 (socket says 172.21.15.153:43122) 2024-03-28T21:52:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.142+0000 7f87afe00640 1 -- 172.21.15.153:0/688437359 learned_addr learned my addr 172.21.15.153:0/688437359 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.142+0000 7f87aea00640 1 --2- 172.21.15.153:0/688437359 >> v2:172.21.15.165:3300/0 conn(0x7f87b013e040 0x7f87b01406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.143+0000 7f87afe00640 1 -- 172.21.15.153:0/688437359 >> v2:172.21.15.165:3300/0 conn(0x7f87b013e040 msgr2=0x7f87b01406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.143+0000 7f87afe00640 1 --2- 172.21.15.153:0/688437359 >> v2:172.21.15.165:3300/0 conn(0x7f87b013e040 0x7f87b01406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.143+0000 7f87afe00640 1 -- 172.21.15.153:0/688437359 >> v1:172.21.15.165:6789/0 conn(0x7f87b013dc60 legacy=0x7f87b013e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.143+0000 7f87afe00640 1 -- 172.21.15.153:0/688437359 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b0140fc0 con 0x7f87b015bf80 2024-03-28T21:52:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.143+0000 7f87ae000640 1 -- 172.21.15.153:0/688437359 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 599843620 0 0) 0x7f87b015c3b0 con 0x7f87b013dc60 2024-03-28T21:52:07.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.144+0000 7f87afe00640 1 --2- 172.21.15.153:0/688437359 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87b015bf80 0x7f87b0070f60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009e50 tx=0x7f87a802e0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b5cc4c441838726 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:07.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.145+0000 7f87ae000640 1 -- 172.21.15.153:0/688437359 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a802ec80 con 0x7f87b015bf80 2024-03-28T21:52:07.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.145+0000 7f87ae000640 1 -- 172.21.15.153:0/688437359 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a802ee20 con 0x7f87b015bf80 2024-03-28T21:52:07.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.145+0000 7f87ae000640 1 -- 172.21.15.153:0/688437359 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8036610 con 0x7f87b015bf80 2024-03-28T21:52:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.145+0000 7f87b4c00640 1 -- 172.21.15.153:0/688437359 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87b015bf80 msgr2=0x7f87b0070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.145+0000 7f87b4c00640 1 --2- 172.21.15.153:0/688437359 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87b015bf80 0x7f87b0070f60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009e50 tx=0x7f87a802e0e0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.145+0000 7f87b4c00640 1 -- 172.21.15.153:0/688437359 shutdown_connections 2024-03-28T21:52:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.145+0000 7f87b4c00640 1 --2- 172.21.15.153:0/688437359 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87b015bf80 0x7f87b0070f60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.145+0000 7f87b4c00640 1 --2- 172.21.15.153:0/688437359 >> v2:172.21.15.165:3300/0 conn(0x7f87b013e040 0x7f87b01406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.145+0000 7f87b4c00640 1 -- 172.21.15.153:0/688437359 >> 172.21.15.153:0/688437359 conn(0x7f87b00b1890 msgr2=0x7f87b00b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.145+0000 7f87b4c00640 1 -- 172.21.15.153:0/688437359 shutdown_connections 2024-03-28T21:52:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.145+0000 7f87b4c00640 1 -- 172.21.15.153:0/688437359 wait complete. 2024-03-28T21:52:07.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.147+0000 7f87b4c00640 1 Processor -- start 2024-03-28T21:52:07.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.147+0000 7f87b4c00640 1 -- start start 2024-03-28T21:52:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.148+0000 7f87b4c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87b013dc60 0x7f87b0155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.148+0000 7f87b4c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87b013e040 0x7f87b0156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.148+0000 7f87b4c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87b015bf80 0x7f87b006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.148+0000 7f87b4c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f87b00ce8c0 con 0x7f87b013dc60 2024-03-28T21:52:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.148+0000 7f87b4c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f87b0141580 con 0x7f87b015bf80 2024-03-28T21:52:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.148+0000 7f87b4c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f87b00714a0 con 0x7f87b013e040 2024-03-28T21:52:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.148+0000 7f87af400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87b013dc60 0x7f87b0155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.148+0000 7f87af400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87b013dc60 0x7f87b0155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45814/0 (socket says 172.21.15.153:45814) 2024-03-28T21:52:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.148+0000 7f87af400640 1 -- 172.21.15.153:0/4133177659 learned_addr learned my addr 172.21.15.153:0/4133177659 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.148+0000 7f87aea00640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87b013e040 0x7f87b0156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.149+0000 7f87afe00640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87b015bf80 0x7f87b006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.149+0000 7f87af400640 1 -- 172.21.15.153:0/4133177659 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87b013e040 msgr2=0x7f87b0156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.149+0000 7f87af400640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87b013e040 0x7f87b0156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.149+0000 7f87af400640 1 -- 172.21.15.153:0/4133177659 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87b015bf80 msgr2=0x7f87b006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.149+0000 7f87af400640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87b015bf80 0x7f87b006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.149+0000 7f87af400640 1 -- 172.21.15.153:0/4133177659 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b0130e30 con 0x7f87b013dc60 2024-03-28T21:52:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.149+0000 7f87afe00640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87b015bf80 0x7f87b006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.149+0000 7f87af400640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87b013dc60 0x7f87b0155770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f87a000c430 tx=0x7f87a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.149+0000 7f87a7400640 1 -- 172.21.15.153:0/4133177659 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0017070 con 0x7f87b013dc60 2024-03-28T21:52:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.149+0000 7f87a7400640 1 -- 172.21.15.153:0/4133177659 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a00052d0 con 0x7f87b013dc60 2024-03-28T21:52:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.149+0000 7f87a7400640 1 -- 172.21.15.153:0/4133177659 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a00037f0 con 0x7f87b013dc60 2024-03-28T21:52:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.149+0000 7f87b4c00640 1 -- 172.21.15.153:0/4133177659 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b01310d0 con 0x7f87b013dc60 2024-03-28T21:52:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.149+0000 7f87b4c00640 1 -- 172.21.15.153:0/4133177659 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b0131690 con 0x7f87b013dc60 2024-03-28T21:52:07.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.150+0000 7f87b4c00640 1 -- 172.21.15.153:0/4133177659 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b004f520 con 0x7f87b013dc60 2024-03-28T21:52:07.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.151+0000 7f87a7400640 1 -- 172.21.15.153:0/4133177659 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f87a001a070 con 0x7f87b013dc60 2024-03-28T21:52:07.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.153+0000 7f87a7400640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f879006b4d0 0x7f879006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:07.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.153+0000 7f87a7400640 1 -- 172.21.15.153:0/4133177659 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f87a0089540 con 0x7f87b013dc60 2024-03-28T21:52:07.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.153+0000 7f87aea00640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f879006b4d0 0x7f879006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:07.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.154+0000 7f87aea00640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f879006b4d0 0x7f879006d990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f87b00cbe50 tx=0x7f879c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:07.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.156+0000 7f87a7400640 1 -- 172.21.15.153:0/4133177659 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f87a0057d60 con 0x7f87b013dc60 2024-03-28T21:52:07.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.363+0000 7f87b4c00640 1 -- 172.21.15.153:0/4133177659 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87b0074dd0 con 0x7f879006b4d0 2024-03-28T21:52:07.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.373+0000 7f87a7400640 1 -- 172.21.15.153:0/4133177659 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251838 (secure 0 0 0) 0x7f87b0074dd0 con 0x7f879006b4d0 2024-03-28T21:52:07.379 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:07.380 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-03-28T21:52:07.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.378+0000 7f87b4c00640 1 -- 172.21.15.153:0/4133177659 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f879006b4d0 msgr2=0x7f879006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:07.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.378+0000 7f87b4c00640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f879006b4d0 0x7f879006d990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f87b00cbe50 tx=0x7f879c008040 comp rx=0 tx=0).stop 2024-03-28T21:52:07.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.378+0000 7f87b4c00640 1 -- 172.21.15.153:0/4133177659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87b013dc60 msgr2=0x7f87b0155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:07.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.378+0000 7f87b4c00640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87b013dc60 0x7f87b0155770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f87a000c430 tx=0x7f87a000c8f0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.378+0000 7f87b4c00640 1 -- 172.21.15.153:0/4133177659 shutdown_connections 2024-03-28T21:52:07.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.378+0000 7f87b4c00640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f879006b4d0 0x7f879006d990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.378+0000 7f87b4c00640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87b015bf80 0x7f87b006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.378+0000 7f87b4c00640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87b013e040 0x7f87b0156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.378+0000 7f87b4c00640 1 --2- 172.21.15.153:0/4133177659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87b013dc60 0x7f87b0155770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.378+0000 7f87b4c00640 1 -- 172.21.15.153:0/4133177659 >> 172.21.15.153:0/4133177659 conn(0x7f87b00b1890 msgr2=0x7f87b00cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:07.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.379+0000 7f87b4c00640 1 -- 172.21.15.153:0/4133177659 shutdown_connections 2024-03-28T21:52:07.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.379+0000 7f87b4c00640 1 -- 172.21.15.153:0/4133177659 wait complete. 2024-03-28T21:52:07.398 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-28T21:52:05.466354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223492,"kb_used_data":2984,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751228,"statfs":{"total":773094113280,"available":772865257472,"internally_reserved":0,"allocated":3055616,"data_stored":1816228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.769494"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735977+0000","last_change":"2024-03-28T21:51:56.734116+0000","last_active":"2024-03-28T21:51:57.735977+0000","last_peered":"2024-03-28T21:51:57.735977+0000","last_clean":"2024-03-28T21:51:57.735977+0000","last_became_active":"2024-03-28T21:51:56.733812+0000","last_became_peered":"2024-03-28T21:51:56.733812+0000","last_unstale":"2024-03-28T21:51:57.735977+0000","last_undegraded":"2024-03-28T21:51:57.735977+0000","last_fullsized":"2024-03-28T21:51:57.735977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:55:29.475667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740119+0000","last_change":"2024-03-28T21:51:56.735553+0000","last_active":"2024-03-28T21:51:57.740119+0000","last_peered":"2024-03-28T21:51:57.740119+0000","last_clean":"2024-03-28T21:51:57.740119+0000","last_became_active":"2024-03-28T21:51:56.734024+0000","last_became_peered":"2024-03-28T21:51:56.734024+0000","last_unstale":"2024-03-28T21:51:57.740119+0000","last_undegraded":"2024-03-28T21:51:57.740119+0000","last_fullsized":"2024-03-28T21:51:57.740119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:11.932847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.329774+0000","last_change":"2024-03-28T21:51:56.737454+0000","last_active":"2024-03-28T21:51:58.329774+0000","last_peered":"2024-03-28T21:51:58.329774+0000","last_clean":"2024-03-28T21:51:58.329774+0000","last_became_active":"2024-03-28T21:51:56.737087+0000","last_became_peered":"2024-03-28T21:51:56.737087+0000","last_unstale":"2024-03-28T21:51:58.329774+0000","last_undegraded":"2024-03-28T21:51:58.329774+0000","last_fullsized":"2024-03-28T21:51:58.329774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:53:53.920816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331759+0000","last_change":"2024-03-28T21:51:56.736235+0000","last_active":"2024-03-28T21:51:58.331759+0000","last_peered":"2024-03-28T21:51:58.331759+0000","last_clean":"2024-03-28T21:51:58.331759+0000","last_became_active":"2024-03-28T21:51:56.735603+0000","last_became_peered":"2024-03-28T21:51:56.735603+0000","last_unstale":"2024-03-28T21:51:58.331759+0000","last_undegraded":"2024-03-28T21:51:58.331759+0000","last_fullsized":"2024-03-28T21:51:58.331759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:24.456985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735254+0000","last_change":"2024-03-28T21:51:56.739891+0000","last_active":"2024-03-28T21:51:57.735254+0000","last_peered":"2024-03-28T21:51:57.735254+0000","last_clean":"2024-03-28T21:51:57.735254+0000","last_became_active":"2024-03-28T21:51:56.739615+0000","last_became_peered":"2024-03-28T21:51:56.739615+0000","last_unstale":"2024-03-28T21:51:57.735254+0000","last_undegraded":"2024-03-28T21:51:57.735254+0000","last_fullsized":"2024-03-28T21:51:57.735254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:30.418711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331127+0000","last_change":"2024-03-28T21:51:56.742464+0000","last_active":"2024-03-28T21:51:58.331127+0000","last_peered":"2024-03-28T21:51:58.331127+0000","last_clean":"2024-03-28T21:51:58.331127+0000","last_became_active":"2024-03-28T21:51:56.741634+0000","last_became_peered":"2024-03-28T21:51:56.741634+0000","last_unstale":"2024-03-28T21:51:58.331127+0000","last_undegraded":"2024-03-28T21:51:58.331127+0000","last_fullsized":"2024-03-28T21:51:58.331127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:09:58.678525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735080+0000","last_change":"2024-03-28T21:51:56.743653+0000","last_active":"2024-03-28T21:51:57.735080+0000","last_peered":"2024-03-28T21:51:57.735080+0000","last_clean":"2024-03-28T21:51:57.735080+0000","last_became_active":"2024-03-28T21:51:56.742149+0000","last_became_peered":"2024-03-28T21:51:56.742149+0000","last_unstale":"2024-03-28T21:51:57.735080+0000","last_undegraded":"2024-03-28T21:51:57.735080+0000","last_fullsized":"2024-03-28T21:51:57.735080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:09:58.678525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828651+0000","last_change":"2024-03-28T21:51:56.752911+0000","last_active":"2024-03-28T21:51:57.828651+0000","last_peered":"2024-03-28T21:51:57.828651+0000","last_clean":"2024-03-28T21:51:57.828651+0000","last_became_active":"2024-03-28T21:51:56.748615+0000","last_became_peered":"2024-03-28T21:51:56.748615+0000","last_unstale":"2024-03-28T21:51:57.828651+0000","last_undegraded":"2024-03-28T21:51:57.828651+0000","last_fullsized":"2024-03-28T21:51:57.828651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:55.682963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736936+0000","last_change":"2024-03-28T21:51:56.741836+0000","last_active":"2024-03-28T21:51:57.736936+0000","last_peered":"2024-03-28T21:51:57.736936+0000","last_clean":"2024-03-28T21:51:57.736936+0000","last_became_active":"2024-03-28T21:51:56.741491+0000","last_became_peered":"2024-03-28T21:51:56.741491+0000","last_unstale":"2024-03-28T21:51:57.736936+0000","last_undegraded":"2024-03-28T21:51:57.736936+0000","last_fullsized":"2024-03-28T21:51:57.736936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:53:40.266285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739986+0000","last_change":"2024-03-28T21:51:56.749181+0000","last_active":"2024-03-28T21:51:57.739986+0000","last_peered":"2024-03-28T21:51:57.739986+0000","last_clean":"2024-03-28T21:51:57.739986+0000","last_became_active":"2024-03-28T21:51:56.748011+0000","last_became_peered":"2024-03-28T21:51:56.748011+0000","last_unstale":"2024-03-28T21:51:57.739986+0000","last_undegraded":"2024-03-28T21:51:57.739986+0000","last_fullsized":"2024-03-28T21:51:57.739986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:11.932847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739442+0000","last_change":"2024-03-28T21:51:56.735051+0000","last_active":"2024-03-28T21:51:57.739442+0000","last_peered":"2024-03-28T21:51:57.739442+0000","last_clean":"2024-03-28T21:51:57.739442+0000","last_became_active":"2024-03-28T21:51:56.734565+0000","last_became_peered":"2024-03-28T21:51:56.734565+0000","last_unstale":"2024-03-28T21:51:57.739442+0000","last_undegraded":"2024-03-28T21:51:57.739442+0000","last_fullsized":"2024-03-28T21:51:57.739442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:28.881798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737999+0000","last_change":"2024-03-28T21:51:56.725130+0000","last_active":"2024-03-28T21:51:57.737999+0000","last_peered":"2024-03-28T21:51:57.737999+0000","last_clean":"2024-03-28T21:51:57.737999+0000","last_became_active":"2024-03-28T21:51:56.724746+0000","last_became_peered":"2024-03-28T21:51:56.724746+0000","last_unstale":"2024-03-28T21:51:57.737999+0000","last_undegraded":"2024-03-28T21:51:57.737999+0000","last_fullsized":"2024-03-28T21:51:57.737999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:31:25.125095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829271+0000","last_change":"2024-03-28T21:51:56.732293+0000","last_active":"2024-03-28T21:51:57.829271+0000","last_peered":"2024-03-28T21:51:57.829271+0000","last_clean":"2024-03-28T21:51:57.829271+0000","last_became_active":"2024-03-28T21:51:56.732008+0000","last_became_peered":"2024-03-28T21:51:56.732008+0000","last_unstale":"2024-03-28T21:51:57.829271+0000","last_undegraded":"2024-03-28T21:51:57.829271+0000","last_fullsized":"2024-03-28T21:51:57.829271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:33:42.107550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330107+0000","last_change":"2024-03-28T21:51:56.732803+0000","last_active":"2024-03-28T21:51:58.330107+0000","last_peered":"2024-03-28T21:51:58.330107+0000","last_clean":"2024-03-28T21:51:58.330107+0000","last_became_active":"2024-03-28T21:51:56.732496+0000","last_became_peered":"2024-03-28T21:51:56.732496+0000","last_unstale":"2024-03-28T21:51:58.330107+0000","last_undegraded":"2024-03-28T21:51:58.330107+0000","last_fullsized":"2024-03-28T21:51:58.330107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:39:08.739432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739756+0000","last_change":"2024-03-28T21:51:56.732159+0000","last_active":"2024-03-28T21:51:57.739756+0000","last_peered":"2024-03-28T21:51:57.739756+0000","last_clean":"2024-03-28T21:51:57.739756+0000","last_became_active":"2024-03-28T21:51:56.731820+0000","last_became_peered":"2024-03-28T21:51:56.731820+0000","last_unstale":"2024-03-28T21:51:57.739756+0000","last_undegraded":"2024-03-28T21:51:57.739756+0000","last_fullsized":"2024-03-28T21:51:57.739756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:08:15.623597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331126+0000","last_change":"2024-03-28T21:51:56.741864+0000","last_active":"2024-03-28T21:51:58.331126+0000","last_peered":"2024-03-28T21:51:58.331126+0000","last_clean":"2024-03-28T21:51:58.331126+0000","last_became_active":"2024-03-28T21:51:56.741579+0000","last_became_peered":"2024-03-28T21:51:56.741579+0000","last_unstale":"2024-03-28T21:51:58.331126+0000","last_undegraded":"2024-03-28T21:51:58.331126+0000","last_fullsized":"2024-03-28T21:51:58.331126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:20:02.821931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332613+0000","last_change":"2024-03-28T21:51:56.739060+0000","last_active":"2024-03-28T21:51:58.332613+0000","last_peered":"2024-03-28T21:51:58.332613+0000","last_clean":"2024-03-28T21:51:58.332613+0000","last_became_active":"2024-03-28T21:51:56.738641+0000","last_became_peered":"2024-03-28T21:51:56.738641+0000","last_unstale":"2024-03-28T21:51:58.332613+0000","last_undegraded":"2024-03-28T21:51:58.332613+0000","last_fullsized":"2024-03-28T21:51:58.332613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:36:15.569229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.799302+0000","last_change":"2024-03-28T21:51:56.737872+0000","last_active":"2024-03-28T21:51:57.799302+0000","last_peered":"2024-03-28T21:51:57.799302+0000","last_clean":"2024-03-28T21:51:57.799302+0000","last_became_active":"2024-03-28T21:51:56.737566+0000","last_became_peered":"2024-03-28T21:51:56.737566+0000","last_unstale":"2024-03-28T21:51:57.799302+0000","last_undegraded":"2024-03-28T21:51:57.799302+0000","last_fullsized":"2024-03-28T21:51:57.799302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:42:21.430278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736646+0000","last_change":"2024-03-28T21:51:56.738430+0000","last_active":"2024-03-28T21:51:57.736646+0000","last_peered":"2024-03-28T21:51:57.736646+0000","last_clean":"2024-03-28T21:51:57.736646+0000","last_became_active":"2024-03-28T21:51:56.738084+0000","last_became_peered":"2024-03-28T21:51:56.738084+0000","last_unstale":"2024-03-28T21:51:57.736646+0000","last_undegraded":"2024-03-28T21:51:57.736646+0000","last_fullsized":"2024-03-28T21:51:57.736646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:21:00.155587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739051+0000","last_change":"2024-03-28T21:51:56.740987+0000","last_active":"2024-03-28T21:51:57.739051+0000","last_peered":"2024-03-28T21:51:57.739051+0000","last_clean":"2024-03-28T21:51:57.739051+0000","last_became_active":"2024-03-28T21:51:56.740456+0000","last_became_peered":"2024-03-28T21:51:56.740456+0000","last_unstale":"2024-03-28T21:51:57.739051+0000","last_undegraded":"2024-03-28T21:51:57.739051+0000","last_fullsized":"2024-03-28T21:51:57.739051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:08:15.623597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330303+0000","last_change":"2024-03-28T21:51:56.737666+0000","last_active":"2024-03-28T21:51:58.330303+0000","last_peered":"2024-03-28T21:51:58.330303+0000","last_clean":"2024-03-28T21:51:58.330303+0000","last_became_active":"2024-03-28T21:51:56.737409+0000","last_became_peered":"2024-03-28T21:51:56.737409+0000","last_unstale":"2024-03-28T21:51:58.330303+0000","last_undegraded":"2024-03-28T21:51:58.330303+0000","last_fullsized":"2024-03-28T21:51:58.330303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:43:56.754076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331510+0000","last_change":"2024-03-28T21:51:56.734651+0000","last_active":"2024-03-28T21:51:58.331510+0000","last_peered":"2024-03-28T21:51:58.331510+0000","last_clean":"2024-03-28T21:51:58.331510+0000","last_became_active":"2024-03-28T21:51:56.733779+0000","last_became_peered":"2024-03-28T21:51:56.733779+0000","last_unstale":"2024-03-28T21:51:58.331510+0000","last_undegraded":"2024-03-28T21:51:58.331510+0000","last_fullsized":"2024-03-28T21:51:58.331510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:27:25.577575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828725+0000","last_change":"2024-03-28T21:51:56.745483+0000","last_active":"2024-03-28T21:51:57.828725+0000","last_peered":"2024-03-28T21:51:57.828725+0000","last_clean":"2024-03-28T21:51:57.828725+0000","last_became_active":"2024-03-28T21:51:56.745196+0000","last_became_peered":"2024-03-28T21:51:56.745196+0000","last_unstale":"2024-03-28T21:51:57.828725+0000","last_undegraded":"2024-03-28T21:51:57.828725+0000","last_fullsized":"2024-03-28T21:51:57.828725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:28.881798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331406+0000","last_change":"2024-03-28T21:51:56.737805+0000","last_active":"2024-03-28T21:51:58.331406+0000","last_peered":"2024-03-28T21:51:58.331406+0000","last_clean":"2024-03-28T21:51:58.331406+0000","last_became_active":"2024-03-28T21:51:56.737549+0000","last_became_peered":"2024-03-28T21:51:56.737549+0000","last_unstale":"2024-03-28T21:51:58.331406+0000","last_undegraded":"2024-03-28T21:51:58.331406+0000","last_fullsized":"2024-03-28T21:51:58.331406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:30.418711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829532+0000","last_change":"2024-03-28T21:51:56.746355+0000","last_active":"2024-03-28T21:51:57.829532+0000","last_peered":"2024-03-28T21:51:57.829532+0000","last_clean":"2024-03-28T21:51:57.829532+0000","last_became_active":"2024-03-28T21:51:56.744993+0000","last_became_peered":"2024-03-28T21:51:56.744993+0000","last_unstale":"2024-03-28T21:51:57.829532+0000","last_undegraded":"2024-03-28T21:51:57.829532+0000","last_fullsized":"2024-03-28T21:51:57.829532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:09:58.678525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740180+0000","last_change":"2024-03-28T21:51:56.718719+0000","last_active":"2024-03-28T21:51:57.740180+0000","last_peered":"2024-03-28T21:51:57.740180+0000","last_clean":"2024-03-28T21:51:57.740180+0000","last_became_active":"2024-03-28T21:51:56.718298+0000","last_became_peered":"2024-03-28T21:51:56.718298+0000","last_unstale":"2024-03-28T21:51:57.740180+0000","last_undegraded":"2024-03-28T21:51:57.740180+0000","last_fullsized":"2024-03-28T21:51:57.740180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:33:42.107550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740391+0000","last_change":"2024-03-28T21:51:56.736179+0000","last_active":"2024-03-28T21:51:57.740391+0000","last_peered":"2024-03-28T21:51:57.740391+0000","last_clean":"2024-03-28T21:51:57.740391+0000","last_became_active":"2024-03-28T21:51:56.735901+0000","last_became_peered":"2024-03-28T21:51:56.735901+0000","last_unstale":"2024-03-28T21:51:57.740391+0000","last_undegraded":"2024-03-28T21:51:57.740391+0000","last_fullsized":"2024-03-28T21:51:57.740391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:33:42.107550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829438+0000","last_change":"2024-03-28T21:51:56.746834+0000","last_active":"2024-03-28T21:51:57.829438+0000","last_peered":"2024-03-28T21:51:57.829438+0000","last_clean":"2024-03-28T21:51:57.829438+0000","last_became_active":"2024-03-28T21:51:56.745939+0000","last_became_peered":"2024-03-28T21:51:56.745939+0000","last_unstale":"2024-03-28T21:51:57.829438+0000","last_undegraded":"2024-03-28T21:51:57.829438+0000","last_fullsized":"2024-03-28T21:51:57.829438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:20:02.821931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330314+0000","last_change":"2024-03-28T21:51:56.737457+0000","last_active":"2024-03-28T21:51:58.330314+0000","last_peered":"2024-03-28T21:51:58.330314+0000","last_clean":"2024-03-28T21:51:58.330314+0000","last_became_active":"2024-03-28T21:51:56.737113+0000","last_became_peered":"2024-03-28T21:51:56.737113+0000","last_unstale":"2024-03-28T21:51:58.330314+0000","last_undegraded":"2024-03-28T21:51:58.330314+0000","last_fullsized":"2024-03-28T21:51:58.330314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:11:32.340414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331592+0000","last_change":"2024-03-28T21:51:56.731405+0000","last_active":"2024-03-28T21:51:58.331592+0000","last_peered":"2024-03-28T21:51:58.331592+0000","last_clean":"2024-03-28T21:51:58.331592+0000","last_became_active":"2024-03-28T21:51:56.731108+0000","last_became_peered":"2024-03-28T21:51:56.731108+0000","last_unstale":"2024-03-28T21:51:58.331592+0000","last_undegraded":"2024-03-28T21:51:58.331592+0000","last_fullsized":"2024-03-28T21:51:58.331592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:59:08.185041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.798726+0000","last_change":"2024-03-28T21:51:56.747423+0000","last_active":"2024-03-28T21:51:57.798726+0000","last_peered":"2024-03-28T21:51:57.798726+0000","last_clean":"2024-03-28T21:51:57.798726+0000","last_became_active":"2024-03-28T21:51:56.746418+0000","last_became_peered":"2024-03-28T21:51:56.746418+0000","last_unstale":"2024-03-28T21:51:57.798726+0000","last_undegraded":"2024-03-28T21:51:57.798726+0000","last_fullsized":"2024-03-28T21:51:57.798726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:53:48.904039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738908+0000","last_change":"2024-03-28T21:51:56.737277+0000","last_active":"2024-03-28T21:51:57.738908+0000","last_peered":"2024-03-28T21:51:57.738908+0000","last_clean":"2024-03-28T21:51:57.738908+0000","last_became_active":"2024-03-28T21:51:56.736790+0000","last_became_peered":"2024-03-28T21:51:56.736790+0000","last_unstale":"2024-03-28T21:51:57.738908+0000","last_undegraded":"2024-03-28T21:51:57.738908+0000","last_fullsized":"2024-03-28T21:51:57.738908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:55.682963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736622+0000","last_change":"2024-03-28T21:51:56.724145+0000","last_active":"2024-03-28T21:51:57.736622+0000","last_peered":"2024-03-28T21:51:57.736622+0000","last_clean":"2024-03-28T21:51:57.736622+0000","last_became_active":"2024-03-28T21:51:56.723562+0000","last_became_peered":"2024-03-28T21:51:56.723562+0000","last_unstale":"2024-03-28T21:51:57.736622+0000","last_undegraded":"2024-03-28T21:51:57.736622+0000","last_fullsized":"2024-03-28T21:51:57.736622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:49:20.458598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829410+0000","last_change":"2024-03-28T21:51:55.736394+0000","last_active":"2024-03-28T21:51:57.829410+0000","last_peered":"2024-03-28T21:51:57.829410+0000","last_clean":"2024-03-28T21:51:57.829410+0000","last_became_active":"2024-03-28T21:51:55.735945+0000","last_became_peered":"2024-03-28T21:51:55.735945+0000","last_unstale":"2024-03-28T21:51:57.829410+0000","last_undegraded":"2024-03-28T21:51:57.829410+0000","last_fullsized":"2024-03-28T21:51:57.829410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:10:58.825950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330791+0000","last_change":"2024-03-28T21:51:56.750688+0000","last_active":"2024-03-28T21:51:58.330791+0000","last_peered":"2024-03-28T21:51:58.330791+0000","last_clean":"2024-03-28T21:51:58.330791+0000","last_became_active":"2024-03-28T21:51:56.750174+0000","last_became_peered":"2024-03-28T21:51:56.750174+0000","last_unstale":"2024-03-28T21:51:58.330791+0000","last_undegraded":"2024-03-28T21:51:58.330791+0000","last_fullsized":"2024-03-28T21:51:58.330791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:59:55.876132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738775+0000","last_change":"2024-03-28T21:51:55.730078+0000","last_active":"2024-03-28T21:51:57.738775+0000","last_peered":"2024-03-28T21:51:57.738775+0000","last_clean":"2024-03-28T21:51:57.738775+0000","last_became_active":"2024-03-28T21:51:55.729059+0000","last_became_peered":"2024-03-28T21:51:55.729059+0000","last_unstale":"2024-03-28T21:51:57.738775+0000","last_undegraded":"2024-03-28T21:51:57.738775+0000","last_fullsized":"2024-03-28T21:51:57.738775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:25:06.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828695+0000","last_change":"2024-03-28T21:51:55.724321+0000","last_active":"2024-03-28T21:51:57.828695+0000","last_peered":"2024-03-28T21:51:57.828695+0000","last_clean":"2024-03-28T21:51:57.828695+0000","last_became_active":"2024-03-28T21:51:55.723873+0000","last_became_peered":"2024-03-28T21:51:55.723873+0000","last_unstale":"2024-03-28T21:51:57.828695+0000","last_undegraded":"2024-03-28T21:51:57.828695+0000","last_fullsized":"2024-03-28T21:51:57.828695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:01:24.561519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828667+0000","last_change":"2024-03-28T21:51:56.738471+0000","last_active":"2024-03-28T21:51:57.828667+0000","last_peered":"2024-03-28T21:51:57.828667+0000","last_clean":"2024-03-28T21:51:57.828667+0000","last_became_active":"2024-03-28T21:51:56.738126+0000","last_became_peered":"2024-03-28T21:51:56.738126+0000","last_unstale":"2024-03-28T21:51:57.828667+0000","last_undegraded":"2024-03-28T21:51:57.828667+0000","last_fullsized":"2024-03-28T21:51:57.828667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:08:15.623597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331496+0000","last_change":"2024-03-28T21:51:55.730358+0000","last_active":"2024-03-28T21:51:58.331496+0000","last_peered":"2024-03-28T21:51:58.331496+0000","last_clean":"2024-03-28T21:51:58.331496+0000","last_became_active":"2024-03-28T21:51:55.730046+0000","last_became_peered":"2024-03-28T21:51:55.730046+0000","last_unstale":"2024-03-28T21:51:58.331496+0000","last_undegraded":"2024-03-28T21:51:58.331496+0000","last_fullsized":"2024-03-28T21:51:58.331496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:52.161365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739961+0000","last_change":"2024-03-28T21:51:56.728333+0000","last_active":"2024-03-28T21:51:57.739961+0000","last_peered":"2024-03-28T21:51:57.739961+0000","last_clean":"2024-03-28T21:51:57.739961+0000","last_became_active":"2024-03-28T21:51:56.728047+0000","last_became_peered":"2024-03-28T21:51:56.728047+0000","last_unstale":"2024-03-28T21:51:57.739961+0000","last_undegraded":"2024-03-28T21:51:57.739961+0000","last_fullsized":"2024-03-28T21:51:57.739961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:46.786652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739888+0000","last_change":"2024-03-28T21:51:55.736601+0000","last_active":"2024-03-28T21:51:57.739888+0000","last_peered":"2024-03-28T21:51:57.739888+0000","last_clean":"2024-03-28T21:51:57.739888+0000","last_became_active":"2024-03-28T21:51:55.735858+0000","last_became_peered":"2024-03-28T21:51:55.735858+0000","last_unstale":"2024-03-28T21:51:57.739888+0000","last_undegraded":"2024-03-28T21:51:57.739888+0000","last_fullsized":"2024-03-28T21:51:57.739888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:49.481854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332438+0000","last_change":"2024-03-28T21:51:56.736289+0000","last_active":"2024-03-28T21:51:58.332438+0000","last_peered":"2024-03-28T21:51:58.332438+0000","last_clean":"2024-03-28T21:51:58.332438+0000","last_became_active":"2024-03-28T21:51:56.735924+0000","last_became_peered":"2024-03-28T21:51:56.735924+0000","last_unstale":"2024-03-28T21:51:58.332438+0000","last_undegraded":"2024-03-28T21:51:58.332438+0000","last_fullsized":"2024-03-28T21:51:58.332438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:53:40.266285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332311+0000","last_change":"2024-03-28T21:51:55.735297+0000","last_active":"2024-03-28T21:51:58.332311+0000","last_peered":"2024-03-28T21:51:58.332311+0000","last_clean":"2024-03-28T21:51:58.332311+0000","last_became_active":"2024-03-28T21:51:55.735006+0000","last_became_peered":"2024-03-28T21:51:55.735006+0000","last_unstale":"2024-03-28T21:51:58.332311+0000","last_undegraded":"2024-03-28T21:51:58.332311+0000","last_fullsized":"2024-03-28T21:51:58.332311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:16.943146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330547+0000","last_change":"2024-03-28T21:51:56.750675+0000","last_active":"2024-03-28T21:51:58.330547+0000","last_peered":"2024-03-28T21:51:58.330547+0000","last_clean":"2024-03-28T21:51:58.330547+0000","last_became_active":"2024-03-28T21:51:56.747119+0000","last_became_peered":"2024-03-28T21:51:56.747119+0000","last_unstale":"2024-03-28T21:51:58.330547+0000","last_undegraded":"2024-03-28T21:51:58.330547+0000","last_fullsized":"2024-03-28T21:51:58.330547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:08:48.875187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740776+0000","last_change":"2024-03-28T21:51:55.737036+0000","last_active":"2024-03-28T21:51:57.740776+0000","last_peered":"2024-03-28T21:51:57.740776+0000","last_clean":"2024-03-28T21:51:57.740776+0000","last_became_active":"2024-03-28T21:51:55.736746+0000","last_became_peered":"2024-03-28T21:51:55.736746+0000","last_unstale":"2024-03-28T21:51:57.740776+0000","last_undegraded":"2024-03-28T21:51:57.740776+0000","last_fullsized":"2024-03-28T21:51:57.740776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:41:33.261221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738359+0000","last_change":"2024-03-28T21:51:56.734022+0000","last_active":"2024-03-28T21:51:57.738359+0000","last_peered":"2024-03-28T21:51:57.738359+0000","last_clean":"2024-03-28T21:51:57.738359+0000","last_became_active":"2024-03-28T21:51:56.731663+0000","last_became_peered":"2024-03-28T21:51:56.731663+0000","last_unstale":"2024-03-28T21:51:57.738359+0000","last_undegraded":"2024-03-28T21:51:57.738359+0000","last_fullsized":"2024-03-28T21:51:57.738359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:10:14.581056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739196+0000","last_change":"2024-03-28T21:51:55.730854+0000","last_active":"2024-03-28T21:51:57.739196+0000","last_peered":"2024-03-28T21:51:57.739196+0000","last_clean":"2024-03-28T21:51:57.739196+0000","last_became_active":"2024-03-28T21:51:55.729293+0000","last_became_peered":"2024-03-28T21:51:55.729293+0000","last_unstale":"2024-03-28T21:51:57.739196+0000","last_undegraded":"2024-03-28T21:51:57.739196+0000","last_fullsized":"2024-03-28T21:51:57.739196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:07:09.631543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735807+0000","last_change":"2024-03-28T21:51:56.739559+0000","last_active":"2024-03-28T21:51:57.735807+0000","last_peered":"2024-03-28T21:51:57.735807+0000","last_clean":"2024-03-28T21:51:57.735807+0000","last_became_active":"2024-03-28T21:51:56.739248+0000","last_became_peered":"2024-03-28T21:51:56.739248+0000","last_unstale":"2024-03-28T21:51:57.735807+0000","last_undegraded":"2024-03-28T21:51:57.735807+0000","last_fullsized":"2024-03-28T21:51:57.735807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:44:09.922647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330696+0000","last_change":"2024-03-28T21:51:55.722706+0000","last_active":"2024-03-28T21:51:58.330696+0000","last_peered":"2024-03-28T21:51:58.330696+0000","last_clean":"2024-03-28T21:51:58.330696+0000","last_became_active":"2024-03-28T21:51:55.722273+0000","last_became_peered":"2024-03-28T21:51:55.722273+0000","last_unstale":"2024-03-28T21:51:58.330696+0000","last_undegraded":"2024-03-28T21:51:58.330696+0000","last_fullsized":"2024-03-28T21:51:58.330696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:25:33.882861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.329913+0000","last_change":"2024-03-28T21:51:56.740785+0000","last_active":"2024-03-28T21:51:58.329913+0000","last_peered":"2024-03-28T21:51:58.329913+0000","last_clean":"2024-03-28T21:51:58.329913+0000","last_became_active":"2024-03-28T21:51:56.740524+0000","last_became_peered":"2024-03-28T21:51:56.740524+0000","last_unstale":"2024-03-28T21:51:58.329913+0000","last_undegraded":"2024-03-28T21:51:58.329913+0000","last_fullsized":"2024-03-28T21:51:58.329913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:00:37.304905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331836+0000","last_change":"2024-03-28T21:51:55.736963+0000","last_active":"2024-03-28T21:51:58.331836+0000","last_peered":"2024-03-28T21:51:58.331836+0000","last_clean":"2024-03-28T21:51:58.331836+0000","last_became_active":"2024-03-28T21:51:55.734830+0000","last_became_peered":"2024-03-28T21:51:55.734830+0000","last_unstale":"2024-03-28T21:51:58.331836+0000","last_undegraded":"2024-03-28T21:51:58.331836+0000","last_fullsized":"2024-03-28T21:51:58.331836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:27.412749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735343+0000","last_change":"2024-03-28T21:51:56.746398+0000","last_active":"2024-03-28T21:51:57.735343+0000","last_peered":"2024-03-28T21:51:57.735343+0000","last_clean":"2024-03-28T21:51:57.735343+0000","last_became_active":"2024-03-28T21:51:56.746126+0000","last_became_peered":"2024-03-28T21:51:56.746126+0000","last_unstale":"2024-03-28T21:51:57.735343+0000","last_undegraded":"2024-03-28T21:51:57.735343+0000","last_fullsized":"2024-03-28T21:51:57.735343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:27:25.577575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738980+0000","last_change":"2024-03-28T21:51:55.730767+0000","last_active":"2024-03-28T21:51:57.738980+0000","last_peered":"2024-03-28T21:51:57.738980+0000","last_clean":"2024-03-28T21:51:57.738980+0000","last_became_active":"2024-03-28T21:51:55.729015+0000","last_became_peered":"2024-03-28T21:51:55.729015+0000","last_unstale":"2024-03-28T21:51:57.738980+0000","last_undegraded":"2024-03-28T21:51:57.738980+0000","last_fullsized":"2024-03-28T21:51:57.738980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:38.624808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739619+0000","last_change":"2024-03-28T21:51:56.737060+0000","last_active":"2024-03-28T21:51:57.739619+0000","last_peered":"2024-03-28T21:51:57.739619+0000","last_clean":"2024-03-28T21:51:57.739619+0000","last_became_active":"2024-03-28T21:51:56.736452+0000","last_became_peered":"2024-03-28T21:51:56.736452+0000","last_unstale":"2024-03-28T21:51:57.739619+0000","last_undegraded":"2024-03-28T21:51:57.739619+0000","last_fullsized":"2024-03-28T21:51:57.739619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:46.786652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.798595+0000","last_change":"2024-03-28T21:51:55.728291+0000","last_active":"2024-03-28T21:51:57.798595+0000","last_peered":"2024-03-28T21:51:57.798595+0000","last_clean":"2024-03-28T21:51:57.798595+0000","last_became_active":"2024-03-28T21:51:55.727942+0000","last_became_peered":"2024-03-28T21:51:55.727942+0000","last_unstale":"2024-03-28T21:51:57.798595+0000","last_undegraded":"2024-03-28T21:51:57.798595+0000","last_fullsized":"2024-03-28T21:51:57.798595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:01:39.586196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735383+0000","last_change":"2024-03-28T21:51:56.746545+0000","last_active":"2024-03-28T21:51:57.735383+0000","last_peered":"2024-03-28T21:51:57.735383+0000","last_clean":"2024-03-28T21:51:57.735383+0000","last_became_active":"2024-03-28T21:51:56.743999+0000","last_became_peered":"2024-03-28T21:51:56.743999+0000","last_unstale":"2024-03-28T21:51:57.735383+0000","last_undegraded":"2024-03-28T21:51:57.735383+0000","last_fullsized":"2024-03-28T21:51:57.735383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:59:08.185041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738223+0000","last_change":"2024-03-28T21:51:55.727110+0000","last_active":"2024-03-28T21:51:57.738223+0000","last_peered":"2024-03-28T21:51:57.738223+0000","last_clean":"2024-03-28T21:51:57.738223+0000","last_became_active":"2024-03-28T21:51:55.726646+0000","last_became_peered":"2024-03-28T21:51:55.726646+0000","last_unstale":"2024-03-28T21:51:57.738223+0000","last_undegraded":"2024-03-28T21:51:57.738223+0000","last_fullsized":"2024-03-28T21:51:57.738223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:10:58.825950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737881+0000","last_change":"2024-03-28T21:51:56.747293+0000","last_active":"2024-03-28T21:51:57.737881+0000","last_peered":"2024-03-28T21:51:57.737881+0000","last_clean":"2024-03-28T21:51:57.737881+0000","last_became_active":"2024-03-28T21:51:56.743809+0000","last_became_peered":"2024-03-28T21:51:56.743809+0000","last_unstale":"2024-03-28T21:51:57.737881+0000","last_undegraded":"2024-03-28T21:51:57.737881+0000","last_fullsized":"2024-03-28T21:51:57.737881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:36:15.569229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.799403+0000","last_change":"2024-03-28T21:51:55.731064+0000","last_active":"2024-03-28T21:51:57.799403+0000","last_peered":"2024-03-28T21:51:57.799403+0000","last_clean":"2024-03-28T21:51:57.799403+0000","last_became_active":"2024-03-28T21:51:55.730784+0000","last_became_peered":"2024-03-28T21:51:55.730784+0000","last_unstale":"2024-03-28T21:51:57.799403+0000","last_undegraded":"2024-03-28T21:51:57.799403+0000","last_fullsized":"2024-03-28T21:51:57.799403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:14:12.770422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737269+0000","last_change":"2024-03-28T21:51:56.748869+0000","last_active":"2024-03-28T21:51:57.737269+0000","last_peered":"2024-03-28T21:51:57.737269+0000","last_clean":"2024-03-28T21:51:57.737269+0000","last_became_active":"2024-03-28T21:51:56.748640+0000","last_became_peered":"2024-03-28T21:51:56.748640+0000","last_unstale":"2024-03-28T21:51:57.737269+0000","last_undegraded":"2024-03-28T21:51:57.737269+0000","last_fullsized":"2024-03-28T21:51:57.737269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:14:34.083715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740696+0000","last_change":"2024-03-28T21:51:55.731550+0000","last_active":"2024-03-28T21:51:57.740696+0000","last_peered":"2024-03-28T21:51:57.740696+0000","last_clean":"2024-03-28T21:51:57.740696+0000","last_became_active":"2024-03-28T21:51:55.728370+0000","last_became_peered":"2024-03-28T21:51:55.728370+0000","last_unstale":"2024-03-28T21:51:57.740696+0000","last_undegraded":"2024-03-28T21:51:57.740696+0000","last_fullsized":"2024-03-28T21:51:57.740696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:49:18.989549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332462+0000","last_change":"2024-03-28T21:51:56.736531+0000","last_active":"2024-03-28T21:51:58.332462+0000","last_peered":"2024-03-28T21:51:58.332462+0000","last_clean":"2024-03-28T21:51:58.332462+0000","last_became_active":"2024-03-28T21:51:56.735968+0000","last_became_peered":"2024-03-28T21:51:56.735968+0000","last_unstale":"2024-03-28T21:51:58.332462+0000","last_undegraded":"2024-03-28T21:51:58.332462+0000","last_fullsized":"2024-03-28T21:51:58.332462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:14:34.083715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.799078+0000","last_change":"2024-03-28T21:51:55.735045+0000","last_active":"2024-03-28T21:51:57.799078+0000","last_peered":"2024-03-28T21:51:57.799078+0000","last_clean":"2024-03-28T21:51:57.799078+0000","last_became_active":"2024-03-28T21:51:55.734768+0000","last_became_peered":"2024-03-28T21:51:55.734768+0000","last_unstale":"2024-03-28T21:51:57.799078+0000","last_undegraded":"2024-03-28T21:51:57.799078+0000","last_fullsized":"2024-03-28T21:51:57.799078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:18:31.421582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735795+0000","last_change":"2024-03-28T21:51:56.745586+0000","last_active":"2024-03-28T21:51:57.735795+0000","last_peered":"2024-03-28T21:51:57.735795+0000","last_clean":"2024-03-28T21:51:57.735795+0000","last_became_active":"2024-03-28T21:51:56.745299+0000","last_became_peered":"2024-03-28T21:51:56.745299+0000","last_unstale":"2024-03-28T21:51:57.735795+0000","last_undegraded":"2024-03-28T21:51:57.735795+0000","last_fullsized":"2024-03-28T21:51:57.735795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:24.456985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.734439+0000","last_change":"2024-03-28T21:51:51.547812+0000","last_active":"2024-03-28T21:51:57.734439+0000","last_peered":"2024-03-28T21:51:57.734439+0000","last_clean":"2024-03-28T21:51:57.734439+0000","last_became_active":"2024-03-28T21:51:51.545783+0000","last_became_peered":"2024-03-28T21:51:51.545783+0000","last_unstale":"2024-03-28T21:51:57.734439+0000","last_undegraded":"2024-03-28T21:51:57.734439+0000","last_fullsized":"2024-03-28T21:51:57.734439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_clean_scrub_stamp":"2024-03-28T21:51:50.185942+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:08:34.531035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331207+0000","last_change":"2024-03-28T21:51:55.733897+0000","last_active":"2024-03-28T21:51:58.331207+0000","last_peered":"2024-03-28T21:51:58.331207+0000","last_clean":"2024-03-28T21:51:58.331207+0000","last_became_active":"2024-03-28T21:51:55.733569+0000","last_became_peered":"2024-03-28T21:51:55.733569+0000","last_unstale":"2024-03-28T21:51:58.331207+0000","last_undegraded":"2024-03-28T21:51:58.331207+0000","last_fullsized":"2024-03-28T21:51:58.331207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:54.213914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829113+0000","last_change":"2024-03-28T21:51:56.750936+0000","last_active":"2024-03-28T21:51:57.829113+0000","last_peered":"2024-03-28T21:51:57.829113+0000","last_clean":"2024-03-28T21:51:57.829113+0000","last_became_active":"2024-03-28T21:51:56.750615+0000","last_became_peered":"2024-03-28T21:51:56.750615+0000","last_unstale":"2024-03-28T21:51:57.829113+0000","last_undegraded":"2024-03-28T21:51:57.829113+0000","last_fullsized":"2024-03-28T21:51:57.829113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:11.932847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.734494+0000","last_change":"2024-03-28T21:51:55.740858+0000","last_active":"2024-03-28T21:51:57.734494+0000","last_peered":"2024-03-28T21:51:57.734494+0000","last_clean":"2024-03-28T21:51:57.734494+0000","last_became_active":"2024-03-28T21:51:55.740499+0000","last_became_peered":"2024-03-28T21:51:55.740499+0000","last_unstale":"2024-03-28T21:51:57.734494+0000","last_undegraded":"2024-03-28T21:51:57.734494+0000","last_fullsized":"2024-03-28T21:51:57.734494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:49:18.989549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.329802+0000","last_change":"2024-03-28T21:51:56.739979+0000","last_active":"2024-03-28T21:51:58.329802+0000","last_peered":"2024-03-28T21:51:58.329802+0000","last_clean":"2024-03-28T21:51:58.329802+0000","last_became_active":"2024-03-28T21:51:56.739738+0000","last_became_peered":"2024-03-28T21:51:56.739738+0000","last_unstale":"2024-03-28T21:51:58.329802+0000","last_undegraded":"2024-03-28T21:51:58.329802+0000","last_fullsized":"2024-03-28T21:51:58.329802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:03:08.464729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.798745+0000","last_change":"2024-03-28T21:51:55.727187+0000","last_active":"2024-03-28T21:51:57.798745+0000","last_peered":"2024-03-28T21:51:57.798745+0000","last_clean":"2024-03-28T21:51:57.798745+0000","last_became_active":"2024-03-28T21:51:55.725654+0000","last_became_peered":"2024-03-28T21:51:55.725654+0000","last_unstale":"2024-03-28T21:51:57.798745+0000","last_undegraded":"2024-03-28T21:51:57.798745+0000","last_fullsized":"2024-03-28T21:51:57.798745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:05:21.056498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739661+0000","last_change":"2024-03-28T21:51:56.731343+0000","last_active":"2024-03-28T21:51:57.739661+0000","last_peered":"2024-03-28T21:51:57.739661+0000","last_clean":"2024-03-28T21:51:57.739661+0000","last_became_active":"2024-03-28T21:51:56.731082+0000","last_became_peered":"2024-03-28T21:51:56.731082+0000","last_unstale":"2024-03-28T21:51:57.739661+0000","last_undegraded":"2024-03-28T21:51:57.739661+0000","last_fullsized":"2024-03-28T21:51:57.739661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:48:55.682963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331842+0000","last_change":"2024-03-28T21:51:55.737531+0000","last_active":"2024-03-28T21:51:58.331842+0000","last_peered":"2024-03-28T21:51:58.331842+0000","last_clean":"2024-03-28T21:51:58.331842+0000","last_became_active":"2024-03-28T21:51:55.736415+0000","last_became_peered":"2024-03-28T21:51:55.736415+0000","last_unstale":"2024-03-28T21:51:58.331842+0000","last_undegraded":"2024-03-28T21:51:58.331842+0000","last_fullsized":"2024-03-28T21:51:58.331842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:45.317603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737122+0000","last_change":"2024-03-28T21:51:56.742717+0000","last_active":"2024-03-28T21:51:57.737122+0000","last_peered":"2024-03-28T21:51:57.737122+0000","last_clean":"2024-03-28T21:51:57.737122+0000","last_became_active":"2024-03-28T21:51:56.742419+0000","last_became_peered":"2024-03-28T21:51:56.742419+0000","last_unstale":"2024-03-28T21:51:57.737122+0000","last_undegraded":"2024-03-28T21:51:57.737122+0000","last_fullsized":"2024-03-28T21:51:57.737122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:53.630414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739963+0000","last_change":"2024-03-28T21:51:55.729598+0000","last_active":"2024-03-28T21:51:57.739963+0000","last_peered":"2024-03-28T21:51:57.739963+0000","last_clean":"2024-03-28T21:51:57.739963+0000","last_became_active":"2024-03-28T21:51:55.729285+0000","last_became_peered":"2024-03-28T21:51:55.729285+0000","last_unstale":"2024-03-28T21:51:57.739963+0000","last_undegraded":"2024-03-28T21:51:57.739963+0000","last_fullsized":"2024-03-28T21:51:57.739963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:25:06.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.332415+0000","last_change":"2024-03-28T21:51:56.738473+0000","last_active":"2024-03-28T21:51:58.332415+0000","last_peered":"2024-03-28T21:51:58.332415+0000","last_clean":"2024-03-28T21:51:58.332415+0000","last_became_active":"2024-03-28T21:51:56.738135+0000","last_became_peered":"2024-03-28T21:51:56.738135+0000","last_unstale":"2024-03-28T21:51:58.332415+0000","last_undegraded":"2024-03-28T21:51:58.332415+0000","last_fullsized":"2024-03-28T21:51:58.332415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:21:00.155587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736603+0000","last_change":"2024-03-28T21:51:55.738867+0000","last_active":"2024-03-28T21:51:57.736603+0000","last_peered":"2024-03-28T21:51:57.736603+0000","last_clean":"2024-03-28T21:51:57.736603+0000","last_became_active":"2024-03-28T21:51:55.738474+0000","last_became_peered":"2024-03-28T21:51:55.738474+0000","last_unstale":"2024-03-28T21:51:57.736603+0000","last_undegraded":"2024-03-28T21:51:57.736603+0000","last_fullsized":"2024-03-28T21:51:57.736603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:31:23.656046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739779+0000","last_change":"2024-03-28T21:51:56.744065+0000","last_active":"2024-03-28T21:51:57.739779+0000","last_peered":"2024-03-28T21:51:57.739779+0000","last_clean":"2024-03-28T21:51:57.739779+0000","last_became_active":"2024-03-28T21:51:56.743726+0000","last_became_peered":"2024-03-28T21:51:56.743726+0000","last_unstale":"2024-03-28T21:51:57.739779+0000","last_undegraded":"2024-03-28T21:51:57.739779+0000","last_fullsized":"2024-03-28T21:51:57.739779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:45:28.881798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.743030+0000","last_change":"2024-03-28T21:51:55.731606+0000","last_active":"2024-03-28T21:51:57.743030+0000","last_peered":"2024-03-28T21:51:57.743030+0000","last_clean":"2024-03-28T21:51:57.743030+0000","last_became_active":"2024-03-28T21:51:55.731290+0000","last_became_peered":"2024-03-28T21:51:55.731290+0000","last_unstale":"2024-03-28T21:51:57.743030+0000","last_undegraded":"2024-03-28T21:51:57.743030+0000","last_fullsized":"2024-03-28T21:51:57.743030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:52.161365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829855+0000","last_change":"2024-03-28T21:51:56.735361+0000","last_active":"2024-03-28T21:51:57.829855+0000","last_peered":"2024-03-28T21:51:57.829855+0000","last_clean":"2024-03-28T21:51:57.829855+0000","last_became_active":"2024-03-28T21:51:56.735118+0000","last_became_peered":"2024-03-28T21:51:56.735118+0000","last_unstale":"2024-03-28T21:51:57.829855+0000","last_undegraded":"2024-03-28T21:51:57.829855+0000","last_fullsized":"2024-03-28T21:51:57.829855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:27:25.577575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.740008+0000","last_change":"2024-03-28T21:51:55.736672+0000","last_active":"2024-03-28T21:51:57.740008+0000","last_peered":"2024-03-28T21:51:57.740008+0000","last_clean":"2024-03-28T21:51:57.740008+0000","last_became_active":"2024-03-28T21:51:55.736295+0000","last_became_peered":"2024-03-28T21:51:55.736295+0000","last_unstale":"2024-03-28T21:51:57.740008+0000","last_undegraded":"2024-03-28T21:51:57.740008+0000","last_fullsized":"2024-03-28T21:51:57.740008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:41:33.261221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330657+0000","last_change":"2024-03-28T21:51:56.732809+0000","last_active":"2024-03-28T21:51:58.330657+0000","last_peered":"2024-03-28T21:51:58.330657+0000","last_clean":"2024-03-28T21:51:58.330657+0000","last_became_active":"2024-03-28T21:51:56.732535+0000","last_became_peered":"2024-03-28T21:51:56.732535+0000","last_unstale":"2024-03-28T21:51:58.330657+0000","last_undegraded":"2024-03-28T21:51:58.330657+0000","last_fullsized":"2024-03-28T21:51:58.330657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:14:33.230114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.734259+0000","last_change":"2024-03-28T21:51:55.738876+0000","last_active":"2024-03-28T21:51:57.734259+0000","last_peered":"2024-03-28T21:51:57.734259+0000","last_clean":"2024-03-28T21:51:57.734259+0000","last_became_active":"2024-03-28T21:51:55.738383+0000","last_became_peered":"2024-03-28T21:51:55.738383+0000","last_unstale":"2024-03-28T21:51:57.734259+0000","last_undegraded":"2024-03-28T21:51:57.734259+0000","last_fullsized":"2024-03-28T21:51:57.734259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:41:33.261221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.737220+0000","last_change":"2024-03-28T21:51:56.737198+0000","last_active":"2024-03-28T21:51:57.737220+0000","last_peered":"2024-03-28T21:51:57.737220+0000","last_clean":"2024-03-28T21:51:57.737220+0000","last_became_active":"2024-03-28T21:51:56.736850+0000","last_became_peered":"2024-03-28T21:51:56.736850+0000","last_unstale":"2024-03-28T21:51:57.737220+0000","last_undegraded":"2024-03-28T21:51:57.737220+0000","last_fullsized":"2024-03-28T21:51:57.737220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:27:52.976796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739863+0000","last_change":"2024-03-28T21:51:55.735856+0000","last_active":"2024-03-28T21:51:57.739863+0000","last_peered":"2024-03-28T21:51:57.739863+0000","last_clean":"2024-03-28T21:51:57.739863+0000","last_became_active":"2024-03-28T21:51:55.735478+0000","last_became_peered":"2024-03-28T21:51:55.735478+0000","last_unstale":"2024-03-28T21:51:57.739863+0000","last_undegraded":"2024-03-28T21:51:57.739863+0000","last_fullsized":"2024-03-28T21:51:57.739863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:49.481854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.828874+0000","last_change":"2024-03-28T21:51:56.731937+0000","last_active":"2024-03-28T21:51:57.828874+0000","last_peered":"2024-03-28T21:51:57.828874+0000","last_clean":"2024-03-28T21:51:57.828874+0000","last_became_active":"2024-03-28T21:51:56.730294+0000","last_became_peered":"2024-03-28T21:51:56.730294+0000","last_unstale":"2024-03-28T21:51:57.828874+0000","last_undegraded":"2024-03-28T21:51:57.828874+0000","last_fullsized":"2024-03-28T21:51:57.828874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:32:46.786652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.739729+0000","last_change":"2024-03-28T21:51:55.733842+0000","last_active":"2024-03-28T21:51:57.739729+0000","last_peered":"2024-03-28T21:51:57.739729+0000","last_clean":"2024-03-28T21:51:57.739729+0000","last_became_active":"2024-03-28T21:51:55.732730+0000","last_became_peered":"2024-03-28T21:51:55.732730+0000","last_unstale":"2024-03-28T21:51:57.739729+0000","last_undegraded":"2024-03-28T21:51:57.739729+0000","last_fullsized":"2024-03-28T21:51:57.739729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:38.624808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829350+0000","last_change":"2024-03-28T21:51:56.741051+0000","last_active":"2024-03-28T21:51:57.829350+0000","last_peered":"2024-03-28T21:51:57.829350+0000","last_clean":"2024-03-28T21:51:57.829350+0000","last_became_active":"2024-03-28T21:51:56.740732+0000","last_became_peered":"2024-03-28T21:51:56.740732+0000","last_unstale":"2024-03-28T21:51:57.829350+0000","last_undegraded":"2024-03-28T21:51:57.829350+0000","last_fullsized":"2024-03-28T21:51:57.829350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:18.412195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735605+0000","last_change":"2024-03-28T21:51:55.741026+0000","last_active":"2024-03-28T21:51:57.735605+0000","last_peered":"2024-03-28T21:51:57.735605+0000","last_clean":"2024-03-28T21:51:57.735605+0000","last_became_active":"2024-03-28T21:51:55.740636+0000","last_became_peered":"2024-03-28T21:51:55.740636+0000","last_unstale":"2024-03-28T21:51:57.735605+0000","last_undegraded":"2024-03-28T21:51:57.735605+0000","last_fullsized":"2024-03-28T21:51:57.735605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:34:52.161365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.738890+0000","last_change":"2024-03-28T21:51:56.738914+0000","last_active":"2024-03-28T21:51:57.738890+0000","last_peered":"2024-03-28T21:51:57.738890+0000","last_clean":"2024-03-28T21:51:57.738890+0000","last_became_active":"2024-03-28T21:51:56.738550+0000","last_became_peered":"2024-03-28T21:51:56.738550+0000","last_unstale":"2024-03-28T21:51:57.738890+0000","last_undegraded":"2024-03-28T21:51:57.738890+0000","last_fullsized":"2024-03-28T21:51:57.738890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:50:06.933438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331969+0000","last_change":"2024-03-28T21:51:56.733615+0000","last_active":"2024-03-28T21:51:58.331969+0000","last_peered":"2024-03-28T21:51:58.331969+0000","last_clean":"2024-03-28T21:51:58.331969+0000","last_became_active":"2024-03-28T21:51:56.732747+0000","last_became_peered":"2024-03-28T21:51:56.732747+0000","last_unstale":"2024-03-28T21:51:58.331969+0000","last_undegraded":"2024-03-28T21:51:58.331969+0000","last_fullsized":"2024-03-28T21:51:58.331969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:55:29.475667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.735421+0000","last_change":"2024-03-28T21:51:55.743426+0000","last_active":"2024-03-28T21:51:57.735421+0000","last_peered":"2024-03-28T21:51:57.735421+0000","last_clean":"2024-03-28T21:51:57.735421+0000","last_became_active":"2024-03-28T21:51:55.743045+0000","last_became_peered":"2024-03-28T21:51:55.743045+0000","last_unstale":"2024-03-28T21:51:57.735421+0000","last_undegraded":"2024-03-28T21:51:57.735421+0000","last_fullsized":"2024-03-28T21:51:57.735421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:27:51.507747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.331789+0000","last_change":"2024-03-28T21:51:56.737059+0000","last_active":"2024-03-28T21:51:58.331789+0000","last_peered":"2024-03-28T21:51:58.331789+0000","last_clean":"2024-03-28T21:51:58.331789+0000","last_became_active":"2024-03-28T21:51:56.736834+0000","last_became_peered":"2024-03-28T21:51:56.736834+0000","last_unstale":"2024-03-28T21:51:58.331789+0000","last_undegraded":"2024-03-28T21:51:58.331789+0000","last_fullsized":"2024-03-28T21:51:58.331789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:44:09.922647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.736413+0000","last_change":"2024-03-28T21:51:55.739827+0000","last_active":"2024-03-28T21:51:57.736413+0000","last_peered":"2024-03-28T21:51:57.736413+0000","last_clean":"2024-03-28T21:51:57.736413+0000","last_became_active":"2024-03-28T21:51:55.739583+0000","last_became_peered":"2024-03-28T21:51:55.739583+0000","last_unstale":"2024-03-28T21:51:57.736413+0000","last_undegraded":"2024-03-28T21:51:57.736413+0000","last_fullsized":"2024-03-28T21:51:57.736413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:10:13.112007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330687+0000","last_change":"2024-03-28T21:51:56.745755+0000","last_active":"2024-03-28T21:51:58.330687+0000","last_peered":"2024-03-28T21:51:58.330687+0000","last_clean":"2024-03-28T21:51:58.330687+0000","last_became_active":"2024-03-28T21:51:56.745454+0000","last_became_peered":"2024-03-28T21:51:56.745454+0000","last_unstale":"2024-03-28T21:51:58.330687+0000","last_undegraded":"2024-03-28T21:51:58.330687+0000","last_fullsized":"2024-03-28T21:51:58.330687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:13:55.392143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829826+0000","last_change":"2024-03-28T21:51:55.726073+0000","last_active":"2024-03-28T21:51:57.829826+0000","last_peered":"2024-03-28T21:51:57.829826+0000","last_clean":"2024-03-28T21:51:57.829826+0000","last_became_active":"2024-03-28T21:51:55.725697+0000","last_became_peered":"2024-03-28T21:51:55.725697+0000","last_unstale":"2024-03-28T21:51:57.829826+0000","last_undegraded":"2024-03-28T21:51:57.829826+0000","last_fullsized":"2024-03-28T21:51:57.829826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:25:06.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:57.829699+0000","last_change":"2024-03-28T21:51:56.732751+0000","last_active":"2024-03-28T21:51:57.829699+0000","last_peered":"2024-03-28T21:51:57.829699+0000","last_clean":"2024-03-28T21:51:57.829699+0000","last_became_active":"2024-03-28T21:51:56.732376+0000","last_became_peered":"2024-03-28T21:51:56.732376+0000","last_unstale":"2024-03-28T21:51:57.829699+0000","last_undegraded":"2024-03-28T21:51:57.829699+0000","last_fullsized":"2024-03-28T21:51:57.829699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:55.686950+0000","last_clean_scrub_stamp":"2024-03-28T21:51:55.686950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:41:30.418711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-28T21:51:58.330732+0000","last_change":"2024-03-28T21:51:55.736690+0000","last_active":"2024-03-28T21:51:58.330732+0000","last_peered":"2024-03-28T21:51:58.330732+0000","last_clean":"2024-03-28T21:51:58.330732+0000","last_became_active":"2024-03-28T21:51:55.736380+0000","last_became_peered":"2024-03-28T21:51:55.736380+0000","last_unstale":"2024-03-28T21:51:58.330732+0000","last_undegraded":"2024-03-28T21:51:58.330732+0000","last_fullsized":"2024-03-28T21:51:58.330732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:54.217901+0000","last_clean_scrub_stamp":"2024-03-28T21:51:54.217901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:18:31.421582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":823296,"data_stored":669784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":78924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":78960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":80446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":78834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":831488,"data_stored":669840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T21:52:07.402 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-28T21:52:07.402 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-28T21:52:07.402 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-28T21:52:07.403 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-28T21:52:07.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.622+0000 7f411aa00640 1 Processor -- start 2024-03-28T21:52:07.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.622+0000 7f411aa00640 1 -- start start 2024-03-28T21:52:07.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.624+0000 7f411aa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4114161d80 0x7f41140b5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:07.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.624+0000 7f411aa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f41140b3820 0x7f4114162160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:07.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.624+0000 7f411aa00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4114162b90 con 0x7f41141626a0 2024-03-28T21:52:07.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.624+0000 7f411aa00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f41140d2820 con 0x7f41140b3820 2024-03-28T21:52:07.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.624+0000 7f411aa00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f41140d2b00 con 0x7f4114161d80 2024-03-28T21:52:07.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.624+0000 7f4118c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f41140b3820 0x7f4114162160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:07.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.624+0000 7f4118c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f41140b3820 0x7f4114162160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45824/0 (socket says 172.21.15.153:45824) 2024-03-28T21:52:07.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.624+0000 7f4118c00640 1 -- 172.21.15.153:0/815982614 learned_addr learned my addr 172.21.15.153:0/815982614 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:07.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.624+0000 7f411a000640 1 --1- 172.21.15.153:0/815982614 >> v1:172.21.15.153:6789/0 conn(0x7f41141626a0 0x7f41140cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54668/0 (socket says 172.21.15.153:54668) 2024-03-28T21:52:07.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.624+0000 7f4118c00640 1 -- 172.21.15.153:0/815982614 >> v2:172.21.15.165:3300/0 conn(0x7f4114161d80 msgr2=0x7f41140b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:07.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.624+0000 7f4118c00640 1 --2- 172.21.15.153:0/815982614 >> v2:172.21.15.165:3300/0 conn(0x7f4114161d80 0x7f41140b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.624+0000 7f4118c00640 1 -- 172.21.15.153:0/815982614 >> v1:172.21.15.153:6789/0 conn(0x7f41141626a0 legacy=0x7f41140cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:07.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.624+0000 7f4118c00640 1 -- 172.21.15.153:0/815982614 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41140d2de0 con 0x7f41140b3820 2024-03-28T21:52:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.625+0000 7f4118c00640 1 --2- 172.21.15.153:0/815982614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41140b3820 0x7f4114162160 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f411408d0f0 tx=0x7f410002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52148701bb06675f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.626+0000 7f4113e00640 1 -- 172.21.15.153:0/815982614 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100035020 con 0x7f41140b3820 2024-03-28T21:52:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.626+0000 7f4113e00640 1 -- 172.21.15.153:0/815982614 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4100031870 con 0x7f41140b3820 2024-03-28T21:52:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.626+0000 7f4113e00640 1 -- 172.21.15.153:0/815982614 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100031c40 con 0x7f41140b3820 2024-03-28T21:52:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.626+0000 7f411aa00640 1 -- 172.21.15.153:0/815982614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41140b3820 msgr2=0x7f4114162160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.626+0000 7f411aa00640 1 --2- 172.21.15.153:0/815982614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41140b3820 0x7f4114162160 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f411408d0f0 tx=0x7f410002b910 comp rx=0 tx=0).stop 2024-03-28T21:52:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.626+0000 7f411aa00640 1 -- 172.21.15.153:0/815982614 shutdown_connections 2024-03-28T21:52:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.626+0000 7f411aa00640 1 --2- 172.21.15.153:0/815982614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41140b3820 0x7f4114162160 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.626+0000 7f411aa00640 1 --2- 172.21.15.153:0/815982614 >> v2:172.21.15.165:3300/0 conn(0x7f4114161d80 0x7f41140b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.626+0000 7f411aa00640 1 -- 172.21.15.153:0/815982614 >> 172.21.15.153:0/815982614 conn(0x7f41140d3f10 msgr2=0x7f41140d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.626+0000 7f411aa00640 1 -- 172.21.15.153:0/815982614 shutdown_connections 2024-03-28T21:52:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.626+0000 7f411aa00640 1 -- 172.21.15.153:0/815982614 wait complete. 2024-03-28T21:52:07.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.629+0000 7f411aa00640 1 Processor -- start 2024-03-28T21:52:07.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.629+0000 7f411aa00640 1 -- start start 2024-03-28T21:52:07.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.631+0000 7f411aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41140b3820 0x7f4114156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:07.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.631+0000 7f411aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4114161d80 0x7f41140b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:07.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.631+0000 7f411aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41141626a0 0x7f41140b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:07.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.631+0000 7f411aa00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f41140cec60 con 0x7f41140b3820 2024-03-28T21:52:07.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.631+0000 7f411aa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f41140ceae0 con 0x7f4114161d80 2024-03-28T21:52:07.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.631+0000 7f411aa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f41140d02c0 con 0x7f41141626a0 2024-03-28T21:52:07.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.631+0000 7f4119600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41140b3820 0x7f4114156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:07.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.631+0000 7f4119600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41140b3820 0x7f4114156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45838/0 (socket says 172.21.15.153:45838) 2024-03-28T21:52:07.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.631+0000 7f4119600640 1 -- 172.21.15.153:0/384375565 learned_addr learned my addr 172.21.15.153:0/384375565 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:07.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.631+0000 7f4119600640 1 -- 172.21.15.153:0/384375565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41141626a0 msgr2=0x7f41140b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:07.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.631+0000 7f4119600640 1 --2- 172.21.15.153:0/384375565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41141626a0 0x7f41140b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.631+0000 7f4119600640 1 -- 172.21.15.153:0/384375565 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4114161d80 msgr2=0x7f41140b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:07.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.631+0000 7f4119600640 1 --2- 172.21.15.153:0/384375565 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4114161d80 0x7f41140b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.631+0000 7f4119600640 1 -- 172.21.15.153:0/384375565 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4114156550 con 0x7f41140b3820 2024-03-28T21:52:07.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.632+0000 7f4119600640 1 --2- 172.21.15.153:0/384375565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41140b3820 0x7f4114156010 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f410800b4a0 tx=0x7f410800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:07.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.632+0000 7f4111600640 1 -- 172.21.15.153:0/384375565 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4108014070 con 0x7f41140b3820 2024-03-28T21:52:07.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.632+0000 7f4111600640 1 -- 172.21.15.153:0/384375565 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4108010610 con 0x7f41140b3820 2024-03-28T21:52:07.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.632+0000 7f411aa00640 1 -- 172.21.15.153:0/384375565 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41140b1730 con 0x7f41140b3820 2024-03-28T21:52:07.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.632+0000 7f4111600640 1 -- 172.21.15.153:0/384375565 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4108010a00 con 0x7f41140b3820 2024-03-28T21:52:07.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.632+0000 7f411aa00640 1 -- 172.21.15.153:0/384375565 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41140c7c70 con 0x7f41140b3820 2024-03-28T21:52:07.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.633+0000 7f411aa00640 1 -- 172.21.15.153:0/384375565 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f411404f520 con 0x7f41140b3820 2024-03-28T21:52:07.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.634+0000 7f4111600640 1 -- 172.21.15.153:0/384375565 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f4108017070 con 0x7f41140b3820 2024-03-28T21:52:07.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.635+0000 7f4111600640 1 --2- 172.21.15.153:0/384375565 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f40f406b4d0 0x7f40f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:07.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.636+0000 7f4111600640 1 -- 172.21.15.153:0/384375565 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4108089c10 con 0x7f41140b3820 2024-03-28T21:52:07.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.636+0000 7f4118c00640 1 --2- 172.21.15.153:0/384375565 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f40f406b4d0 0x7f40f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:07.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.636+0000 7f4118c00640 1 --2- 172.21.15.153:0/384375565 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f40f406b4d0 0x7f40f406d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4100036000 tx=0x7f4100030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:07.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.639+0000 7f4111600640 1 -- 172.21.15.153:0/384375565 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4108058a80 con 0x7f41140b3820 2024-03-28T21:52:07.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.875+0000 7f411aa00640 1 -- 172.21.15.153:0/384375565 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f411406b320 con 0x7f41140b3820 2024-03-28T21:52:07.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.876+0000 7f4111600640 1 -- 172.21.15.153:0/384375565 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4108058380 con 0x7f41140b3820 2024-03-28T21:52:07.878 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:07.878 INFO:teuthology.orchestra.run.smithi153.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-28T21:52:07.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.878+0000 7f411aa00640 1 -- 172.21.15.153:0/384375565 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f40f406b4d0 msgr2=0x7f40f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:07.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.878+0000 7f411aa00640 1 --2- 172.21.15.153:0/384375565 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f40f406b4d0 0x7f40f406d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4100036000 tx=0x7f4100030000 comp rx=0 tx=0).stop 2024-03-28T21:52:07.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.878+0000 7f411aa00640 1 -- 172.21.15.153:0/384375565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41140b3820 msgr2=0x7f4114156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:07.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.878+0000 7f411aa00640 1 --2- 172.21.15.153:0/384375565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41140b3820 0x7f4114156010 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f410800b4a0 tx=0x7f410800b960 comp rx=0 tx=0).stop 2024-03-28T21:52:07.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.879+0000 7f411aa00640 1 -- 172.21.15.153:0/384375565 shutdown_connections 2024-03-28T21:52:07.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.879+0000 7f411aa00640 1 --2- 172.21.15.153:0/384375565 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f40f406b4d0 0x7f40f406d990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.879+0000 7f411aa00640 1 --2- 172.21.15.153:0/384375565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41141626a0 0x7f41140b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.879+0000 7f411aa00640 1 --2- 172.21.15.153:0/384375565 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4114161d80 0x7f41140b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.879+0000 7f411aa00640 1 --2- 172.21.15.153:0/384375565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41140b3820 0x7f4114156010 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:07.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.879+0000 7f411aa00640 1 -- 172.21.15.153:0/384375565 >> 172.21.15.153:0/384375565 conn(0x7f41140d3f10 msgr2=0x7f411406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:07.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.879+0000 7f411aa00640 1 -- 172.21.15.153:0/384375565 shutdown_connections 2024-03-28T21:52:07.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:07.879+0000 7f411aa00640 1 -- 172.21.15.153:0/384375565 wait complete. 2024-03-28T21:52:07.904 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-28T21:52:07.905 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:08.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.106+0000 7fd922a00640 1 Processor -- start 2024-03-28T21:52:08.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.107+0000 7fd922a00640 1 -- start start 2024-03-28T21:52:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.108+0000 7fd922a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd91c15ade0 0x7fd91c0acd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.108+0000 7fd922a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd91c15ef20 0x7fd91c15f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.108+0000 7fd922a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd91c15ea70 con 0x7fd91c0ae8e0 2024-03-28T21:52:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.108+0000 7fd922a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd91c0aee50 con 0x7fd91c15ade0 2024-03-28T21:52:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.108+0000 7fd922a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd91c0af130 con 0x7fd91c15ef20 2024-03-28T21:52:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.109+0000 7fd91be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd91c15ade0 0x7fd91c0acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.109+0000 7fd91be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd91c15ade0 0x7fd91c0acd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45840/0 (socket says 172.21.15.153:45840) 2024-03-28T21:52:08.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.109+0000 7fd91be00640 1 -- 172.21.15.153:0/2248968398 learned_addr learned my addr 172.21.15.153:0/2248968398 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:08.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.109+0000 7fd920a00640 1 --2- 172.21.15.153:0/2248968398 >> v2:172.21.15.165:3300/0 conn(0x7fd91c15ef20 0x7fd91c15f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:08.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.109+0000 7fd91be00640 1 -- 172.21.15.153:0/2248968398 >> v2:172.21.15.165:3300/0 conn(0x7fd91c15ef20 msgr2=0x7fd91c15f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:08.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.109+0000 7fd91be00640 1 --2- 172.21.15.153:0/2248968398 >> v2:172.21.15.165:3300/0 conn(0x7fd91c15ef20 0x7fd91c15f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.109+0000 7fd91be00640 1 -- 172.21.15.153:0/2248968398 >> v1:172.21.15.153:6789/0 conn(0x7fd91c0ae8e0 legacy=0x7fd91c0b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:08.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.109+0000 7fd91be00640 1 -- 172.21.15.153:0/2248968398 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91c0af410 con 0x7fd91c15ade0 2024-03-28T21:52:08.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.109+0000 7fd920a00640 1 --2- 172.21.15.153:0/2248968398 >> v2:172.21.15.165:3300/0 conn(0x7fd91c15ef20 0x7fd91c15f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:08.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.110+0000 7fd91be00640 1 --2- 172.21.15.153:0/2248968398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd91c15ade0 0x7fd91c0acd80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd91c15fa70 tx=0x7fd90c02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a0cb9900aacb05 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:08.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.111+0000 7fd91aa00640 1 -- 172.21.15.153:0/2248968398 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c02cb10 con 0x7fd91c15ade0 2024-03-28T21:52:08.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.111+0000 7fd91aa00640 1 -- 172.21.15.153:0/2248968398 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c02ccb0 con 0x7fd91c15ade0 2024-03-28T21:52:08.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.111+0000 7fd91aa00640 1 -- 172.21.15.153:0/2248968398 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c02ce60 con 0x7fd91c15ade0 2024-03-28T21:52:08.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.111+0000 7fd922a00640 1 -- 172.21.15.153:0/2248968398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd91c15ade0 msgr2=0x7fd91c0acd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:08.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.111+0000 7fd922a00640 1 --2- 172.21.15.153:0/2248968398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd91c15ade0 0x7fd91c0acd80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd91c15fa70 tx=0x7fd90c02bf70 comp rx=0 tx=0).stop 2024-03-28T21:52:08.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.111+0000 7fd922a00640 1 -- 172.21.15.153:0/2248968398 shutdown_connections 2024-03-28T21:52:08.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.111+0000 7fd922a00640 1 --2- 172.21.15.153:0/2248968398 >> v2:172.21.15.165:3300/0 conn(0x7fd91c15ef20 0x7fd91c15f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.111+0000 7fd922a00640 1 --2- 172.21.15.153:0/2248968398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd91c15ade0 0x7fd91c0acd80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.111+0000 7fd922a00640 1 -- 172.21.15.153:0/2248968398 >> 172.21.15.153:0/2248968398 conn(0x7fd91c0b1a30 msgr2=0x7fd91c0b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.111+0000 7fd922a00640 1 -- 172.21.15.153:0/2248968398 shutdown_connections 2024-03-28T21:52:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.112+0000 7fd922a00640 1 -- 172.21.15.153:0/2248968398 wait complete. 2024-03-28T21:52:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.113+0000 7fd922a00640 1 Processor -- start 2024-03-28T21:52:08.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.113+0000 7fd922a00640 1 -- start start 2024-03-28T21:52:08.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.114+0000 7fd922a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd91c0ae8e0 0x7fd91c09bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:08.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.114+0000 7fd922a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd91c15ade0 0x7fd91c15de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:08.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.114+0000 7fd922a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd91c15ef20 0x7fd91c146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:08.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.114+0000 7fd922a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd91c0af6f0 con 0x7fd91c15ade0 2024-03-28T21:52:08.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.114+0000 7fd922a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd91c0ad2c0 con 0x7fd91c15ef20 2024-03-28T21:52:08.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.114+0000 7fd922a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd91c15b1c0 con 0x7fd91c0ae8e0 2024-03-28T21:52:08.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.114+0000 7fd91b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd91c15ade0 0x7fd91c15de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:08.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.115+0000 7fd91b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd91c15ade0 0x7fd91c15de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45844/0 (socket says 172.21.15.153:45844) 2024-03-28T21:52:08.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.115+0000 7fd91b400640 1 -- 172.21.15.153:0/3576804059 learned_addr learned my addr 172.21.15.153:0/3576804059 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:08.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.115+0000 7fd91be00640 1 --2- 172.21.15.153:0/3576804059 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd91c0ae8e0 0x7fd91c09bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:08.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.115+0000 7fd91b400640 1 -- 172.21.15.153:0/3576804059 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd91c0ae8e0 msgr2=0x7fd91c09bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:08.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.115+0000 7fd91b400640 1 --2- 172.21.15.153:0/3576804059 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd91c0ae8e0 0x7fd91c09bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.115+0000 7fd91b400640 1 -- 172.21.15.153:0/3576804059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd91c15ef20 msgr2=0x7fd91c146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:08.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.115+0000 7fd91b400640 1 --2- 172.21.15.153:0/3576804059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd91c15ef20 0x7fd91c146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.115+0000 7fd91b400640 1 -- 172.21.15.153:0/3576804059 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91c15e5e0 con 0x7fd91c15ade0 2024-03-28T21:52:08.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.115+0000 7fd91b400640 1 --2- 172.21.15.153:0/3576804059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd91c15ade0 0x7fd91c15de90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c3f0 tx=0x7fd90800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:08.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.115+0000 7fd913e00640 1 -- 172.21.15.153:0/3576804059 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9080052d0 con 0x7fd91c15ade0 2024-03-28T21:52:08.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.115+0000 7fd913e00640 1 -- 172.21.15.153:0/3576804059 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd908005490 con 0x7fd91c15ade0 2024-03-28T21:52:08.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.115+0000 7fd913e00640 1 -- 172.21.15.153:0/3576804059 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908007260 con 0x7fd91c15ade0 2024-03-28T21:52:08.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.115+0000 7fd922a00640 1 -- 172.21.15.153:0/3576804059 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd91c15bf10 con 0x7fd91c15ade0 2024-03-28T21:52:08.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.116+0000 7fd922a00640 1 -- 172.21.15.153:0/3576804059 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd91c15c4d0 con 0x7fd91c15ade0 2024-03-28T21:52:08.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.117+0000 7fd922a00640 1 -- 172.21.15.153:0/3576804059 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd91c068ff0 con 0x7fd91c15ade0 2024-03-28T21:52:08.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.118+0000 7fd913e00640 1 -- 172.21.15.153:0/3576804059 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fd908007400 con 0x7fd91c15ade0 2024-03-28T21:52:08.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.118+0000 7fd913e00640 1 --2- 172.21.15.153:0/3576804059 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd8fc06b500 0x7fd8fc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:08.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.118+0000 7fd913e00640 1 -- 172.21.15.153:0/3576804059 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd9080896e0 con 0x7fd91c15ade0 2024-03-28T21:52:08.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.119+0000 7fd91be00640 1 --2- 172.21.15.153:0/3576804059 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd8fc06b500 0x7fd8fc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:08.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.119+0000 7fd91be00640 1 --2- 172.21.15.153:0/3576804059 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd8fc06b500 0x7fd8fc06d9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd90c035000 tx=0x7fd90c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:08.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.127+0000 7fd913e00640 1 -- 172.21.15.153:0/3576804059 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd908058560 con 0x7fd91c15ade0 2024-03-28T21:52:08.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.399+0000 7fd922a00640 1 -- 172.21.15.153:0/3576804059 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd91c0b28a0 con 0x7fd91c15ade0 2024-03-28T21:52:08.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.402+0000 7fd913e00640 1 -- 172.21.15.153:0/3576804059 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7fd908057e60 con 0x7fd91c15ade0 2024-03-28T21:52:08.405 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:08.405 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:57.716531+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:08.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.404+0000 7fd922a00640 1 -- 172.21.15.153:0/3576804059 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd8fc06b500 msgr2=0x7fd8fc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:08.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.404+0000 7fd922a00640 1 --2- 172.21.15.153:0/3576804059 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd8fc06b500 0x7fd8fc06d9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd90c035000 tx=0x7fd90c030000 comp rx=0 tx=0).stop 2024-03-28T21:52:08.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.404+0000 7fd922a00640 1 -- 172.21.15.153:0/3576804059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd91c15ade0 msgr2=0x7fd91c15de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:08.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.405+0000 7fd922a00640 1 --2- 172.21.15.153:0/3576804059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd91c15ade0 0x7fd91c15de90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c3f0 tx=0x7fd90800c8b0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.405+0000 7fd922a00640 1 -- 172.21.15.153:0/3576804059 shutdown_connections 2024-03-28T21:52:08.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.405+0000 7fd922a00640 1 --2- 172.21.15.153:0/3576804059 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd8fc06b500 0x7fd8fc06d9c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.405+0000 7fd922a00640 1 --2- 172.21.15.153:0/3576804059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd91c15ef20 0x7fd91c146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.405+0000 7fd922a00640 1 --2- 172.21.15.153:0/3576804059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd91c15ade0 0x7fd91c15de90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.405+0000 7fd922a00640 1 --2- 172.21.15.153:0/3576804059 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd91c0ae8e0 0x7fd91c09bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.405+0000 7fd922a00640 1 -- 172.21.15.153:0/3576804059 >> 172.21.15.153:0/3576804059 conn(0x7fd91c0b1a30 msgr2=0x7fd91c06e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:08.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.405+0000 7fd922a00640 1 -- 172.21.15.153:0/3576804059 shutdown_connections 2024-03-28T21:52:08.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.405+0000 7fd922a00640 1 -- 172.21.15.153:0/3576804059 wait complete. 2024-03-28T21:52:08.425 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T21:51:53.863931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T21:51:55.188736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T21:52:08.425 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T21:52:08.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.628+0000 7f0cc6000640 1 Processor -- start 2024-03-28T21:52:08.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.628+0000 7f0cc6000640 1 -- start start 2024-03-28T21:52:08.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.629+0000 7f0cc6000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0cc015e630 0x7f0cc00d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:08.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.629+0000 7f0cc6000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc00b7150 con 0x7f0cc015e250 2024-03-28T21:52:08.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.629+0000 7f0cc6000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc00b7430 con 0x7f0cc00d1090 2024-03-28T21:52:08.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.629+0000 7f0cc6000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00d14e0 con 0x7f0cc015e630 2024-03-28T21:52:08.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.629+0000 7f0cbf400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0cc015e250 0x7f0cc00cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54686/0 (socket says 172.21.15.153:54686) 2024-03-28T21:52:08.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.629+0000 7f0cbf400640 1 -- 172.21.15.153:0/3954491215 learned_addr learned my addr 172.21.15.153:0/3954491215 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:08.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.630+0000 7f0cb6a00640 1 --2- 172.21.15.153:0/3954491215 >> v2:172.21.15.165:3300/0 conn(0x7f0cc015e630 0x7f0cc00d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:08.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.630+0000 7f0cbea00640 1 -- 172.21.15.153:0/3954491215 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3076653041 0 0) 0x7f0cc00b7150 con 0x7f0cc015e250 2024-03-28T21:52:08.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.630+0000 7f0cbea00640 1 -- 172.21.15.153:0/3954491215 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ca4003520 con 0x7f0cc015e250 2024-03-28T21:52:08.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.630+0000 7f0cbea00640 1 -- 172.21.15.153:0/3954491215 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3238100377 0 0) 0x7f0ca4003520 con 0x7f0cc015e250 2024-03-28T21:52:08.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.630+0000 7f0cbea00640 1 -- 172.21.15.153:0/3954491215 >> v2:172.21.15.165:3300/0 conn(0x7f0cc015e630 msgr2=0x7f0cc00d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:08.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.630+0000 7f0cbea00640 1 --2- 172.21.15.153:0/3954491215 >> v2:172.21.15.165:3300/0 conn(0x7f0cc015e630 0x7f0cc00d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.630+0000 7f0cbea00640 1 -- 172.21.15.153:0/3954491215 >> v1:172.21.15.165:6789/0 conn(0x7f0cc00d1090 legacy=0x7f0cc00b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:08.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.630+0000 7f0cbea00640 1 -- 172.21.15.153:0/3954491215 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc00b7710 con 0x7f0cc015e250 2024-03-28T21:52:08.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.630+0000 7f0cbea00640 1 -- 172.21.15.153:0/3954491215 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f0cb0001670 con 0x7f0cc015e250 2024-03-28T21:52:08.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.630+0000 7f0cbea00640 1 -- 172.21.15.153:0/3954491215 >> v1:172.21.15.153:6789/0 conn(0x7f0cc015e250 legacy=0x7f0cc00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:08.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.630+0000 7f0cbea00640 1 --2- 172.21.15.153:0/3954491215 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ca4003a00 0x7f0ca4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:08.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.630+0000 7f0cbea00640 1 --2- 172.21.15.153:0/3954491215 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ca4004800 0x7f0ca4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:08.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.631+0000 7f0cbea00640 1 --2- 172.21.15.153:0/3954491215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca40051c0 0x7f0ca400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:08.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.631+0000 7f0cbea00640 1 -- 172.21.15.153:0/3954491215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00d14e0 con 0x7f0ca40051c0 2024-03-28T21:52:08.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.631+0000 7f0cbea00640 1 -- 172.21.15.153:0/3954491215 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca400c0c0 con 0x7f0ca4003a00 2024-03-28T21:52:08.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.631+0000 7f0cbea00640 1 -- 172.21.15.153:0/3954491215 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca400c2c0 con 0x7f0ca4004800 2024-03-28T21:52:08.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.631+0000 7f0cbfe00640 1 --2- 172.21.15.153:0/3954491215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca40051c0 0x7f0ca400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:08.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.631+0000 7f0cb6a00640 1 --2- 172.21.15.153:0/3954491215 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ca4004800 0x7f0ca4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:08.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.631+0000 7f0cbfe00640 1 -- 172.21.15.153:0/3954491215 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ca4004800 msgr2=0x7f0ca4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:08.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.631+0000 7f0cbfe00640 1 --2- 172.21.15.153:0/3954491215 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ca4004800 0x7f0ca4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.631+0000 7f0cbfe00640 1 -- 172.21.15.153:0/3954491215 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ca4003a00 msgr2=0x7f0ca4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:08.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.631+0000 7f0cbfe00640 1 --2- 172.21.15.153:0/3954491215 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ca4003a00 0x7f0ca4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.631+0000 7f0cbfe00640 1 -- 172.21.15.153:0/3954491215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca4003520 con 0x7f0ca40051c0 2024-03-28T21:52:08.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.632+0000 7f0cbfe00640 1 -- 172.21.15.153:0/3954491215 reap_dead start 2024-03-28T21:52:08.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.632+0000 7f0cbfe00640 1 --2- 172.21.15.153:0/3954491215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca40051c0 0x7f0ca400b9c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8001e50 tx=0x7f0ca4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ca442501585467 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:08.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.633+0000 7f0cbea00640 1 -- 172.21.15.153:0/3954491215 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8001a70 con 0x7f0ca40051c0 2024-03-28T21:52:08.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.633+0000 7f0cbea00640 1 -- 172.21.15.153:0/3954491215 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb8003bb0 con 0x7f0ca40051c0 2024-03-28T21:52:08.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.633+0000 7f0cbea00640 1 -- 172.21.15.153:0/3954491215 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80050d0 con 0x7f0ca40051c0 2024-03-28T21:52:08.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.633+0000 7f0cc6000640 1 -- 172.21.15.153:0/3954491215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca40051c0 msgr2=0x7f0ca400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:08.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.633+0000 7f0cc6000640 1 --2- 172.21.15.153:0/3954491215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca40051c0 0x7f0ca400b9c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8001e50 tx=0x7f0ca4005830 comp rx=0 tx=0).stop 2024-03-28T21:52:08.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.633+0000 7f0cc6000640 1 -- 172.21.15.153:0/3954491215 shutdown_connections 2024-03-28T21:52:08.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.633+0000 7f0cc6000640 1 --2- 172.21.15.153:0/3954491215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca40051c0 0x7f0ca400b9c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.633+0000 7f0cc6000640 1 -- 172.21.15.153:0/3954491215 >> 172.21.15.153:0/3954491215 conn(0x7f0cc009d4a0 msgr2=0x7f0cc00d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:08.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.633+0000 7f0cc6000640 1 -- 172.21.15.153:0/3954491215 shutdown_connections 2024-03-28T21:52:08.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.633+0000 7f0cc6000640 1 -- 172.21.15.153:0/3954491215 wait complete. 2024-03-28T21:52:08.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.635+0000 7f0cc6000640 1 Processor -- start 2024-03-28T21:52:08.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.635+0000 7f0cc6000640 1 -- start start 2024-03-28T21:52:08.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.636+0000 7f0cc6000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca40051c0 0x7f0cc00b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:08.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.636+0000 7f0cc6000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0cc00b3e00 0x7f0cc01f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.636+0000 7f0cc6000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0cc00b5780 0x7f0cc01f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.636+0000 7f0cc6000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00d0b50 con 0x7f0ca40051c0 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.636+0000 7f0cc6000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00d2ef0 con 0x7f0cc00b5780 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.636+0000 7f0cc6000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc00d0cd0 con 0x7f0cc00b3e00 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.637+0000 7f0cbf400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca40051c0 0x7f0cc00b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.637+0000 7f0cbf400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca40051c0 0x7f0cc00b38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45860/0 (socket says 172.21.15.153:45860) 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.637+0000 7f0cbf400640 1 -- 172.21.15.153:0/726421044 learned_addr learned my addr 172.21.15.153:0/726421044 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.637+0000 7f0cb6a00640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0cc00b3e00 0x7f0cc01f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.637+0000 7f0cbfe00640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0cc00b5780 0x7f0cc01f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.637+0000 7f0cbf400640 1 -- 172.21.15.153:0/726421044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0cc00b3e00 msgr2=0x7f0cc01f3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.637+0000 7f0cbf400640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0cc00b3e00 0x7f0cc01f3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.637+0000 7f0cbf400640 1 -- 172.21.15.153:0/726421044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0cc00b5780 msgr2=0x7f0cc01f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.637+0000 7f0cbf400640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0cc00b5780 0x7f0cc01f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.637+0000 7f0cbf400640 1 -- 172.21.15.153:0/726421044 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc01f4900 con 0x7f0ca40051c0 2024-03-28T21:52:08.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.637+0000 7f0cbfe00640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0cc00b5780 0x7f0cc01f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:08.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.637+0000 7f0cbf400640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca40051c0 0x7f0cc00b38c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000c700 tx=0x7f0cb000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:08.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.638+0000 7f0cb7e00640 1 -- 172.21.15.153:0/726421044 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0018070 con 0x7f0ca40051c0 2024-03-28T21:52:08.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.638+0000 7f0cb7e00640 1 -- 172.21.15.153:0/726421044 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb00072d0 con 0x7f0ca40051c0 2024-03-28T21:52:08.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.638+0000 7f0cb7e00640 1 -- 172.21.15.153:0/726421044 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00047e0 con 0x7f0ca40051c0 2024-03-28T21:52:08.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.638+0000 7f0cc6000640 1 -- 172.21.15.153:0/726421044 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc01f4be0 con 0x7f0ca40051c0 2024-03-28T21:52:08.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.638+0000 7f0cc6000640 1 -- 172.21.15.153:0/726421044 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc00b33a0 con 0x7f0ca40051c0 2024-03-28T21:52:08.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.639+0000 7f0cc6000640 1 -- 172.21.15.153:0/726421044 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc00b35a0 con 0x7f0ca40051c0 2024-03-28T21:52:08.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.640+0000 7f0cb7e00640 1 -- 172.21.15.153:0/726421044 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0cb001b070 con 0x7f0ca40051c0 2024-03-28T21:52:08.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.641+0000 7f0cb7e00640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c9c06b500 0x7f0c9c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:08.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.641+0000 7f0cb7e00640 1 -- 172.21.15.153:0/726421044 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0cb0089690 con 0x7f0ca40051c0 2024-03-28T21:52:08.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.641+0000 7f0cb6a00640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c9c06b500 0x7f0c9c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:08.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.642+0000 7f0cb6a00640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c9c06b500 0x7f0c9c06d9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00b4320 tx=0x7f0ca8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:08.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.645+0000 7f0cb7e00640 1 -- 172.21.15.153:0/726421044 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0cc00b35a0 con 0x7f0ca40051c0 2024-03-28T21:52:08.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.949+0000 7f0cc6000640 1 -- 172.21.15.153:0/726421044 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0cc0068ff0 con 0x7f0ca40051c0 2024-03-28T21:52:08.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.950+0000 7f0cb7e00640 1 -- 172.21.15.153:0/726421044 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f0cb0058470 con 0x7f0ca40051c0 2024-03-28T21:52:08.952 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-28T21:52:08.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.952+0000 7f0cc6000640 1 -- 172.21.15.153:0/726421044 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c9c06b500 msgr2=0x7f0c9c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:08.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.952+0000 7f0cc6000640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c9c06b500 0x7f0c9c06d9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00b4320 tx=0x7f0ca8008040 comp rx=0 tx=0).stop 2024-03-28T21:52:08.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.952+0000 7f0cc6000640 1 -- 172.21.15.153:0/726421044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca40051c0 msgr2=0x7f0cc00b38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:08.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.952+0000 7f0cc6000640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca40051c0 0x7f0cc00b38c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000c700 tx=0x7f0cb000cbc0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.952+0000 7f0cc6000640 1 -- 172.21.15.153:0/726421044 shutdown_connections 2024-03-28T21:52:08.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.952+0000 7f0cc6000640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c9c06b500 0x7f0c9c06d9c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.952+0000 7f0cc6000640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0cc00b5780 0x7f0cc01f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.952+0000 7f0cc6000640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0cc00b3e00 0x7f0cc01f3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.952+0000 7f0cc6000640 1 --2- 172.21.15.153:0/726421044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca40051c0 0x7f0cc00b38c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:08.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.953+0000 7f0cc6000640 1 -- 172.21.15.153:0/726421044 >> 172.21.15.153:0/726421044 conn(0x7f0cc009d4a0 msgr2=0x7f0cc00b9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:08.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.953+0000 7f0cc6000640 1 -- 172.21.15.153:0/726421044 shutdown_connections 2024-03-28T21:52:08.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:08.953+0000 7f0cc6000640 1 -- 172.21.15.153:0/726421044 wait complete. 2024-03-28T21:52:08.974 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T21:52:09.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.193+0000 7fc7e4600640 1 Processor -- start 2024-03-28T21:52:09.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.193+0000 7fc7e4600640 1 -- start start 2024-03-28T21:52:09.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.194+0000 7fc7e4600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc7dc15f7a0 0x7fc7dc0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:09.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.195+0000 7fc7e4600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc7dc09b160 0x7fc7dc06eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:09.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.195+0000 7fc7e4600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7dc09b860 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.195+0000 7fc7e4600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc7dc0d2ec0 con 0x7fc7dc09b160 2024-03-28T21:52:09.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.195+0000 7fc7e4600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc7dc0cd4c0 con 0x7fc7dc15f7a0 2024-03-28T21:52:09.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.195+0000 7fc7e2600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc7dc09b160 0x7fc7dc06eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:09.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.195+0000 7fc7e2600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc7dc09b160 0x7fc7dc06eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45870/0 (socket says 172.21.15.153:45870) 2024-03-28T21:52:09.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.195+0000 7fc7e2600640 1 -- 172.21.15.153:0/2099568512 learned_addr learned my addr 172.21.15.153:0/2099568512 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:09.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.195+0000 7fc7e1200640 1 --1- 172.21.15.153:0/2099568512 >> v1:172.21.15.153:6789/0 conn(0x7fc7dc0d2a30 0x7fc7dc09aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54692/0 (socket says 172.21.15.153:54692) 2024-03-28T21:52:09.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.195+0000 7fc7e1c00640 1 --2- 172.21.15.153:0/2099568512 >> v2:172.21.15.165:3300/0 conn(0x7fc7dc15f7a0 0x7fc7dc0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:09.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.195+0000 7fc7e2600640 1 -- 172.21.15.153:0/2099568512 >> v2:172.21.15.165:3300/0 conn(0x7fc7dc15f7a0 msgr2=0x7fc7dc0b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:09.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.195+0000 7fc7e2600640 1 --2- 172.21.15.153:0/2099568512 >> v2:172.21.15.165:3300/0 conn(0x7fc7dc15f7a0 0x7fc7dc0b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.195+0000 7fc7e2600640 1 -- 172.21.15.153:0/2099568512 >> v1:172.21.15.153:6789/0 conn(0x7fc7dc0d2a30 legacy=0x7fc7dc09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:09.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.195+0000 7fc7e2600640 1 -- 172.21.15.153:0/2099568512 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7dc0cd700 con 0x7fc7dc09b160 2024-03-28T21:52:09.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.195+0000 7fc7dbe00640 1 -- 172.21.15.153:0/2099568512 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2704044013 0 0) 0x7fc7dc09b860 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.197+0000 7fc7e2600640 1 --2- 172.21.15.153:0/2099568512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7dc09b160 0x7fc7dc06eec0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc06be70 tx=0x7fc7d402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3ad303eefcca2f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:09.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.197+0000 7fc7dbe00640 1 -- 172.21.15.153:0/2099568512 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d402ca80 con 0x7fc7dc09b160 2024-03-28T21:52:09.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.197+0000 7fc7dbe00640 1 -- 172.21.15.153:0/2099568512 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d402cc20 con 0x7fc7dc09b160 2024-03-28T21:52:09.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.197+0000 7fc7dbe00640 1 -- 172.21.15.153:0/2099568512 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40343f0 con 0x7fc7dc09b160 2024-03-28T21:52:09.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.197+0000 7fc7e4600640 1 -- 172.21.15.153:0/2099568512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7dc09b160 msgr2=0x7fc7dc06eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:09.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.197+0000 7fc7e4600640 1 --2- 172.21.15.153:0/2099568512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7dc09b160 0x7fc7dc06eec0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc06be70 tx=0x7fc7d402bee0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.198+0000 7fc7e4600640 1 -- 172.21.15.153:0/2099568512 shutdown_connections 2024-03-28T21:52:09.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.198+0000 7fc7e4600640 1 --2- 172.21.15.153:0/2099568512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7dc09b160 0x7fc7dc06eec0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.198+0000 7fc7e4600640 1 --2- 172.21.15.153:0/2099568512 >> v2:172.21.15.165:3300/0 conn(0x7fc7dc15f7a0 0x7fc7dc0b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.198+0000 7fc7e4600640 1 -- 172.21.15.153:0/2099568512 >> 172.21.15.153:0/2099568512 conn(0x7fc7dc0d1f10 msgr2=0x7fc7dc0d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:09.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.198+0000 7fc7e4600640 1 -- 172.21.15.153:0/2099568512 shutdown_connections 2024-03-28T21:52:09.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.198+0000 7fc7e4600640 1 -- 172.21.15.153:0/2099568512 wait complete. 2024-03-28T21:52:09.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.199+0000 7fc7e4600640 1 Processor -- start 2024-03-28T21:52:09.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.200+0000 7fc7e4600640 1 -- start start 2024-03-28T21:52:09.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e4600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7dc09b160 0x7fc7dc0c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:09.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e4600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7dc0d2a30 0x7fc7dc15c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:09.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e4600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7dc15f7a0 0x7fc7dc1f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e4600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc06f400 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e4600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc15fb80 con 0x7fc7dc09b160 2024-03-28T21:52:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e4600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc7dc06f580 con 0x7fc7dc15f7a0 2024-03-28T21:52:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7dc0d2a30 0x7fc7dc15c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7dc0d2a30 0x7fc7dc15c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45882/0 (socket says 172.21.15.153:45882) 2024-03-28T21:52:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e1200640 1 -- 172.21.15.153:0/3010411259 learned_addr learned my addr 172.21.15.153:0/3010411259 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e1c00640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7dc09b160 0x7fc7dc0c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e2600640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7dc15f7a0 0x7fc7dc1f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e1200640 1 -- 172.21.15.153:0/3010411259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7dc15f7a0 msgr2=0x7fc7dc1f4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e1200640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7dc15f7a0 0x7fc7dc1f4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e1200640 1 -- 172.21.15.153:0/3010411259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7dc09b160 msgr2=0x7fc7dc0c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:09.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e1200640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7dc09b160 0x7fc7dc0c4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e1200640 1 -- 172.21.15.153:0/3010411259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7dc1f4330 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.201+0000 7fc7e2600640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7dc15f7a0 0x7fc7dc1f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:09.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.202+0000 7fc7e1200640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7dc0d2a30 0x7fc7dc15c330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800c4d0 tx=0x7fc7c800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:09.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.202+0000 7fc7d9600640 1 -- 172.21.15.153:0/3010411259 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8018070 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.202+0000 7fc7d9600640 1 -- 172.21.15.153:0/3010411259 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c8007500 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.202+0000 7fc7d9600640 1 -- 172.21.15.153:0/3010411259 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8004a20 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.202+0000 7fc7e4600640 1 -- 172.21.15.153:0/3010411259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7dc1f4610 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.202+0000 7fc7e4600640 1 -- 172.21.15.153:0/3010411259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7dc1f4bd0 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.203+0000 7fc7e4600640 1 -- 172.21.15.153:0/3010411259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7dc0681c0 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.204+0000 7fc7d9600640 1 -- 172.21.15.153:0/3010411259 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc7c801b070 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.206+0000 7fc7d9600640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc7bc06b500 0x7fc7bc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:09.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.206+0000 7fc7d9600640 1 -- 172.21.15.153:0/3010411259 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc7c8089530 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.206+0000 7fc7e1c00640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc7bc06b500 0x7fc7bc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:09.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.207+0000 7fc7e1c00640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc7bc06b500 0x7fc7bc06d9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0006fd0 tx=0x7fc7d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:09.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.212+0000 7fc7d9600640 1 -- 172.21.15.153:0/3010411259 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc7c80583a0 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.404+0000 7fc7e4600640 1 -- 172.21.15.153:0/3010411259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc7dc15cbb0 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.405+0000 7fc7d9600640 1 -- 172.21.15.153:0/3010411259 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fc7c8057ca0 con 0x7fc7dc0d2a30 2024-03-28T21:52:09.407 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-03-28T21:52:09.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.407+0000 7fc7e4600640 1 -- 172.21.15.153:0/3010411259 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc7bc06b500 msgr2=0x7fc7bc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:09.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.407+0000 7fc7e4600640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc7bc06b500 0x7fc7bc06d9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0006fd0 tx=0x7fc7d0008040 comp rx=0 tx=0).stop 2024-03-28T21:52:09.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.407+0000 7fc7e4600640 1 -- 172.21.15.153:0/3010411259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7dc0d2a30 msgr2=0x7fc7dc15c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:09.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.407+0000 7fc7e4600640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7dc0d2a30 0x7fc7dc15c330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800c4d0 tx=0x7fc7c800c990 comp rx=0 tx=0).stop 2024-03-28T21:52:09.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.407+0000 7fc7e4600640 1 -- 172.21.15.153:0/3010411259 shutdown_connections 2024-03-28T21:52:09.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.407+0000 7fc7e4600640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc7bc06b500 0x7fc7bc06d9c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.407+0000 7fc7e4600640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7dc15f7a0 0x7fc7dc1f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.407+0000 7fc7e4600640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7dc0d2a30 0x7fc7dc15c330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.407+0000 7fc7e4600640 1 --2- 172.21.15.153:0/3010411259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7dc09b160 0x7fc7dc0c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.407+0000 7fc7e4600640 1 -- 172.21.15.153:0/3010411259 >> 172.21.15.153:0/3010411259 conn(0x7fc7dc0d1f10 msgr2=0x7fc7dc15d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:09.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.407+0000 7fc7e4600640 1 -- 172.21.15.153:0/3010411259 shutdown_connections 2024-03-28T21:52:09.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.407+0000 7fc7e4600640 1 -- 172.21.15.153:0/3010411259 wait complete. 2024-03-28T21:52:09.428 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T21:52:09.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.637+0000 7f36fdc00640 1 Processor -- start 2024-03-28T21:52:09.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.637+0000 7f36fdc00640 1 -- start start 2024-03-28T21:52:09.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.640+0000 7f36fdc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36f815afb0 0x7f36f80b5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:09.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.640+0000 7f36fdc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f36f806c180 0x7f36f806c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:09.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.640+0000 7f36fdc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f80b56c0 con 0x7f36f815e9c0 2024-03-28T21:52:09.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.640+0000 7f36fdc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f36f806cb20 con 0x7f36f806c180 2024-03-28T21:52:09.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.640+0000 7f36fdc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f36f806d6f0 con 0x7f36f815afb0 2024-03-28T21:52:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.641+0000 7f36f6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36f815afb0 0x7f36f80b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.641+0000 7f36f6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36f815afb0 0x7f36f80b5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:43204/0 (socket says 172.21.15.153:43204) 2024-03-28T21:52:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.641+0000 7f36f6a00640 1 -- 172.21.15.153:0/1625738021 learned_addr learned my addr 172.21.15.153:0/1625738021 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.641+0000 7f36efe00640 1 --2- 172.21.15.153:0/1625738021 >> v2:172.21.15.165:3300/0 conn(0x7f36f806c180 0x7f36f806c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.641+0000 7f36f6a00640 1 -- 172.21.15.153:0/1625738021 >> v2:172.21.15.165:3300/0 conn(0x7f36f806c180 msgr2=0x7f36f806c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.641+0000 7f36f6a00640 1 --2- 172.21.15.153:0/1625738021 >> v2:172.21.15.165:3300/0 conn(0x7f36f806c180 0x7f36f806c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.641+0000 7f36f6a00640 1 -- 172.21.15.153:0/1625738021 >> v1:172.21.15.165:6789/0 conn(0x7f36f815e9c0 legacy=0x7f36f815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.641+0000 7f36f6a00640 1 -- 172.21.15.153:0/1625738021 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f8072500 con 0x7f36f815afb0 2024-03-28T21:52:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.641+0000 7f36f6000640 1 -- 172.21.15.153:0/1625738021 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157646738 0 0) 0x7f36f80b56c0 con 0x7f36f815e9c0 2024-03-28T21:52:09.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.643+0000 7f36f6a00640 1 --2- 172.21.15.153:0/1625738021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36f815afb0 0x7f36f80b5180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009870 tx=0x7f36e802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed82f941ad6c5732 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:09.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.643+0000 7f36f6000640 1 -- 172.21.15.153:0/1625738021 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e8035020 con 0x7f36f815afb0 2024-03-28T21:52:09.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.643+0000 7f36f6000640 1 -- 172.21.15.153:0/1625738021 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e8031640 con 0x7f36f815afb0 2024-03-28T21:52:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.643+0000 7f36f6000640 1 -- 172.21.15.153:0/1625738021 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e802d040 con 0x7f36f815afb0 2024-03-28T21:52:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.644+0000 7f36fdc00640 1 -- 172.21.15.153:0/1625738021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36f815afb0 msgr2=0x7f36f80b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.644+0000 7f36fdc00640 1 --2- 172.21.15.153:0/1625738021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36f815afb0 0x7f36f80b5180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009870 tx=0x7f36e802b8f0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.644+0000 7f36fdc00640 1 -- 172.21.15.153:0/1625738021 shutdown_connections 2024-03-28T21:52:09.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.644+0000 7f36fdc00640 1 --2- 172.21.15.153:0/1625738021 >> v2:172.21.15.165:3300/0 conn(0x7f36f806c180 0x7f36f806c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.644+0000 7f36fdc00640 1 --2- 172.21.15.153:0/1625738021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36f815afb0 0x7f36f80b5180 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.644+0000 7f36fdc00640 1 -- 172.21.15.153:0/1625738021 >> 172.21.15.153:0/1625738021 conn(0x7f36f8071690 msgr2=0x7f36f8071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:09.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.644+0000 7f36fdc00640 1 -- 172.21.15.153:0/1625738021 shutdown_connections 2024-03-28T21:52:09.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.644+0000 7f36fdc00640 1 -- 172.21.15.153:0/1625738021 wait complete. 2024-03-28T21:52:09.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.646+0000 7f36fdc00640 1 Processor -- start 2024-03-28T21:52:09.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.647+0000 7f36fdc00640 1 -- start start 2024-03-28T21:52:09.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.648+0000 7f36fdc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36f806c180 0x7f36f814e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:09.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.648+0000 7f36fdc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36f815afb0 0x7f36f80ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:09.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.648+0000 7f36fdc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f815e9c0 0x7f36f80cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:09.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.648+0000 7f36fdc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f36f806d940 con 0x7f36f815e9c0 2024-03-28T21:52:09.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.648+0000 7f36fdc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f36f806dcb0 con 0x7f36f806c180 2024-03-28T21:52:09.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.648+0000 7f36fdc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f36f80721b0 con 0x7f36f815afb0 2024-03-28T21:52:09.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.649+0000 7f36f7400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f815e9c0 0x7f36f80cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:09.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.649+0000 7f36f7400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f815e9c0 0x7f36f80cf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45888/0 (socket says 172.21.15.153:45888) 2024-03-28T21:52:09.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.649+0000 7f36f7400640 1 -- 172.21.15.153:0/3545946596 learned_addr learned my addr 172.21.15.153:0/3545946596 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:09.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.649+0000 7f36f6a00640 1 --2- 172.21.15.153:0/3545946596 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36f806c180 0x7f36f814e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:09.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.649+0000 7f36efe00640 1 --2- 172.21.15.153:0/3545946596 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36f815afb0 0x7f36f80ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:09.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.649+0000 7f36f7400640 1 -- 172.21.15.153:0/3545946596 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36f815afb0 msgr2=0x7f36f80ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:09.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.649+0000 7f36f7400640 1 --2- 172.21.15.153:0/3545946596 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36f815afb0 0x7f36f80ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.649+0000 7f36f7400640 1 -- 172.21.15.153:0/3545946596 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36f806c180 msgr2=0x7f36f814e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:09.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.649+0000 7f36f7400640 1 --2- 172.21.15.153:0/3545946596 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36f806c180 0x7f36f814e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.649+0000 7f36f7400640 1 -- 172.21.15.153:0/3545946596 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f80ade00 con 0x7f36f815e9c0 2024-03-28T21:52:09.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.649+0000 7f36f7400640 1 --2- 172.21.15.153:0/3545946596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f815e9c0 0x7f36f80cf450 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c710 tx=0x7f36f000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:09.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.650+0000 7f36eea00640 1 -- 172.21.15.153:0/3545946596 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0017070 con 0x7f36f815e9c0 2024-03-28T21:52:09.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.650+0000 7f36eea00640 1 -- 172.21.15.153:0/3545946596 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f0003da0 con 0x7f36f815e9c0 2024-03-28T21:52:09.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.650+0000 7f36fdc00640 1 -- 172.21.15.153:0/3545946596 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f80ae0a0 con 0x7f36f815e9c0 2024-03-28T21:52:09.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.650+0000 7f36eea00640 1 -- 172.21.15.153:0/3545946596 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0005290 con 0x7f36f815e9c0 2024-03-28T21:52:09.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.650+0000 7f36fdc00640 1 -- 172.21.15.153:0/3545946596 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f80ae940 con 0x7f36f815e9c0 2024-03-28T21:52:09.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.651+0000 7f36fdc00640 1 -- 172.21.15.153:0/3545946596 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f8068ff0 con 0x7f36f815e9c0 2024-03-28T21:52:09.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.652+0000 7f36eea00640 1 -- 172.21.15.153:0/3545946596 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f36f001a070 con 0x7f36f815e9c0 2024-03-28T21:52:09.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.653+0000 7f36eea00640 1 --2- 172.21.15.153:0/3545946596 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f36d406b4d0 0x7f36d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:09.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.653+0000 7f36eea00640 1 -- 172.21.15.153:0/3545946596 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f36f0089790 con 0x7f36f815e9c0 2024-03-28T21:52:09.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.653+0000 7f36f6a00640 1 --2- 172.21.15.153:0/3545946596 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f36d406b4d0 0x7f36d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:09.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.654+0000 7f36f6a00640 1 --2- 172.21.15.153:0/3545946596 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f36d406b4d0 0x7f36d406d990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f36e8036000 tx=0x7f36e803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:09.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.657+0000 7f36eea00640 1 -- 172.21.15.153:0/3545946596 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f36f000ce20 con 0x7f36f815e9c0 2024-03-28T21:52:09.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.921+0000 7f36fdc00640 1 -- 172.21.15.153:0/3545946596 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f36f806ea80 con 0x7f36f815e9c0 2024-03-28T21:52:09.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.922+0000 7f36eea00640 1 -- 172.21.15.153:0/3545946596 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f36f0057fb0 con 0x7f36f815e9c0 2024-03-28T21:52:09.924 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-03-28T21:52:09.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.925+0000 7f36fdc00640 1 -- 172.21.15.153:0/3545946596 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f36d406b4d0 msgr2=0x7f36d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:09.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.925+0000 7f36fdc00640 1 --2- 172.21.15.153:0/3545946596 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f36d406b4d0 0x7f36d406d990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f36e8036000 tx=0x7f36e803c040 comp rx=0 tx=0).stop 2024-03-28T21:52:09.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.925+0000 7f36fdc00640 1 -- 172.21.15.153:0/3545946596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f815e9c0 msgr2=0x7f36f80cf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:09.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.925+0000 7f36fdc00640 1 --2- 172.21.15.153:0/3545946596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f815e9c0 0x7f36f80cf450 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c710 tx=0x7f36f000cbd0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.925+0000 7f36fdc00640 1 -- 172.21.15.153:0/3545946596 shutdown_connections 2024-03-28T21:52:09.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.925+0000 7f36fdc00640 1 --2- 172.21.15.153:0/3545946596 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f36d406b4d0 0x7f36d406d990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.925+0000 7f36fdc00640 1 --2- 172.21.15.153:0/3545946596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f815e9c0 0x7f36f80cf450 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.925+0000 7f36fdc00640 1 --2- 172.21.15.153:0/3545946596 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36f815afb0 0x7f36f80ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.925+0000 7f36fdc00640 1 --2- 172.21.15.153:0/3545946596 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36f806c180 0x7f36f814e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:09.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.925+0000 7f36fdc00640 1 -- 172.21.15.153:0/3545946596 >> 172.21.15.153:0/3545946596 conn(0x7f36f8071690 msgr2=0x7f36f80b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:09.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.925+0000 7f36fdc00640 1 -- 172.21.15.153:0/3545946596 shutdown_connections 2024-03-28T21:52:09.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:09.925+0000 7f36fdc00640 1 -- 172.21.15.153:0/3545946596 wait complete. 2024-03-28T21:52:09.943 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T21:52:10.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.136+0000 7f6940800640 1 Processor -- start 2024-03-28T21:52:10.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.136+0000 7f6940800640 1 -- start start 2024-03-28T21:52:10.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.138+0000 7f6940800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6938159a10 0x7f693815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:10.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.138+0000 7f6940800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f693806e440 0x7f69380b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:10.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.138+0000 7f6940800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69380b2e60 con 0x7f69380ad830 2024-03-28T21:52:10.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.138+0000 7f6940800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f69380adc70 con 0x7f693806e440 2024-03-28T21:52:10.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.138+0000 7f6940800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6938159df0 con 0x7f6938159a10 2024-03-28T21:52:10.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.138+0000 7f693d400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f69380ad830 0x7f693806dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54700/0 (socket says 172.21.15.153:54700) 2024-03-28T21:52:10.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.138+0000 7f693d400640 1 -- 172.21.15.153:0/3892443789 learned_addr learned my addr 172.21.15.153:0/3892443789 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:10.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.138+0000 7f693e800640 1 --2- 172.21.15.153:0/3892443789 >> v2:172.21.15.153:3300/0 conn(0x7f693806e440 0x7f69380b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:10.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.138+0000 7f693de00640 1 --2- 172.21.15.153:0/3892443789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6938159a10 0x7f693815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:10.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.138+0000 7f693ca00640 1 -- 172.21.15.153:0/3892443789 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 335282534 0 0) 0x7f69380b2e60 con 0x7f69380ad830 2024-03-28T21:52:10.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.138+0000 7f693ca00640 1 -- 172.21.15.153:0/3892443789 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6920003520 con 0x7f69380ad830 2024-03-28T21:52:10.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.139+0000 7f693e800640 1 -- 172.21.15.153:0/3892443789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6938159a10 msgr2=0x7f693815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:10.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.139+0000 7f693e800640 1 --2- 172.21.15.153:0/3892443789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6938159a10 0x7f693815cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.139+0000 7f693e800640 1 -- 172.21.15.153:0/3892443789 >> v1:172.21.15.153:6789/0 conn(0x7f69380ad830 legacy=0x7f693806dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:10.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.139+0000 7f693e800640 1 -- 172.21.15.153:0/3892443789 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69380adf10 con 0x7f693806e440 2024-03-28T21:52:10.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.140+0000 7f693e800640 1 --2- 172.21.15.153:0/3892443789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693806e440 0x7f69380b3620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6934009d90 tx=0x7f693402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97565110ea9a4ed server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:10.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.140+0000 7f693ca00640 1 -- 172.21.15.153:0/3892443789 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934039070 con 0x7f693806e440 2024-03-28T21:52:10.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.140+0000 7f693ca00640 1 -- 172.21.15.153:0/3892443789 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693402cbd0 con 0x7f693806e440 2024-03-28T21:52:10.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.140+0000 7f693ca00640 1 -- 172.21.15.153:0/3892443789 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934034440 con 0x7f693806e440 2024-03-28T21:52:10.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.140+0000 7f6940800640 1 -- 172.21.15.153:0/3892443789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693806e440 msgr2=0x7f69380b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:10.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.140+0000 7f6940800640 1 --2- 172.21.15.153:0/3892443789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693806e440 0x7f69380b3620 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6934009d90 tx=0x7f693402be20 comp rx=0 tx=0).stop 2024-03-28T21:52:10.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.141+0000 7f6940800640 1 -- 172.21.15.153:0/3892443789 shutdown_connections 2024-03-28T21:52:10.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.141+0000 7f6940800640 1 --2- 172.21.15.153:0/3892443789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693806e440 0x7f69380b3620 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.141+0000 7f6940800640 1 --2- 172.21.15.153:0/3892443789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6938159a10 0x7f693815cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.141+0000 7f6940800640 1 -- 172.21.15.153:0/3892443789 >> 172.21.15.153:0/3892443789 conn(0x7f69380b1a30 msgr2=0x7f69380b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:10.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.141+0000 7f6940800640 1 -- 172.21.15.153:0/3892443789 shutdown_connections 2024-03-28T21:52:10.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.141+0000 7f6940800640 1 -- 172.21.15.153:0/3892443789 wait complete. 2024-03-28T21:52:10.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.143+0000 7f6940800640 1 Processor -- start 2024-03-28T21:52:10.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.143+0000 7f6940800640 1 -- start start 2024-03-28T21:52:10.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.144+0000 7f6940800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693806e440 0x7f69381f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:10.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f6940800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69380ad830 0x7f69380ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:10.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f6940800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6938159a10 0x7f69380ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:10.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f6940800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69380ae4d0 con 0x7f693806e440 2024-03-28T21:52:10.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f6940800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f69380b3100 con 0x7f6938159a10 2024-03-28T21:52:10.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f6940800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f69380b3b60 con 0x7f69380ad830 2024-03-28T21:52:10.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f693de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693806e440 0x7f69381f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:10.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f693de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693806e440 0x7f69381f5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45896/0 (socket says 172.21.15.153:45896) 2024-03-28T21:52:10.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f693de00640 1 -- 172.21.15.153:0/2772357683 learned_addr learned my addr 172.21.15.153:0/2772357683 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:10.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f693d400640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69380ad830 0x7f69380ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:10.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f693e800640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6938159a10 0x7f69380ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:10.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f693de00640 1 -- 172.21.15.153:0/2772357683 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69380ad830 msgr2=0x7f69380ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:10.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f693de00640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69380ad830 0x7f69380ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f693de00640 1 -- 172.21.15.153:0/2772357683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6938159a10 msgr2=0x7f69380ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:10.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f693de00640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6938159a10 0x7f69380ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f693de00640 1 -- 172.21.15.153:0/2772357683 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69380c9250 con 0x7f693806e440 2024-03-28T21:52:10.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f693d400640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69380ad830 0x7f69380ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:10.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.145+0000 7f693e800640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6938159a10 0x7f69380ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:10.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.146+0000 7f693de00640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693806e440 0x7f69381f5020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f692c00d620 tx=0x7f692c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:10.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.146+0000 7f6932000640 1 -- 172.21.15.153:0/2772357683 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c00b620 con 0x7f693806e440 2024-03-28T21:52:10.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.146+0000 7f6932000640 1 -- 172.21.15.153:0/2772357683 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692c019070 con 0x7f693806e440 2024-03-28T21:52:10.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.146+0000 7f6940800640 1 -- 172.21.15.153:0/2772357683 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69380c9530 con 0x7f693806e440 2024-03-28T21:52:10.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.146+0000 7f6932000640 1 -- 172.21.15.153:0/2772357683 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c00ba00 con 0x7f693806e440 2024-03-28T21:52:10.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.146+0000 7f6940800640 1 -- 172.21.15.153:0/2772357683 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69380c9af0 con 0x7f693806e440 2024-03-28T21:52:10.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.147+0000 7f6940800640 1 -- 172.21.15.153:0/2772357683 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f693809df20 con 0x7f693806e440 2024-03-28T21:52:10.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.148+0000 7f6932000640 1 -- 172.21.15.153:0/2772357683 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f692c00bba0 con 0x7f693806e440 2024-03-28T21:52:10.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.149+0000 7f6932000640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f691c06b4d0 0x7f691c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:10.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.149+0000 7f6932000640 1 -- 172.21.15.153:0/2772357683 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f692c08a5b0 con 0x7f693806e440 2024-03-28T21:52:10.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.149+0000 7f693d400640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f691c06b4d0 0x7f691c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:10.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.150+0000 7f693d400640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f691c06b4d0 0x7f691c06d990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6938072cc0 tx=0x7f6928009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:10.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.154+0000 7f6932000640 1 -- 172.21.15.153:0/2772357683 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f693809df20 con 0x7f693806e440 2024-03-28T21:52:10.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.386+0000 7f6940800640 1 -- 172.21.15.153:0/2772357683 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6938068ff0 con 0x7f693806e440 2024-03-28T21:52:10.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.387+0000 7f6932000640 1 -- 172.21.15.153:0/2772357683 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f692c0594c0 con 0x7f693806e440 2024-03-28T21:52:10.388 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:10.388 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/207550071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":207550071},{"type":"v1","addr":"172.21.15.165:6835","nonce":207550071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/900073633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":900073633},{"type":"v1","addr":"172.21.15.153:6837","nonce":900073633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3915706377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3915706377},{"type":"v1","addr":"172.21.15.165:6833","nonce":3915706377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T21:51:56.169625+0000","modified":"2024-03-28T21:51:59.218861+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6836/3516257974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3516257974},{"type":"v1","addr":"172.21.15.153:6836","nonce":3516257974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-03-28T21:52:10.389 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2024-03-28T21:52:10.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.389+0000 7f6940800640 1 -- 172.21.15.153:0/2772357683 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f691c06b4d0 msgr2=0x7f691c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:10.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.389+0000 7f6940800640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f691c06b4d0 0x7f691c06d990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6938072cc0 tx=0x7f6928009040 comp rx=0 tx=0).stop 2024-03-28T21:52:10.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.389+0000 7f6940800640 1 -- 172.21.15.153:0/2772357683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693806e440 msgr2=0x7f69381f5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:10.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.389+0000 7f6940800640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693806e440 0x7f69381f5020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f692c00d620 tx=0x7f692c00dae0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.389+0000 7f6940800640 1 -- 172.21.15.153:0/2772357683 shutdown_connections 2024-03-28T21:52:10.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.389+0000 7f6940800640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f691c06b4d0 0x7f691c06d990 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.389+0000 7f6940800640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6938159a10 0x7f69380ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.389+0000 7f6940800640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69380ad830 0x7f69380ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.389+0000 7f6940800640 1 --2- 172.21.15.153:0/2772357683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f693806e440 0x7f69381f5020 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.389+0000 7f6940800640 1 -- 172.21.15.153:0/2772357683 >> 172.21.15.153:0/2772357683 conn(0x7f69380b1a30 msgr2=0x7f6938074180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:10.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.390+0000 7f6940800640 1 -- 172.21.15.153:0/2772357683 shutdown_connections 2024-03-28T21:52:10.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.390+0000 7f6940800640 1 -- 172.21.15.153:0/2772357683 wait complete. 2024-03-28T21:52:10.416 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:10.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.623+0000 7f0f95600640 1 Processor -- start 2024-03-28T21:52:10.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.623+0000 7f0f95600640 1 -- start start 2024-03-28T21:52:10.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.625+0000 7f0f95600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0f900d2a20 0x7f0f900b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:10.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.625+0000 7f0f95600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f900cff80 con 0x7f0f900cedb0 2024-03-28T21:52:10.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.625+0000 7f0f95600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f900d1950 con 0x7f0f9015e600 2024-03-28T21:52:10.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.625+0000 7f0f95600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0f900d1720 con 0x7f0f900d2a20 2024-03-28T21:52:10.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.625+0000 7f0f86000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0f900d2a20 0x7f0f900b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:10.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.625+0000 7f0f8f400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0f900cedb0 0x7f0f900b2e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54708/0 (socket says 172.21.15.153:54708) 2024-03-28T21:52:10.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.625+0000 7f0f8f400640 1 -- 172.21.15.153:0/1167026022 learned_addr learned my addr 172.21.15.153:0/1167026022 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:10.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.625+0000 7f0f86000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0f900d2a20 0x7f0f900b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45900/0 (socket says 172.21.15.153:45900) 2024-03-28T21:52:10.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.626+0000 7f0f86000640 1 -- 172.21.15.153:0/1167026022 >> v1:172.21.15.165:6789/0 conn(0x7f0f9015e600 legacy=0x7f0f900ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:10.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.626+0000 7f0f86000640 1 -- 172.21.15.153:0/1167026022 >> v1:172.21.15.153:6789/0 conn(0x7f0f900cedb0 legacy=0x7f0f900b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:10.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.626+0000 7f0f86000640 1 -- 172.21.15.153:0/1167026022 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f900b2410 con 0x7f0f900d2a20 2024-03-28T21:52:10.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.626+0000 7f0f8e000640 1 -- 172.21.15.153:0/1167026022 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1466393363 0 0) 0x7f0f900cff80 con 0x7f0f900cedb0 2024-03-28T21:52:10.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.627+0000 7f0f86000640 1 --2- 172.21.15.153:0/1167026022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f900d2a20 0x7f0f900b2930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f780097a0 tx=0x7f0f7802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a137c4a823e769f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:10.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.627+0000 7f0f8e000640 1 -- 172.21.15.153:0/1167026022 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f780315a0 con 0x7f0f900d2a20 2024-03-28T21:52:10.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.627+0000 7f0f8e000640 1 -- 172.21.15.153:0/1167026022 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f78037070 con 0x7f0f900d2a20 2024-03-28T21:52:10.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.627+0000 7f0f8e000640 1 -- 172.21.15.153:0/1167026022 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78031960 con 0x7f0f900d2a20 2024-03-28T21:52:10.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.627+0000 7f0f95600640 1 -- 172.21.15.153:0/1167026022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f900d2a20 msgr2=0x7f0f900b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:10.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.627+0000 7f0f95600640 1 --2- 172.21.15.153:0/1167026022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f900d2a20 0x7f0f900b2930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f780097a0 tx=0x7f0f7802b840 comp rx=0 tx=0).stop 2024-03-28T21:52:10.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.628+0000 7f0f95600640 1 -- 172.21.15.153:0/1167026022 shutdown_connections 2024-03-28T21:52:10.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.628+0000 7f0f95600640 1 --2- 172.21.15.153:0/1167026022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f900d2a20 0x7f0f900b2930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.628+0000 7f0f95600640 1 -- 172.21.15.153:0/1167026022 >> 172.21.15.153:0/1167026022 conn(0x7f0f900d1f00 msgr2=0x7f0f900d2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:10.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.628+0000 7f0f95600640 1 -- 172.21.15.153:0/1167026022 shutdown_connections 2024-03-28T21:52:10.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.628+0000 7f0f95600640 1 -- 172.21.15.153:0/1167026022 wait complete. 2024-03-28T21:52:10.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.629+0000 7f0f95600640 1 Processor -- start 2024-03-28T21:52:10.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.630+0000 7f0f95600640 1 -- start start 2024-03-28T21:52:10.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f95600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f900cedb0 0x7f0f900b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:10.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f95600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f900d2a20 0x7f0f9014d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:10.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f95600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f9015e600 0x7f0f9015e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:10.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f95600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9006c280 con 0x7f0f900cedb0 2024-03-28T21:52:10.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f95600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0f900cf240 con 0x7f0f9015e600 2024-03-28T21:52:10.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f95600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f900d1c30 con 0x7f0f900d2a20 2024-03-28T21:52:10.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f8ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f900cedb0 0x7f0f900b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:10.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f8ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f900cedb0 0x7f0f900b6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45916/0 (socket says 172.21.15.153:45916) 2024-03-28T21:52:10.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f8ea00640 1 -- 172.21.15.153:0/1256860607 learned_addr learned my addr 172.21.15.153:0/1256860607 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:10.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f8ea00640 1 -- 172.21.15.153:0/1256860607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f900d2a20 msgr2=0x7f0f9014d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:10.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f86000640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f900d2a20 0x7f0f9014d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:10.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f8f400640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f9015e600 0x7f0f9015e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:10.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f8ea00640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f900d2a20 0x7f0f9014d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f8ea00640 1 -- 172.21.15.153:0/1256860607 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f9015e600 msgr2=0x7f0f9015e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:10.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f8ea00640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f9015e600 0x7f0f9015e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f8ea00640 1 -- 172.21.15.153:0/1256860607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9014dea0 con 0x7f0f900cedb0 2024-03-28T21:52:10.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.631+0000 7f0f86000640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f900d2a20 0x7f0f9014d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:10.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.632+0000 7f0f8ea00640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f900cedb0 0x7f0f900b6dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000c730 tx=0x7f0f8000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:10.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.632+0000 7f0f87400640 1 -- 172.21.15.153:0/1256860607 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f80003b70 con 0x7f0f900cedb0 2024-03-28T21:52:10.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.632+0000 7f0f87400640 1 -- 172.21.15.153:0/1256860607 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f80003d30 con 0x7f0f900cedb0 2024-03-28T21:52:10.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.632+0000 7f0f95600640 1 -- 172.21.15.153:0/1256860607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f90161080 con 0x7f0f900cedb0 2024-03-28T21:52:10.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.632+0000 7f0f87400640 1 -- 172.21.15.153:0/1256860607 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8000aa90 con 0x7f0f900cedb0 2024-03-28T21:52:10.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.632+0000 7f0f95600640 1 -- 172.21.15.153:0/1256860607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f90161600 con 0x7f0f900cedb0 2024-03-28T21:52:10.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.633+0000 7f0f95600640 1 -- 172.21.15.153:0/1256860607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f90068ff0 con 0x7f0f900cedb0 2024-03-28T21:52:10.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.635+0000 7f0f87400640 1 -- 172.21.15.153:0/1256860607 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0f8000ac30 con 0x7f0f900cedb0 2024-03-28T21:52:10.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.636+0000 7f0f87400640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0f6c06b4d0 0x7f0f6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:10.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.636+0000 7f0f87400640 1 -- 172.21.15.153:0/1256860607 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0f8008a050 con 0x7f0f900cedb0 2024-03-28T21:52:10.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.636+0000 7f0f86000640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0f6c06b4d0 0x7f0f6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:10.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.637+0000 7f0f86000640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0f6c06b4d0 0x7f0f6c06d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0f78036000 tx=0x7f0f78008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:10.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.641+0000 7f0f87400640 1 -- 172.21.15.153:0/1256860607 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0f9014dea0 con 0x7f0f900cedb0 2024-03-28T21:52:10.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.836+0000 7f0f95600640 1 -- 172.21.15.153:0/1256860607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f9006fde0 con 0x7f0f900cedb0 2024-03-28T21:52:10.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.837+0000 7f0f87400640 1 -- 172.21.15.153:0/1256860607 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f0f80058f60 con 0x7f0f900cedb0 2024-03-28T21:52:10.839 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:10.839 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:57.716531+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:10.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.840+0000 7f0f95600640 1 -- 172.21.15.153:0/1256860607 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0f6c06b4d0 msgr2=0x7f0f6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:10.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.840+0000 7f0f95600640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0f6c06b4d0 0x7f0f6c06d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0f78036000 tx=0x7f0f78008030 comp rx=0 tx=0).stop 2024-03-28T21:52:10.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.840+0000 7f0f95600640 1 -- 172.21.15.153:0/1256860607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f900cedb0 msgr2=0x7f0f900b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:10.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.840+0000 7f0f95600640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f900cedb0 0x7f0f900b6dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000c730 tx=0x7f0f8000cbf0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.840+0000 7f0f95600640 1 -- 172.21.15.153:0/1256860607 shutdown_connections 2024-03-28T21:52:10.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.840+0000 7f0f95600640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0f6c06b4d0 0x7f0f6c06d990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.840+0000 7f0f95600640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f9015e600 0x7f0f9015e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.840+0000 7f0f95600640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f900d2a20 0x7f0f9014d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.840+0000 7f0f95600640 1 --2- 172.21.15.153:0/1256860607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f900cedb0 0x7f0f900b6dc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:10.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.840+0000 7f0f95600640 1 -- 172.21.15.153:0/1256860607 >> 172.21.15.153:0/1256860607 conn(0x7f0f900d1f00 msgr2=0x7f0f9009aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:10.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.840+0000 7f0f95600640 1 -- 172.21.15.153:0/1256860607 shutdown_connections 2024-03-28T21:52:10.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:10.840+0000 7f0f95600640 1 -- 172.21.15.153:0/1256860607 wait complete. 2024-03-28T21:52:10.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T21:51:53.863931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T21:51:55.188736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T21:52:10.858 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T21:52:11.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.069+0000 7fc0bca00640 1 Processor -- start 2024-03-28T21:52:11.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.069+0000 7fc0bca00640 1 -- start start 2024-03-28T21:52:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0bca00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0b815ad40 0x7fc0b80b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0bca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0b815b120 0x7fc0b806e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0bca00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc0b806ebe0 0x7fc0b80b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0bca00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b806f030 con 0x7fc0b815ad40 2024-03-28T21:52:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0bca00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b80716d0 con 0x7fc0b806ebe0 2024-03-28T21:52:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0bca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b80729c0 con 0x7fc0b815b120 2024-03-28T21:52:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0b7400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0b815ad40 0x7fc0b80b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0b7400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0b815ad40 0x7fc0b80b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45928/0 (socket says 172.21.15.153:45928) 2024-03-28T21:52:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0b7400640 1 -- 172.21.15.153:0/4111251080 learned_addr learned my addr 172.21.15.153:0/4111251080 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0afe00640 1 --2- 172.21.15.153:0/4111251080 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0b815b120 0x7fc0b806e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0b7400640 1 -- 172.21.15.153:0/4111251080 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0b815b120 msgr2=0x7fc0b806e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:11.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0b7e00640 1 --2- 172.21.15.153:0/4111251080 >> v2:172.21.15.165:3300/0 conn(0x7fc0b806ebe0 0x7fc0b80b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0b7400640 1 --2- 172.21.15.153:0/4111251080 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0b815b120 0x7fc0b806e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0b7400640 1 -- 172.21.15.153:0/4111251080 >> v2:172.21.15.165:3300/0 conn(0x7fc0b806ebe0 msgr2=0x7fc0b80b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:11.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0b7400640 1 --2- 172.21.15.153:0/4111251080 >> v2:172.21.15.165:3300/0 conn(0x7fc0b806ebe0 0x7fc0b80b2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0b7400640 1 -- 172.21.15.153:0/4111251080 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b8071920 con 0x7fc0b815ad40 2024-03-28T21:52:11.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.071+0000 7fc0afe00640 1 --2- 172.21.15.153:0/4111251080 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0b815b120 0x7fc0b806e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:11.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.072+0000 7fc0b7400640 1 --2- 172.21.15.153:0/4111251080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b815ad40 0x7fc0b80b40f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80731e0 tx=0x7fc0a802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bec28a0eb449bb server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:11.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.073+0000 7fc0b6a00640 1 -- 172.21.15.153:0/4111251080 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a803b070 con 0x7fc0b815ad40 2024-03-28T21:52:11.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.073+0000 7fc0b6a00640 1 -- 172.21.15.153:0/4111251080 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a8036440 con 0x7fc0b815ad40 2024-03-28T21:52:11.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.073+0000 7fc0b6a00640 1 -- 172.21.15.153:0/4111251080 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8036810 con 0x7fc0b815ad40 2024-03-28T21:52:11.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.073+0000 7fc0bca00640 1 -- 172.21.15.153:0/4111251080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b815ad40 msgr2=0x7fc0b80b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.073+0000 7fc0bca00640 1 --2- 172.21.15.153:0/4111251080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b815ad40 0x7fc0b80b40f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80731e0 tx=0x7fc0a802e0e0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.073+0000 7fc0bca00640 1 -- 172.21.15.153:0/4111251080 shutdown_connections 2024-03-28T21:52:11.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.073+0000 7fc0bca00640 1 --2- 172.21.15.153:0/4111251080 >> v2:172.21.15.165:3300/0 conn(0x7fc0b806ebe0 0x7fc0b80b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.073+0000 7fc0bca00640 1 --2- 172.21.15.153:0/4111251080 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0b815b120 0x7fc0b806e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.073+0000 7fc0bca00640 1 --2- 172.21.15.153:0/4111251080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b815ad40 0x7fc0b80b40f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.073+0000 7fc0bca00640 1 -- 172.21.15.153:0/4111251080 >> 172.21.15.153:0/4111251080 conn(0x7fc0b80b1820 msgr2=0x7fc0b80b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:11.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.073+0000 7fc0bca00640 1 -- 172.21.15.153:0/4111251080 shutdown_connections 2024-03-28T21:52:11.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.073+0000 7fc0bca00640 1 -- 172.21.15.153:0/4111251080 wait complete. 2024-03-28T21:52:11.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.075+0000 7fc0bca00640 1 Processor -- start 2024-03-28T21:52:11.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.075+0000 7fc0bca00640 1 -- start start 2024-03-28T21:52:11.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0bca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0b806ebe0 0x7fc0b815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0bca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b815ad40 0x7fc0b815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0bca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0b815b120 0x7fc0b81543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0bca00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b80721c0 con 0x7fc0b815ad40 2024-03-28T21:52:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0bca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b8071f20 con 0x7fc0b806ebe0 2024-03-28T21:52:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0bca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b80724a0 con 0x7fc0b815b120 2024-03-28T21:52:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0afe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b815ad40 0x7fc0b815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0afe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b815ad40 0x7fc0b815b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45932/0 (socket says 172.21.15.153:45932) 2024-03-28T21:52:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0afe00640 1 -- 172.21.15.153:0/3597295637 learned_addr learned my addr 172.21.15.153:0/3597295637 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0b7e00640 1 --2- 172.21.15.153:0/3597295637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0b815b120 0x7fc0b81543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0afe00640 1 -- 172.21.15.153:0/3597295637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0b815b120 msgr2=0x7fc0b81543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0afe00640 1 --2- 172.21.15.153:0/3597295637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0b815b120 0x7fc0b81543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0b7400640 1 --2- 172.21.15.153:0/3597295637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0b806ebe0 0x7fc0b815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0afe00640 1 -- 172.21.15.153:0/3597295637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0b806ebe0 msgr2=0x7fc0b815dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0afe00640 1 --2- 172.21.15.153:0/3597295637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0b806ebe0 0x7fc0b815dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.077+0000 7fc0afe00640 1 -- 172.21.15.153:0/3597295637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b815bda0 con 0x7fc0b815ad40 2024-03-28T21:52:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.078+0000 7fc0afe00640 1 --2- 172.21.15.153:0/3597295637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b815ad40 0x7fc0b815b550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000c7f0 tx=0x7fc0a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:11.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.078+0000 7fc0af400640 1 -- 172.21.15.153:0/3597295637 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0015070 con 0x7fc0b815ad40 2024-03-28T21:52:11.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.078+0000 7fc0af400640 1 -- 172.21.15.153:0/3597295637 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a0007820 con 0x7fc0b815ad40 2024-03-28T21:52:11.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.078+0000 7fc0af400640 1 -- 172.21.15.153:0/3597295637 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0007bf0 con 0x7fc0b815ad40 2024-03-28T21:52:11.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.078+0000 7fc0bca00640 1 -- 172.21.15.153:0/3597295637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b815c080 con 0x7fc0b815ad40 2024-03-28T21:52:11.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.078+0000 7fc0bca00640 1 -- 172.21.15.153:0/3597295637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b815c640 con 0x7fc0b815ad40 2024-03-28T21:52:11.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.079+0000 7fc0bca00640 1 -- 172.21.15.153:0/3597295637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b8068ff0 con 0x7fc0b815ad40 2024-03-28T21:52:11.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.080+0000 7fc0af400640 1 -- 172.21.15.153:0/3597295637 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc0a0018070 con 0x7fc0b815ad40 2024-03-28T21:52:11.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.081+0000 7fc0af400640 1 --2- 172.21.15.153:0/3597295637 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc09406b4d0 0x7fc09406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.081+0000 7fc0af400640 1 -- 172.21.15.153:0/3597295637 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc0a008a360 con 0x7fc0b815ad40 2024-03-28T21:52:11.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.081+0000 7fc0b7400640 1 --2- 172.21.15.153:0/3597295637 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc09406b4d0 0x7fc09406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.082+0000 7fc0b7400640 1 --2- 172.21.15.153:0/3597295637 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc09406b4d0 0x7fc09406d990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8038000 tx=0x7fc0a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:11.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.086+0000 7fc0af400640 1 -- 172.21.15.153:0/3597295637 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc0a00591d0 con 0x7fc0b815ad40 2024-03-28T21:52:11.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.278+0000 7fc0bca00640 1 -- 172.21.15.153:0/3597295637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc0b806d110 con 0x7fc0b815ad40 2024-03-28T21:52:11.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.279+0000 7fc0af400640 1 -- 172.21.15.153:0/3597295637 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fc0a0058ad0 con 0x7fc0b815ad40 2024-03-28T21:52:11.280 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-28T21:52:11.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.281+0000 7fc0bca00640 1 -- 172.21.15.153:0/3597295637 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc09406b4d0 msgr2=0x7fc09406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.281+0000 7fc0bca00640 1 --2- 172.21.15.153:0/3597295637 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc09406b4d0 0x7fc09406d990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8038000 tx=0x7fc0a8008040 comp rx=0 tx=0).stop 2024-03-28T21:52:11.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.281+0000 7fc0bca00640 1 -- 172.21.15.153:0/3597295637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b815ad40 msgr2=0x7fc0b815b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.281+0000 7fc0bca00640 1 --2- 172.21.15.153:0/3597295637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b815ad40 0x7fc0b815b550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000c7f0 tx=0x7fc0a000ccb0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.281+0000 7fc0bca00640 1 -- 172.21.15.153:0/3597295637 shutdown_connections 2024-03-28T21:52:11.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.281+0000 7fc0bca00640 1 --2- 172.21.15.153:0/3597295637 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc09406b4d0 0x7fc09406d990 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.281+0000 7fc0bca00640 1 --2- 172.21.15.153:0/3597295637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0b815b120 0x7fc0b81543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.281+0000 7fc0bca00640 1 --2- 172.21.15.153:0/3597295637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0b815ad40 0x7fc0b815b550 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.281+0000 7fc0bca00640 1 --2- 172.21.15.153:0/3597295637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0b806ebe0 0x7fc0b815dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.281+0000 7fc0bca00640 1 -- 172.21.15.153:0/3597295637 >> 172.21.15.153:0/3597295637 conn(0x7fc0b80b1820 msgr2=0x7fc0b80b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:11.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.282+0000 7fc0bca00640 1 -- 172.21.15.153:0/3597295637 shutdown_connections 2024-03-28T21:52:11.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.282+0000 7fc0bca00640 1 -- 172.21.15.153:0/3597295637 wait complete. 2024-03-28T21:52:11.300 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T21:52:11.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.499+0000 7fdafbe00640 1 Processor -- start 2024-03-28T21:52:11.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.500+0000 7fdafbe00640 1 -- start start 2024-03-28T21:52:11.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.502+0000 7fdafbe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdafc1624a0 0x7fdafc06b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.502+0000 7fdafbe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdafc070450 con 0x7fdafc06e690 2024-03-28T21:52:11.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.502+0000 7fdafbe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdafc162930 con 0x7fdafc06b6b0 2024-03-28T21:52:11.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.502+0000 7fdafbe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdafc06bb00 con 0x7fdafc1624a0 2024-03-28T21:52:11.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.502+0000 7fdafaa00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fdafc06e690 0x7fdafc15e450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54714/0 (socket says 172.21.15.153:54714) 2024-03-28T21:52:11.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.502+0000 7fdafaa00640 1 -- 172.21.15.153:0/2358665413 learned_addr learned my addr 172.21.15.153:0/2358665413 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:11.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 -- 172.21.15.153:0/2358665413 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158424198 0 0) 0x7fdafc070450 con 0x7fdafc06e690 2024-03-28T21:52:11.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 -- 172.21.15.153:0/2358665413 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdae0003520 con 0x7fdafc06e690 2024-03-28T21:52:11.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdaf2000640 1 --2- 172.21.15.153:0/2358665413 >> v2:172.21.15.165:3300/0 conn(0x7fdafc1624a0 0x7fdafc06b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 -- 172.21.15.153:0/2358665413 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3364202933 0 0) 0x7fdae0003520 con 0x7fdafc06e690 2024-03-28T21:52:11.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 -- 172.21.15.153:0/2358665413 >> v2:172.21.15.165:3300/0 conn(0x7fdafc1624a0 msgr2=0x7fdafc06b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:11.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 --2- 172.21.15.153:0/2358665413 >> v2:172.21.15.165:3300/0 conn(0x7fdafc1624a0 0x7fdafc06b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 -- 172.21.15.153:0/2358665413 >> v1:172.21.15.165:6789/0 conn(0x7fdafc06b6b0 legacy=0x7fdafc0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 -- 172.21.15.153:0/2358665413 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdafc15efb0 con 0x7fdafc06e690 2024-03-28T21:52:11.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 -- 172.21.15.153:0/2358665413 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fdaec0019f0 con 0x7fdafc06e690 2024-03-28T21:52:11.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 -- 172.21.15.153:0/2358665413 >> v1:172.21.15.153:6789/0 conn(0x7fdafc06e690 legacy=0x7fdafc15e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 --2- 172.21.15.153:0/2358665413 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdae0003a00 0x7fdae0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 --2- 172.21.15.153:0/2358665413 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdae0004800 0x7fdae0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 --2- 172.21.15.153:0/2358665413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdae00052e0 0x7fdae000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 -- 172.21.15.153:0/2358665413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdafc06bb00 con 0x7fdae00052e0 2024-03-28T21:52:11.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 -- 172.21.15.153:0/2358665413 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdae000c200 con 0x7fdae0004800 2024-03-28T21:52:11.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.503+0000 7fdafa000640 1 -- 172.21.15.153:0/2358665413 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdae000c400 con 0x7fdae0003a00 2024-03-28T21:52:11.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.504+0000 7fdafb400640 1 --2- 172.21.15.153:0/2358665413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdae00052e0 0x7fdae000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.504+0000 7fdafaa00640 1 --2- 172.21.15.153:0/2358665413 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdae0003a00 0x7fdae0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.504+0000 7fdaf2000640 1 --2- 172.21.15.153:0/2358665413 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdae0004800 0x7fdae0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.504+0000 7fdafb400640 1 -- 172.21.15.153:0/2358665413 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdae0003a00 msgr2=0x7fdae0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:11.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.504+0000 7fdafb400640 1 --2- 172.21.15.153:0/2358665413 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdae0003a00 0x7fdae0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.504+0000 7fdafb400640 1 -- 172.21.15.153:0/2358665413 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdae0004800 msgr2=0x7fdae0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:11.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.504+0000 7fdafb400640 1 --2- 172.21.15.153:0/2358665413 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdae0004800 0x7fdae0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.504+0000 7fdafb400640 1 -- 172.21.15.153:0/2358665413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae0003520 con 0x7fdae00052e0 2024-03-28T21:52:11.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.504+0000 7fdafaa00640 1 --2- 172.21.15.153:0/2358665413 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdae0003a00 0x7fdae0003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:11.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.505+0000 7fdafb400640 1 -- 172.21.15.153:0/2358665413 reap_dead start 2024-03-28T21:52:11.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.505+0000 7fdafb400640 1 --2- 172.21.15.153:0/2358665413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdae00052e0 0x7fdae000b9c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4001750 tx=0x7fdae0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8934238159f8e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:11.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.505+0000 7fdafa000640 1 -- 172.21.15.153:0/2358665413 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4001370 con 0x7fdae00052e0 2024-03-28T21:52:11.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.506+0000 7fdafa000640 1 -- 172.21.15.153:0/2358665413 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf4005310 con 0x7fdae00052e0 2024-03-28T21:52:11.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.506+0000 7fdafa000640 1 -- 172.21.15.153:0/2358665413 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4003830 con 0x7fdae00052e0 2024-03-28T21:52:11.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.506+0000 7fdafbe00640 1 -- 172.21.15.153:0/2358665413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdae00052e0 msgr2=0x7fdae000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.506+0000 7fdafbe00640 1 --2- 172.21.15.153:0/2358665413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdae00052e0 0x7fdae000b9c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4001750 tx=0x7fdae0005830 comp rx=0 tx=0).stop 2024-03-28T21:52:11.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.506+0000 7fdafbe00640 1 -- 172.21.15.153:0/2358665413 shutdown_connections 2024-03-28T21:52:11.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.506+0000 7fdafbe00640 1 --2- 172.21.15.153:0/2358665413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdae00052e0 0x7fdae000b9c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.506+0000 7fdafbe00640 1 -- 172.21.15.153:0/2358665413 >> 172.21.15.153:0/2358665413 conn(0x7fdafc0b28a0 msgr2=0x7fdafc0b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:11.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.506+0000 7fdafbe00640 1 -- 172.21.15.153:0/2358665413 shutdown_connections 2024-03-28T21:52:11.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.506+0000 7fdafbe00640 1 -- 172.21.15.153:0/2358665413 wait complete. 2024-03-28T21:52:11.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.508+0000 7fdafbe00640 1 Processor -- start 2024-03-28T21:52:11.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.508+0000 7fdafbe00640 1 -- start start 2024-03-28T21:52:11.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.509+0000 7fdafbe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdae00052e0 0x7fdafc1f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.509+0000 7fdafbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdafc0b4af0 0x7fdafc0b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.509+0000 7fdafbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdafc0ae910 0x7fdafc0aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.509+0000 7fdafbe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdafc161f80 con 0x7fdafc0ae910 2024-03-28T21:52:11.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.509+0000 7fdafbe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdafc161ca0 con 0x7fdae00052e0 2024-03-28T21:52:11.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.509+0000 7fdafbe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdafc06ea70 con 0x7fdafc0b4af0 2024-03-28T21:52:11.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.509+0000 7fdafb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdafc0ae910 0x7fdafc0aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.509+0000 7fdafb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdafc0ae910 0x7fdafc0aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45952/0 (socket says 172.21.15.153:45952) 2024-03-28T21:52:11.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.509+0000 7fdafb400640 1 -- 172.21.15.153:0/3305766251 learned_addr learned my addr 172.21.15.153:0/3305766251 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:11.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.510+0000 7fdaf2000640 1 --2- 172.21.15.153:0/3305766251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdafc0b4af0 0x7fdafc0b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.510+0000 7fdafaa00640 1 --2- 172.21.15.153:0/3305766251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdae00052e0 0x7fdafc1f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.510+0000 7fdafb400640 1 -- 172.21.15.153:0/3305766251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdafc0b4af0 msgr2=0x7fdafc0b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.510+0000 7fdafb400640 1 --2- 172.21.15.153:0/3305766251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdafc0b4af0 0x7fdafc0b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.510+0000 7fdafb400640 1 -- 172.21.15.153:0/3305766251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdae00052e0 msgr2=0x7fdafc1f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.510+0000 7fdafb400640 1 --2- 172.21.15.153:0/3305766251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdae00052e0 0x7fdafc1f39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.510+0000 7fdafb400640 1 -- 172.21.15.153:0/3305766251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdafc1f40b0 con 0x7fdafc0ae910 2024-03-28T21:52:11.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.510+0000 7fdafb400640 1 --2- 172.21.15.153:0/3305766251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdafc0ae910 0x7fdafc0aed90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdaf402bd00 tx=0x7fdaf4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:11.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.510+0000 7fdaf3400640 1 -- 172.21.15.153:0/3305766251 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4001370 con 0x7fdafc0ae910 2024-03-28T21:52:11.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.510+0000 7fdaf3400640 1 -- 172.21.15.153:0/3305766251 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf4007240 con 0x7fdafc0ae910 2024-03-28T21:52:11.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.510+0000 7fdaf3400640 1 -- 172.21.15.153:0/3305766251 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4007a30 con 0x7fdafc0ae910 2024-03-28T21:52:11.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.510+0000 7fdafbe00640 1 -- 172.21.15.153:0/3305766251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdafc1f4390 con 0x7fdafc0ae910 2024-03-28T21:52:11.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.511+0000 7fdafbe00640 1 -- 172.21.15.153:0/3305766251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdafc1f4950 con 0x7fdafc0ae910 2024-03-28T21:52:11.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.512+0000 7fdafbe00640 1 -- 172.21.15.153:0/3305766251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdafc0681c0 con 0x7fdafc0ae910 2024-03-28T21:52:11.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.512+0000 7fdaf3400640 1 -- 172.21.15.153:0/3305766251 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fdaf4005310 con 0x7fdafc0ae910 2024-03-28T21:52:11.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.513+0000 7fdaf3400640 1 --2- 172.21.15.153:0/3305766251 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdad806b4d0 0x7fdad806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.513+0000 7fdaf3400640 1 -- 172.21.15.153:0/3305766251 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdaf403a020 con 0x7fdafc0ae910 2024-03-28T21:52:11.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.514+0000 7fdafaa00640 1 --2- 172.21.15.153:0/3305766251 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdad806b4d0 0x7fdad806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.514+0000 7fdafaa00640 1 --2- 172.21.15.153:0/3305766251 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdad806b4d0 0x7fdad806d990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdaec001af0 tx=0x7fdaec0012d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:11.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.518+0000 7fdaf3400640 1 -- 172.21.15.153:0/3305766251 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdaf40791c0 con 0x7fdafc0ae910 2024-03-28T21:52:11.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.714+0000 7fdafbe00640 1 -- 172.21.15.153:0/3305766251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdafc0d0960 con 0x7fdafc0ae910 2024-03-28T21:52:11.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.715+0000 7fdaf3400640 1 -- 172.21.15.153:0/3305766251 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fdaf407d260 con 0x7fdafc0ae910 2024-03-28T21:52:11.717 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-03-28T21:52:11.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.718+0000 7fdafbe00640 1 -- 172.21.15.153:0/3305766251 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdad806b4d0 msgr2=0x7fdad806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.718+0000 7fdafbe00640 1 --2- 172.21.15.153:0/3305766251 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdad806b4d0 0x7fdad806d990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdaec001af0 tx=0x7fdaec0012d0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.718+0000 7fdafbe00640 1 -- 172.21.15.153:0/3305766251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdafc0ae910 msgr2=0x7fdafc0aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.718+0000 7fdafbe00640 1 --2- 172.21.15.153:0/3305766251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdafc0ae910 0x7fdafc0aed90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdaf402bd00 tx=0x7fdaf4001120 comp rx=0 tx=0).stop 2024-03-28T21:52:11.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.718+0000 7fdafbe00640 1 -- 172.21.15.153:0/3305766251 shutdown_connections 2024-03-28T21:52:11.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.718+0000 7fdafbe00640 1 --2- 172.21.15.153:0/3305766251 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdad806b4d0 0x7fdad806d990 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.718+0000 7fdafbe00640 1 --2- 172.21.15.153:0/3305766251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdafc0ae910 0x7fdafc0aed90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.718+0000 7fdafbe00640 1 --2- 172.21.15.153:0/3305766251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdafc0b4af0 0x7fdafc0b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.718+0000 7fdafbe00640 1 --2- 172.21.15.153:0/3305766251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdae00052e0 0x7fdafc1f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.718+0000 7fdafbe00640 1 -- 172.21.15.153:0/3305766251 >> 172.21.15.153:0/3305766251 conn(0x7fdafc0b28a0 msgr2=0x7fdafc0b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:11.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.718+0000 7fdafbe00640 1 -- 172.21.15.153:0/3305766251 shutdown_connections 2024-03-28T21:52:11.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.718+0000 7fdafbe00640 1 -- 172.21.15.153:0/3305766251 wait complete. 2024-03-28T21:52:11.741 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T21:52:11.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.951+0000 7fe39cc00640 1 Processor -- start 2024-03-28T21:52:11.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.952+0000 7fe39cc00640 1 -- start start 2024-03-28T21:52:11.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.953+0000 7fe39cc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe398161a20 0x7fe3980d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.953+0000 7fe39cc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3980d1470 con 0x7fe3980cfd70 2024-03-28T21:52:11.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.953+0000 7fe39cc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3980b3320 con 0x7fe3980d1010 2024-03-28T21:52:11.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.953+0000 7fe39cc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe3980d2910 con 0x7fe398161a20 2024-03-28T21:52:11.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.953+0000 7fe396800640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe3980cfd70 0x7fe3980b47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54716/0 (socket says 172.21.15.153:54716) 2024-03-28T21:52:11.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.953+0000 7fe396800640 1 -- 172.21.15.153:0/2425237917 learned_addr learned my addr 172.21.15.153:0/2425237917 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:11.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.954+0000 7fe395e00640 1 --2- 172.21.15.153:0/2425237917 >> v2:172.21.15.165:3300/0 conn(0x7fe398161a20 0x7fe3980d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.954+0000 7fe395400640 1 -- 172.21.15.153:0/2425237917 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161049262 0 0) 0x7fe3980d1470 con 0x7fe3980cfd70 2024-03-28T21:52:11.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.954+0000 7fe395400640 1 -- 172.21.15.153:0/2425237917 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe37c003520 con 0x7fe3980cfd70 2024-03-28T21:52:11.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.954+0000 7fe395400640 1 -- 172.21.15.153:0/2425237917 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4070380372 0 0) 0x7fe37c003520 con 0x7fe3980cfd70 2024-03-28T21:52:11.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.954+0000 7fe395400640 1 -- 172.21.15.153:0/2425237917 >> v2:172.21.15.165:3300/0 conn(0x7fe398161a20 msgr2=0x7fe3980d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:11.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.954+0000 7fe395400640 1 --2- 172.21.15.153:0/2425237917 >> v2:172.21.15.165:3300/0 conn(0x7fe398161a20 0x7fe3980d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.954+0000 7fe395400640 1 -- 172.21.15.153:0/2425237917 >> v1:172.21.15.165:6789/0 conn(0x7fe3980d1010 legacy=0x7fe3980b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.954+0000 7fe395400640 1 -- 172.21.15.153:0/2425237917 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3980d2bf0 con 0x7fe3980cfd70 2024-03-28T21:52:11.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.954+0000 7fe395400640 1 -- 172.21.15.153:0/2425237917 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fe390001670 con 0x7fe3980cfd70 2024-03-28T21:52:11.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.954+0000 7fe395400640 1 -- 172.21.15.153:0/2425237917 >> v1:172.21.15.153:6789/0 conn(0x7fe3980cfd70 legacy=0x7fe3980b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.954+0000 7fe395400640 1 --2- 172.21.15.153:0/2425237917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe37c0039b0 0x7fe37c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.954+0000 7fe395400640 1 --2- 172.21.15.153:0/2425237917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe37c004800 0x7fe37c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.954+0000 7fe395400640 1 --2- 172.21.15.153:0/2425237917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe37c0051c0 0x7fe37c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.955+0000 7fe395400640 1 -- 172.21.15.153:0/2425237917 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe3980d2910 con 0x7fe37c0039b0 2024-03-28T21:52:11.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.955+0000 7fe395400640 1 -- 172.21.15.153:0/2425237917 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c00c160 con 0x7fe37c004800 2024-03-28T21:52:11.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.955+0000 7fe395400640 1 -- 172.21.15.153:0/2425237917 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe37c00c360 con 0x7fe37c0051c0 2024-03-28T21:52:11.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.955+0000 7fe395e00640 1 --2- 172.21.15.153:0/2425237917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe37c0039b0 0x7fe37c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.955+0000 7fe38d400640 1 --2- 172.21.15.153:0/2425237917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe37c004800 0x7fe37c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.955+0000 7fe395e00640 1 -- 172.21.15.153:0/2425237917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe37c0051c0 msgr2=0x7fe37c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:11.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.955+0000 7fe396800640 1 --2- 172.21.15.153:0/2425237917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe37c0051c0 0x7fe37c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.955+0000 7fe395e00640 1 --2- 172.21.15.153:0/2425237917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe37c0051c0 0x7fe37c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.955+0000 7fe395e00640 1 -- 172.21.15.153:0/2425237917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe37c004800 msgr2=0x7fe37c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:11.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.955+0000 7fe395e00640 1 --2- 172.21.15.153:0/2425237917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe37c004800 0x7fe37c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.955+0000 7fe395e00640 1 -- 172.21.15.153:0/2425237917 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37c003520 con 0x7fe37c0039b0 2024-03-28T21:52:11.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.955+0000 7fe38d400640 1 --2- 172.21.15.153:0/2425237917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe37c004800 0x7fe37c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:11.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.955+0000 7fe396800640 1 --2- 172.21.15.153:0/2425237917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe37c0051c0 0x7fe37c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:11.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.955+0000 7fe396800640 1 -- 172.21.15.153:0/2425237917 reap_dead start 2024-03-28T21:52:11.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.956+0000 7fe395e00640 1 --2- 172.21.15.153:0/2425237917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe37c0039b0 0x7fe37c003dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe388009fc0 tx=0x7fe37c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73d74fb8aa3e00f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:11.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.957+0000 7fe395400640 1 -- 172.21.15.153:0/2425237917 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388039070 con 0x7fe37c0039b0 2024-03-28T21:52:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.957+0000 7fe395400640 1 -- 172.21.15.153:0/2425237917 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38802cbf0 con 0x7fe37c0039b0 2024-03-28T21:52:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.957+0000 7fe395400640 1 -- 172.21.15.153:0/2425237917 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388009c10 con 0x7fe37c0039b0 2024-03-28T21:52:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.957+0000 7fe39cc00640 1 -- 172.21.15.153:0/2425237917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe37c0039b0 msgr2=0x7fe37c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.957+0000 7fe39cc00640 1 --2- 172.21.15.153:0/2425237917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe37c0039b0 0x7fe37c003dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe388009fc0 tx=0x7fe37c005830 comp rx=0 tx=0).stop 2024-03-28T21:52:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.957+0000 7fe39cc00640 1 -- 172.21.15.153:0/2425237917 shutdown_connections 2024-03-28T21:52:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.957+0000 7fe39cc00640 1 --2- 172.21.15.153:0/2425237917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe37c0039b0 0x7fe37c003dd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.957+0000 7fe39cc00640 1 -- 172.21.15.153:0/2425237917 >> 172.21.15.153:0/2425237917 conn(0x7fe39809d430 msgr2=0x7fe3980d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.957+0000 7fe39cc00640 1 -- 172.21.15.153:0/2425237917 shutdown_connections 2024-03-28T21:52:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.957+0000 7fe39cc00640 1 -- 172.21.15.153:0/2425237917 wait complete. 2024-03-28T21:52:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.959+0000 7fe39cc00640 1 Processor -- start 2024-03-28T21:52:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.959+0000 7fe39cc00640 1 -- start start 2024-03-28T21:52:11.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.960+0000 7fe39cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe37c0039b0 0x7fe3981f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.960+0000 7fe39cc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3980b9500 0x7fe39814f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.960+0000 7fe39cc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3980b5b80 0x7fe3980b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.960+0000 7fe39cc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe3980d31b0 con 0x7fe3980b5b80 2024-03-28T21:52:11.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.960+0000 7fe39cc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3980b3b90 con 0x7fe3980b9500 2024-03-28T21:52:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.960+0000 7fe39cc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe398161e00 con 0x7fe37c0039b0 2024-03-28T21:52:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.960+0000 7fe396800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3980b5b80 0x7fe3980b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.960+0000 7fe396800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3980b5b80 0x7fe3980b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45970/0 (socket says 172.21.15.153:45970) 2024-03-28T21:52:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.960+0000 7fe396800640 1 -- 172.21.15.153:0/2878307597 learned_addr learned my addr 172.21.15.153:0/2878307597 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.961+0000 7fe38d400640 1 --2- 172.21.15.153:0/2878307597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3980b9500 0x7fe39814f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.961+0000 7fe396800640 1 -- 172.21.15.153:0/2878307597 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe37c0039b0 msgr2=0x7fe3981f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.961+0000 7fe396800640 1 --2- 172.21.15.153:0/2878307597 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe37c0039b0 0x7fe3981f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.961+0000 7fe396800640 1 -- 172.21.15.153:0/2878307597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3980b9500 msgr2=0x7fe39814f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.961+0000 7fe396800640 1 --2- 172.21.15.153:0/2878307597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3980b9500 0x7fe39814f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.961+0000 7fe396800640 1 -- 172.21.15.153:0/2878307597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3981f7f10 con 0x7fe3980b5b80 2024-03-28T21:52:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.961+0000 7fe396800640 1 --2- 172.21.15.153:0/2878307597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3980b5b80 0x7fe3980b4c30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe390000ff0 tx=0x7fe39000d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.961+0000 7fe38ea00640 1 -- 172.21.15.153:0/2878307597 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390007440 con 0x7fe3980b5b80 2024-03-28T21:52:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.961+0000 7fe38ea00640 1 -- 172.21.15.153:0/2878307597 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe390007600 con 0x7fe3980b5b80 2024-03-28T21:52:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.961+0000 7fe39cc00640 1 -- 172.21.15.153:0/2878307597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3981f81f0 con 0x7fe3980b5b80 2024-03-28T21:52:11.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.961+0000 7fe38ea00640 1 -- 172.21.15.153:0/2878307597 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390004a20 con 0x7fe3980b5b80 2024-03-28T21:52:11.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.961+0000 7fe39cc00640 1 -- 172.21.15.153:0/2878307597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3981f87b0 con 0x7fe3980b5b80 2024-03-28T21:52:11.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.963+0000 7fe39cc00640 1 -- 172.21.15.153:0/2878307597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe398068ff0 con 0x7fe3980b5b80 2024-03-28T21:52:11.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.963+0000 7fe38ea00640 1 -- 172.21.15.153:0/2878307597 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe390004bc0 con 0x7fe3980b5b80 2024-03-28T21:52:11.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.965+0000 7fe38ea00640 1 --2- 172.21.15.153:0/2878307597 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe37406b500 0x7fe37406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:11.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.965+0000 7fe38ea00640 1 -- 172.21.15.153:0/2878307597 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe390089cd0 con 0x7fe3980b5b80 2024-03-28T21:52:11.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.965+0000 7fe395e00640 1 --2- 172.21.15.153:0/2878307597 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe37406b500 0x7fe37406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:11.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.966+0000 7fe395e00640 1 --2- 172.21.15.153:0/2878307597 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe37406b500 0x7fe37406d9c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe388036000 tx=0x7fe38802e070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:11.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:11.969+0000 7fe38ea00640 1 -- 172.21.15.153:0/2878307597 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe390058ab0 con 0x7fe3980b5b80 2024-03-28T21:52:12.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.187+0000 7fe39cc00640 1 -- 172.21.15.153:0/2878307597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe3980b4710 con 0x7fe3980b5b80 2024-03-28T21:52:12.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.188+0000 7fe38ea00640 1 -- 172.21.15.153:0/2878307597 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fe3900583b0 con 0x7fe3980b5b80 2024-03-28T21:52:12.189 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-03-28T21:52:12.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.191+0000 7fe39cc00640 1 -- 172.21.15.153:0/2878307597 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe37406b500 msgr2=0x7fe37406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:12.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.191+0000 7fe39cc00640 1 --2- 172.21.15.153:0/2878307597 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe37406b500 0x7fe37406d9c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe388036000 tx=0x7fe38802e070 comp rx=0 tx=0).stop 2024-03-28T21:52:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.191+0000 7fe39cc00640 1 -- 172.21.15.153:0/2878307597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3980b5b80 msgr2=0x7fe3980b4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.191+0000 7fe39cc00640 1 --2- 172.21.15.153:0/2878307597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3980b5b80 0x7fe3980b4c30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe390000ff0 tx=0x7fe39000d880 comp rx=0 tx=0).stop 2024-03-28T21:52:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.191+0000 7fe39cc00640 1 -- 172.21.15.153:0/2878307597 shutdown_connections 2024-03-28T21:52:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.191+0000 7fe39cc00640 1 --2- 172.21.15.153:0/2878307597 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe37406b500 0x7fe37406d9c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.191+0000 7fe39cc00640 1 --2- 172.21.15.153:0/2878307597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3980b5b80 0x7fe3980b4c30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.191+0000 7fe39cc00640 1 --2- 172.21.15.153:0/2878307597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3980b9500 0x7fe39814f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.191+0000 7fe39cc00640 1 --2- 172.21.15.153:0/2878307597 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe37c0039b0 0x7fe3981f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.191+0000 7fe39cc00640 1 -- 172.21.15.153:0/2878307597 >> 172.21.15.153:0/2878307597 conn(0x7fe39809d430 msgr2=0x7fe3980b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.191+0000 7fe39cc00640 1 -- 172.21.15.153:0/2878307597 shutdown_connections 2024-03-28T21:52:12.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.191+0000 7fe39cc00640 1 -- 172.21.15.153:0/2878307597 wait complete. 2024-03-28T21:52:12.220 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T21:52:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.428+0000 7fb088a00640 1 Processor -- start 2024-03-28T21:52:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.428+0000 7fb088a00640 1 -- start start 2024-03-28T21:52:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.430+0000 7fb088a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb08415e600 0x7fb0840ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.430+0000 7fb088a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb0840d2a20 0x7fb0840cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.430+0000 7fb088a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0840cf6c0 0x7fb084161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.430+0000 7fb088a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb0840d1720 con 0x7fb08415e600 2024-03-28T21:52:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.430+0000 7fb088a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb0840cff80 con 0x7fb0840d2a20 2024-03-28T21:52:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.430+0000 7fb088a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb0840d1950 con 0x7fb0840cf6c0 2024-03-28T21:52:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.430+0000 7fb081e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb08415e600 0x7fb0840ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.430+0000 7fb081e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb08415e600 0x7fb0840ce6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45984/0 (socket says 172.21.15.153:45984) 2024-03-28T21:52:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.430+0000 7fb081e00640 1 -- 172.21.15.153:0/440082872 learned_addr learned my addr 172.21.15.153:0/440082872 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.431+0000 7fb081400640 1 --2- 172.21.15.153:0/440082872 >> v2:172.21.15.165:3300/0 conn(0x7fb0840d2a20 0x7fb0840cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.431+0000 7fb082800640 1 --2- 172.21.15.153:0/440082872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0840cf6c0 0x7fb084161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.431+0000 7fb081e00640 1 -- 172.21.15.153:0/440082872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0840cf6c0 msgr2=0x7fb084161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.431+0000 7fb081e00640 1 --2- 172.21.15.153:0/440082872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0840cf6c0 0x7fb084161fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.431+0000 7fb081e00640 1 -- 172.21.15.153:0/440082872 >> v2:172.21.15.165:3300/0 conn(0x7fb0840d2a20 msgr2=0x7fb0840cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.431+0000 7fb081e00640 1 --2- 172.21.15.153:0/440082872 >> v2:172.21.15.165:3300/0 conn(0x7fb0840d2a20 0x7fb0840cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.431+0000 7fb081e00640 1 -- 172.21.15.153:0/440082872 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0840b2410 con 0x7fb08415e600 2024-03-28T21:52:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.431+0000 7fb081400640 1 --2- 172.21.15.153:0/440082872 >> v2:172.21.15.165:3300/0 conn(0x7fb0840d2a20 0x7fb0840cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:12.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.432+0000 7fb081e00640 1 --2- 172.21.15.153:0/440082872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08415e600 0x7fb0840ce6a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb0840cfc30 tx=0x7fb07402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51cc136b13217ee server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:12.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.433+0000 7fb080a00640 1 -- 172.21.15.153:0/440082872 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074038070 con 0x7fb08415e600 2024-03-28T21:52:12.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.433+0000 7fb080a00640 1 -- 172.21.15.153:0/440082872 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb07402f050 con 0x7fb08415e600 2024-03-28T21:52:12.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.433+0000 7fb080a00640 1 -- 172.21.15.153:0/440082872 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074031970 con 0x7fb08415e600 2024-03-28T21:52:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.434+0000 7fb088a00640 1 -- 172.21.15.153:0/440082872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08415e600 msgr2=0x7fb0840ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.434+0000 7fb088a00640 1 --2- 172.21.15.153:0/440082872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08415e600 0x7fb0840ce6a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb0840cfc30 tx=0x7fb07402b7f0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.434+0000 7fb088a00640 1 -- 172.21.15.153:0/440082872 shutdown_connections 2024-03-28T21:52:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.434+0000 7fb088a00640 1 --2- 172.21.15.153:0/440082872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0840cf6c0 0x7fb084161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.434+0000 7fb088a00640 1 --2- 172.21.15.153:0/440082872 >> v2:172.21.15.165:3300/0 conn(0x7fb0840d2a20 0x7fb0840cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.434+0000 7fb088a00640 1 --2- 172.21.15.153:0/440082872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08415e600 0x7fb0840ce6a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.434+0000 7fb088a00640 1 -- 172.21.15.153:0/440082872 >> 172.21.15.153:0/440082872 conn(0x7fb0840d1f00 msgr2=0x7fb0840d2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.434+0000 7fb088a00640 1 -- 172.21.15.153:0/440082872 shutdown_connections 2024-03-28T21:52:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.434+0000 7fb088a00640 1 -- 172.21.15.153:0/440082872 wait complete. 2024-03-28T21:52:12.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.435+0000 7fb088a00640 1 Processor -- start 2024-03-28T21:52:12.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.436+0000 7fb088a00640 1 -- start start 2024-03-28T21:52:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.436+0000 7fb088a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0840cf6c0 0x7fb0840b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb088a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0840d2a20 0x7fb084159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb088a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb08415e600 0x7fb08415e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb088a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb08406c280 con 0x7fb0840d2a20 2024-03-28T21:52:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb088a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb0840cf240 con 0x7fb0840cf6c0 2024-03-28T21:52:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb088a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb0840d1c30 con 0x7fb08415e600 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb081400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0840d2a20 0x7fb084159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb081400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0840d2a20 0x7fb084159ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45998/0 (socket says 172.21.15.153:45998) 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb081400640 1 -- 172.21.15.153:0/1894765204 learned_addr learned my addr 172.21.15.153:0/1894765204 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb081e00640 1 --2- 172.21.15.153:0/1894765204 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0840cf6c0 0x7fb0840b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb081400640 1 -- 172.21.15.153:0/1894765204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb08415e600 msgr2=0x7fb08415e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb082800640 1 --2- 172.21.15.153:0/1894765204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb08415e600 0x7fb08415e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb081400640 1 --2- 172.21.15.153:0/1894765204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb08415e600 0x7fb08415e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb081400640 1 -- 172.21.15.153:0/1894765204 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0840cf6c0 msgr2=0x7fb0840b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb081400640 1 --2- 172.21.15.153:0/1894765204 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0840cf6c0 0x7fb0840b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb081400640 1 -- 172.21.15.153:0/1894765204 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0840b64f0 con 0x7fb0840d2a20 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.437+0000 7fb081400640 1 --2- 172.21.15.153:0/1894765204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0840d2a20 0x7fb084159ae0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb07000c7f0 tx=0x7fb07000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.438+0000 7fb07a000640 1 -- 172.21.15.153:0/1894765204 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb070015070 con 0x7fb0840d2a20 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.438+0000 7fb07a000640 1 -- 172.21.15.153:0/1894765204 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb070007a30 con 0x7fb0840d2a20 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.438+0000 7fb088a00640 1 -- 172.21.15.153:0/1894765204 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0840cd8e0 con 0x7fb0840d2a20 2024-03-28T21:52:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.438+0000 7fb07a000640 1 -- 172.21.15.153:0/1894765204 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb070007e00 con 0x7fb0840d2a20 2024-03-28T21:52:12.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.438+0000 7fb088a00640 1 -- 172.21.15.153:0/1894765204 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0840cdb80 con 0x7fb0840d2a20 2024-03-28T21:52:12.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.439+0000 7fb088a00640 1 -- 172.21.15.153:0/1894765204 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb084068ff0 con 0x7fb0840d2a20 2024-03-28T21:52:12.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.440+0000 7fb07a000640 1 -- 172.21.15.153:0/1894765204 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb070018070 con 0x7fb0840d2a20 2024-03-28T21:52:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.441+0000 7fb07a000640 1 --2- 172.21.15.153:0/1894765204 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb06406b500 0x7fb06406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.442+0000 7fb07a000640 1 -- 172.21.15.153:0/1894765204 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb07008a160 con 0x7fb0840d2a20 2024-03-28T21:52:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.442+0000 7fb081e00640 1 --2- 172.21.15.153:0/1894765204 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb06406b500 0x7fb06406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.442+0000 7fb081e00640 1 --2- 172.21.15.153:0/1894765204 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb06406b500 0x7fb06406d9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb074035000 tx=0x7fb074008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:12.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.445+0000 7fb07a000640 1 -- 172.21.15.153:0/1894765204 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb0840b64f0 con 0x7fb0840d2a20 2024-03-28T21:52:12.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.685+0000 7fb088a00640 1 -- 172.21.15.153:0/1894765204 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb084074e10 con 0x7fb0840d2a20 2024-03-28T21:52:12.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.686+0000 7fb07a000640 1 -- 172.21.15.153:0/1894765204 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fb070058fd0 con 0x7fb0840d2a20 2024-03-28T21:52:12.687 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:12.687 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/207550071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":207550071},{"type":"v1","addr":"172.21.15.165:6835","nonce":207550071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/900073633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":900073633},{"type":"v1","addr":"172.21.15.153:6837","nonce":900073633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3915706377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3915706377},{"type":"v1","addr":"172.21.15.165:6833","nonce":3915706377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T21:51:56.169625+0000","modified":"2024-03-28T21:51:59.218861+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6836/3516257974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3516257974},{"type":"v1","addr":"172.21.15.153:6836","nonce":3516257974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-03-28T21:52:12.688 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2024-03-28T21:52:12.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.689+0000 7fb088a00640 1 -- 172.21.15.153:0/1894765204 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb06406b500 msgr2=0x7fb06406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:12.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.689+0000 7fb088a00640 1 --2- 172.21.15.153:0/1894765204 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb06406b500 0x7fb06406d9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb074035000 tx=0x7fb074008030 comp rx=0 tx=0).stop 2024-03-28T21:52:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.689+0000 7fb088a00640 1 -- 172.21.15.153:0/1894765204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0840d2a20 msgr2=0x7fb084159ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.689+0000 7fb088a00640 1 --2- 172.21.15.153:0/1894765204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0840d2a20 0x7fb084159ae0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb07000c7f0 tx=0x7fb07000cbf0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.689+0000 7fb088a00640 1 -- 172.21.15.153:0/1894765204 shutdown_connections 2024-03-28T21:52:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.689+0000 7fb088a00640 1 --2- 172.21.15.153:0/1894765204 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb06406b500 0x7fb06406d9c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.689+0000 7fb088a00640 1 --2- 172.21.15.153:0/1894765204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb08415e600 0x7fb08415e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.689+0000 7fb088a00640 1 --2- 172.21.15.153:0/1894765204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0840d2a20 0x7fb084159ae0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.689+0000 7fb088a00640 1 --2- 172.21.15.153:0/1894765204 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0840cf6c0 0x7fb0840b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.689+0000 7fb088a00640 1 -- 172.21.15.153:0/1894765204 >> 172.21.15.153:0/1894765204 conn(0x7fb0840d1f00 msgr2=0x7fb084161cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.689+0000 7fb088a00640 1 -- 172.21.15.153:0/1894765204 shutdown_connections 2024-03-28T21:52:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.689+0000 7fb088a00640 1 -- 172.21.15.153:0/1894765204 wait complete. 2024-03-28T21:52:12.709 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.913+0000 7f7b26800640 1 Processor -- start 2024-03-28T21:52:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.914+0000 7f7b26800640 1 -- start start 2024-03-28T21:52:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.915+0000 7f7b26800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7b20159a10 0x7f7b2015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.915+0000 7f7b26800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b2006e440 0x7f7b200b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.915+0000 7f7b26800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b200b2e60 con 0x7f7b200ad830 2024-03-28T21:52:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.915+0000 7f7b26800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7b200adc70 con 0x7f7b2006e440 2024-03-28T21:52:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.915+0000 7f7b26800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7b20159df0 con 0x7f7b20159a10 2024-03-28T21:52:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.916+0000 7f7b1fe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b2006e440 0x7f7b200b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.916+0000 7f7b16a00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7b200ad830 0x7f7b2006dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54732/0 (socket says 172.21.15.153:54732) 2024-03-28T21:52:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.916+0000 7f7b16a00640 1 -- 172.21.15.153:0/3390178307 learned_addr learned my addr 172.21.15.153:0/3390178307 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.916+0000 7f7b1f400640 1 --2- 172.21.15.153:0/3390178307 >> v2:172.21.15.165:3300/0 conn(0x7f7b20159a10 0x7f7b2015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.916+0000 7f7b1fe00640 1 -- 172.21.15.153:0/3390178307 >> v2:172.21.15.165:3300/0 conn(0x7f7b20159a10 msgr2=0x7f7b2015cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.916+0000 7f7b1fe00640 1 --2- 172.21.15.153:0/3390178307 >> v2:172.21.15.165:3300/0 conn(0x7f7b20159a10 0x7f7b2015cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.916+0000 7f7b1fe00640 1 -- 172.21.15.153:0/3390178307 >> v1:172.21.15.153:6789/0 conn(0x7f7b200ad830 legacy=0x7f7b2006dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.916+0000 7f7b1ea00640 1 -- 172.21.15.153:0/3390178307 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3040474148 0 0) 0x7f7b200b2e60 con 0x7f7b200ad830 2024-03-28T21:52:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.916+0000 7f7b1fe00640 1 -- 172.21.15.153:0/3390178307 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b200adf10 con 0x7f7b2006e440 2024-03-28T21:52:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.918+0000 7f7b1fe00640 1 --2- 172.21.15.153:0/3390178307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b2006e440 0x7f7b200b3620 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7b200b2640 tx=0x7f7b1802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716901e00451e753 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.918+0000 7f7b1ea00640 1 -- 172.21.15.153:0/3390178307 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18039070 con 0x7f7b2006e440 2024-03-28T21:52:12.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.918+0000 7f7b1ea00640 1 -- 172.21.15.153:0/3390178307 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1802cbf0 con 0x7f7b2006e440 2024-03-28T21:52:12.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.918+0000 7f7b1ea00640 1 -- 172.21.15.153:0/3390178307 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18034440 con 0x7f7b2006e440 2024-03-28T21:52:12.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.919+0000 7f7b26800640 1 -- 172.21.15.153:0/3390178307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b2006e440 msgr2=0x7f7b200b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:12.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.919+0000 7f7b26800640 1 --2- 172.21.15.153:0/3390178307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b2006e440 0x7f7b200b3620 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7b200b2640 tx=0x7f7b1802be40 comp rx=0 tx=0).stop 2024-03-28T21:52:12.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.919+0000 7f7b26800640 1 -- 172.21.15.153:0/3390178307 shutdown_connections 2024-03-28T21:52:12.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.919+0000 7f7b26800640 1 --2- 172.21.15.153:0/3390178307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b2006e440 0x7f7b200b3620 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.919+0000 7f7b26800640 1 --2- 172.21.15.153:0/3390178307 >> v2:172.21.15.165:3300/0 conn(0x7f7b20159a10 0x7f7b2015cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.919+0000 7f7b26800640 1 -- 172.21.15.153:0/3390178307 >> 172.21.15.153:0/3390178307 conn(0x7f7b200b1a30 msgr2=0x7f7b200b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:12.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.919+0000 7f7b26800640 1 -- 172.21.15.153:0/3390178307 shutdown_connections 2024-03-28T21:52:12.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.919+0000 7f7b26800640 1 -- 172.21.15.153:0/3390178307 wait complete. 2024-03-28T21:52:12.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.921+0000 7f7b26800640 1 Processor -- start 2024-03-28T21:52:12.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.921+0000 7f7b26800640 1 -- start start 2024-03-28T21:52:12.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b26800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b2006e440 0x7f7b200cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:12.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b26800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b200ad830 0x7f7b20157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:12.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b26800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b20159a10 0x7f7b20150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:12.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b26800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b200ae4d0 con 0x7f7b200ad830 2024-03-28T21:52:12.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b26800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7b200b3100 con 0x7f7b20159a10 2024-03-28T21:52:12.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b26800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7b200b3b60 con 0x7f7b2006e440 2024-03-28T21:52:12.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b16a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b200ad830 0x7f7b20157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:12.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b16a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b200ad830 0x7f7b20157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46024/0 (socket says 172.21.15.153:46024) 2024-03-28T21:52:12.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b16a00640 1 -- 172.21.15.153:0/3538384601 learned_addr learned my addr 172.21.15.153:0/3538384601 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:12.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b1f400640 1 --2- 172.21.15.153:0/3538384601 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b2006e440 0x7f7b200cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:12.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b16a00640 1 -- 172.21.15.153:0/3538384601 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b2006e440 msgr2=0x7f7b200cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:12.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b16a00640 1 --2- 172.21.15.153:0/3538384601 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b2006e440 0x7f7b200cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b16a00640 1 -- 172.21.15.153:0/3538384601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b20159a10 msgr2=0x7f7b20150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:12.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b16a00640 1 --2- 172.21.15.153:0/3538384601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b20159a10 0x7f7b20150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:12.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.922+0000 7f7b16a00640 1 -- 172.21.15.153:0/3538384601 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b20150f40 con 0x7f7b200ad830 2024-03-28T21:52:12.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.923+0000 7f7b16a00640 1 --2- 172.21.15.153:0/3538384601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b200ad830 0x7f7b20157000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000c4d0 tx=0x7f7b1000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:12.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.923+0000 7f7b17e00640 1 -- 172.21.15.153:0/3538384601 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10017070 con 0x7f7b200ad830 2024-03-28T21:52:12.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.923+0000 7f7b17e00640 1 -- 172.21.15.153:0/3538384601 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b10005d00 con 0x7f7b200ad830 2024-03-28T21:52:12.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.923+0000 7f7b26800640 1 -- 172.21.15.153:0/3538384601 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b20157690 con 0x7f7b200ad830 2024-03-28T21:52:12.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.923+0000 7f7b17e00640 1 -- 172.21.15.153:0/3538384601 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b100072b0 con 0x7f7b200ad830 2024-03-28T21:52:12.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.923+0000 7f7b26800640 1 -- 172.21.15.153:0/3538384601 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b20157c50 con 0x7f7b200ad830 2024-03-28T21:52:12.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.924+0000 7f7b26800640 1 -- 172.21.15.153:0/3538384601 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b20068ff0 con 0x7f7b200ad830 2024-03-28T21:52:12.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.925+0000 7f7b17e00640 1 -- 172.21.15.153:0/3538384601 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f7b1001a070 con 0x7f7b200ad830 2024-03-28T21:52:12.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.927+0000 7f7b17e00640 1 --2- 172.21.15.153:0/3538384601 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7afc06b4d0 0x7f7afc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:12.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.927+0000 7f7b17e00640 1 -- 172.21.15.153:0/3538384601 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7b10089540 con 0x7f7b200ad830 2024-03-28T21:52:12.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.927+0000 7f7b1f400640 1 --2- 172.21.15.153:0/3538384601 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7afc06b4d0 0x7f7afc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:12.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.928+0000 7f7b1f400640 1 --2- 172.21.15.153:0/3538384601 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7afc06b4d0 0x7f7afc06d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b08009970 tx=0x7f7b08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:12.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:12.931+0000 7f7b17e00640 1 -- 172.21.15.153:0/3538384601 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7b20150f40 con 0x7f7b200ad830 2024-03-28T21:52:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.127+0000 7f7b26800640 1 -- 172.21.15.153:0/3538384601 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b200b0240 con 0x7f7b200ad830 2024-03-28T21:52:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.129+0000 7f7b17e00640 1 -- 172.21.15.153:0/3538384601 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f7b10058450 con 0x7f7b200ad830 2024-03-28T21:52:13.130 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:13.130 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:57.716531+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.131+0000 7f7b26800640 1 -- 172.21.15.153:0/3538384601 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7afc06b4d0 msgr2=0x7f7afc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.131+0000 7f7b26800640 1 --2- 172.21.15.153:0/3538384601 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7afc06b4d0 0x7f7afc06d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b08009970 tx=0x7f7b08008040 comp rx=0 tx=0).stop 2024-03-28T21:52:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.131+0000 7f7b26800640 1 -- 172.21.15.153:0/3538384601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b200ad830 msgr2=0x7f7b20157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.131+0000 7f7b26800640 1 --2- 172.21.15.153:0/3538384601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b200ad830 0x7f7b20157000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000c4d0 tx=0x7f7b1000c990 comp rx=0 tx=0).stop 2024-03-28T21:52:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.131+0000 7f7b26800640 1 -- 172.21.15.153:0/3538384601 shutdown_connections 2024-03-28T21:52:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.131+0000 7f7b26800640 1 --2- 172.21.15.153:0/3538384601 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7afc06b4d0 0x7f7afc06d990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.131+0000 7f7b26800640 1 --2- 172.21.15.153:0/3538384601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b20159a10 0x7f7b20150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.131+0000 7f7b26800640 1 --2- 172.21.15.153:0/3538384601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b200ad830 0x7f7b20157000 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.131+0000 7f7b26800640 1 --2- 172.21.15.153:0/3538384601 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b2006e440 0x7f7b200cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.131+0000 7f7b26800640 1 -- 172.21.15.153:0/3538384601 >> 172.21.15.153:0/3538384601 conn(0x7f7b200b1a30 msgr2=0x7f7b2015cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.131+0000 7f7b26800640 1 -- 172.21.15.153:0/3538384601 shutdown_connections 2024-03-28T21:52:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.132+0000 7f7b26800640 1 -- 172.21.15.153:0/3538384601 wait complete. 2024-03-28T21:52:13.153 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T21:52:13.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.352+0000 7fbe9a800640 1 Processor -- start 2024-03-28T21:52:13.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.352+0000 7fbe9a800640 1 -- start start 2024-03-28T21:52:13.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.353+0000 7fbe9a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe94159a10 0x7fbe9415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:13.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.353+0000 7fbe9a800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe940b2e60 con 0x7fbe940ad830 2024-03-28T21:52:13.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.354+0000 7fbe9a800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe940adc70 con 0x7fbe9406e440 2024-03-28T21:52:13.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.354+0000 7fbe9a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe94159df0 con 0x7fbe94159a10 2024-03-28T21:52:13.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.354+0000 7fbe8aa00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbe940ad830 0x7fbe9406dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60298/0 (socket says 172.21.15.153:60298) 2024-03-28T21:52:13.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.354+0000 7fbe8aa00640 1 -- 172.21.15.153:0/357179075 learned_addr learned my addr 172.21.15.153:0/357179075 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:13.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.354+0000 7fbe93400640 1 --2- 172.21.15.153:0/357179075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe94159a10 0x7fbe9415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:13.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.354+0000 7fbe92a00640 1 -- 172.21.15.153:0/357179075 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525472789 0 0) 0x7fbe940b2e60 con 0x7fbe940ad830 2024-03-28T21:52:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.354+0000 7fbe92a00640 1 -- 172.21.15.153:0/357179075 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe78003520 con 0x7fbe940ad830 2024-03-28T21:52:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.355+0000 7fbe92a00640 1 -- 172.21.15.153:0/357179075 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1615276403 0 0) 0x7fbe78003520 con 0x7fbe940ad830 2024-03-28T21:52:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.355+0000 7fbe92a00640 1 -- 172.21.15.153:0/357179075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe94159a10 msgr2=0x7fbe9415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.355+0000 7fbe92a00640 1 --2- 172.21.15.153:0/357179075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe94159a10 0x7fbe9415cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.355+0000 7fbe92a00640 1 -- 172.21.15.153:0/357179075 >> v1:172.21.15.165:6789/0 conn(0x7fbe9406e440 legacy=0x7fbe940b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.355+0000 7fbe92a00640 1 -- 172.21.15.153:0/357179075 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe940adf10 con 0x7fbe940ad830 2024-03-28T21:52:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.355+0000 7fbe92a00640 1 -- 172.21.15.153:0/357179075 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fbe7c001690 con 0x7fbe940ad830 2024-03-28T21:52:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.355+0000 7fbe92a00640 1 -- 172.21.15.153:0/357179075 >> v1:172.21.15.153:6789/0 conn(0x7fbe940ad830 legacy=0x7fbe9406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.355+0000 7fbe92a00640 1 --2- 172.21.15.153:0/357179075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe780039e0 0x7fbe78003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.355+0000 7fbe92a00640 1 --2- 172.21.15.153:0/357179075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe78004800 0x7fbe78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.355+0000 7fbe92a00640 1 --2- 172.21.15.153:0/357179075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe94159a10 0x7fbe78005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.355+0000 7fbe92a00640 1 -- 172.21.15.153:0/357179075 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94159df0 con 0x7fbe780039e0 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.355+0000 7fbe92a00640 1 -- 172.21.15.153:0/357179075 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7800bb50 con 0x7fbe78004800 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.355+0000 7fbe92a00640 1 -- 172.21.15.153:0/357179075 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe7800bd50 con 0x7fbe94159a10 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.355+0000 7fbe93400640 1 --2- 172.21.15.153:0/357179075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe780039e0 0x7fbe78003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.356+0000 7fbe93400640 1 -- 172.21.15.153:0/357179075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe94159a10 msgr2=0x7fbe78005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.356+0000 7fbe93e00640 1 --2- 172.21.15.153:0/357179075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe94159a10 0x7fbe78005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.356+0000 7fbe8aa00640 1 --2- 172.21.15.153:0/357179075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe78004800 0x7fbe78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.356+0000 7fbe93400640 1 --2- 172.21.15.153:0/357179075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe94159a10 0x7fbe78005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.356+0000 7fbe93400640 1 -- 172.21.15.153:0/357179075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe78004800 msgr2=0x7fbe78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.356+0000 7fbe93400640 1 --2- 172.21.15.153:0/357179075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe78004800 0x7fbe78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.356+0000 7fbe93400640 1 -- 172.21.15.153:0/357179075 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe78003520 con 0x7fbe780039e0 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.356+0000 7fbe93e00640 1 --2- 172.21.15.153:0/357179075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe94159a10 0x7fbe78005270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.356+0000 7fbe8aa00640 1 --2- 172.21.15.153:0/357179075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe78004800 0x7fbe78004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:13.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.357+0000 7fbe93400640 1 --2- 172.21.15.153:0/357179075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe780039e0 0x7fbe78003e00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009ac0 tx=0x7fbe78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b76b207ed6a4e9b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:13.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.357+0000 7fbe92a00640 1 -- 172.21.15.153:0/357179075 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84039070 con 0x7fbe780039e0 2024-03-28T21:52:13.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.357+0000 7fbe92a00640 1 -- 172.21.15.153:0/357179075 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8402c6b0 con 0x7fbe780039e0 2024-03-28T21:52:13.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.357+0000 7fbe92a00640 1 -- 172.21.15.153:0/357179075 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84009690 con 0x7fbe780039e0 2024-03-28T21:52:13.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.358+0000 7fbe9a800640 1 -- 172.21.15.153:0/357179075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe780039e0 msgr2=0x7fbe78003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:13.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.358+0000 7fbe9a800640 1 --2- 172.21.15.153:0/357179075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe780039e0 0x7fbe78003e00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009ac0 tx=0x7fbe78005830 comp rx=0 tx=0).stop 2024-03-28T21:52:13.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.358+0000 7fbe93e00640 1 -- 172.21.15.153:0/357179075 reap_dead start 2024-03-28T21:52:13.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.358+0000 7fbe9a800640 1 -- 172.21.15.153:0/357179075 shutdown_connections 2024-03-28T21:52:13.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.358+0000 7fbe9a800640 1 -- 172.21.15.153:0/357179075 >> 172.21.15.153:0/357179075 conn(0x7fbe940b1a30 msgr2=0x7fbe940b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:13.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.358+0000 7fbe9a800640 1 -- 172.21.15.153:0/357179075 shutdown_connections 2024-03-28T21:52:13.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.358+0000 7fbe9a800640 1 -- 172.21.15.153:0/357179075 wait complete. 2024-03-28T21:52:13.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.359+0000 7fbe9a800640 1 Processor -- start 2024-03-28T21:52:13.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.360+0000 7fbe9a800640 1 -- start start 2024-03-28T21:52:13.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.360+0000 7fbe9a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe780039e0 0x7fbe9409d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:13.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.360+0000 7fbe9a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe9409be00 0x7fbe94146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:13.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.360+0000 7fbe9a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe940c90b0 0x7fbe940af800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:13.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.360+0000 7fbe9a800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe940ae4d0 con 0x7fbe780039e0 2024-03-28T21:52:13.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.360+0000 7fbe9a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbe940b3100 con 0x7fbe9409be00 2024-03-28T21:52:13.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.360+0000 7fbe9a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9415cf00 con 0x7fbe940c90b0 2024-03-28T21:52:13.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.361+0000 7fbe93400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe780039e0 0x7fbe9409d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:13.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.361+0000 7fbe93400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe780039e0 0x7fbe9409d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47406/0 (socket says 172.21.15.153:47406) 2024-03-28T21:52:13.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.361+0000 7fbe93400640 1 -- 172.21.15.153:0/1101803005 learned_addr learned my addr 172.21.15.153:0/1101803005 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:13.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.361+0000 7fbe93e00640 1 --2- 172.21.15.153:0/1101803005 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe940c90b0 0x7fbe940af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:13.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.361+0000 7fbe93400640 1 -- 172.21.15.153:0/1101803005 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe940c90b0 msgr2=0x7fbe940af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:13.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.361+0000 7fbe93400640 1 --2- 172.21.15.153:0/1101803005 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe940c90b0 0x7fbe940af800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:13.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.361+0000 7fbe8aa00640 1 --2- 172.21.15.153:0/1101803005 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe9409be00 0x7fbe94146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:13.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.361+0000 7fbe93400640 1 -- 172.21.15.153:0/1101803005 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe9409be00 msgr2=0x7fbe94146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:13.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.361+0000 7fbe93400640 1 --2- 172.21.15.153:0/1101803005 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe9409be00 0x7fbe94146550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:13.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.361+0000 7fbe93400640 1 -- 172.21.15.153:0/1101803005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9409c370 con 0x7fbe780039e0 2024-03-28T21:52:13.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.361+0000 7fbe93400640 1 --2- 172.21.15.153:0/1101803005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe780039e0 0x7fbe9409d410 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbe8402c320 tx=0x7fbe84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:13.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.362+0000 7fbe8be00640 1 -- 172.21.15.153:0/1101803005 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84042020 con 0x7fbe780039e0 2024-03-28T21:52:13.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.362+0000 7fbe8be00640 1 -- 172.21.15.153:0/1101803005 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8403a040 con 0x7fbe780039e0 2024-03-28T21:52:13.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.362+0000 7fbe8be00640 1 -- 172.21.15.153:0/1101803005 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84039070 con 0x7fbe780039e0 2024-03-28T21:52:13.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.362+0000 7fbe9a800640 1 -- 172.21.15.153:0/1101803005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9409c650 con 0x7fbe780039e0 2024-03-28T21:52:13.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.362+0000 7fbe9a800640 1 -- 172.21.15.153:0/1101803005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9409cc10 con 0x7fbe780039e0 2024-03-28T21:52:13.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.363+0000 7fbe9a800640 1 -- 172.21.15.153:0/1101803005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe94068ff0 con 0x7fbe780039e0 2024-03-28T21:52:13.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.364+0000 7fbe8be00640 1 -- 172.21.15.153:0/1101803005 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fbe84045020 con 0x7fbe780039e0 2024-03-28T21:52:13.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.365+0000 7fbe8be00640 1 --2- 172.21.15.153:0/1101803005 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbe7006b500 0x7fbe7006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:13.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.365+0000 7fbe8be00640 1 -- 172.21.15.153:0/1101803005 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbe840aba70 con 0x7fbe780039e0 2024-03-28T21:52:13.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.365+0000 7fbe8aa00640 1 --2- 172.21.15.153:0/1101803005 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbe7006b500 0x7fbe7006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:13.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.366+0000 7fbe8aa00640 1 --2- 172.21.15.153:0/1101803005 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbe7006b500 0x7fbe7006d9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c001010 tx=0x7fbe7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.370+0000 7fbe8be00640 1 -- 172.21.15.153:0/1101803005 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbe8404c030 con 0x7fbe780039e0 2024-03-28T21:52:13.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.735+0000 7fbe9a800640 1 -- 172.21.15.153:0/1101803005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe9406de40 con 0x7fbe780039e0 2024-03-28T21:52:13.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.736+0000 7fbe8be00640 1 -- 172.21.15.153:0/1101803005 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fbe8407aaa0 con 0x7fbe780039e0 2024-03-28T21:52:13.737 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:13.737 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/207550071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":207550071},{"type":"v1","addr":"172.21.15.165:6835","nonce":207550071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/900073633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":900073633},{"type":"v1","addr":"172.21.15.153:6837","nonce":900073633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3915706377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3915706377},{"type":"v1","addr":"172.21.15.165:6833","nonce":3915706377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T21:51:56.169625+0000","modified":"2024-03-28T21:51:59.218861+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6836/3516257974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3516257974},{"type":"v1","addr":"172.21.15.153:6836","nonce":3516257974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-03-28T21:52:13.737 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2024-03-28T21:52:13.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.738+0000 7fbe9a800640 1 -- 172.21.15.153:0/1101803005 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbe7006b500 msgr2=0x7fbe7006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.738+0000 7fbe9a800640 1 --2- 172.21.15.153:0/1101803005 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbe7006b500 0x7fbe7006d9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c001010 tx=0x7fbe7c009040 comp rx=0 tx=0).stop 2024-03-28T21:52:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.738+0000 7fbe9a800640 1 -- 172.21.15.153:0/1101803005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe780039e0 msgr2=0x7fbe9409d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.738+0000 7fbe9a800640 1 --2- 172.21.15.153:0/1101803005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe780039e0 0x7fbe9409d410 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbe8402c320 tx=0x7fbe84004730 comp rx=0 tx=0).stop 2024-03-28T21:52:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.738+0000 7fbe9a800640 1 -- 172.21.15.153:0/1101803005 shutdown_connections 2024-03-28T21:52:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.738+0000 7fbe9a800640 1 --2- 172.21.15.153:0/1101803005 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbe7006b500 0x7fbe7006d9c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.738+0000 7fbe9a800640 1 --2- 172.21.15.153:0/1101803005 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe940c90b0 0x7fbe940af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.738+0000 7fbe9a800640 1 --2- 172.21.15.153:0/1101803005 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe9409be00 0x7fbe94146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.738+0000 7fbe9a800640 1 --2- 172.21.15.153:0/1101803005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe780039e0 0x7fbe9409d410 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.738+0000 7fbe9a800640 1 -- 172.21.15.153:0/1101803005 >> 172.21.15.153:0/1101803005 conn(0x7fbe940b1a30 msgr2=0x7fbe9415c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.738+0000 7fbe9a800640 1 -- 172.21.15.153:0/1101803005 shutdown_connections 2024-03-28T21:52:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:13.738+0000 7fbe9a800640 1 -- 172.21.15.153:0/1101803005 wait complete. 2024-03-28T21:52:14.161 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-28T21:51:56.169625+0000', 'modified': '2024-03-28T21:51:59.218861+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6836/3516257974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 3516257974}, {'type': 'v1', 'addr': '172.21.15.153:6836', 'nonce': 3516257974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4260, 'qdb_cluster': [4260]} 2024-03-28T21:52:14.161 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-28T21:52:14.161 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-28T21:52:14.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.425+0000 7f929ec00640 1 Processor -- start 2024-03-28T21:52:14.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.425+0000 7f929ec00640 1 -- start start 2024-03-28T21:52:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.427+0000 7f929ec00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92980d0410 0x7f92980cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.427+0000 7f929ec00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92980ce1f0 con 0x7f92981448e0 2024-03-28T21:52:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.427+0000 7f929ec00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92980ce490 con 0x7f9298144cc0 2024-03-28T21:52:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.427+0000 7f929ec00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f92980ce770 con 0x7f92980d0410 2024-03-28T21:52:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.427+0000 7f929ce00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92980d0410 0x7f92980cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.427+0000 7f929ce00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92980d0410 0x7f92980cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47418/0 (socket says 172.21.15.153:47418) 2024-03-28T21:52:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.427+0000 7f929ce00640 1 -- 172.21.15.153:0/2303500603 learned_addr learned my addr 172.21.15.153:0/2303500603 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.427+0000 7f929d800640 1 --1- 172.21.15.153:0/2303500603 >> v1:172.21.15.153:6789/0 conn(0x7f92981448e0 0x7f92980cfd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60310/0 (socket says 172.21.15.153:60310) 2024-03-28T21:52:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.428+0000 7f929ce00640 1 -- 172.21.15.153:0/2303500603 >> v1:172.21.15.165:6789/0 conn(0x7f9298144cc0 legacy=0x7f92980b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:14.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.428+0000 7f929ce00640 1 -- 172.21.15.153:0/2303500603 >> v1:172.21.15.153:6789/0 conn(0x7f92981448e0 legacy=0x7f92980cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:14.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.428+0000 7f929ce00640 1 -- 172.21.15.153:0/2303500603 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92980cea50 con 0x7f92980d0410 2024-03-28T21:52:14.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.428+0000 7f9297e00640 1 -- 172.21.15.153:0/2303500603 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1191779000 0 0) 0x7f92980ce1f0 con 0x7f92981448e0 2024-03-28T21:52:14.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.429+0000 7f929ce00640 1 --2- 172.21.15.153:0/2303500603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92980d0410 0x7f92980cef70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9284009870 tx=0x7f928402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7314a51e5478149b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:14.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.429+0000 7f9297e00640 1 -- 172.21.15.153:0/2303500603 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284035020 con 0x7f92980d0410 2024-03-28T21:52:14.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.429+0000 7f9297e00640 1 -- 172.21.15.153:0/2303500603 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9284031870 con 0x7f92980d0410 2024-03-28T21:52:14.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.429+0000 7f9297e00640 1 -- 172.21.15.153:0/2303500603 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284031c40 con 0x7f92980d0410 2024-03-28T21:52:14.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.430+0000 7f929ec00640 1 -- 172.21.15.153:0/2303500603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92980d0410 msgr2=0x7f92980cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:14.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.430+0000 7f929ec00640 1 --2- 172.21.15.153:0/2303500603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92980d0410 0x7f92980cef70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9284009870 tx=0x7f928402b910 comp rx=0 tx=0).stop 2024-03-28T21:52:14.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.430+0000 7f929ec00640 1 -- 172.21.15.153:0/2303500603 shutdown_connections 2024-03-28T21:52:14.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.430+0000 7f929ec00640 1 --2- 172.21.15.153:0/2303500603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92980d0410 0x7f92980cef70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.430+0000 7f929ec00640 1 -- 172.21.15.153:0/2303500603 >> 172.21.15.153:0/2303500603 conn(0x7f929806b350 msgr2=0x7f929806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:14.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.430+0000 7f929ec00640 1 -- 172.21.15.153:0/2303500603 shutdown_connections 2024-03-28T21:52:14.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.430+0000 7f929ec00640 1 -- 172.21.15.153:0/2303500603 wait complete. 2024-03-28T21:52:14.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.432+0000 7f929ec00640 1 Processor -- start 2024-03-28T21:52:14.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.432+0000 7f929ec00640 1 -- start start 2024-03-28T21:52:14.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929ec00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92980d0410 0x7f929813c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92981448e0 0x7f92980afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9298144cc0 0x7f92981f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929ec00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92980b4cd0 con 0x7f92980d0410 2024-03-28T21:52:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929ec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f92980b4b50 con 0x7f9298144cc0 2024-03-28T21:52:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f92980b4e50 con 0x7f92981448e0 2024-03-28T21:52:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92980d0410 0x7f929813c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92980d0410 0x7f929813c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47420/0 (socket says 172.21.15.153:47420) 2024-03-28T21:52:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929d800640 1 -- 172.21.15.153:0/946981309 learned_addr learned my addr 172.21.15.153:0/946981309 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929ce00640 1 --2- 172.21.15.153:0/946981309 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92981448e0 0x7f92980afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929e200640 1 --2- 172.21.15.153:0/946981309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9298144cc0 0x7f92981f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929d800640 1 -- 172.21.15.153:0/946981309 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92981448e0 msgr2=0x7f92980afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929d800640 1 --2- 172.21.15.153:0/946981309 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92981448e0 0x7f92980afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929d800640 1 -- 172.21.15.153:0/946981309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9298144cc0 msgr2=0x7f92981f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929d800640 1 --2- 172.21.15.153:0/946981309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9298144cc0 0x7f92981f7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.433+0000 7f929d800640 1 -- 172.21.15.153:0/946981309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929813ceb0 con 0x7f92980d0410 2024-03-28T21:52:14.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.434+0000 7f929d800640 1 --2- 172.21.15.153:0/946981309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92980d0410 0x7f929813c0d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f928c00c500 tx=0x7f928c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:14.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.434+0000 7f9295600640 1 -- 172.21.15.153:0/946981309 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c018070 con 0x7f92980d0410 2024-03-28T21:52:14.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.434+0000 7f9295600640 1 -- 172.21.15.153:0/946981309 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928c007580 con 0x7f92980d0410 2024-03-28T21:52:14.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.434+0000 7f9295600640 1 -- 172.21.15.153:0/946981309 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c004a20 con 0x7f92980d0410 2024-03-28T21:52:14.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.434+0000 7f929ec00640 1 -- 172.21.15.153:0/946981309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f929813d190 con 0x7f92980d0410 2024-03-28T21:52:14.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.434+0000 7f929ec00640 1 -- 172.21.15.153:0/946981309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f929813c610 con 0x7f92980d0410 2024-03-28T21:52:14.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.436+0000 7f9295600640 1 -- 172.21.15.153:0/946981309 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f928c004bc0 con 0x7f92980d0410 2024-03-28T21:52:14.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.438+0000 7f9295600640 1 --2- 172.21.15.153:0/946981309 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f927806b500 0x7f927806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.438+0000 7f9295600640 1 -- 172.21.15.153:0/946981309 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f928c0894a0 con 0x7f92980d0410 2024-03-28T21:52:14.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.438+0000 7f929ce00640 1 --2- 172.21.15.153:0/946981309 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f927806b500 0x7f927806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.439+0000 7f929ce00640 1 --2- 172.21.15.153:0/946981309 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f927806b500 0x7f927806d9c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9284036000 tx=0x7f928403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:14.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.439+0000 7f92a2e7d740 1 Processor -- start 2024-03-28T21:52:14.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.439+0000 7f92a2e7d740 1 -- start start 2024-03-28T21:52:14.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.440+0000 7f92a2e7d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb5234e0 0x560eeb5238c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.440+0000 7f92a2e7d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f3790 0x560eeb520750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.440+0000 7f92a2e7d740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb4f7060 0x560eeb520c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.440+0000 7f92a2e7d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560eeb45c9c0 con 0x560eeb4f3790 2024-03-28T21:52:14.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.440+0000 7f92a2e7d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560eeb405c30 con 0x560eeb5234e0 2024-03-28T21:52:14.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.440+0000 7f92a2e7d740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x560eeb458a60 con 0x560eeb4f7060 2024-03-28T21:52:14.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.440+0000 7f929ce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f3790 0x560eeb520750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.440+0000 7f929ce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f3790 0x560eeb520750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47434/0 (socket says 172.21.15.153:47434) 2024-03-28T21:52:14.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.440+0000 7f929ce00640 1 -- 172.21.15.153:0/1594584127 learned_addr learned my addr 172.21.15.153:0/1594584127 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:14.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.441+0000 7f929e200640 1 --2- 172.21.15.153:0/1594584127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb4f7060 0x560eeb520c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.441+0000 7f929ce00640 1 -- 172.21.15.153:0/1594584127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb4f7060 msgr2=0x560eeb520c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:14.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.441+0000 7f929d800640 1 --2- 172.21.15.153:0/1594584127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb5234e0 0x560eeb5238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.441+0000 7f929ce00640 1 --2- 172.21.15.153:0/1594584127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb4f7060 0x560eeb520c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.441+0000 7f929ce00640 1 -- 172.21.15.153:0/1594584127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb5234e0 msgr2=0x560eeb5238c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:14.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.441+0000 7f929ce00640 1 --2- 172.21.15.153:0/1594584127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb5234e0 0x560eeb5238c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.441+0000 7f929ce00640 1 -- 172.21.15.153:0/1594584127 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eeb1712d0 con 0x560eeb4f3790 2024-03-28T21:52:14.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.441+0000 7f929ce00640 1 --2- 172.21.15.153:0/1594584127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f3790 0x560eeb520750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f928402bf20 tx=0x7f9284030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b7c98f61460b60 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:14.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.441+0000 7f928a000640 1 -- 172.21.15.153:0/1594584127 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284053070 con 0x560eeb4f3790 2024-03-28T21:52:14.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.441+0000 7f928a000640 1 -- 172.21.15.153:0/1594584127 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928403aaf0 con 0x560eeb4f3790 2024-03-28T21:52:14.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.441+0000 7f928a000640 1 -- 172.21.15.153:0/1594584127 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284044420 con 0x560eeb4f3790 2024-03-28T21:52:14.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.442+0000 7f92a2e7d740 1 -- 172.21.15.153:0/1594584127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f3790 msgr2=0x560eeb520750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:14.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.442+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/1594584127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f3790 0x560eeb520750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f928402bf20 tx=0x7f9284030000 comp rx=0 tx=0).stop 2024-03-28T21:52:14.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.442+0000 7f92a2e7d740 1 -- 172.21.15.153:0/1594584127 shutdown_connections 2024-03-28T21:52:14.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.442+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/1594584127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb4f7060 0x560eeb520c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.442+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/1594584127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f3790 0x560eeb520750 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.442+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/1594584127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb5234e0 0x560eeb5238c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.442+0000 7f92a2e7d740 1 -- 172.21.15.153:0/1594584127 >> 172.21.15.153:0/1594584127 conn(0x560eeb4f5a00 msgr2=0x560eeb53e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:14.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.442+0000 7f92a2e7d740 1 -- 172.21.15.153:0/1594584127 shutdown_connections 2024-03-28T21:52:14.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.442+0000 7f92a2e7d740 1 -- 172.21.15.153:0/1594584127 wait complete. 2024-03-28T21:52:14.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.443+0000 7f92a2e7d740 1 -- start start 2024-03-28T21:52:14.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.444+0000 7f92a2e7d740 1 Processor -- start 2024-03-28T21:52:14.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.445+0000 7f92a2e7d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f7060 0x560eeb5153e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.445+0000 7f92a2e7d740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb5234e0 0x560eeb5238c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.445+0000 7f92a2e7d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb523e00 0x560eeb51d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.445+0000 7f92a2e7d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560eeb4f8210 con 0x560eeb4f7060 2024-03-28T21:52:14.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.445+0000 7f92a2e7d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560eeb3fb180 con 0x560eeb523e00 2024-03-28T21:52:14.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.445+0000 7f92a2e7d740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x560eeb4f7600 con 0x560eeb5234e0 2024-03-28T21:52:14.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.445+0000 7f92a2e7d740 10 client.0 _ll_register_callbacks cb 0x560eeb170ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T21:52:14.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.445+0000 7f929d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f7060 0x560eeb5153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.445+0000 7f929d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f7060 0x560eeb5153e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47450/0 (socket says 172.21.15.153:47450) 2024-03-28T21:52:14.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.445+0000 7f929d800640 1 -- 172.21.15.153:0/1010275677 learned_addr learned my addr 172.21.15.153:0/1010275677 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:14.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.446+0000 7f929ce00640 1 --2- 172.21.15.153:0/1010275677 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb5234e0 0x560eeb5238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.446+0000 7f929d800640 1 -- 172.21.15.153:0/1010275677 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb5234e0 msgr2=0x560eeb5238c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:14.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.446+0000 7f929d800640 1 --2- 172.21.15.153:0/1010275677 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb5234e0 0x560eeb5238c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.446+0000 7f929d800640 1 -- 172.21.15.153:0/1010275677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb523e00 msgr2=0x560eeb51d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:14.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.446+0000 7f929d800640 1 --2- 172.21.15.153:0/1010275677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb523e00 0x560eeb51d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.446+0000 7f929d800640 1 -- 172.21.15.153:0/1010275677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eeb23b6b0 con 0x560eeb4f7060 2024-03-28T21:52:14.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.446+0000 7f929d800640 1 --2- 172.21.15.153:0/1010275677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f7060 0x560eeb5153e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f928c057ba0 tx=0x7f928c057670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2847e0336c81d601 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:14.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.446+0000 7f927ea00640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-28T21:52:14.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.446+0000 7f927ea00640 1 -- 172.21.15.153:0/1010275677 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c089270 con 0x560eeb4f7060 2024-03-28T21:52:14.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.446+0000 7f927ea00640 1 -- 172.21.15.153:0/1010275677 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f928c057060 con 0x560eeb4f7060 2024-03-28T21:52:14.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.446+0000 7f92a2e7d740 1 -- 172.21.15.153:0/1010275677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f928403aaf0 con 0x560eeb4f7060 2024-03-28T21:52:14.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.447+0000 7f927ea00640 1 -- 172.21.15.153:0/1010275677 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f928c05bd60 con 0x560eeb4f7060 2024-03-28T21:52:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.447+0000 7f92a2e7d740 10 client.4644 fetch_fsmap learned FSMap version 8 2024-03-28T21:52:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.447+0000 7f92a2e7d740 1 -- 172.21.15.153:0/1010275677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x560eeb527120 con 0x560eeb4f7060 2024-03-28T21:52:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.447+0000 7f927ea00640 1 -- 172.21.15.153:0/1010275677 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928403aaf0 con 0x560eeb4f7060 2024-03-28T21:52:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.447+0000 7f927ea00640 1 -- 172.21.15.153:0/1010275677 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f928c06bbd0 con 0x560eeb4f7060 2024-03-28T21:52:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.447+0000 7f92a2e7d740 10 client.4644 fetch_fsmap finished waiting for FSMap version 8 2024-03-28T21:52:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.447+0000 7f92a2e7d740 10 client.4644 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-28T21:52:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.447+0000 7f92a2e7d740 20 client.4644 populate_metadata read hostname 'smithi153' 2024-03-28T21:52:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.447+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/1010275677 >> [v2:172.21.15.153:6834/3516257974,v1:172.21.15.153:6836/3516257974] conn(0x560eeb519a80 0x560eeb552580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.447+0000 7f92a2e7d740 4 client.4644 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T21:52:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.447+0000 7f92a2e7d740 1 -- 172.21.15.153:0/1010275677 --> [v2:172.21.15.153:6834/3516257974,v1:172.21.15.153:6836/3516257974] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560eeb469f00 con 0x560eeb519a80 2024-03-28T21:52:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.447+0000 7f929ce00640 1 --2- 172.21.15.153:0/1010275677 >> [v2:172.21.15.153:6834/3516257974,v1:172.21.15.153:6836/3516257974] conn(0x560eeb519a80 0x560eeb552580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.448+0000 7f929ce00640 1 --2- 172.21.15.153:0/1010275677 >> [v2:172.21.15.153:6834/3516257974,v1:172.21.15.153:6836/3516257974] conn(0x560eeb519a80 0x560eeb552580 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b37c944ca1e8875 server_cookie=f23202a519d2fd43 in_seq=0 out_seq=0 2024-03-28T21:52:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.448+0000 7f927ea00640 10 client.4644 ms_handle_connect on v2:172.21.15.153:6834/3516257974 2024-03-28T21:52:14.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.449+0000 7f927ea00640 1 -- 172.21.15.153:0/1010275677 <== mds.0 v2:172.21.15.153:6834/3516257974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x560eeb469f00 con 0x560eeb519a80 2024-03-28T21:52:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.449+0000 7f927ea00640 10 client.4644 handle_command_reply: tid=0 2024-03-28T21:52:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.449+0000 7f92a2e7d740 1 client.4644 shutdown 2024-03-28T21:52:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.449+0000 7f92a2e7d740 1 -- 172.21.15.153:0/1010275677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f7060 msgr2=0x560eeb5153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.449+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/1010275677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f7060 0x560eeb5153e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f928c057ba0 tx=0x7f928c057670 comp rx=0 tx=0).stop 2024-03-28T21:52:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.449+0000 7f92a2e7d740 1 -- 172.21.15.153:0/1010275677 shutdown_connections 2024-03-28T21:52:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.449+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/1010275677 >> [v2:172.21.15.153:6834/3516257974,v1:172.21.15.153:6836/3516257974] conn(0x560eeb519a80 0x560eeb552580 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.449+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/1010275677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb523e00 0x560eeb51d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.449+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/1010275677 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb5234e0 0x560eeb5238c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.449+0000 7f927ea00640 0 client.4644 ms_handle_reset on v2:172.21.15.153:6834/3516257974 2024-03-28T21:52:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.449+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/1010275677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f7060 0x560eeb5153e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.449+0000 7f92a2e7d740 1 -- 172.21.15.153:0/1010275677 >> 172.21.15.153:0/1010275677 conn(0x560eeb4f3790 msgr2=0x560eeb541800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.450+0000 7f92a2e7d740 1 -- 172.21.15.153:0/1010275677 shutdown_connections 2024-03-28T21:52:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.450+0000 7f92a2e7d740 1 -- 172.21.15.153:0/1010275677 wait complete. 2024-03-28T21:52:14.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.450+0000 7f92a2e7d740 20 client.4644 trim_cache size 0 max 16384 2024-03-28T21:52:14.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.469+0000 7f92a2e7d740 1 Processor -- start 2024-03-28T21:52:14.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.469+0000 7f92a2e7d740 1 -- start start 2024-03-28T21:52:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.470+0000 7f92a2e7d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f7060 0x560eeb541800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.470+0000 7f92a2e7d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb5234e0 0x560eeb541d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.470+0000 7f92a2e7d740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb523e00 0x560eeb51ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.470+0000 7f92a2e7d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f929813fe90 con 0x560eeb4f7060 2024-03-28T21:52:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.470+0000 7f92a2e7d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f929815d5d0 con 0x560eeb5234e0 2024-03-28T21:52:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.470+0000 7f92a2e7d740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f929813f840 con 0x560eeb523e00 2024-03-28T21:52:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.470+0000 7f929d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f7060 0x560eeb541800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.470+0000 7f929d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f7060 0x560eeb541800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47462/0 (socket says 172.21.15.153:47462) 2024-03-28T21:52:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.470+0000 7f929d800640 1 -- 172.21.15.153:0/2994589740 learned_addr learned my addr 172.21.15.153:0/2994589740 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.471+0000 7f929e200640 1 --2- 172.21.15.153:0/2994589740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb523e00 0x560eeb51ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.471+0000 7f929d800640 1 -- 172.21.15.153:0/2994589740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb523e00 msgr2=0x560eeb51ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.471+0000 7f929d800640 1 --2- 172.21.15.153:0/2994589740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb523e00 0x560eeb51ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.471+0000 7f929d800640 1 -- 172.21.15.153:0/2994589740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb5234e0 msgr2=0x560eeb541d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:14.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.471+0000 7f929ce00640 1 --2- 172.21.15.153:0/2994589740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb5234e0 0x560eeb541d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.471+0000 7f929d800640 1 --2- 172.21.15.153:0/2994589740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb5234e0 0x560eeb541d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.471+0000 7f929d800640 1 -- 172.21.15.153:0/2994589740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eeb523c30 con 0x560eeb4f7060 2024-03-28T21:52:14.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.471+0000 7f929d800640 1 --2- 172.21.15.153:0/2994589740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f7060 0x560eeb541800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f928c05a010 tx=0x7f928c05b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3520bf461d58d607 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:14.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.471+0000 7f9289600640 1 -- 172.21.15.153:0/2994589740 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c06bbd0 con 0x560eeb4f7060 2024-03-28T21:52:14.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.471+0000 7f9289600640 1 -- 172.21.15.153:0/2994589740 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928c089070 con 0x560eeb4f7060 2024-03-28T21:52:14.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.471+0000 7f9289600640 1 -- 172.21.15.153:0/2994589740 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c053b60 con 0x560eeb4f7060 2024-03-28T21:52:14.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.472+0000 7f92a2e7d740 1 -- 172.21.15.153:0/2994589740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f7060 msgr2=0x560eeb541800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:14.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.472+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/2994589740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f7060 0x560eeb541800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f928c05a010 tx=0x7f928c05b000 comp rx=0 tx=0).stop 2024-03-28T21:52:14.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.472+0000 7f92a2e7d740 1 -- 172.21.15.153:0/2994589740 shutdown_connections 2024-03-28T21:52:14.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.472+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/2994589740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb523e00 0x560eeb51ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.472+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/2994589740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb5234e0 0x560eeb541d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.472+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/2994589740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb4f7060 0x560eeb541800 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.472+0000 7f92a2e7d740 1 -- 172.21.15.153:0/2994589740 >> 172.21.15.153:0/2994589740 conn(0x560eeb4f3790 msgr2=0x560eeb5151f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.472+0000 7f92a2e7d740 1 -- 172.21.15.153:0/2994589740 shutdown_connections 2024-03-28T21:52:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.472+0000 7f92a2e7d740 1 -- 172.21.15.153:0/2994589740 wait complete. 2024-03-28T21:52:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.473+0000 7f92a2e7d740 1 -- start start 2024-03-28T21:52:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.473+0000 7f92a2e7d740 1 Processor -- start 2024-03-28T21:52:14.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.475+0000 7f92a2e7d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb4f7060 0x560eeb5179d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.475+0000 7f92a2e7d740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb5234e0 0x560eeb517f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.475+0000 7f92a2e7d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb523e00 0x560eeb5241e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.475+0000 7f92a2e7d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560eeb519900 con 0x560eeb523e00 2024-03-28T21:52:14.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.475+0000 7f92a2e7d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560eeb51ad80 con 0x560eeb4f7060 2024-03-28T21:52:14.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.475+0000 7f92a2e7d740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x560eeb519f20 con 0x560eeb5234e0 2024-03-28T21:52:14.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.475+0000 7f92a2e7d740 10 client.0 _ll_register_callbacks cb 0x7f928c057750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T21:52:14.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.475+0000 7f929e200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb523e00 0x560eeb5241e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.475+0000 7f929e200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb523e00 0x560eeb5241e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47476/0 (socket says 172.21.15.153:47476) 2024-03-28T21:52:14.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.475+0000 7f929e200640 1 -- 172.21.15.153:0/2293136334 learned_addr learned my addr 172.21.15.153:0/2293136334 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:14.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.476+0000 7f929d800640 1 --2- 172.21.15.153:0/2293136334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb4f7060 0x560eeb5179d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.476+0000 7f929ce00640 1 --2- 172.21.15.153:0/2293136334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb5234e0 0x560eeb517f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.476+0000 7f929e200640 1 -- 172.21.15.153:0/2293136334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb5234e0 msgr2=0x560eeb517f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:14.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.476+0000 7f929e200640 1 --2- 172.21.15.153:0/2293136334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb5234e0 0x560eeb517f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.476+0000 7f929e200640 1 -- 172.21.15.153:0/2293136334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb4f7060 msgr2=0x560eeb5179d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.476+0000 7f929e200640 1 --2- 172.21.15.153:0/2293136334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb4f7060 0x560eeb5179d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.476+0000 7f929e200640 1 -- 172.21.15.153:0/2293136334 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eeb53dcd0 con 0x560eeb523e00 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.476+0000 7f929d800640 1 --2- 172.21.15.153:0/2293136334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb4f7060 0x560eeb5179d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.476+0000 7f929e200640 1 --2- 172.21.15.153:0/2293136334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb523e00 0x560eeb5241e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f929000e5a0 tx=0x7f929000ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd34d82d3c1e6f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.476+0000 7f927ea00640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.476+0000 7f927ea00640 1 -- 172.21.15.153:0/2293136334 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9290003970 con 0x560eeb523e00 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.476+0000 7f927ea00640 1 -- 172.21.15.153:0/2293136334 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9290003b10 con 0x560eeb523e00 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.476+0000 7f92a2e7d740 1 -- 172.21.15.153:0/2293136334 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f928c089070 con 0x560eeb523e00 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.477+0000 7f927ea00640 1 -- 172.21.15.153:0/2293136334 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f9290021050 con 0x560eeb523e00 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.477+0000 7f92a2e7d740 10 client.4650 fetch_fsmap learned FSMap version 8 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.477+0000 7f92a2e7d740 1 -- 172.21.15.153:0/2293136334 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x560eeb540a60 con 0x560eeb523e00 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.477+0000 7f927ea00640 1 -- 172.21.15.153:0/2293136334 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928c089070 con 0x560eeb523e00 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.477+0000 7f927ea00640 1 -- 172.21.15.153:0/2293136334 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f9290024020 con 0x560eeb523e00 2024-03-28T21:52:14.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.477+0000 7f92a2e7d740 10 client.4650 fetch_fsmap finished waiting for FSMap version 8 2024-03-28T21:52:14.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.477+0000 7f92a2e7d740 10 client.4650 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-28T21:52:14.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.477+0000 7f92a2e7d740 20 client.4650 populate_metadata read hostname 'smithi153' 2024-03-28T21:52:14.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.477+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/2293136334 >> [v2:172.21.15.153:6834/3516257974,v1:172.21.15.153:6836/3516257974] conn(0x560eeb4f8180 0x560eeb4f8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:14.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.477+0000 7f92a2e7d740 4 client.4650 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-28T21:52:14.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.477+0000 7f92a2e7d740 1 -- 172.21.15.153:0/2293136334 --> [v2:172.21.15.153:6834/3516257974,v1:172.21.15.153:6836/3516257974] -- command(tid 0: {"prefix": "status"}) -- 0x560eeb4f3f90 con 0x560eeb4f8180 2024-03-28T21:52:14.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.477+0000 7f929d800640 1 --2- 172.21.15.153:0/2293136334 >> [v2:172.21.15.153:6834/3516257974,v1:172.21.15.153:6836/3516257974] conn(0x560eeb4f8180 0x560eeb4f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:14.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.478+0000 7f927ea00640 10 client.4650 ms_handle_connect on v2:172.21.15.153:6834/3516257974 2024-03-28T21:52:14.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.478+0000 7f929d800640 1 --2- 172.21.15.153:0/2293136334 >> [v2:172.21.15.153:6834/3516257974,v1:172.21.15.153:6836/3516257974] conn(0x560eeb4f8180 0x560eeb4f8560 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2ba333a320d68c server_cookie=75115d11b9a6dd88 in_seq=0 out_seq=0 2024-03-28T21:52:14.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.478+0000 7f927ea00640 1 -- 172.21.15.153:0/2293136334 <== mds.0 v2:172.21.15.153:6834/3516257974 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x560eeb4f3f90 con 0x560eeb4f8180 2024-03-28T21:52:14.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.478+0000 7f927ea00640 10 client.4650 handle_command_reply: tid=0 2024-03-28T21:52:14.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.478+0000 7f92a2e7d740 1 client.4650 shutdown 2024-03-28T21:52:14.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.478+0000 7f92a2e7d740 1 -- 172.21.15.153:0/2293136334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb523e00 msgr2=0x560eeb5241e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:14.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.478+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/2293136334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb523e00 0x560eeb5241e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f929000e5a0 tx=0x7f929000ea60 comp rx=0 tx=0).stop 2024-03-28T21:52:14.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.478+0000 7f92a2e7d740 1 -- 172.21.15.153:0/2293136334 shutdown_connections 2024-03-28T21:52:14.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.478+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/2293136334 >> [v2:172.21.15.153:6834/3516257974,v1:172.21.15.153:6836/3516257974] conn(0x560eeb4f8180 0x560eeb4f8560 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.478+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/2293136334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560eeb523e00 0x560eeb5241e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.478+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/2293136334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560eeb5234e0 0x560eeb517f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.478+0000 7f92a2e7d740 1 --2- 172.21.15.153:0/2293136334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eeb4f7060 0x560eeb5179d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.478+0000 7f927ea00640 0 client.4650 ms_handle_reset on v2:172.21.15.153:6834/3516257974 2024-03-28T21:52:14.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.478+0000 7f92a2e7d740 1 -- 172.21.15.153:0/2293136334 >> 172.21.15.153:0/2293136334 conn(0x560eeb4f3790 msgr2=0x560eeb4eeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:14.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.479+0000 7f92a2e7d740 1 -- 172.21.15.153:0/2293136334 shutdown_connections 2024-03-28T21:52:14.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.479+0000 7f92a2e7d740 1 -- 172.21.15.153:0/2293136334 wait complete. 2024-03-28T21:52:14.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.479+0000 7f92a2e7d740 20 client.4650 trim_cache size 0 max 16384 2024-03-28T21:52:14.484 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-28T21:52:14.484 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "2549e48d-ef7b-419c-89c4-4d0726d7d873", 2024-03-28T21:52:14.484 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2024-03-28T21:52:14.484 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4260, 2024-03-28T21:52:14.484 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2024-03-28T21:52:14.484 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2024-03-28T21:52:14.484 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2024-03-28T21:52:14.484 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 17.756535829000001, 2024-03-28T21:52:14.484 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 8, 2024-03-28T21:52:14.484 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 22, 2024-03-28T21:52:14.484 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 22, 2024-03-28T21:52:14.484 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 25.704996438999999 2024-03-28T21:52:14.484 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-28T21:52:14.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.479+0000 7f929ec00640 1 -- 172.21.15.153:0/946981309 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f927806b500 msgr2=0x7f927806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:14.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.479+0000 7f929ec00640 1 --2- 172.21.15.153:0/946981309 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f927806b500 0x7f927806d9c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9284036000 tx=0x7f928403c040 comp rx=0 tx=0).stop 2024-03-28T21:52:14.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.479+0000 7f929ec00640 1 -- 172.21.15.153:0/946981309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92980d0410 msgr2=0x7f929813c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:14.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.479+0000 7f929ec00640 1 --2- 172.21.15.153:0/946981309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92980d0410 0x7f929813c0d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f928c00c500 tx=0x7f928c00c9c0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.479+0000 7f929ec00640 1 -- 172.21.15.153:0/946981309 shutdown_connections 2024-03-28T21:52:14.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.479+0000 7f929ec00640 1 --2- 172.21.15.153:0/946981309 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f927806b500 0x7f927806d9c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.479+0000 7f929ec00640 1 --2- 172.21.15.153:0/946981309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9298144cc0 0x7f92981f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.479+0000 7f929ec00640 1 --2- 172.21.15.153:0/946981309 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92981448e0 0x7f92980afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.479+0000 7f929ec00640 1 --2- 172.21.15.153:0/946981309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92980d0410 0x7f929813c0d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:14.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.480+0000 7f929ec00640 1 -- 172.21.15.153:0/946981309 >> 172.21.15.153:0/946981309 conn(0x7f929806b350 msgr2=0x7f92980cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:14.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.480+0000 7f929ec00640 1 -- 172.21.15.153:0/946981309 shutdown_connections 2024-03-28T21:52:14.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:14.480+0000 7f929ec00640 1 -- 172.21.15.153:0/946981309 wait complete. 2024-03-28T21:52:14.498 INFO:teuthology.run_tasks:Running task kclient... 2024-03-28T21:52:14.524 INFO:tasks.kclient:Mounting kernel clients... 2024-03-28T21:52:14.525 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-28T21:52:14.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:14.525 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-03-28T21:52:14.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:14.574 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-03-28T21:52:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-03-28T21:52:14.667 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T21:52:14.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:14.668 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-03-28T21:52:14.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:14.724 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-03-28T21:52:14.816 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-03-28T21:52:14.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T21:52:14.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:14.821 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-03-28T21:52:14.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:14.876 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link delete ceph-brx 2024-03-28T21:52:14.972 INFO:teuthology.orchestra.run.smithi165.stderr:Cannot find device "ceph-brx" 2024-03-28T21:52:14.976 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T21:52:14.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:14.977 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-03-28T21:52:15.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:15.030 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link delete ceph-brx 2024-03-28T21:52:15.120 INFO:teuthology.orchestra.run.smithi165.stderr:Cannot find device "ceph-brx" 2024-03-28T21:52:15.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T21:52:15.123 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-03-28T21:52:15.123 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-28T21:52:15.123 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-28T21:52:15.124 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-28T21:52:15.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.340+0000 7f7180c00640 1 Processor -- start 2024-03-28T21:52:15.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.340+0000 7f7180c00640 1 -- start start 2024-03-28T21:52:15.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.341+0000 7f7180c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f717c0d02c0 0x7f717c0b5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:15.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.341+0000 7f7180c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f717c162b90 con 0x7f717c0b3820 2024-03-28T21:52:15.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.341+0000 7f7180c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f717c0d2820 con 0x7f717c161d80 2024-03-28T21:52:15.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.341+0000 7f7180c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f717c0d2b00 con 0x7f717c0d02c0 2024-03-28T21:52:15.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.341+0000 7f7173e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f717c0b3820 0x7f717c0cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60320/0 (socket says 172.21.15.153:60320) 2024-03-28T21:52:15.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.341+0000 7f7173e00640 1 -- 172.21.15.153:0/2814307637 learned_addr learned my addr 172.21.15.153:0/2814307637 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717be00640 1 --2- 172.21.15.153:0/2814307637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f717c0d02c0 0x7f717c0b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 -- 172.21.15.153:0/2814307637 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3220177083 0 0) 0x7f717c162b90 con 0x7f717c0b3820 2024-03-28T21:52:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 -- 172.21.15.153:0/2814307637 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7160003520 con 0x7f717c0b3820 2024-03-28T21:52:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 -- 172.21.15.153:0/2814307637 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4005221255 0 0) 0x7f7160003520 con 0x7f717c0b3820 2024-03-28T21:52:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 -- 172.21.15.153:0/2814307637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f717c0d02c0 msgr2=0x7f717c0b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 --2- 172.21.15.153:0/2814307637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f717c0d02c0 0x7f717c0b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 -- 172.21.15.153:0/2814307637 >> v1:172.21.15.165:6789/0 conn(0x7f717c161d80 legacy=0x7f717c162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 -- 172.21.15.153:0/2814307637 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c0d2de0 con 0x7f717c0b3820 2024-03-28T21:52:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 -- 172.21.15.153:0/2814307637 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f7164001670 con 0x7f717c0b3820 2024-03-28T21:52:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 -- 172.21.15.153:0/2814307637 >> v1:172.21.15.153:6789/0 conn(0x7f717c0b3820 legacy=0x7f717c0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 --2- 172.21.15.153:0/2814307637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7160003a50 0x7f7160003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 --2- 172.21.15.153:0/2814307637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f717c0d02c0 0x7f7160004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 --2- 172.21.15.153:0/2814307637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7160004d40 0x7f71600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 -- 172.21.15.153:0/2814307637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f717c0d2b00 con 0x7f7160003a50 2024-03-28T21:52:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 -- 172.21.15.153:0/2814307637 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f716000bb50 con 0x7f7160004d40 2024-03-28T21:52:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.342+0000 7f717aa00640 1 -- 172.21.15.153:0/2814307637 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f716000bd50 con 0x7f717c0d02c0 2024-03-28T21:52:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.343+0000 7f717b400640 1 --2- 172.21.15.153:0/2814307637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7160003a50 0x7f7160003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.343+0000 7f717b400640 1 -- 172.21.15.153:0/2814307637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f717c0d02c0 msgr2=0x7f7160004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.343+0000 7f7173e00640 1 --2- 172.21.15.153:0/2814307637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f717c0d02c0 0x7f7160004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.343+0000 7f717be00640 1 --2- 172.21.15.153:0/2814307637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7160004d40 0x7f71600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.343+0000 7f717b400640 1 --2- 172.21.15.153:0/2814307637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f717c0d02c0 0x7f7160004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.343+0000 7f717b400640 1 -- 172.21.15.153:0/2814307637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7160004d40 msgr2=0x7f71600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.343+0000 7f717b400640 1 --2- 172.21.15.153:0/2814307637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7160004d40 0x7f71600051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.343+0000 7f717b400640 1 -- 172.21.15.153:0/2814307637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7160003520 con 0x7f7160003a50 2024-03-28T21:52:15.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.344+0000 7f717b400640 1 --2- 172.21.15.153:0/2814307637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7160003a50 0x7f7160003e70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f716c001750 tx=0x7f7160005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc99ae77c8eb061 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:15.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.344+0000 7f717aa00640 1 -- 172.21.15.153:0/2814307637 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c001370 con 0x7f7160003a50 2024-03-28T21:52:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.344+0000 7f717aa00640 1 -- 172.21.15.153:0/2814307637 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f716c0052d0 con 0x7f7160003a50 2024-03-28T21:52:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.344+0000 7f717aa00640 1 -- 172.21.15.153:0/2814307637 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c003830 con 0x7f7160003a50 2024-03-28T21:52:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.345+0000 7f7180c00640 1 -- 172.21.15.153:0/2814307637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7160003a50 msgr2=0x7f7160003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.345+0000 7f7180c00640 1 --2- 172.21.15.153:0/2814307637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7160003a50 0x7f7160003e70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f716c001750 tx=0x7f7160005830 comp rx=0 tx=0).stop 2024-03-28T21:52:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.345+0000 7f717be00640 1 -- 172.21.15.153:0/2814307637 reap_dead start 2024-03-28T21:52:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.345+0000 7f7180c00640 1 -- 172.21.15.153:0/2814307637 shutdown_connections 2024-03-28T21:52:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.345+0000 7f7180c00640 1 -- 172.21.15.153:0/2814307637 >> 172.21.15.153:0/2814307637 conn(0x7f717c0d3f10 msgr2=0x7f717c0d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.345+0000 7f7180c00640 1 -- 172.21.15.153:0/2814307637 shutdown_connections 2024-03-28T21:52:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.345+0000 7f7180c00640 1 -- 172.21.15.153:0/2814307637 wait complete. 2024-03-28T21:52:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.347+0000 7f7180c00640 1 Processor -- start 2024-03-28T21:52:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.347+0000 7f7180c00640 1 -- start start 2024-03-28T21:52:15.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.348+0000 7f7180c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7160003a50 0x7f717c156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.348+0000 7f7180c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f717c0c9b40 0x7f717c0ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.348+0000 7f7180c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f717c0b2030 0x7f717c0b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.348+0000 7f7180c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f717c0ceae0 con 0x7f717c0c9b40 2024-03-28T21:52:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.348+0000 7f7180c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f717c161a60 con 0x7f717c0b2030 2024-03-28T21:52:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.348+0000 7f7180c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f717c0cec60 con 0x7f7160003a50 2024-03-28T21:52:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.348+0000 7f7173e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f717c0c9b40 0x7f717c0ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.348+0000 7f7173e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f717c0c9b40 0x7f717c0ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47492/0 (socket says 172.21.15.153:47492) 2024-03-28T21:52:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.348+0000 7f7173e00640 1 -- 172.21.15.153:0/548197598 learned_addr learned my addr 172.21.15.153:0/548197598 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.348+0000 7f717b400640 1 --2- 172.21.15.153:0/548197598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7160003a50 0x7f717c156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.349+0000 7f717be00640 1 --2- 172.21.15.153:0/548197598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f717c0b2030 0x7f717c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.349+0000 7f7173e00640 1 -- 172.21.15.153:0/548197598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7160003a50 msgr2=0x7f717c156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.349+0000 7f7173e00640 1 --2- 172.21.15.153:0/548197598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7160003a50 0x7f717c156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.349+0000 7f7173e00640 1 -- 172.21.15.153:0/548197598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f717c0b2030 msgr2=0x7f717c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.349+0000 7f7173e00640 1 --2- 172.21.15.153:0/548197598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f717c0b2030 0x7f717c0b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.349+0000 7f7173e00640 1 -- 172.21.15.153:0/548197598 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c15f000 con 0x7f717c0c9b40 2024-03-28T21:52:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.349+0000 7f7173e00640 1 --2- 172.21.15.153:0/548197598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f717c0c9b40 0x7f717c0ca110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f716400d770 tx=0x7f716400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.349+0000 7f7173400640 1 -- 172.21.15.153:0/548197598 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164019070 con 0x7f717c0c9b40 2024-03-28T21:52:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.349+0000 7f7173400640 1 -- 172.21.15.153:0/548197598 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71640072d0 con 0x7f717c0c9b40 2024-03-28T21:52:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.349+0000 7f7173400640 1 -- 172.21.15.153:0/548197598 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71640047e0 con 0x7f717c0c9b40 2024-03-28T21:52:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.349+0000 7f7180c00640 1 -- 172.21.15.153:0/548197598 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717c15f2e0 con 0x7f717c0c9b40 2024-03-28T21:52:15.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.349+0000 7f7180c00640 1 -- 172.21.15.153:0/548197598 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f717c15f8a0 con 0x7f717c0c9b40 2024-03-28T21:52:15.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.351+0000 7f7180c00640 1 -- 172.21.15.153:0/548197598 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f717c0b5040 con 0x7f717c0c9b40 2024-03-28T21:52:15.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.351+0000 7f7173400640 1 -- 172.21.15.153:0/548197598 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f7164004980 con 0x7f717c0c9b40 2024-03-28T21:52:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.353+0000 7f7173400640 1 --2- 172.21.15.153:0/548197598 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f715806b4d0 0x7f715806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.353+0000 7f7173400640 1 -- 172.21.15.153:0/548197598 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f71640899d0 con 0x7f717c0c9b40 2024-03-28T21:52:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.353+0000 7f717b400640 1 --2- 172.21.15.153:0/548197598 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f715806b4d0 0x7f715806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.354+0000 7f717b400640 1 --2- 172.21.15.153:0/548197598 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f715806b4d0 0x7f715806d990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f716c033000 tx=0x7f716c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:15.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.357+0000 7f7173400640 1 -- 172.21.15.153:0/548197598 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f717c0b5040 con 0x7f717c0c9b40 2024-03-28T21:52:15.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.594+0000 7f7180c00640 1 -- 172.21.15.153:0/548197598 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f717c08d6e0 con 0x7f717c0c9b40 2024-03-28T21:52:15.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.594+0000 7f7173400640 1 -- 172.21.15.153:0/548197598 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f71640588e0 con 0x7f717c0c9b40 2024-03-28T21:52:15.596 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-28T21:52:15.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.597+0000 7f7180c00640 1 -- 172.21.15.153:0/548197598 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f715806b4d0 msgr2=0x7f715806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:15.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.597+0000 7f7180c00640 1 --2- 172.21.15.153:0/548197598 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f715806b4d0 0x7f715806d990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f716c033000 tx=0x7f716c009030 comp rx=0 tx=0).stop 2024-03-28T21:52:15.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.597+0000 7f7180c00640 1 -- 172.21.15.153:0/548197598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f717c0c9b40 msgr2=0x7f717c0ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:15.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.597+0000 7f7180c00640 1 --2- 172.21.15.153:0/548197598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f717c0c9b40 0x7f717c0ca110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f716400d770 tx=0x7f716400dc30 comp rx=0 tx=0).stop 2024-03-28T21:52:15.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.597+0000 7f7180c00640 1 -- 172.21.15.153:0/548197598 shutdown_connections 2024-03-28T21:52:15.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.597+0000 7f7180c00640 1 --2- 172.21.15.153:0/548197598 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f715806b4d0 0x7f715806d990 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:15.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.597+0000 7f7180c00640 1 --2- 172.21.15.153:0/548197598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f717c0b2030 0x7f717c0b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:15.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.597+0000 7f7180c00640 1 --2- 172.21.15.153:0/548197598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f717c0c9b40 0x7f717c0ca110 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:15.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.597+0000 7f7180c00640 1 --2- 172.21.15.153:0/548197598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7160003a50 0x7f717c156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:15.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.597+0000 7f7180c00640 1 -- 172.21.15.153:0/548197598 >> 172.21.15.153:0/548197598 conn(0x7f717c0d3f10 msgr2=0x7f717c15d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:15.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.598+0000 7f7180c00640 1 -- 172.21.15.153:0/548197598 shutdown_connections 2024-03-28T21:52:15.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15.598+0000 7f7180c00640 1 -- 172.21.15.153:0/548197598 wait complete. 2024-03-28T21:52:15.620 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-28T21:52:15.620 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-28T21:52:15.620 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-03-28T21:52:15.620 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-28T21:52:15.620 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-28T21:52:15.620 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-28T21:52:15.620 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-28T21:52:15.621 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-28T21:52:15.621 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-28T21:52:15.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:15.621 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-03-28T21:52:15.665 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-28T21:52:15.665 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-28T21:52:15.665 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-03-28T21:52:15.665 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:15.665 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-03-28T21:52:15.665 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:15.665 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:52:15.665 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:15.665 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-03-28T21:52:15.665 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:52:15.665 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:15.666 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-03-28T21:52:15.666 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:52:15.666 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:15.666 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-28T21:52:15.666 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:15.666 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-28T21:52:15.666 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42565sec preferred_lft 42565sec 2024-03-28T21:52:15.666 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-03-28T21:52:15.666 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:15.667 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-28T21:52:15.667 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:15.667 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-28T21:52:15.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2024-03-28T21:52:15.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2024-03-28T21:52:15.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2024-03-28T21:52:15.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-28T21:52:15.667 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-28T21:52:15.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:16.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:16.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:16.192 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-28T21:52:16.274 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-03-28T21:52:16.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:16.278 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-03-28T21:52:16.346 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-03-28T21:52:16.346 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-28T21:52:16.346 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-28T21:52:16.347 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-28T21:52:16.347 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-28T21:52:16.347 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:16.347 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-28T21:52:16.347 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-28T21:52:16.348 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-28T21:52:16.348 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-28T21:52:16.348 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-28T21:52:16.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:17.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:17.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:17.115 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-03-28T21:52:17.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:17.157 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-03-28T21:52:17.237 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:17.238 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-28T21:52:17.238 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-28T21:52:17.238 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-28T21:52:17.238 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-28T21:52:17.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:17.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:17.480 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-28T21:52:17.480 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:17.481 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-28T21:52:17.481 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-28T21:52:17.481 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-28T21:52:17.481 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-28T21:52:17.481 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-28T21:52:17.481 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-28T21:52:17.481 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-28T21:52:17.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:17.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:17.796 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:17.796 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-28T21:52:17.796 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-03-28T21:52:17.796 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2024-03-28T21:52:17.796 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-28T21:52:17.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:17.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:17.999 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T21:52:17.999 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-28T21:52:18.041 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-28T21:52:18.041 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T21:52:18.041 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-28T21:52:18.126 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-28T21:52:18.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:18.127 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-28T21:52:18.288 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-28T21:52:18.288 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-28T21:52:18.288 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-03-28T21:52:18.869 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-28T21:52:18.869 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-28T21:52:18.869 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-03-28T21:52:18.869 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-03-28T21:52:18.869 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-28T21:52:18.902 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-28T21:52:18.902 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-28T21:52:18.902 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-03-28T21:52:18.902 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-03-28T21:52:18.902 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-28T21:52:18.902 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.165:6789,172.21.15.165:6790" 2024-03-28T21:52:18.902 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.165:6789,172.21.15.165:6790:/ 2024-03-28T21:52:18.902 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=2549e48d-ef7b-419c-89c4-4d0726d7d873" will pass to kernel 2024-03-28T21:52:18.907 INFO:teuthology.orchestra.run.smithi153.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-28T21:52:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: You just mounted a file system that supports labels which does not 2024-03-28T21:52:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-28T21:52:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: applications will generate AVC messages and not be allowed access to 2024-03-28T21:52:18.907 INFO:teuthology.orchestra.run.smithi153.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-28T21:52:18.912 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-28T21:52:18.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:18.912 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-28T21:52:18.991 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T21:52:19.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T21:52:19.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:19.126 INFO:teuthology.orchestra.run.smithi153.stdout:client4659 2024-03-28T21:52:19.126 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:52:19.126 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:19.175 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T21:52:19.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T21:52:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:19.347 INFO:teuthology.orchestra.run.smithi153.stdout:client4659 2024-03-28T21:52:19.348 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T21:52:19.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T21:52:19.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:19.475 INFO:teuthology.orchestra.run.smithi153.stdout:client4659 2024-03-28T21:52:19.476 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2549e48d-ef7b-419c-89c4-4d0726d7d873.client4659/status') 2024-03-28T21:52:19.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:19.617 INFO:teuthology.orchestra.run.smithi153.stdout:instance: client.4659 (3)192.168.0.1:0/550455260 2024-03-28T21:52:19.617 INFO:teuthology.orchestra.run.smithi153.stdout:blocklisted: false 2024-03-28T21:52:19.618 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records in 2024-03-28T21:52:19.618 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records out 2024-03-28T21:52:19.618 INFO:teuthology.orchestra.run.smithi153.stderr:68 bytes copied, 5.4343e-05 s, 1.3 MB/s 2024-03-28T21:52:19.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:19.629 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-03-28T21:52:19.629 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-28T21:52:19.629 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-28T21:52:19.629 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-28T21:52:19.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.828+0000 7f2b2fe00640 1 Processor -- start 2024-03-28T21:52:19.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.828+0000 7f2b2fe00640 1 -- start start 2024-03-28T21:52:19.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.831+0000 7f2b2fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2b2806c4c0 0x7f2b2815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:19.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.831+0000 7f2b2fe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b2815e760 con 0x7f2b28162350 2024-03-28T21:52:19.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.831+0000 7f2b2fe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b281627e0 con 0x7f2b2806c8a0 2024-03-28T21:52:19.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.831+0000 7f2b2fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2b281415e0 con 0x7f2b2806c4c0 2024-03-28T21:52:19.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.832+0000 7f2b2de00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2b28162350 0x7f2b280b4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60330/0 (socket says 172.21.15.153:60330) 2024-03-28T21:52:19.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.832+0000 7f2b2de00640 1 -- 172.21.15.153:0/1278417341 learned_addr learned my addr 172.21.15.153:0/1278417341 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:19.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.832+0000 7f2b2d400640 1 --2- 172.21.15.153:0/1278417341 >> v2:172.21.15.165:3300/0 conn(0x7f2b2806c4c0 0x7f2b2815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:19.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.832+0000 7f2b27e00640 1 -- 172.21.15.153:0/1278417341 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4123413484 0 0) 0x7f2b2815e760 con 0x7f2b28162350 2024-03-28T21:52:19.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.832+0000 7f2b27e00640 1 -- 172.21.15.153:0/1278417341 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b10003520 con 0x7f2b28162350 2024-03-28T21:52:19.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.832+0000 7f2b27e00640 1 -- 172.21.15.153:0/1278417341 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2316988452 0 0) 0x7f2b10003520 con 0x7f2b28162350 2024-03-28T21:52:19.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.832+0000 7f2b27e00640 1 -- 172.21.15.153:0/1278417341 >> v2:172.21.15.165:3300/0 conn(0x7f2b2806c4c0 msgr2=0x7f2b2815f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:19.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.832+0000 7f2b27e00640 1 --2- 172.21.15.153:0/1278417341 >> v2:172.21.15.165:3300/0 conn(0x7f2b2806c4c0 0x7f2b2815f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:19.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.832+0000 7f2b27e00640 1 -- 172.21.15.153:0/1278417341 >> v1:172.21.15.165:6789/0 conn(0x7f2b2806c8a0 legacy=0x7f2b28161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:19.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.832+0000 7f2b27e00640 1 -- 172.21.15.153:0/1278417341 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2815e9d0 con 0x7f2b28162350 2024-03-28T21:52:19.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.832+0000 7f2b27e00640 1 -- 172.21.15.153:0/1278417341 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f2b200019f0 con 0x7f2b28162350 2024-03-28T21:52:19.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.832+0000 7f2b27e00640 1 -- 172.21.15.153:0/1278417341 >> v1:172.21.15.153:6789/0 conn(0x7f2b28162350 legacy=0x7f2b280b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b27e00640 1 --2- 172.21.15.153:0/1278417341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b100039b0 0x7f2b10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b27e00640 1 --2- 172.21.15.153:0/1278417341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b10004800 0x7f2b10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b27e00640 1 --2- 172.21.15.153:0/1278417341 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b100051c0 0x7f2b1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b27e00640 1 -- 172.21.15.153:0/1278417341 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2b281415e0 con 0x7f2b10004800 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b27e00640 1 -- 172.21.15.153:0/1278417341 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1000c160 con 0x7f2b100039b0 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b27e00640 1 -- 172.21.15.153:0/1278417341 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2b1000c360 con 0x7f2b100051c0 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b2ca00640 1 --2- 172.21.15.153:0/1278417341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b10004800 0x7f2b10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b2d400640 1 --2- 172.21.15.153:0/1278417341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b100039b0 0x7f2b10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b2de00640 1 --2- 172.21.15.153:0/1278417341 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b100051c0 0x7f2b1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b2ca00640 1 -- 172.21.15.153:0/1278417341 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b100051c0 msgr2=0x7f2b1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b2ca00640 1 --2- 172.21.15.153:0/1278417341 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b100051c0 0x7f2b1000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b2ca00640 1 -- 172.21.15.153:0/1278417341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b100039b0 msgr2=0x7f2b10003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b2ca00640 1 --2- 172.21.15.153:0/1278417341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b100039b0 0x7f2b10003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b2ca00640 1 -- 172.21.15.153:0/1278417341 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b10003520 con 0x7f2b10004800 2024-03-28T21:52:19.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b2de00640 1 --2- 172.21.15.153:0/1278417341 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b100051c0 0x7f2b1000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:19.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b2d400640 1 --2- 172.21.15.153:0/1278417341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b100039b0 0x7f2b10003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:19.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.833+0000 7f2b2de00640 1 -- 172.21.15.153:0/1278417341 reap_dead start 2024-03-28T21:52:19.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.835+0000 7f2b2ca00640 1 --2- 172.21.15.153:0/1278417341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b10004800 0x7f2b10004c80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b14001750 tx=0x7f2b10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b254f99d084dbf4 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:19.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.835+0000 7f2b27e00640 1 -- 172.21.15.153:0/1278417341 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b14001370 con 0x7f2b10004800 2024-03-28T21:52:19.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.835+0000 7f2b27e00640 1 -- 172.21.15.153:0/1278417341 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b140052d0 con 0x7f2b10004800 2024-03-28T21:52:19.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.835+0000 7f2b27e00640 1 -- 172.21.15.153:0/1278417341 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b14003830 con 0x7f2b10004800 2024-03-28T21:52:19.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.835+0000 7f2b2fe00640 1 -- 172.21.15.153:0/1278417341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b10004800 msgr2=0x7f2b10004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:19.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.835+0000 7f2b2fe00640 1 --2- 172.21.15.153:0/1278417341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b10004800 0x7f2b10004c80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b14001750 tx=0x7f2b10005830 comp rx=0 tx=0).stop 2024-03-28T21:52:19.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.835+0000 7f2b2fe00640 1 -- 172.21.15.153:0/1278417341 shutdown_connections 2024-03-28T21:52:19.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.835+0000 7f2b2fe00640 1 --2- 172.21.15.153:0/1278417341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b10004800 0x7f2b10004c80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:19.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.835+0000 7f2b2fe00640 1 -- 172.21.15.153:0/1278417341 >> 172.21.15.153:0/1278417341 conn(0x7f2b280b2710 msgr2=0x7f2b280b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:19.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.836+0000 7f2b2fe00640 1 -- 172.21.15.153:0/1278417341 shutdown_connections 2024-03-28T21:52:19.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.836+0000 7f2b2fe00640 1 -- 172.21.15.153:0/1278417341 wait complete. 2024-03-28T21:52:19.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.837+0000 7f2b2fe00640 1 Processor -- start 2024-03-28T21:52:19.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.838+0000 7f2b2fe00640 1 -- start start 2024-03-28T21:52:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b10004800 0x7f2b28133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b2815c1f0 0x7f2b2815c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2815a4a0 0x7f2b2815a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2fe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2b280b3910 con 0x7f2b2815a4a0 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2815ed40 con 0x7f2b2815c1f0 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2815f1d0 con 0x7f2b10004800 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2815a4a0 0x7f2b2815a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2815a4a0 0x7f2b2815a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47514/0 (socket says 172.21.15.153:47514) 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2de00640 1 -- 172.21.15.153:0/3951319515 learned_addr learned my addr 172.21.15.153:0/3951319515 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2d400640 1 --2- 172.21.15.153:0/3951319515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b10004800 0x7f2b28133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2ca00640 1 --2- 172.21.15.153:0/3951319515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b2815c1f0 0x7f2b2815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2de00640 1 -- 172.21.15.153:0/3951319515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b10004800 msgr2=0x7f2b28133dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2de00640 1 --2- 172.21.15.153:0/3951319515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b10004800 0x7f2b28133dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2de00640 1 -- 172.21.15.153:0/3951319515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b2815c1f0 msgr2=0x7f2b2815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2de00640 1 --2- 172.21.15.153:0/3951319515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b2815c1f0 0x7f2b2815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.839+0000 7f2b2de00640 1 -- 172.21.15.153:0/3951319515 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2815b190 con 0x7f2b2815a4a0 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.840+0000 7f2b2de00640 1 --2- 172.21.15.153:0/3951319515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2815a4a0 0x7f2b2815a920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2b280adcd0 tx=0x7f2b2000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.840+0000 7f2b25600640 1 -- 172.21.15.153:0/3951319515 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20004d60 con 0x7f2b2815a4a0 2024-03-28T21:52:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.840+0000 7f2b25600640 1 -- 172.21.15.153:0/3951319515 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b2000baa0 con 0x7f2b2815a4a0 2024-03-28T21:52:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.840+0000 7f2b25600640 1 -- 172.21.15.153:0/3951319515 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000be90 con 0x7f2b2815a4a0 2024-03-28T21:52:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.840+0000 7f2b2fe00640 1 -- 172.21.15.153:0/3951319515 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2815b470 con 0x7f2b2815a4a0 2024-03-28T21:52:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.840+0000 7f2b2fe00640 1 -- 172.21.15.153:0/3951319515 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b281f4420 con 0x7f2b2815a4a0 2024-03-28T21:52:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.841+0000 7f2b2fe00640 1 -- 172.21.15.153:0/3951319515 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b28068ff0 con 0x7f2b2815a4a0 2024-03-28T21:52:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.843+0000 7f2b25600640 1 -- 172.21.15.153:0/3951319515 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f2b2001b020 con 0x7f2b2815a4a0 2024-03-28T21:52:19.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.844+0000 7f2b25600640 1 --2- 172.21.15.153:0/3951319515 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2b0806b6a0 0x7f2b0806db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:19.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.844+0000 7f2b25600640 1 -- 172.21.15.153:0/3951319515 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2b2008a2f0 con 0x7f2b2815a4a0 2024-03-28T21:52:19.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.844+0000 7f2b2d400640 1 --2- 172.21.15.153:0/3951319515 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2b0806b6a0 0x7f2b0806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:19.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.845+0000 7f2b2d400640 1 --2- 172.21.15.153:0/3951319515 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2b0806b6a0 0x7f2b0806db60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009b10 tx=0x7f2b1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:19.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:19.848+0000 7f2b25600640 1 -- 172.21.15.153:0/3951319515 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2b200590d0 con 0x7f2b2815a4a0 2024-03-28T21:52:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20.088+0000 7f2b2fe00640 1 -- 172.21.15.153:0/3951319515 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2b2806e100 con 0x7f2b2815a4a0 2024-03-28T21:52:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20.089+0000 7f2b25600640 1 -- 172.21.15.153:0/3951319515 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f2b200589d0 con 0x7f2b2815a4a0 2024-03-28T21:52:20.091 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-28T21:52:20.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20.092+0000 7f2b2fe00640 1 -- 172.21.15.153:0/3951319515 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2b0806b6a0 msgr2=0x7f2b0806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:20.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20.092+0000 7f2b2fe00640 1 --2- 172.21.15.153:0/3951319515 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2b0806b6a0 0x7f2b0806db60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009b10 tx=0x7f2b1c008040 comp rx=0 tx=0).stop 2024-03-28T21:52:20.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20.092+0000 7f2b2fe00640 1 -- 172.21.15.153:0/3951319515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2815a4a0 msgr2=0x7f2b2815a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:20.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20.092+0000 7f2b2fe00640 1 --2- 172.21.15.153:0/3951319515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2815a4a0 0x7f2b2815a920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2b280adcd0 tx=0x7f2b2000b4a0 comp rx=0 tx=0).stop 2024-03-28T21:52:20.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20.092+0000 7f2b2fe00640 1 -- 172.21.15.153:0/3951319515 shutdown_connections 2024-03-28T21:52:20.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20.092+0000 7f2b2fe00640 1 --2- 172.21.15.153:0/3951319515 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2b0806b6a0 0x7f2b0806db60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:20.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20.092+0000 7f2b2fe00640 1 --2- 172.21.15.153:0/3951319515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b2815a4a0 0x7f2b2815a920 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:20.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20.092+0000 7f2b2fe00640 1 --2- 172.21.15.153:0/3951319515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b2815c1f0 0x7f2b2815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:20.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20.092+0000 7f2b2fe00640 1 --2- 172.21.15.153:0/3951319515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b10004800 0x7f2b28133dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:20.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20.092+0000 7f2b2fe00640 1 -- 172.21.15.153:0/3951319515 >> 172.21.15.153:0/3951319515 conn(0x7f2b280b2710 msgr2=0x7f2b280ae4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:20.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20.092+0000 7f2b2fe00640 1 -- 172.21.15.153:0/3951319515 shutdown_connections 2024-03-28T21:52:20.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20.092+0000 7f2b2fe00640 1 -- 172.21.15.153:0/3951319515 wait complete. 2024-03-28T21:52:20.112 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-28T21:52:20.112 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-28T21:52:20.112 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-03-28T21:52:20.112 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-28T21:52:20.113 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-28T21:52:20.113 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-28T21:52:20.113 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-28T21:52:20.113 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-28T21:52:20.113 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-28T21:52:20.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:20.113 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-03-28T21:52:20.164 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-28T21:52:20.164 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-28T21:52:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-03-28T21:52:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-03-28T21:52:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:20.165 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:52:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-03-28T21:52:20.165 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:52:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-03-28T21:52:20.165 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:52:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:20.165 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-28T21:52:20.165 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-28T21:52:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42561sec preferred_lft 42561sec 2024-03-28T21:52:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-03-28T21:52:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:20.166 INFO:teuthology.orchestra.run.smithi153.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-28T21:52:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 2a:9f:2c:04:d2:5c brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-28T21:52:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::3485:dcff:fe35:8e7b/64 scope link 2024-03-28T21:52:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:20.166 INFO:teuthology.orchestra.run.smithi153.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-28T21:52:20.166 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 2a:9f:2c:04:d2:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-28T21:52:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::289f:2cff:fe04:d25c/64 scope link 2024-03-28T21:52:20.167 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:20.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:20.167 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-28T21:52:20.248 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-03-28T21:52:20.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:20.252 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-03-28T21:52:20.298 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-03-28T21:52:20.298 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-28T21:52:20.298 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-28T21:52:20.298 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-28T21:52:20.298 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-28T21:52:20.299 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:20.299 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-28T21:52:20.299 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-28T21:52:20.299 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-28T21:52:20.299 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-28T21:52:20.299 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-28T21:52:20.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:20.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:20.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:20.585 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-03-28T21:52:20.634 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-28T21:52:20.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:20.635 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-03-28T21:52:20.678 INFO:teuthology.orchestra.run.smithi153.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-28T21:52:20.678 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:20.678 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-28T21:52:20.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-28T21:52:20.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-28T21:52:20.679 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-28T21:52:20.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:20.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:20.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:20.922 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-28T21:52:21.008 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-28T21:52:21.008 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-28T21:52:21.008 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-03-28T21:52:21.008 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:21.008 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-03-28T21:52:21.008 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:21.008 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-28T21:52:21.008 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:8f:22:22:27:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-28T21:52:21.009 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-28T21:52:21.009 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:21.009 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e88f:22ff:fe22:2739/64 scope link 2024-03-28T21:52:21.009 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:21.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:21.013 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-28T21:52:21.104 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-28T21:52:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-28T21:52:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-03-28T21:52:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-03-28T21:52:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:21.104 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-28T21:52:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:8f:22:22:27:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-28T21:52:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-28T21:52:21.104 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:21.105 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e88f:22ff:fe22:2739/64 scope link 2024-03-28T21:52:21.105 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:21.108 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-28T21:52:21.109 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:21.109 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-28T21:52:21.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-28T21:52:21.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-28T21:52:21.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-28T21:52:21.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-28T21:52:21.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-28T21:52:21.109 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-28T21:52:21.121 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:52:21.165 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:52:21.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:21.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:21.426 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:21.426 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-28T21:52:21.426 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.1 up 2024-03-28T21:52:21.426 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.1 master ceph-brx 2024-03-28T21:52:21.426 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-28T21:52:21.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:21.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:21.638 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T21:52:21.638 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-28T21:52:21.677 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-28T21:52:21.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T21:52:21.678 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-28T21:52:21.766 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-28T21:52:21.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:21.767 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-28T21:52:21.937 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-28T21:52:21.938 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-28T21:52:21.938 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-03-28T21:52:21.957 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-28T21:52:21.957 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-28T21:52:21.957 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-03-28T21:52:21.958 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-03-28T21:52:21.958 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-28T21:52:21.983 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-28T21:52:21.984 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-28T21:52:21.984 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-03-28T21:52:21.984 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-03-28T21:52:21.984 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-28T21:52:21.984 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.165:6789,172.21.15.165:6790" 2024-03-28T21:52:21.984 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.165:6789,172.21.15.165:6790:/ 2024-03-28T21:52:21.984 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=2549e48d-ef7b-419c-89c4-4d0726d7d873" will pass to kernel 2024-03-28T21:52:21.986 INFO:teuthology.orchestra.run.smithi153.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-03-28T21:52:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: You just mounted a file system that supports labels which does not 2024-03-28T21:52:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-28T21:52:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: applications will generate AVC messages and not be allowed access to 2024-03-28T21:52:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-28T21:52:21.989 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-28T21:52:21.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:21.989 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-28T21:52:22.069 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T21:52:22.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T21:52:22.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:22.187 INFO:teuthology.orchestra.run.smithi153.stdout:client4540 2024-03-28T21:52:22.188 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:52:22.188 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:22.234 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T21:52:22.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T21:52:22.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:22.388 INFO:teuthology.orchestra.run.smithi153.stdout:client4540 2024-03-28T21:52:22.388 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T21:52:22.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T21:52:22.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:22.497 INFO:teuthology.orchestra.run.smithi153.stdout:client4540 2024-03-28T21:52:22.498 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2549e48d-ef7b-419c-89c4-4d0726d7d873.client4540/status') 2024-03-28T21:52:22.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:22.633 INFO:teuthology.orchestra.run.smithi153.stdout:instance: client.4540 (3)172.21.15.153:0/2275994683 2024-03-28T21:52:22.633 INFO:teuthology.orchestra.run.smithi153.stdout:blocklisted: false 2024-03-28T21:52:22.634 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records in 2024-03-28T21:52:22.634 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records out 2024-03-28T21:52:22.634 INFO:teuthology.orchestra.run.smithi153.stderr:71 bytes copied, 6.0819e-05 s, 1.2 MB/s 2024-03-28T21:52:22.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:22.645 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-03-28T21:52:22.645 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-28T21:52:22.645 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-28T21:52:22.646 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-28T21:52:22.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.839+0000 7f7a18800640 1 Processor -- start 2024-03-28T21:52:22.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.839+0000 7f7a18800640 1 -- start start 2024-03-28T21:52:22.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.841+0000 7f7a18800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a1006e440 0x7f7a1015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:22.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.841+0000 7f7a18800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a100b2e60 con 0x7f7a10159a10 2024-03-28T21:52:22.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.841+0000 7f7a18800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a10159df0 con 0x7f7a100ad830 2024-03-28T21:52:22.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.841+0000 7f7a18800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7a100adce0 con 0x7f7a1006e440 2024-03-28T21:52:22.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.841+0000 7f7a15e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7a10159a10 0x7f7a1006dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60342/0 (socket says 172.21.15.153:60342) 2024-03-28T21:52:22.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.841+0000 7f7a15e00640 1 -- 172.21.15.153:0/3267205895 learned_addr learned my addr 172.21.15.153:0/3267205895 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.841+0000 7f7a15400640 1 --2- 172.21.15.153:0/3267205895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a1006e440 0x7f7a1015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.841+0000 7f7a14a00640 1 -- 172.21.15.153:0/3267205895 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 466270410 0 0) 0x7f7a100b2e60 con 0x7f7a10159a10 2024-03-28T21:52:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.841+0000 7f7a14a00640 1 -- 172.21.15.153:0/3267205895 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79f8003520 con 0x7f7a10159a10 2024-03-28T21:52:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.842+0000 7f7a14a00640 1 -- 172.21.15.153:0/3267205895 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4198212606 0 0) 0x7f79f8003520 con 0x7f7a10159a10 2024-03-28T21:52:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.842+0000 7f7a14a00640 1 -- 172.21.15.153:0/3267205895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a1006e440 msgr2=0x7f7a1015cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.842+0000 7f7a14a00640 1 --2- 172.21.15.153:0/3267205895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a1006e440 0x7f7a1015cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.842+0000 7f7a14a00640 1 -- 172.21.15.153:0/3267205895 >> v1:172.21.15.165:6789/0 conn(0x7f7a100ad830 legacy=0x7f7a100b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.842+0000 7f7a14a00640 1 -- 172.21.15.153:0/3267205895 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a100adf10 con 0x7f7a10159a10 2024-03-28T21:52:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.842+0000 7f7a14a00640 1 -- 172.21.15.153:0/3267205895 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f7a04001670 con 0x7f7a10159a10 2024-03-28T21:52:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.842+0000 7f7a14a00640 1 -- 172.21.15.153:0/3267205895 >> v1:172.21.15.153:6789/0 conn(0x7f7a10159a10 legacy=0x7f7a1006dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.842+0000 7f7a14a00640 1 --2- 172.21.15.153:0/3267205895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79f80039e0 0x7f79f8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.842+0000 7f7a14a00640 1 --2- 172.21.15.153:0/3267205895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f8004800 0x7f79f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.842+0000 7f7a14a00640 1 --2- 172.21.15.153:0/3267205895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a1006e440 0x7f79f8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.842+0000 7f7a14a00640 1 -- 172.21.15.153:0/3267205895 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f79f800bac0 con 0x7f79f80039e0 2024-03-28T21:52:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.842+0000 7f7a14a00640 1 -- 172.21.15.153:0/3267205895 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f79f800bc70 con 0x7f79f8004800 2024-03-28T21:52:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.842+0000 7f7a14a00640 1 -- 172.21.15.153:0/3267205895 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f79f800be70 con 0x7f7a1006e440 2024-03-28T21:52:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.842+0000 7f7a15e00640 1 --2- 172.21.15.153:0/3267205895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79f80039e0 0x7f79f8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.843+0000 7f7a15400640 1 --2- 172.21.15.153:0/3267205895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f8004800 0x7f79f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.843+0000 7f7a15e00640 1 -- 172.21.15.153:0/3267205895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a1006e440 msgr2=0x7f79f8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.843+0000 7f7a16800640 1 --2- 172.21.15.153:0/3267205895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a1006e440 0x7f79f8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.843+0000 7f7a15e00640 1 --2- 172.21.15.153:0/3267205895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a1006e440 0x7f79f8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.843+0000 7f7a15e00640 1 -- 172.21.15.153:0/3267205895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f8004800 msgr2=0x7f79f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.843+0000 7f7a15e00640 1 --2- 172.21.15.153:0/3267205895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f8004800 0x7f79f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.843+0000 7f7a15e00640 1 -- 172.21.15.153:0/3267205895 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f8003520 con 0x7f79f80039e0 2024-03-28T21:52:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.843+0000 7f7a16800640 1 --2- 172.21.15.153:0/3267205895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a1006e440 0x7f79f8005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.845+0000 7f7a15e00640 1 --2- 172.21.15.153:0/3267205895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79f80039e0 0x7f79f8003e00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400c210 tx=0x7f79f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bcbdf55dc9c76 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.845+0000 7f7a14a00640 1 -- 172.21.15.153:0/3267205895 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a04007d30 con 0x7f79f80039e0 2024-03-28T21:52:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.845+0000 7f7a14a00640 1 -- 172.21.15.153:0/3267205895 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a04030070 con 0x7f79f80039e0 2024-03-28T21:52:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.845+0000 7f7a14a00640 1 -- 172.21.15.153:0/3267205895 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0402cd60 con 0x7f79f80039e0 2024-03-28T21:52:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.846+0000 7f7a18800640 1 -- 172.21.15.153:0/3267205895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79f80039e0 msgr2=0x7f79f8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.846+0000 7f7a18800640 1 --2- 172.21.15.153:0/3267205895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79f80039e0 0x7f79f8003e00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400c210 tx=0x7f79f8005830 comp rx=0 tx=0).stop 2024-03-28T21:52:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.846+0000 7f7a16800640 1 -- 172.21.15.153:0/3267205895 reap_dead start 2024-03-28T21:52:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.846+0000 7f7a18800640 1 -- 172.21.15.153:0/3267205895 shutdown_connections 2024-03-28T21:52:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.846+0000 7f7a18800640 1 -- 172.21.15.153:0/3267205895 >> 172.21.15.153:0/3267205895 conn(0x7f7a100b1a30 msgr2=0x7f7a100b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.846+0000 7f7a18800640 1 -- 172.21.15.153:0/3267205895 shutdown_connections 2024-03-28T21:52:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.846+0000 7f7a18800640 1 -- 172.21.15.153:0/3267205895 wait complete. 2024-03-28T21:52:22.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.848+0000 7f7a18800640 1 Processor -- start 2024-03-28T21:52:22.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.848+0000 7f7a18800640 1 -- start start 2024-03-28T21:52:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a18800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79f80039e0 0x7f7a1009d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a18800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a10151320 0x7f7a1014c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a18800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a100cd360 0x7f7a100ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a18800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a100ae4d0 con 0x7f7a100cd360 2024-03-28T21:52:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a18800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7a100b3100 con 0x7f7a10151320 2024-03-28T21:52:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a18800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7a1015cf00 con 0x7f79f80039e0 2024-03-28T21:52:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a16800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a100cd360 0x7f7a100ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a16800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a100cd360 0x7f7a100ce890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47536/0 (socket says 172.21.15.153:47536) 2024-03-28T21:52:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a16800640 1 -- 172.21.15.153:0/4035769779 learned_addr learned my addr 172.21.15.153:0/4035769779 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a15400640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a10151320 0x7f7a1014c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a15e00640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79f80039e0 0x7f7a1009d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a16800640 1 -- 172.21.15.153:0/4035769779 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79f80039e0 msgr2=0x7f7a1009d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a16800640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79f80039e0 0x7f7a1009d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a16800640 1 -- 172.21.15.153:0/4035769779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a10151320 msgr2=0x7f7a1014c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a16800640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a10151320 0x7f7a1014c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a16800640 1 -- 172.21.15.153:0/4035769779 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a100cd7f0 con 0x7f7a100cd360 2024-03-28T21:52:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a15e00640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79f80039e0 0x7f7a1009d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.849+0000 7f7a15400640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a10151320 0x7f7a1014c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.850+0000 7f7a16800640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a100cd360 0x7f7a100ce890 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a1009e0d0 tx=0x7f7a0c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.850+0000 7f7a0a000640 1 -- 172.21.15.153:0/4035769779 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c006d50 con 0x7f7a100cd360 2024-03-28T21:52:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.850+0000 7f7a0a000640 1 -- 172.21.15.153:0/4035769779 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a0c003970 con 0x7f7a100cd360 2024-03-28T21:52:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.850+0000 7f7a18800640 1 -- 172.21.15.153:0/4035769779 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a100cdab0 con 0x7f7a100cd360 2024-03-28T21:52:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.850+0000 7f7a0a000640 1 -- 172.21.15.153:0/4035769779 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c003da0 con 0x7f7a100cd360 2024-03-28T21:52:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.850+0000 7f7a18800640 1 -- 172.21.15.153:0/4035769779 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1009aca0 con 0x7f7a100cd360 2024-03-28T21:52:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.851+0000 7f7a18800640 1 -- 172.21.15.153:0/4035769779 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a10068ff0 con 0x7f7a100cd360 2024-03-28T21:52:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.852+0000 7f7a0a000640 1 -- 172.21.15.153:0/4035769779 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f7a0c01b020 con 0x7f7a100cd360 2024-03-28T21:52:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.853+0000 7f7a0a000640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f79f406b500 0x7f79f406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.853+0000 7f7a0a000640 1 -- 172.21.15.153:0/4035769779 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7a0c089f60 con 0x7f7a100cd360 2024-03-28T21:52:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.853+0000 7f7a15e00640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f79f406b500 0x7f79f406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:22.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.854+0000 7f7a15e00640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f79f406b500 0x7f79f406d9c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a04034000 tx=0x7f7a04009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:22.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:22.857+0000 7f7a0a000640 1 -- 172.21.15.153:0/4035769779 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7a0c01ce40 con 0x7f7a100cd360 2024-03-28T21:52:23.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:23.100+0000 7f7a18800640 1 -- 172.21.15.153:0/4035769779 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7a100b45c0 con 0x7f7a100cd360 2024-03-28T21:52:23.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:23.101+0000 7f7a0a000640 1 -- 172.21.15.153:0/4035769779 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f7a0c058d40 con 0x7f7a100cd360 2024-03-28T21:52:23.103 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-28T21:52:23.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:23.104+0000 7f7a18800640 1 -- 172.21.15.153:0/4035769779 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f79f406b500 msgr2=0x7f79f406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:23.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:23.104+0000 7f7a18800640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f79f406b500 0x7f79f406d9c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a04034000 tx=0x7f7a04009030 comp rx=0 tx=0).stop 2024-03-28T21:52:23.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:23.104+0000 7f7a18800640 1 -- 172.21.15.153:0/4035769779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a100cd360 msgr2=0x7f7a100ce890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:23.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:23.104+0000 7f7a18800640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a100cd360 0x7f7a100ce890 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a1009e0d0 tx=0x7f7a0c00dc00 comp rx=0 tx=0).stop 2024-03-28T21:52:23.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:23.104+0000 7f7a18800640 1 -- 172.21.15.153:0/4035769779 shutdown_connections 2024-03-28T21:52:23.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:23.104+0000 7f7a18800640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f79f406b500 0x7f79f406d9c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:23.104+0000 7f7a18800640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a100cd360 0x7f7a100ce890 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:23.104+0000 7f7a18800640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a10151320 0x7f7a1014c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:23.104+0000 7f7a18800640 1 --2- 172.21.15.153:0/4035769779 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79f80039e0 0x7f7a1009d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:23.104+0000 7f7a18800640 1 -- 172.21.15.153:0/4035769779 >> 172.21.15.153:0/4035769779 conn(0x7f7a100b1a30 msgr2=0x7f7a1015da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:23.104+0000 7f7a18800640 1 -- 172.21.15.153:0/4035769779 shutdown_connections 2024-03-28T21:52:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:23.104+0000 7f7a18800640 1 -- 172.21.15.153:0/4035769779 wait complete. 2024-03-28T21:52:23.126 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-28T21:52:23.126 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-28T21:52:23.126 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-03-28T21:52:23.126 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-28T21:52:23.126 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-28T21:52:23.126 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-28T21:52:23.126 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-28T21:52:23.126 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-28T21:52:23.126 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-28T21:52:23.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:23.127 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-03-28T21:52:23.182 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-28T21:52:23.182 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-28T21:52:23.182 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-28T21:52:23.183 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42582sec preferred_lft 42582sec 2024-03-28T21:52:23.184 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link 2024-03-28T21:52:23.184 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:23.185 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-28T21:52:23.185 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:23.185 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-03-28T21:52:23.185 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link add name ceph-brx type bridge 2024-03-28T21:52:23.185 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip addr flush dev ceph-brx 2024-03-28T21:52:23.185 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set ceph-brx up 2024-03-28T21:52:23.185 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-28T21:52:23.186 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-03-28T21:52:23.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:23.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:23.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:23.707 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-28T21:52:23.782 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-03-28T21:52:23.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:23.787 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-03-28T21:52:23.851 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-03-28T21:52:23.852 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-28T21:52:23.852 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-28T21:52:23.852 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-28T21:52:23.852 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-28T21:52:23.853 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:23.853 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-03-28T21:52:23.853 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-28T21:52:23.853 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-28T21:52:23.853 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-28T21:52:23.853 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-03-28T21:52:23.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:24.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:24.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:24.605 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-03-28T21:52:24.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:24.656 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list-id 2024-03-28T21:52:24.713 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:24.714 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-03-28T21:52:24.714 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-28T21:52:24.714 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-28T21:52:24.714 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-03-28T21:52:24.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:24.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:24.918 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-28T21:52:24.919 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:24.919 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-03-28T21:52:24.919 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-28T21:52:24.919 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-28T21:52:24.919 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-28T21:52:24.919 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-28T21:52:24.919 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-28T21:52:24.919 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-03-28T21:52:25.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:25.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:25.255 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:25.256 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-03-28T21:52:25.256 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-03-28T21:52:25.256 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set dev brx.0 master ceph-brx 2024-03-28T21:52:25.256 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-03-28T21:52:25.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:25.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:25.480 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T21:52:25.481 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-28T21:52:25.523 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-28T21:52:25.523 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T21:52:25.523 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-28T21:52:25.607 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-28T21:52:25.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:25.607 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-28T21:52:25.762 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-28T21:52:25.763 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-28T21:52:25.763 INFO:teuthology.orchestra.run.smithi165.stdout:invalid new device string format 2024-03-28T21:52:26.408 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-28T21:52:26.409 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-28T21:52:26.409 INFO:teuthology.orchestra.run.smithi165.stdout:invalid new device string format 2024-03-28T21:52:26.409 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-03-28T21:52:26.409 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-28T21:52:26.442 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-28T21:52:26.442 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-28T21:52:26.442 INFO:teuthology.orchestra.run.smithi165.stdout:invalid new device string format 2024-03-28T21:52:26.442 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-03-28T21:52:26.442 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-28T21:52:26.443 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.165:6789,172.21.15.165:6790" 2024-03-28T21:52:26.443 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.165:6789,172.21.15.165:6790:/ 2024-03-28T21:52:26.443 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=2549e48d-ef7b-419c-89c4-4d0726d7d873" will pass to kernel 2024-03-28T21:52:26.450 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-28T21:52:26.450 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-03-28T21:52:26.450 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-28T21:52:26.451 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-03-28T21:52:26.451 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-28T21:52:26.456 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-28T21:52:26.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:26.456 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-28T21:52:26.536 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T21:52:26.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T21:52:26.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:26.639 INFO:teuthology.orchestra.run.smithi165.stdout:client4546 2024-03-28T21:52:26.640 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:52:26.640 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:26.685 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T21:52:26.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T21:52:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:26.840 INFO:teuthology.orchestra.run.smithi165.stdout:client4546 2024-03-28T21:52:26.840 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T21:52:26.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T21:52:26.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:26.953 INFO:teuthology.orchestra.run.smithi165.stdout:client4546 2024-03-28T21:52:26.953 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2549e48d-ef7b-419c-89c4-4d0726d7d873.client4546/status') 2024-03-28T21:52:27.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:27.090 INFO:teuthology.orchestra.run.smithi165.stdout:instance: client.4546 (3)192.168.0.1:0/4289860010 2024-03-28T21:52:27.091 INFO:teuthology.orchestra.run.smithi165.stdout:blocklisted: false 2024-03-28T21:52:27.091 INFO:teuthology.orchestra.run.smithi165.stderr:0+1 records in 2024-03-28T21:52:27.091 INFO:teuthology.orchestra.run.smithi165.stderr:0+1 records out 2024-03-28T21:52:27.091 INFO:teuthology.orchestra.run.smithi165.stderr:69 bytes copied, 7.3497e-05 s, 939 kB/s 2024-03-28T21:52:27.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:27.103 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-03-28T21:52:27.104 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-28T21:52:27.104 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-28T21:52:27.104 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-28T21:52:27.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.315+0000 7f349f000640 1 Processor -- start 2024-03-28T21:52:27.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.316+0000 7f349f000640 1 -- start start 2024-03-28T21:52:27.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.317+0000 7f349f000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3498159a10 0x7f349815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:27.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.317+0000 7f349f000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f34980ad830 0x7f349806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:27.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.317+0000 7f349f000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349806e270 0x7f349815fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:27.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.317+0000 7f349f000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f349806e6e0 con 0x7f3498159a10 2024-03-28T21:52:27.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.317+0000 7f349f000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f34980b2e60 con 0x7f34980ad830 2024-03-28T21:52:27.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.317+0000 7f349f000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f34980adc70 con 0x7f349806e270 2024-03-28T21:52:27.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.317+0000 7f3497e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3498159a10 0x7f349815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:27.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.318+0000 7f3497e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3498159a10 0x7f349815cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46086/0 (socket says 172.21.15.153:46086) 2024-03-28T21:52:27.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.318+0000 7f3497e00640 1 -- 172.21.15.153:0/3754723536 learned_addr learned my addr 172.21.15.153:0/3754723536 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:27.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.318+0000 7f348f400640 1 --2- 172.21.15.153:0/3754723536 >> v2:172.21.15.165:3300/0 conn(0x7f34980ad830 0x7f349806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:27.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.318+0000 7f349d000640 1 --2- 172.21.15.153:0/3754723536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349806e270 0x7f349815fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:27.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.318+0000 7f3497e00640 1 -- 172.21.15.153:0/3754723536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349806e270 msgr2=0x7f349815fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:27.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.318+0000 7f3497e00640 1 --2- 172.21.15.153:0/3754723536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349806e270 0x7f349815fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:27.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.318+0000 7f3497e00640 1 -- 172.21.15.153:0/3754723536 >> v2:172.21.15.165:3300/0 conn(0x7f34980ad830 msgr2=0x7f349806dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:27.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.318+0000 7f3497e00640 1 --2- 172.21.15.153:0/3754723536 >> v2:172.21.15.165:3300/0 conn(0x7f34980ad830 0x7f349806dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:27.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.318+0000 7f3497e00640 1 -- 172.21.15.153:0/3754723536 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3498159df0 con 0x7f3498159a10 2024-03-28T21:52:27.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.319+0000 7f3497e00640 1 --2- 172.21.15.153:0/3754723536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3498159a10 0x7f349815cf00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f34980736e0 tx=0x7f348802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4698a78185d8fef2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:27.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.319+0000 7f3497400640 1 -- 172.21.15.153:0/3754723536 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348802c9e0 con 0x7f3498159a10 2024-03-28T21:52:27.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.320+0000 7f3497400640 1 -- 172.21.15.153:0/3754723536 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348802cb80 con 0x7f3498159a10 2024-03-28T21:52:27.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.320+0000 7f3497400640 1 -- 172.21.15.153:0/3754723536 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34880343f0 con 0x7f3498159a10 2024-03-28T21:52:27.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.321+0000 7f349f000640 1 -- 172.21.15.153:0/3754723536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3498159a10 msgr2=0x7f349815cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:27.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.321+0000 7f349f000640 1 --2- 172.21.15.153:0/3754723536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3498159a10 0x7f349815cf00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f34980736e0 tx=0x7f348802be40 comp rx=0 tx=0).stop 2024-03-28T21:52:27.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.321+0000 7f349f000640 1 -- 172.21.15.153:0/3754723536 shutdown_connections 2024-03-28T21:52:27.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.321+0000 7f349f000640 1 --2- 172.21.15.153:0/3754723536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349806e270 0x7f349815fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:27.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.321+0000 7f349f000640 1 --2- 172.21.15.153:0/3754723536 >> v2:172.21.15.165:3300/0 conn(0x7f34980ad830 0x7f349806dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:27.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.321+0000 7f349f000640 1 --2- 172.21.15.153:0/3754723536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3498159a10 0x7f349815cf00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:27.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.321+0000 7f349f000640 1 -- 172.21.15.153:0/3754723536 >> 172.21.15.153:0/3754723536 conn(0x7f34980b1a30 msgr2=0x7f34980b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:27.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.321+0000 7f349f000640 1 -- 172.21.15.153:0/3754723536 shutdown_connections 2024-03-28T21:52:27.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.321+0000 7f349f000640 1 -- 172.21.15.153:0/3754723536 wait complete. 2024-03-28T21:52:27.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.323+0000 7f349f000640 1 Processor -- start 2024-03-28T21:52:27.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.323+0000 7f349f000640 1 -- start start 2024-03-28T21:52:27.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.324+0000 7f349f000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349806e270 0x7f3498152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:27.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.324+0000 7f349f000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34980ad830 0x7f34981f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:27.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.324+0000 7f349f000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3498159a10 0x7f34981eb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:27.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.324+0000 7f349f000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f34980b3100 con 0x7f34980ad830 2024-03-28T21:52:27.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.324+0000 7f349f000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f34980ae1f0 con 0x7f3498159a10 2024-03-28T21:52:27.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.324+0000 7f349f000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f34980ae4d0 con 0x7f349806e270 2024-03-28T21:52:27.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.324+0000 7f348f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34980ad830 0x7f34981f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:27.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.324+0000 7f348f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34980ad830 0x7f34981f52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46100/0 (socket says 172.21.15.153:46100) 2024-03-28T21:52:27.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.324+0000 7f348f400640 1 -- 172.21.15.153:0/1420224998 learned_addr learned my addr 172.21.15.153:0/1420224998 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:27.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.324+0000 7f3497e00640 1 --2- 172.21.15.153:0/1420224998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349806e270 0x7f3498152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:27.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.324+0000 7f348f400640 1 -- 172.21.15.153:0/1420224998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349806e270 msgr2=0x7f3498152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:27.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.324+0000 7f348f400640 1 --2- 172.21.15.153:0/1420224998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349806e270 0x7f3498152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:27.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.324+0000 7f348f400640 1 -- 172.21.15.153:0/1420224998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3498159a10 msgr2=0x7f34981eb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:27.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.324+0000 7f349d000640 1 --2- 172.21.15.153:0/1420224998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3498159a10 0x7f34981eb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:27.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.325+0000 7f348f400640 1 --2- 172.21.15.153:0/1420224998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3498159a10 0x7f34981eb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:27.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.325+0000 7f348f400640 1 -- 172.21.15.153:0/1420224998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3498151d90 con 0x7f34980ad830 2024-03-28T21:52:27.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.325+0000 7f348f400640 1 --2- 172.21.15.153:0/1420224998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34980ad830 0x7f34981f52b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f348000c7f0 tx=0x7f348000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:27.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.325+0000 7f3494c00640 1 -- 172.21.15.153:0/1420224998 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480015070 con 0x7f34980ad830 2024-03-28T21:52:27.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.325+0000 7f3494c00640 1 -- 172.21.15.153:0/1420224998 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3480004240 con 0x7f34980ad830 2024-03-28T21:52:27.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.325+0000 7f3494c00640 1 -- 172.21.15.153:0/1420224998 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480007620 con 0x7f34980ad830 2024-03-28T21:52:27.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.325+0000 7f349f000640 1 -- 172.21.15.153:0/1420224998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3498152070 con 0x7f34980ad830 2024-03-28T21:52:27.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.325+0000 7f349f000640 1 -- 172.21.15.153:0/1420224998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3498152630 con 0x7f34980ad830 2024-03-28T21:52:27.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.326+0000 7f349f000640 1 -- 172.21.15.153:0/1420224998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f349809d990 con 0x7f34980ad830 2024-03-28T21:52:27.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.327+0000 7f3494c00640 1 -- 172.21.15.153:0/1420224998 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f34800079d0 con 0x7f34980ad830 2024-03-28T21:52:27.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.328+0000 7f3494c00640 1 --2- 172.21.15.153:0/1420224998 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f347406b4d0 0x7f347406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:27.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.329+0000 7f3494c00640 1 -- 172.21.15.153:0/1420224998 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f348008a530 con 0x7f34980ad830 2024-03-28T21:52:27.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.329+0000 7f3497e00640 1 --2- 172.21.15.153:0/1420224998 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f347406b4d0 0x7f347406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:27.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.330+0000 7f3497e00640 1 --2- 172.21.15.153:0/1420224998 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f347406b4d0 0x7f347406d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3488035000 tx=0x7f3488030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:27.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.333+0000 7f3494c00640 1 -- 172.21.15.153:0/1420224998 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f349809d990 con 0x7f34980ad830 2024-03-28T21:52:27.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.576+0000 7f349f000640 1 -- 172.21.15.153:0/1420224998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f34980afdd0 con 0x7f34980ad830 2024-03-28T21:52:27.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.577+0000 7f3494c00640 1 -- 172.21.15.153:0/1420224998 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f3480059440 con 0x7f34980ad830 2024-03-28T21:52:27.579 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-28T21:52:27.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.581+0000 7f349f000640 1 -- 172.21.15.153:0/1420224998 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f347406b4d0 msgr2=0x7f347406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:27.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.581+0000 7f349f000640 1 --2- 172.21.15.153:0/1420224998 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f347406b4d0 0x7f347406d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3488035000 tx=0x7f3488030000 comp rx=0 tx=0).stop 2024-03-28T21:52:27.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.581+0000 7f349f000640 1 -- 172.21.15.153:0/1420224998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34980ad830 msgr2=0x7f34981f52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:27.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.581+0000 7f349f000640 1 --2- 172.21.15.153:0/1420224998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34980ad830 0x7f34981f52b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f348000c7f0 tx=0x7f348000ccb0 comp rx=0 tx=0).stop 2024-03-28T21:52:27.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.581+0000 7f349f000640 1 -- 172.21.15.153:0/1420224998 shutdown_connections 2024-03-28T21:52:27.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.581+0000 7f349f000640 1 --2- 172.21.15.153:0/1420224998 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f347406b4d0 0x7f347406d990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:27.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.581+0000 7f349f000640 1 --2- 172.21.15.153:0/1420224998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3498159a10 0x7f34981eb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:27.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.581+0000 7f349f000640 1 --2- 172.21.15.153:0/1420224998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34980ad830 0x7f34981f52b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:27.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.581+0000 7f349f000640 1 --2- 172.21.15.153:0/1420224998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349806e270 0x7f3498152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:27.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.581+0000 7f349f000640 1 -- 172.21.15.153:0/1420224998 >> 172.21.15.153:0/1420224998 conn(0x7f34980b1a30 msgr2=0x7f349806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:27.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.581+0000 7f349f000640 1 -- 172.21.15.153:0/1420224998 shutdown_connections 2024-03-28T21:52:27.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:27.582+0000 7f349f000640 1 -- 172.21.15.153:0/1420224998 wait complete. 2024-03-28T21:52:27.609 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-28T21:52:27.609 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-28T21:52:27.609 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-03-28T21:52:27.609 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-28T21:52:27.609 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-28T21:52:27.609 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-28T21:52:27.609 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-28T21:52:27.609 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-28T21:52:27.609 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-28T21:52:27.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:27.609 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-03-28T21:52:27.668 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-28T21:52:27.668 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-28T21:52:27.668 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-03-28T21:52:27.668 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:27.668 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-03-28T21:52:27.668 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:27.668 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:52:27.668 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:27.668 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-03-28T21:52:27.669 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:52:27.669 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:27.669 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-03-28T21:52:27.669 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:52:27.669 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:27.669 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-28T21:52:27.669 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:27.669 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-28T21:52:27.669 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42577sec preferred_lft 42577sec 2024-03-28T21:52:27.669 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link 2024-03-28T21:52:27.669 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:27.669 INFO:teuthology.orchestra.run.smithi165.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-28T21:52:27.669 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether fe:42:3d:72:58:82 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:52:27.669 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-28T21:52:27.670 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:27.670 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::f4fd:d9ff:fe9a:974f/64 scope link 2024-03-28T21:52:27.670 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:27.670 INFO:teuthology.orchestra.run.smithi165.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-28T21:52:27.670 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether fe:42:3d:72:58:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-28T21:52:27.670 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::fc42:3dff:fe72:5882/64 scope link 2024-03-28T21:52:27.670 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:27.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:27.670 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-28T21:52:27.762 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-03-28T21:52:27.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:27.766 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-03-28T21:52:27.817 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-03-28T21:52:27.817 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-28T21:52:27.817 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-28T21:52:27.817 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-28T21:52:27.817 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-28T21:52:27.818 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:27.818 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-03-28T21:52:27.819 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-28T21:52:27.819 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-28T21:52:27.819 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-28T21:52:27.819 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-03-28T21:52:27.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:28.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:28.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:28.060 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-03-28T21:52:28.109 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-28T21:52:28.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:28.110 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list-id 2024-03-28T21:52:28.160 INFO:teuthology.orchestra.run.smithi165.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-28T21:52:28.161 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:28.162 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-03-28T21:52:28.162 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-28T21:52:28.162 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-28T21:52:28.162 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-03-28T21:52:28.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:28.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:28.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:28.365 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-28T21:52:28.456 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-28T21:52:28.456 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-28T21:52:28.456 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-03-28T21:52:28.456 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:28.456 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-03-28T21:52:28.456 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:28.457 INFO:teuthology.orchestra.run.smithi165.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-28T21:52:28.457 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether b6:d3:89:3d:5c:0a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-28T21:52:28.457 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-28T21:52:28.457 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:28.457 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::b4d3:89ff:fe3d:5c0a/64 scope link 2024-03-28T21:52:28.457 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:28.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:28.460 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-28T21:52:28.555 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-28T21:52:28.556 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-28T21:52:28.556 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-03-28T21:52:28.556 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:28.556 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-03-28T21:52:28.556 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:28.556 INFO:teuthology.orchestra.run.smithi165.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-28T21:52:28.556 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether b6:d3:89:3d:5c:0a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-28T21:52:28.556 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-28T21:52:28.556 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:28.557 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::b4d3:89ff:fe3d:5c0a/64 scope link 2024-03-28T21:52:28.557 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:52:28.560 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-28T21:52:28.560 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:28.560 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-03-28T21:52:28.560 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-28T21:52:28.560 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-28T21:52:28.561 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-28T21:52:28.561 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-28T21:52:28.561 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-28T21:52:28.561 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-03-28T21:52:28.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:28.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:28.925 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:52:28.925 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-03-28T21:52:28.925 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.1 up 2024-03-28T21:52:28.925 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set dev brx.1 master ceph-brx 2024-03-28T21:52:28.925 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-03-28T21:52:29.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:29.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:29.154 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T21:52:29.154 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-28T21:52:29.202 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-28T21:52:29.203 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T21:52:29.203 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-28T21:52:29.250 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-28T21:52:29.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:29.251 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-28T21:52:29.429 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-28T21:52:29.429 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-28T21:52:29.429 INFO:teuthology.orchestra.run.smithi165.stdout:invalid new device string format 2024-03-28T21:52:29.452 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-28T21:52:29.452 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-28T21:52:29.452 INFO:teuthology.orchestra.run.smithi165.stdout:invalid new device string format 2024-03-28T21:52:29.452 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-03-28T21:52:29.452 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-28T21:52:29.480 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-28T21:52:29.481 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-28T21:52:29.481 INFO:teuthology.orchestra.run.smithi165.stdout:invalid new device string format 2024-03-28T21:52:29.481 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-03-28T21:52:29.481 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-28T21:52:29.481 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.165:6789,172.21.15.165:6790" 2024-03-28T21:52:29.481 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.165:6789,172.21.15.165:6790:/ 2024-03-28T21:52:29.481 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=2549e48d-ef7b-419c-89c4-4d0726d7d873" will pass to kernel 2024-03-28T21:52:29.484 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-03-28T21:52:29.484 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-03-28T21:52:29.484 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-28T21:52:29.484 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-03-28T21:52:29.484 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-28T21:52:29.489 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-28T21:52:29.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:29.489 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-28T21:52:29.573 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T21:52:29.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T21:52:29.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:29.693 INFO:teuthology.orchestra.run.smithi165.stdout:client4680 2024-03-28T21:52:29.693 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:52:29.693 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:29.743 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T21:52:29.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T21:52:29.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:29.860 INFO:teuthology.orchestra.run.smithi165.stdout:client4680 2024-03-28T21:52:29.860 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T21:52:29.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T21:52:29.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:29.981 INFO:teuthology.orchestra.run.smithi165.stdout:client4680 2024-03-28T21:52:29.981 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2549e48d-ef7b-419c-89c4-4d0726d7d873.client4680/status') 2024-03-28T21:52:30.084 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:52:30.124 INFO:teuthology.orchestra.run.smithi165.stdout:instance: client.4680 (3)172.21.15.165:0/1575232333 2024-03-28T21:52:30.124 INFO:teuthology.orchestra.run.smithi165.stdout:blocklisted: false 2024-03-28T21:52:30.124 INFO:teuthology.orchestra.run.smithi165.stderr:0+1 records in 2024-03-28T21:52:30.124 INFO:teuthology.orchestra.run.smithi165.stderr:0+1 records out 2024-03-28T21:52:30.124 INFO:teuthology.orchestra.run.smithi165.stderr:71 bytes copied, 7.3514e-05 s, 966 kB/s 2024-03-28T21:52:30.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-03-28T21:52:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:52:30.137 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-28T21:52:30.378 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:30.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.597+0000 7f17b7a00640 1 Processor -- start 2024-03-28T21:52:30.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.597+0000 7f17b7a00640 1 -- start start 2024-03-28T21:52:30.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.598+0000 7f17b7a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f17b006e440 0x7f17b015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:30.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.598+0000 7f17b7a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17b00ad830 0x7f17b00b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:30.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.598+0000 7f17b7a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17b00b2e60 con 0x7f17b0159a10 2024-03-28T21:52:30.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.598+0000 7f17b7a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f17b00adcc0 con 0x7f17b006e440 2024-03-28T21:52:30.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.598+0000 7f17b7a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f17b0159df0 con 0x7f17b00ad830 2024-03-28T21:52:30.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.599+0000 7f17b5000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f17b0159a10 0x7f17b006dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42744/0 (socket says 172.21.15.153:42744) 2024-03-28T21:52:30.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.599+0000 7f17b5000640 1 -- 172.21.15.153:0/1895087724 learned_addr learned my addr 172.21.15.153:0/1895087724 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.599+0000 7f17afe00640 1 -- 172.21.15.153:0/1895087724 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1476833774 0 0) 0x7f17b00b2e60 con 0x7f17b0159a10 2024-03-28T21:52:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.599+0000 7f17a7e00640 1 --2- 172.21.15.153:0/1895087724 >> v2:172.21.15.165:3300/0 conn(0x7f17b006e440 0x7f17b015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.599+0000 7f17b5a00640 1 --2- 172.21.15.153:0/1895087724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17b00ad830 0x7f17b00b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.599+0000 7f17afe00640 1 -- 172.21.15.153:0/1895087724 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1790003520 con 0x7f17b0159a10 2024-03-28T21:52:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.599+0000 7f17afe00640 1 -- 172.21.15.153:0/1895087724 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3335386855 0 0) 0x7f1790003520 con 0x7f17b0159a10 2024-03-28T21:52:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.599+0000 7f17afe00640 1 -- 172.21.15.153:0/1895087724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17b00ad830 msgr2=0x7f17b00b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.599+0000 7f17afe00640 1 --2- 172.21.15.153:0/1895087724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17b00ad830 0x7f17b00b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.599+0000 7f17afe00640 1 -- 172.21.15.153:0/1895087724 >> v2:172.21.15.165:3300/0 conn(0x7f17b006e440 msgr2=0x7f17b015cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.599+0000 7f17afe00640 1 --2- 172.21.15.153:0/1895087724 >> v2:172.21.15.165:3300/0 conn(0x7f17b006e440 0x7f17b015cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.599+0000 7f17afe00640 1 -- 172.21.15.153:0/1895087724 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b00adf10 con 0x7f17b0159a10 2024-03-28T21:52:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17afe00640 1 -- 172.21.15.153:0/1895087724 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f1798001690 con 0x7f17b0159a10 2024-03-28T21:52:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17afe00640 1 -- 172.21.15.153:0/1895087724 >> v1:172.21.15.153:6789/0 conn(0x7f17b0159a10 legacy=0x7f17b006dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17afe00640 1 --2- 172.21.15.153:0/1895087724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17900039b0 0x7f1790003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17afe00640 1 --2- 172.21.15.153:0/1895087724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1790004800 0x7f1790004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17afe00640 1 --2- 172.21.15.153:0/1895087724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17b00ad830 0x7f17900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17afe00640 1 -- 172.21.15.153:0/1895087724 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f17b00adcc0 con 0x7f1790004800 2024-03-28T21:52:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17afe00640 1 -- 172.21.15.153:0/1895087724 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f17b0159df0 con 0x7f17900039b0 2024-03-28T21:52:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17afe00640 1 -- 172.21.15.153:0/1895087724 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f179000bb20 con 0x7f17b00ad830 2024-03-28T21:52:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17a7e00640 1 --2- 172.21.15.153:0/1895087724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1790004800 0x7f1790004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17b5000640 1 --2- 172.21.15.153:0/1895087724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17900039b0 0x7f1790003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17a7e00640 1 -- 172.21.15.153:0/1895087724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17b00ad830 msgr2=0x7f17900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17a7e00640 1 --2- 172.21.15.153:0/1895087724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17b00ad830 0x7f17900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17a7e00640 1 -- 172.21.15.153:0/1895087724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17900039b0 msgr2=0x7f1790003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17a7e00640 1 --2- 172.21.15.153:0/1895087724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17900039b0 0x7f1790003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.600+0000 7f17a7e00640 1 -- 172.21.15.153:0/1895087724 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1790003520 con 0x7f1790004800 2024-03-28T21:52:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.601+0000 7f17a7e00640 1 --2- 172.21.15.153:0/1895087724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1790004800 0x7f1790004c80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f17a000ba00 tx=0x7f1790005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb1d975f7b3a197 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:30.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.602+0000 7f17afe00640 1 -- 172.21.15.153:0/1895087724 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a0036020 con 0x7f1790004800 2024-03-28T21:52:30.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.602+0000 7f17afe00640 1 -- 172.21.15.153:0/1895087724 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a0032630 con 0x7f1790004800 2024-03-28T21:52:30.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.602+0000 7f17afe00640 1 -- 172.21.15.153:0/1895087724 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a000b600 con 0x7f1790004800 2024-03-28T21:52:30.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.602+0000 7f17b7a00640 1 -- 172.21.15.153:0/1895087724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1790004800 msgr2=0x7f1790004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:30.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.602+0000 7f17b7a00640 1 --2- 172.21.15.153:0/1895087724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1790004800 0x7f1790004c80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f17a000ba00 tx=0x7f1790005830 comp rx=0 tx=0).stop 2024-03-28T21:52:30.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.602+0000 7f17b5a00640 1 -- 172.21.15.153:0/1895087724 reap_dead start 2024-03-28T21:52:30.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.602+0000 7f17b7a00640 1 -- 172.21.15.153:0/1895087724 shutdown_connections 2024-03-28T21:52:30.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.602+0000 7f17b7a00640 1 -- 172.21.15.153:0/1895087724 >> 172.21.15.153:0/1895087724 conn(0x7f17b00b1a30 msgr2=0x7f17b00b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:30.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.602+0000 7f17b7a00640 1 -- 172.21.15.153:0/1895087724 shutdown_connections 2024-03-28T21:52:30.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.603+0000 7f17b7a00640 1 -- 172.21.15.153:0/1895087724 wait complete. 2024-03-28T21:52:30.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.604+0000 7f17b7a00640 1 Processor -- start 2024-03-28T21:52:30.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.604+0000 7f17b7a00640 1 -- start start 2024-03-28T21:52:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.605+0000 7f17b7a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1790004800 0x7f17b00cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.605+0000 7f17b7a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17b00ce6b0 0x7f17b009ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.605+0000 7f17b7a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b0157de0 0x7f17b0154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.605+0000 7f17b7a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f17b00ae4d0 con 0x7f17b0157de0 2024-03-28T21:52:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.605+0000 7f17b7a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f17b00b3100 con 0x7f17b00ce6b0 2024-03-28T21:52:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.605+0000 7f17b7a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f17b00b3620 con 0x7f1790004800 2024-03-28T21:52:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.606+0000 7f17b5a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b0157de0 0x7f17b0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.606+0000 7f17b5a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b0157de0 0x7f17b0154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46116/0 (socket says 172.21.15.153:46116) 2024-03-28T21:52:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.606+0000 7f17b5a00640 1 -- 172.21.15.153:0/2236653707 learned_addr learned my addr 172.21.15.153:0/2236653707 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.606+0000 7f17b5000640 1 --2- 172.21.15.153:0/2236653707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1790004800 0x7f17b00cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.606+0000 7f17a7e00640 1 --2- 172.21.15.153:0/2236653707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17b00ce6b0 0x7f17b009ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.606+0000 7f17b5a00640 1 -- 172.21.15.153:0/2236653707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1790004800 msgr2=0x7f17b00cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.606+0000 7f17b5a00640 1 --2- 172.21.15.153:0/2236653707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1790004800 0x7f17b00cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.606+0000 7f17b5a00640 1 -- 172.21.15.153:0/2236653707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17b00ce6b0 msgr2=0x7f17b009ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.606+0000 7f17b5a00640 1 --2- 172.21.15.153:0/2236653707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17b00ce6b0 0x7f17b009ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.606+0000 7f17b5a00640 1 -- 172.21.15.153:0/2236653707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b00ccf20 con 0x7f17b0157de0 2024-03-28T21:52:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.606+0000 7f17b5a00640 1 --2- 172.21.15.153:0/2236653707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b0157de0 0x7f17b0154530 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f17b0073090 tx=0x7f17a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.607+0000 7f17ad600640 1 -- 172.21.15.153:0/2236653707 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a800ed90 con 0x7f17b0157de0 2024-03-28T21:52:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.607+0000 7f17ad600640 1 -- 172.21.15.153:0/2236653707 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a8019070 con 0x7f17b0157de0 2024-03-28T21:52:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.607+0000 7f17b7a00640 1 -- 172.21.15.153:0/2236653707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b00cd200 con 0x7f17b0157de0 2024-03-28T21:52:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.607+0000 7f17ad600640 1 -- 172.21.15.153:0/2236653707 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a8014660 con 0x7f17b0157de0 2024-03-28T21:52:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.607+0000 7f17b7a00640 1 -- 172.21.15.153:0/2236653707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b00cd7c0 con 0x7f17b0157de0 2024-03-28T21:52:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.608+0000 7f17b7a00640 1 -- 172.21.15.153:0/2236653707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17b0068ff0 con 0x7f17b0157de0 2024-03-28T21:52:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.609+0000 7f17ad600640 1 -- 172.21.15.153:0/2236653707 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f17a8014800 con 0x7f17b0157de0 2024-03-28T21:52:30.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.610+0000 7f17ad600640 1 --2- 172.21.15.153:0/2236653707 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f178c06b500 0x7f178c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:30.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.610+0000 7f17ad600640 1 -- 172.21.15.153:0/2236653707 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f17a808a5d0 con 0x7f17b0157de0 2024-03-28T21:52:30.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.610+0000 7f17b5000640 1 --2- 172.21.15.153:0/2236653707 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f178c06b500 0x7f178c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:30.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.611+0000 7f17b5000640 1 --2- 172.21.15.153:0/2236653707 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f178c06b500 0x7f178c06d9c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1798001050 tx=0x7f1798009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:30.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.615+0000 7f17ad600640 1 -- 172.21.15.153:0/2236653707 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f17a80593b0 con 0x7f17b0157de0 2024-03-28T21:52:30.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.810+0000 7f17b7a00640 1 -- 172.21.15.153:0/2236653707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17b015b440 con 0x7f17b0157de0 2024-03-28T21:52:30.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.813+0000 7f17ad600640 1 -- 172.21.15.153:0/2236653707 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f17a8058cb0 con 0x7f17b0157de0 2024-03-28T21:52:30.815 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:30.815 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:57.716531+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:30.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.815+0000 7f17b7a00640 1 -- 172.21.15.153:0/2236653707 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f178c06b500 msgr2=0x7f178c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:30.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.815+0000 7f17b7a00640 1 --2- 172.21.15.153:0/2236653707 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f178c06b500 0x7f178c06d9c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1798001050 tx=0x7f1798009040 comp rx=0 tx=0).stop 2024-03-28T21:52:30.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.815+0000 7f17b7a00640 1 -- 172.21.15.153:0/2236653707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b0157de0 msgr2=0x7f17b0154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:30.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.815+0000 7f17b7a00640 1 --2- 172.21.15.153:0/2236653707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b0157de0 0x7f17b0154530 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f17b0073090 tx=0x7f17a800e4b0 comp rx=0 tx=0).stop 2024-03-28T21:52:30.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.816+0000 7f17b7a00640 1 -- 172.21.15.153:0/2236653707 shutdown_connections 2024-03-28T21:52:30.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.816+0000 7f17b7a00640 1 --2- 172.21.15.153:0/2236653707 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f178c06b500 0x7f178c06d9c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:30.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.816+0000 7f17b7a00640 1 --2- 172.21.15.153:0/2236653707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17b0157de0 0x7f17b0154530 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:30.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.816+0000 7f17b7a00640 1 --2- 172.21.15.153:0/2236653707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17b00ce6b0 0x7f17b009ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:30.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.816+0000 7f17b7a00640 1 --2- 172.21.15.153:0/2236653707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1790004800 0x7f17b00cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:30.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.816+0000 7f17b7a00640 1 -- 172.21.15.153:0/2236653707 >> 172.21.15.153:0/2236653707 conn(0x7f17b00b1a30 msgr2=0x7f17b0158c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:30.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.816+0000 7f17b7a00640 1 -- 172.21.15.153:0/2236653707 shutdown_connections 2024-03-28T21:52:30.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:30.816+0000 7f17b7a00640 1 -- 172.21.15.153:0/2236653707 wait complete. 2024-03-28T21:52:30.837 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T21:51:53.863931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T21:51:55.188736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T21:52:30.838 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T21:52:31.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.053+0000 7fed61600640 1 Processor -- start 2024-03-28T21:52:31.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.053+0000 7fed61600640 1 -- start start 2024-03-28T21:52:31.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.056+0000 7fed61600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fed5c0d22d0 0x7fed5c0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.056+0000 7fed61600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fed5c0d2730 0x7fed5c0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.056+0000 7fed61600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed5c0cff40 con 0x7fed5c15e0e0 2024-03-28T21:52:31.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.056+0000 7fed61600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fed5c0cf980 con 0x7fed5c0d2730 2024-03-28T21:52:31.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.056+0000 7fed61600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fed5c0cfc60 con 0x7fed5c0d22d0 2024-03-28T21:52:31.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.056+0000 7fed60c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fed5c0d2730 0x7fed5c0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.056+0000 7fed60c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fed5c0d2730 0x7fed5c0c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46128/0 (socket says 172.21.15.153:46128) 2024-03-28T21:52:31.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.056+0000 7fed60c00640 1 -- 172.21.15.153:0/2411991081 learned_addr learned my addr 172.21.15.153:0/2411991081 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:31.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.057+0000 7fed53400640 1 --2- 172.21.15.153:0/2411991081 >> v2:172.21.15.165:3300/0 conn(0x7fed5c0d22d0 0x7fed5c0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.057+0000 7fed60c00640 1 -- 172.21.15.153:0/2411991081 >> v2:172.21.15.165:3300/0 conn(0x7fed5c0d22d0 msgr2=0x7fed5c0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:31.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.057+0000 7fed60c00640 1 --2- 172.21.15.153:0/2411991081 >> v2:172.21.15.165:3300/0 conn(0x7fed5c0d22d0 0x7fed5c0c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.057+0000 7fed60c00640 1 -- 172.21.15.153:0/2411991081 >> v1:172.21.15.165:6789/0 conn(0x7fed5c15e0e0 legacy=0x7fed5c0d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:31.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.057+0000 7fed60c00640 1 -- 172.21.15.153:0/2411991081 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c0c7be0 con 0x7fed5c0d2730 2024-03-28T21:52:31.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.058+0000 7fed60c00640 1 --2- 172.21.15.153:0/2411991081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed5c0d2730 0x7fed5c0c8920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fed5c06bad0 tx=0x7fed5402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80cc443b41f839b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:31.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.058+0000 7fed5b400640 1 -- 172.21.15.153:0/2411991081 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54035020 con 0x7fed5c0d2730 2024-03-28T21:52:31.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.058+0000 7fed5b400640 1 -- 172.21.15.153:0/2411991081 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed54031870 con 0x7fed5c0d2730 2024-03-28T21:52:31.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.058+0000 7fed5b400640 1 -- 172.21.15.153:0/2411991081 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54031c40 con 0x7fed5c0d2730 2024-03-28T21:52:31.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.059+0000 7fed61600640 1 -- 172.21.15.153:0/2411991081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed5c0d2730 msgr2=0x7fed5c0c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.059+0000 7fed61600640 1 --2- 172.21.15.153:0/2411991081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed5c0d2730 0x7fed5c0c8920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fed5c06bad0 tx=0x7fed5402b910 comp rx=0 tx=0).stop 2024-03-28T21:52:31.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.059+0000 7fed61600640 1 -- 172.21.15.153:0/2411991081 shutdown_connections 2024-03-28T21:52:31.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.059+0000 7fed61600640 1 --2- 172.21.15.153:0/2411991081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed5c0d2730 0x7fed5c0c8920 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.059+0000 7fed61600640 1 --2- 172.21.15.153:0/2411991081 >> v2:172.21.15.165:3300/0 conn(0x7fed5c0d22d0 0x7fed5c0c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.059+0000 7fed61600640 1 -- 172.21.15.153:0/2411991081 >> 172.21.15.153:0/2411991081 conn(0x7fed5c0d3ff0 msgr2=0x7fed5c0d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:31.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.059+0000 7fed61600640 1 -- 172.21.15.153:0/2411991081 shutdown_connections 2024-03-28T21:52:31.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.059+0000 7fed61600640 1 -- 172.21.15.153:0/2411991081 wait complete. 2024-03-28T21:52:31.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.061+0000 7fed61600640 1 Processor -- start 2024-03-28T21:52:31.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.061+0000 7fed61600640 1 -- start start 2024-03-28T21:52:31.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.062+0000 7fed61600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed5c0d22d0 0x7fed5c156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.062+0000 7fed61600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed5c0d2730 0x7fed5c0cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.062+0000 7fed61600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed5c15e0e0 0x7fed5c0cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.062+0000 7fed61600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c0d4d40 con 0x7fed5c0d2730 2024-03-28T21:52:31.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.062+0000 7fed61600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c0d18d0 con 0x7fed5c0d22d0 2024-03-28T21:52:31.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.062+0000 7fed61600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fed5c0cf610 con 0x7fed5c15e0e0 2024-03-28T21:52:31.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.063+0000 7fed53400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed5c0d2730 0x7fed5c0cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.063+0000 7fed53400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed5c0d2730 0x7fed5c0cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46132/0 (socket says 172.21.15.153:46132) 2024-03-28T21:52:31.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.063+0000 7fed53400640 1 -- 172.21.15.153:0/3390646782 learned_addr learned my addr 172.21.15.153:0/3390646782 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:31.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.063+0000 7fed60c00640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed5c15e0e0 0x7fed5c0cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.063+0000 7fed5be00640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed5c0d22d0 0x7fed5c156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.063+0000 7fed53400640 1 -- 172.21.15.153:0/3390646782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed5c15e0e0 msgr2=0x7fed5c0cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.063+0000 7fed53400640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed5c15e0e0 0x7fed5c0cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.063+0000 7fed53400640 1 -- 172.21.15.153:0/3390646782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed5c0d22d0 msgr2=0x7fed5c156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.063+0000 7fed53400640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed5c0d22d0 0x7fed5c156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.063+0000 7fed53400640 1 -- 172.21.15.153:0/3390646782 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c0cdfa0 con 0x7fed5c0d2730 2024-03-28T21:52:31.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.063+0000 7fed5be00640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed5c0d22d0 0x7fed5c156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:31.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.063+0000 7fed53400640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed5c0d2730 0x7fed5c0cd520 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fed4400d830 tx=0x7fed4400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:31.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.064+0000 7fed58c00640 1 -- 172.21.15.153:0/3390646782 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4400b6c0 con 0x7fed5c0d2730 2024-03-28T21:52:31.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.064+0000 7fed58c00640 1 -- 172.21.15.153:0/3390646782 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed44019070 con 0x7fed5c0d2730 2024-03-28T21:52:31.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.064+0000 7fed58c00640 1 -- 172.21.15.153:0/3390646782 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4400ba80 con 0x7fed5c0d2730 2024-03-28T21:52:31.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.064+0000 7fed61600640 1 -- 172.21.15.153:0/3390646782 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5c159420 con 0x7fed5c0d2730 2024-03-28T21:52:31.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.064+0000 7fed61600640 1 -- 172.21.15.153:0/3390646782 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5c14a8e0 con 0x7fed5c0d2730 2024-03-28T21:52:31.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.065+0000 7fed61600640 1 -- 172.21.15.153:0/3390646782 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed5c068ff0 con 0x7fed5c0d2730 2024-03-28T21:52:31.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.066+0000 7fed58c00640 1 -- 172.21.15.153:0/3390646782 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fed4401e460 con 0x7fed5c0d2730 2024-03-28T21:52:31.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.067+0000 7fed58c00640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fed3806b4d0 0x7fed3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.067+0000 7fed58c00640 1 -- 172.21.15.153:0/3390646782 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fed4408a950 con 0x7fed5c0d2730 2024-03-28T21:52:31.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.067+0000 7fed5be00640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fed3806b4d0 0x7fed3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.068+0000 7fed5be00640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fed3806b4d0 0x7fed3806d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed4c007e90 tx=0x7fed4c0073a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:31.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.072+0000 7fed58c00640 1 -- 172.21.15.153:0/3390646782 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fed5c0cdfa0 con 0x7fed5c0d2730 2024-03-28T21:52:31.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.265+0000 7fed61600640 1 -- 172.21.15.153:0/3390646782 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fed5c0d0160 con 0x7fed5c0d2730 2024-03-28T21:52:31.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.266+0000 7fed58c00640 1 -- 172.21.15.153:0/3390646782 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fed44059730 con 0x7fed5c0d2730 2024-03-28T21:52:31.268 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-28T21:52:31.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.268+0000 7fed61600640 1 -- 172.21.15.153:0/3390646782 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fed3806b4d0 msgr2=0x7fed3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.268+0000 7fed61600640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fed3806b4d0 0x7fed3806d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed4c007e90 tx=0x7fed4c0073a0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.268+0000 7fed61600640 1 -- 172.21.15.153:0/3390646782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed5c0d2730 msgr2=0x7fed5c0cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.268+0000 7fed61600640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed5c0d2730 0x7fed5c0cd520 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fed4400d830 tx=0x7fed4400dcf0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.269+0000 7fed61600640 1 -- 172.21.15.153:0/3390646782 shutdown_connections 2024-03-28T21:52:31.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.269+0000 7fed61600640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fed3806b4d0 0x7fed3806d990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.269+0000 7fed61600640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed5c15e0e0 0x7fed5c0cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.269+0000 7fed61600640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed5c0d2730 0x7fed5c0cd520 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.269+0000 7fed61600640 1 --2- 172.21.15.153:0/3390646782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed5c0d22d0 0x7fed5c156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.269+0000 7fed61600640 1 -- 172.21.15.153:0/3390646782 >> 172.21.15.153:0/3390646782 conn(0x7fed5c0d3ff0 msgr2=0x7fed5c15d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:31.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.269+0000 7fed61600640 1 -- 172.21.15.153:0/3390646782 shutdown_connections 2024-03-28T21:52:31.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.269+0000 7fed61600640 1 -- 172.21.15.153:0/3390646782 wait complete. 2024-03-28T21:52:31.289 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T21:52:31.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.497+0000 7f08af200640 1 Processor -- start 2024-03-28T21:52:31.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.497+0000 7f08af200640 1 -- start start 2024-03-28T21:52:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.498+0000 7f08af200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f08a815e950 0x7f08a80cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.498+0000 7f08af200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f08a80b4b40 0x7f08a806dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.498+0000 7f08af200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a80b3b60 con 0x7f08a8151550 2024-03-28T21:52:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.498+0000 7f08af200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f08a806d750 con 0x7f08a815e950 2024-03-28T21:52:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.498+0000 7f08af200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f08a80b46a0 con 0x7f08a80b4b40 2024-03-28T21:52:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.499+0000 7f08ad400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f08a815e950 0x7f08a80cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.499+0000 7f08ad400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f08a815e950 0x7f08a80cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46134/0 (socket says 172.21.15.153:46134) 2024-03-28T21:52:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.499+0000 7f08ad400640 1 -- 172.21.15.153:0/1305414713 learned_addr learned my addr 172.21.15.153:0/1305414713 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.499+0000 7f08ae800640 1 --2- 172.21.15.153:0/1305414713 >> v2:172.21.15.165:3300/0 conn(0x7f08a80b4b40 0x7f08a806dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.499+0000 7f08ad400640 1 -- 172.21.15.153:0/1305414713 >> v2:172.21.15.165:3300/0 conn(0x7f08a80b4b40 msgr2=0x7f08a806dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:31.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.499+0000 7f08ad400640 1 --2- 172.21.15.153:0/1305414713 >> v2:172.21.15.165:3300/0 conn(0x7f08a80b4b40 0x7f08a806dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.499+0000 7f08ad400640 1 -- 172.21.15.153:0/1305414713 >> v1:172.21.15.165:6789/0 conn(0x7f08a8151550 legacy=0x7f08a815e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.499+0000 7f08ad400640 1 -- 172.21.15.153:0/1305414713 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a80b3e00 con 0x7f08a815e950 2024-03-28T21:52:31.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.500+0000 7f08ad400640 1 --2- 172.21.15.153:0/1305414713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a815e950 0x7f08a80cf570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f08a806f860 tx=0x7f089802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e849ac46daf8ba server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:31.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.501+0000 7f08aca00640 1 -- 172.21.15.153:0/1305414713 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898035020 con 0x7f08a815e950 2024-03-28T21:52:31.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.501+0000 7f08aca00640 1 -- 172.21.15.153:0/1305414713 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0898031870 con 0x7f08a815e950 2024-03-28T21:52:31.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.501+0000 7f08aca00640 1 -- 172.21.15.153:0/1305414713 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898031c40 con 0x7f08a815e950 2024-03-28T21:52:31.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.501+0000 7f08af200640 1 -- 172.21.15.153:0/1305414713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a815e950 msgr2=0x7f08a80cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.501+0000 7f08af200640 1 --2- 172.21.15.153:0/1305414713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a815e950 0x7f08a80cf570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f08a806f860 tx=0x7f089802b910 comp rx=0 tx=0).stop 2024-03-28T21:52:31.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.501+0000 7f08af200640 1 -- 172.21.15.153:0/1305414713 shutdown_connections 2024-03-28T21:52:31.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.501+0000 7f08af200640 1 --2- 172.21.15.153:0/1305414713 >> v2:172.21.15.165:3300/0 conn(0x7f08a80b4b40 0x7f08a806dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.501+0000 7f08af200640 1 --2- 172.21.15.153:0/1305414713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a815e950 0x7f08a80cf570 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.501+0000 7f08af200640 1 -- 172.21.15.153:0/1305414713 >> 172.21.15.153:0/1305414713 conn(0x7f08a80b1820 msgr2=0x7f08a80b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:31.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.502+0000 7f08af200640 1 -- 172.21.15.153:0/1305414713 shutdown_connections 2024-03-28T21:52:31.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.502+0000 7f08af200640 1 -- 172.21.15.153:0/1305414713 wait complete. 2024-03-28T21:52:31.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.504+0000 7f08af200640 1 Processor -- start 2024-03-28T21:52:31.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.504+0000 7f08af200640 1 -- start start 2024-03-28T21:52:31.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.505+0000 7f08af200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08a80b4b40 0x7f08a80b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.505+0000 7f08af200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a8151550 0x7f08a80b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.505+0000 7f08af200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08a815e950 0x7f08a8153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.505+0000 7f08af200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f08a8151930 con 0x7f08a8151550 2024-03-28T21:52:31.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.505+0000 7f08af200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f08a80b43c0 con 0x7f08a80b4b40 2024-03-28T21:52:31.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.506+0000 7f08af200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f08a8151ab0 con 0x7f08a815e950 2024-03-28T21:52:31.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.506+0000 7f08ad400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a8151550 0x7f08a80b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.506+0000 7f08ad400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a8151550 0x7f08a80b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46140/0 (socket says 172.21.15.153:46140) 2024-03-28T21:52:31.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.506+0000 7f08ad400640 1 -- 172.21.15.153:0/2798796520 learned_addr learned my addr 172.21.15.153:0/2798796520 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:31.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.506+0000 7f08ae800640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08a815e950 0x7f08a8153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.506+0000 7f08ade00640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08a80b4b40 0x7f08a80b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.506+0000 7f08ad400640 1 -- 172.21.15.153:0/2798796520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08a815e950 msgr2=0x7f08a8153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.506+0000 7f08ad400640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08a815e950 0x7f08a8153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.506+0000 7f08ad400640 1 -- 172.21.15.153:0/2798796520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08a80b4b40 msgr2=0x7f08a80b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.506+0000 7f08ad400640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08a80b4b40 0x7f08a80b0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.506+0000 7f08ad400640 1 -- 172.21.15.153:0/2798796520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a8149420 con 0x7f08a8151550 2024-03-28T21:52:31.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.506+0000 7f08ae800640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08a815e950 0x7f08a8153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:31.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.506+0000 7f08ade00640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08a80b4b40 0x7f08a80b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:31.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.507+0000 7f08ad400640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a8151550 0x7f08a80b10c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f089802b950 tx=0x7f08980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:31.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.507+0000 7f08a2000640 1 -- 172.21.15.153:0/2798796520 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898040070 con 0x7f08a8151550 2024-03-28T21:52:31.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.507+0000 7f08a2000640 1 -- 172.21.15.153:0/2798796520 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0898030d00 con 0x7f08a8151550 2024-03-28T21:52:31.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.507+0000 7f08a2000640 1 -- 172.21.15.153:0/2798796520 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898035040 con 0x7f08a8151550 2024-03-28T21:52:31.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.507+0000 7f08af200640 1 -- 172.21.15.153:0/2798796520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a8149700 con 0x7f08a8151550 2024-03-28T21:52:31.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.507+0000 7f08af200640 1 -- 172.21.15.153:0/2798796520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a8149040 con 0x7f08a8151550 2024-03-28T21:52:31.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.508+0000 7f08af200640 1 -- 172.21.15.153:0/2798796520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a8068ff0 con 0x7f08a8151550 2024-03-28T21:52:31.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.509+0000 7f08a2000640 1 -- 172.21.15.153:0/2798796520 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f089804b060 con 0x7f08a8151550 2024-03-28T21:52:31.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.510+0000 7f08a2000640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f088c06b500 0x7f088c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.510+0000 7f08a2000640 1 -- 172.21.15.153:0/2798796520 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f08980abff0 con 0x7f08a8151550 2024-03-28T21:52:31.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.510+0000 7f08ade00640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f088c06b500 0x7f088c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.511+0000 7f08ade00640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f088c06b500 0x7f088c06d9c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f089c000f60 tx=0x7f089c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:31.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.519+0000 7f08a2000640 1 -- 172.21.15.153:0/2798796520 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f089807ae10 con 0x7f08a8151550 2024-03-28T21:52:31.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.714+0000 7f08af200640 1 -- 172.21.15.153:0/2798796520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f08a80b20b0 con 0x7f08a8151550 2024-03-28T21:52:31.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.715+0000 7f08a2000640 1 -- 172.21.15.153:0/2798796520 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f089807a710 con 0x7f08a8151550 2024-03-28T21:52:31.716 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-03-28T21:52:31.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.718+0000 7f08af200640 1 -- 172.21.15.153:0/2798796520 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f088c06b500 msgr2=0x7f088c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.718+0000 7f08af200640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f088c06b500 0x7f088c06d9c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f089c000f60 tx=0x7f089c009040 comp rx=0 tx=0).stop 2024-03-28T21:52:31.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.718+0000 7f08af200640 1 -- 172.21.15.153:0/2798796520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a8151550 msgr2=0x7f08a80b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.718+0000 7f08af200640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a8151550 0x7f08a80b10c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f089802b950 tx=0x7f08980046c0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.718+0000 7f08af200640 1 -- 172.21.15.153:0/2798796520 shutdown_connections 2024-03-28T21:52:31.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.718+0000 7f08af200640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f088c06b500 0x7f088c06d9c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.718+0000 7f08af200640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08a815e950 0x7f08a8153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.718+0000 7f08af200640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08a8151550 0x7f08a80b10c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.718+0000 7f08af200640 1 --2- 172.21.15.153:0/2798796520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08a80b4b40 0x7f08a80b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.718+0000 7f08af200640 1 -- 172.21.15.153:0/2798796520 >> 172.21.15.153:0/2798796520 conn(0x7f08a80b1820 msgr2=0x7f08a815c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:31.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.719+0000 7f08af200640 1 -- 172.21.15.153:0/2798796520 shutdown_connections 2024-03-28T21:52:31.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.719+0000 7f08af200640 1 -- 172.21.15.153:0/2798796520 wait complete. 2024-03-28T21:52:31.738 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T21:52:31.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.959+0000 7f4c5d000640 1 Processor -- start 2024-03-28T21:52:31.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.960+0000 7f4c5d000640 1 -- start start 2024-03-28T21:52:31.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.961+0000 7f4c5d000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4c580acd80 0x7f4c58071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.961+0000 7f4c5d000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4c580728c0 0x7f4c5806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.961+0000 7f4c5d000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c58070f20 con 0x7f4c580cef30 2024-03-28T21:52:31.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.962+0000 7f4c5d000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4c58071200 con 0x7f4c580728c0 2024-03-28T21:52:31.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.962+0000 7f4c5d000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4c580714e0 con 0x7f4c580acd80 2024-03-28T21:52:31.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.962+0000 7f4c55e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4c580cef30 0x7f4c580cf310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42760/0 (socket says 172.21.15.153:42760) 2024-03-28T21:52:31.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.962+0000 7f4c55e00640 1 -- 172.21.15.153:0/1196016823 learned_addr learned my addr 172.21.15.153:0/1196016823 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:31.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.962+0000 7f4c56800640 1 --2- 172.21.15.153:0/1196016823 >> v2:172.21.15.153:3300/0 conn(0x7f4c580728c0 0x7f4c5806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.962+0000 7f4c4d400640 1 --2- 172.21.15.153:0/1196016823 >> v2:172.21.15.165:3300/0 conn(0x7f4c580acd80 0x7f4c58071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.962+0000 7f4c55400640 1 -- 172.21.15.153:0/1196016823 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3049148514 0 0) 0x7f4c58070f20 con 0x7f4c580cef30 2024-03-28T21:52:31.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.962+0000 7f4c55400640 1 -- 172.21.15.153:0/1196016823 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c3c003520 con 0x7f4c580cef30 2024-03-28T21:52:31.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.963+0000 7f4c56800640 1 -- 172.21.15.153:0/1196016823 >> v2:172.21.15.165:3300/0 conn(0x7f4c580acd80 msgr2=0x7f4c58071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:31.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.963+0000 7f4c56800640 1 --2- 172.21.15.153:0/1196016823 >> v2:172.21.15.165:3300/0 conn(0x7f4c580acd80 0x7f4c58071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.963+0000 7f4c56800640 1 -- 172.21.15.153:0/1196016823 >> v1:172.21.15.153:6789/0 conn(0x7f4c580cef30 legacy=0x7f4c580cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.963+0000 7f4c56800640 1 -- 172.21.15.153:0/1196016823 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c580717c0 con 0x7f4c580728c0 2024-03-28T21:52:31.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.964+0000 7f4c56800640 1 --2- 172.21.15.153:0/1196016823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c580728c0 0x7f4c5806cb00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4c5806f820 tx=0x7f4c5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ce25c256e9d81a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:31.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.964+0000 7f4c55400640 1 -- 172.21.15.153:0/1196016823 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c50035020 con 0x7f4c580728c0 2024-03-28T21:52:31.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.964+0000 7f4c55400640 1 -- 172.21.15.153:0/1196016823 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c50031830 con 0x7f4c580728c0 2024-03-28T21:52:31.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.964+0000 7f4c55400640 1 -- 172.21.15.153:0/1196016823 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c50031be0 con 0x7f4c580728c0 2024-03-28T21:52:31.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.965+0000 7f4c5d000640 1 -- 172.21.15.153:0/1196016823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c580728c0 msgr2=0x7f4c5806cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.965+0000 7f4c5d000640 1 --2- 172.21.15.153:0/1196016823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c580728c0 0x7f4c5806cb00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4c5806f820 tx=0x7f4c5002b8d0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.965+0000 7f4c5d000640 1 -- 172.21.15.153:0/1196016823 shutdown_connections 2024-03-28T21:52:31.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.965+0000 7f4c5d000640 1 --2- 172.21.15.153:0/1196016823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c580728c0 0x7f4c5806cb00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.965+0000 7f4c5d000640 1 --2- 172.21.15.153:0/1196016823 >> v2:172.21.15.165:3300/0 conn(0x7f4c580acd80 0x7f4c58071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.965+0000 7f4c5d000640 1 -- 172.21.15.153:0/1196016823 >> 172.21.15.153:0/1196016823 conn(0x7f4c580b19a0 msgr2=0x7f4c580b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:31.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.965+0000 7f4c5d000640 1 -- 172.21.15.153:0/1196016823 shutdown_connections 2024-03-28T21:52:31.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.965+0000 7f4c5d000640 1 -- 172.21.15.153:0/1196016823 wait complete. 2024-03-28T21:52:31.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.966+0000 7f4c5d000640 1 Processor -- start 2024-03-28T21:52:31.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.967+0000 7f4c5d000640 1 -- start start 2024-03-28T21:52:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.967+0000 7f4c5d000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c580728c0 0x7f4c5814e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.968+0000 7f4c5d000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c580acd80 0x7f4c580b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.968+0000 7f4c5d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c580cef30 0x7f4c580b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.968+0000 7f4c5d000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5815c370 con 0x7f4c580acd80 2024-03-28T21:52:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.968+0000 7f4c5d000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5815c1f0 con 0x7f4c580728c0 2024-03-28T21:52:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.968+0000 7f4c5d000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5806d040 con 0x7f4c580cef30 2024-03-28T21:52:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.968+0000 7f4c4d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c580acd80 0x7f4c580b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.968+0000 7f4c4d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c580acd80 0x7f4c580b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46156/0 (socket says 172.21.15.153:46156) 2024-03-28T21:52:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.968+0000 7f4c4d400640 1 -- 172.21.15.153:0/1297848442 learned_addr learned my addr 172.21.15.153:0/1297848442 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.968+0000 7f4c55e00640 1 --2- 172.21.15.153:0/1297848442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c580728c0 0x7f4c5814e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.968+0000 7f4c4d400640 1 -- 172.21.15.153:0/1297848442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c580cef30 msgr2=0x7f4c580b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.968+0000 7f4c4d400640 1 --2- 172.21.15.153:0/1297848442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c580cef30 0x7f4c580b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.968+0000 7f4c4d400640 1 -- 172.21.15.153:0/1297848442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c580728c0 msgr2=0x7f4c5814e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:31.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.968+0000 7f4c4d400640 1 --2- 172.21.15.153:0/1297848442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c580728c0 0x7f4c5814e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:31.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.968+0000 7f4c4d400640 1 -- 172.21.15.153:0/1297848442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5809b510 con 0x7f4c580acd80 2024-03-28T21:52:31.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.969+0000 7f4c4d400640 1 --2- 172.21.15.153:0/1297848442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c580acd80 0x7f4c580b3cc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000d800 tx=0x7f4c4000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:31.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.969+0000 7f4c4ea00640 1 -- 172.21.15.153:0/1297848442 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000b6c0 con 0x7f4c580acd80 2024-03-28T21:52:31.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.969+0000 7f4c4ea00640 1 -- 172.21.15.153:0/1297848442 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c40019070 con 0x7f4c580acd80 2024-03-28T21:52:31.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.969+0000 7f4c4ea00640 1 -- 172.21.15.153:0/1297848442 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000ba80 con 0x7f4c580acd80 2024-03-28T21:52:31.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.969+0000 7f4c5d000640 1 -- 172.21.15.153:0/1297848442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c5809b7f0 con 0x7f4c580acd80 2024-03-28T21:52:31.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.969+0000 7f4c5d000640 1 -- 172.21.15.153:0/1297848442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c5809bdb0 con 0x7f4c580acd80 2024-03-28T21:52:31.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.970+0000 7f4c5d000640 1 -- 172.21.15.153:0/1297848442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c58068ff0 con 0x7f4c580acd80 2024-03-28T21:52:31.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.971+0000 7f4c4ea00640 1 -- 172.21.15.153:0/1297848442 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f4c4000bc20 con 0x7f4c580acd80 2024-03-28T21:52:31.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.973+0000 7f4c4ea00640 1 --2- 172.21.15.153:0/1297848442 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4c3406b4d0 0x7f4c3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:31.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.973+0000 7f4c4ea00640 1 -- 172.21.15.153:0/1297848442 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4c4008a7e0 con 0x7f4c580acd80 2024-03-28T21:52:31.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.973+0000 7f4c55e00640 1 --2- 172.21.15.153:0/1297848442 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4c3406b4d0 0x7f4c3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:31.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.974+0000 7f4c55e00640 1 --2- 172.21.15.153:0/1297848442 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4c3406b4d0 0x7f4c3406d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4c480012e0 tx=0x7f4c48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:31.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:31.977+0000 7f4c4ea00640 1 -- 172.21.15.153:0/1297848442 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4c40059530 con 0x7f4c580acd80 2024-03-28T21:52:32.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.172+0000 7f4c5d000640 1 -- 172.21.15.153:0/1297848442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4c5815b8a0 con 0x7f4c580acd80 2024-03-28T21:52:32.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.173+0000 7f4c4ea00640 1 -- 172.21.15.153:0/1297848442 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f4c40058e30 con 0x7f4c580acd80 2024-03-28T21:52:32.174 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-03-28T21:52:32.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.175+0000 7f4c5d000640 1 -- 172.21.15.153:0/1297848442 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4c3406b4d0 msgr2=0x7f4c3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:32.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.175+0000 7f4c5d000640 1 --2- 172.21.15.153:0/1297848442 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4c3406b4d0 0x7f4c3406d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4c480012e0 tx=0x7f4c48009040 comp rx=0 tx=0).stop 2024-03-28T21:52:32.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.175+0000 7f4c5d000640 1 -- 172.21.15.153:0/1297848442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c580acd80 msgr2=0x7f4c580b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:32.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.175+0000 7f4c5d000640 1 --2- 172.21.15.153:0/1297848442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c580acd80 0x7f4c580b3cc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000d800 tx=0x7f4c4000dcc0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.176+0000 7f4c5d000640 1 -- 172.21.15.153:0/1297848442 shutdown_connections 2024-03-28T21:52:32.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.176+0000 7f4c5d000640 1 --2- 172.21.15.153:0/1297848442 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4c3406b4d0 0x7f4c3406d990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.176+0000 7f4c5d000640 1 --2- 172.21.15.153:0/1297848442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c580cef30 0x7f4c580b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.176+0000 7f4c5d000640 1 --2- 172.21.15.153:0/1297848442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c580acd80 0x7f4c580b3cc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.176+0000 7f4c5d000640 1 --2- 172.21.15.153:0/1297848442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c580728c0 0x7f4c5814e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.176+0000 7f4c5d000640 1 -- 172.21.15.153:0/1297848442 >> 172.21.15.153:0/1297848442 conn(0x7f4c580b19a0 msgr2=0x7f4c5815e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:32.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.176+0000 7f4c5d000640 1 -- 172.21.15.153:0/1297848442 shutdown_connections 2024-03-28T21:52:32.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.176+0000 7f4c5d000640 1 -- 172.21.15.153:0/1297848442 wait complete. 2024-03-28T21:52:32.200 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:32.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.435+0000 7f58c7e00640 1 Processor -- start 2024-03-28T21:52:32.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.435+0000 7f58c7e00640 1 -- start start 2024-03-28T21:52:32.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.436+0000 7f58c7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c806b170 0x7f58c806b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:32.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.437+0000 7f58c7e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58c80ad8c0 0x7f58c80add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:32.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.437+0000 7f58c7e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58c80b4990 con 0x7f58c8147880 2024-03-28T21:52:32.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.437+0000 7f58c7e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f58c806bb10 con 0x7f58c80ad8c0 2024-03-28T21:52:32.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.437+0000 7f58c7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f58c80b55a0 con 0x7f58c806b170 2024-03-28T21:52:32.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.437+0000 7f58c6a00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f58c8147880 0x7f58c80b3ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42766/0 (socket says 172.21.15.153:42766) 2024-03-28T21:52:32.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.437+0000 7f58c6a00640 1 -- 172.21.15.153:0/1207642214 learned_addr learned my addr 172.21.15.153:0/1207642214 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:32.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.437+0000 7f58c7400640 1 --2- 172.21.15.153:0/1207642214 >> v2:172.21.15.153:3300/0 conn(0x7f58c80ad8c0 0x7f58c80add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:32.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.437+0000 7f58c6000640 1 --2- 172.21.15.153:0/1207642214 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c806b170 0x7f58c806b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:32.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.437+0000 7f58c5600640 1 -- 172.21.15.153:0/1207642214 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4275892175 0 0) 0x7f58c80b4990 con 0x7f58c8147880 2024-03-28T21:52:32.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.437+0000 7f58c7400640 1 -- 172.21.15.153:0/1207642214 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c806b170 msgr2=0x7f58c806b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:32.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.437+0000 7f58c7400640 1 --2- 172.21.15.153:0/1207642214 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c806b170 0x7f58c806b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.437+0000 7f58c7400640 1 -- 172.21.15.153:0/1207642214 >> v1:172.21.15.153:6789/0 conn(0x7f58c8147880 legacy=0x7f58c80b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:32.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.437+0000 7f58c7400640 1 -- 172.21.15.153:0/1207642214 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c80b4c70 con 0x7f58c80ad8c0 2024-03-28T21:52:32.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.439+0000 7f58c7400640 1 --2- 172.21.15.153:0/1207642214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c80ad8c0 0x7f58c80add30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f58b80097a0 tx=0x7f58b802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddeb443889ee579a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:32.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.439+0000 7f58c5600640 1 -- 172.21.15.153:0/1207642214 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b80315a0 con 0x7f58c80ad8c0 2024-03-28T21:52:32.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.439+0000 7f58c5600640 1 -- 172.21.15.153:0/1207642214 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b8037070 con 0x7f58c80ad8c0 2024-03-28T21:52:32.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.439+0000 7f58c5600640 1 -- 172.21.15.153:0/1207642214 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8031960 con 0x7f58c80ad8c0 2024-03-28T21:52:32.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.439+0000 7f58c7e00640 1 -- 172.21.15.153:0/1207642214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c80ad8c0 msgr2=0x7f58c80add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:32.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.439+0000 7f58c7e00640 1 --2- 172.21.15.153:0/1207642214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c80ad8c0 0x7f58c80add30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f58b80097a0 tx=0x7f58b802b840 comp rx=0 tx=0).stop 2024-03-28T21:52:32.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.440+0000 7f58c7e00640 1 -- 172.21.15.153:0/1207642214 shutdown_connections 2024-03-28T21:52:32.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.440+0000 7f58c7e00640 1 --2- 172.21.15.153:0/1207642214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c80ad8c0 0x7f58c80add30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.440+0000 7f58c7e00640 1 --2- 172.21.15.153:0/1207642214 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c806b170 0x7f58c806b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.440+0000 7f58c7e00640 1 -- 172.21.15.153:0/1207642214 >> 172.21.15.153:0/1207642214 conn(0x7f58c80b28a0 msgr2=0x7f58c80b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:32.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.440+0000 7f58c7e00640 1 -- 172.21.15.153:0/1207642214 shutdown_connections 2024-03-28T21:52:32.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.440+0000 7f58c7e00640 1 -- 172.21.15.153:0/1207642214 wait complete. 2024-03-28T21:52:32.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.441+0000 7f58c7e00640 1 Processor -- start 2024-03-28T21:52:32.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.441+0000 7f58c7e00640 1 -- start start 2024-03-28T21:52:32.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.442+0000 7f58c7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58c806b170 0x7f58c815d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:32.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.442+0000 7f58c7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c80ad8c0 0x7f58c81436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:32.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.442+0000 7f58c7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c8147880 0x7f58c8143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:32.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.442+0000 7f58c7e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f58c8147c60 con 0x7f58c80ad8c0 2024-03-28T21:52:32.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.442+0000 7f58c7e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f58c80b5230 con 0x7f58c806b170 2024-03-28T21:52:32.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.442+0000 7f58c7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f58c8070400 con 0x7f58c8147880 2024-03-28T21:52:32.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.443+0000 7f58c6000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c80ad8c0 0x7f58c81436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:32.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.443+0000 7f58c6000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c80ad8c0 0x7f58c81436f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46178/0 (socket says 172.21.15.153:46178) 2024-03-28T21:52:32.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.443+0000 7f58c6000640 1 -- 172.21.15.153:0/3154395005 learned_addr learned my addr 172.21.15.153:0/3154395005 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:32.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.443+0000 7f58c6a00640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58c806b170 0x7f58c815d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:32.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.443+0000 7f58c7400640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c8147880 0x7f58c8143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:32.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.443+0000 7f58c6000640 1 -- 172.21.15.153:0/3154395005 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c8147880 msgr2=0x7f58c8143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:32.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.443+0000 7f58c6000640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c8147880 0x7f58c8143c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.443+0000 7f58c6000640 1 -- 172.21.15.153:0/3154395005 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58c806b170 msgr2=0x7f58c815d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:32.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.443+0000 7f58c6000640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58c806b170 0x7f58c815d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.443+0000 7f58c6000640 1 -- 172.21.15.153:0/3154395005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c813fa00 con 0x7f58c80ad8c0 2024-03-28T21:52:32.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.443+0000 7f58c7400640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c8147880 0x7f58c8143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:32.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.443+0000 7f58c6000640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c80ad8c0 0x7f58c81436f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f58b000d830 tx=0x7f58b000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:32.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.444+0000 7f58bea00640 1 -- 172.21.15.153:0/3154395005 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b000b6c0 con 0x7f58c80ad8c0 2024-03-28T21:52:32.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.444+0000 7f58bea00640 1 -- 172.21.15.153:0/3154395005 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b0019070 con 0x7f58c80ad8c0 2024-03-28T21:52:32.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.444+0000 7f58bea00640 1 -- 172.21.15.153:0/3154395005 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b000ba80 con 0x7f58c80ad8c0 2024-03-28T21:52:32.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.444+0000 7f58c7e00640 1 -- 172.21.15.153:0/3154395005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c813fce0 con 0x7f58c80ad8c0 2024-03-28T21:52:32.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.444+0000 7f58c7e00640 1 -- 172.21.15.153:0/3154395005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c81402a0 con 0x7f58c80ad8c0 2024-03-28T21:52:32.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.445+0000 7f58c7e00640 1 -- 172.21.15.153:0/3154395005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c804f520 con 0x7f58c80ad8c0 2024-03-28T21:52:32.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.446+0000 7f58bea00640 1 -- 172.21.15.153:0/3154395005 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f58b001e460 con 0x7f58c80ad8c0 2024-03-28T21:52:32.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.447+0000 7f58bea00640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f58a406b4d0 0x7f58a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:32.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.447+0000 7f58bea00640 1 -- 172.21.15.153:0/3154395005 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f58b008a950 con 0x7f58c80ad8c0 2024-03-28T21:52:32.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.448+0000 7f58c6a00640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f58a406b4d0 0x7f58a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:32.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.448+0000 7f58c6a00640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f58a406b4d0 0x7f58a406d990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f58c00012e0 tx=0x7f58c0005eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:32.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.452+0000 7f58bea00640 1 -- 172.21.15.153:0/3154395005 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f58b0059730 con 0x7f58c80ad8c0 2024-03-28T21:52:32.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.649+0000 7f58c7e00640 1 -- 172.21.15.153:0/3154395005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58c8146f30 con 0x7f58c80ad8c0 2024-03-28T21:52:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.651+0000 7f58bea00640 1 -- 172.21.15.153:0/3154395005 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f58b0059030 con 0x7f58c80ad8c0 2024-03-28T21:52:32.653 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:32.653 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:57.716531+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:32.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.654+0000 7f58c7e00640 1 -- 172.21.15.153:0/3154395005 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f58a406b4d0 msgr2=0x7f58a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.654+0000 7f58c7e00640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f58a406b4d0 0x7f58a406d990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f58c00012e0 tx=0x7f58c0005eb0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.654+0000 7f58c7e00640 1 -- 172.21.15.153:0/3154395005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c80ad8c0 msgr2=0x7f58c81436f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.654+0000 7f58c7e00640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c80ad8c0 0x7f58c81436f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f58b000d830 tx=0x7f58b000dcf0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.654+0000 7f58c7e00640 1 -- 172.21.15.153:0/3154395005 shutdown_connections 2024-03-28T21:52:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.654+0000 7f58c7e00640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f58a406b4d0 0x7f58a406d990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.654+0000 7f58c7e00640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c8147880 0x7f58c8143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.654+0000 7f58c7e00640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58c80ad8c0 0x7f58c81436f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.654+0000 7f58c7e00640 1 --2- 172.21.15.153:0/3154395005 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58c806b170 0x7f58c815d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.654+0000 7f58c7e00640 1 -- 172.21.15.153:0/3154395005 >> 172.21.15.153:0/3154395005 conn(0x7f58c80b28a0 msgr2=0x7f58c80b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.654+0000 7f58c7e00640 1 -- 172.21.15.153:0/3154395005 shutdown_connections 2024-03-28T21:52:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.654+0000 7f58c7e00640 1 -- 172.21.15.153:0/3154395005 wait complete. 2024-03-28T21:52:32.673 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T21:51:53.863931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T21:51:55.188736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T21:52:32.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T21:52:32.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.878+0000 7fad02400640 1 Processor -- start 2024-03-28T21:52:32.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.879+0000 7fad02400640 1 -- start start 2024-03-28T21:52:32.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.881+0000 7fad02400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7facfc15e290 0x7facfc06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:32.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.882+0000 7fad02400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc0ade20 0x7facfc06c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:32.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.882+0000 7fad02400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facfc0ae450 con 0x7facfc0721b0 2024-03-28T21:52:32.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.882+0000 7fad02400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7facfc0b4410 con 0x7facfc15e290 2024-03-28T21:52:32.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.882+0000 7fad02400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7facfc06dc30 con 0x7facfc0ade20 2024-03-28T21:52:32.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.882+0000 7facfb400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7facfc15e290 0x7facfc06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:32.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.882+0000 7facf2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc0ade20 0x7facfc06c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:32.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.882+0000 7facf2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc0ade20 0x7facfc06c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:36412/0 (socket says 172.21.15.153:36412) 2024-03-28T21:52:32.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.882+0000 7facf2a00640 1 -- 172.21.15.153:0/2108616831 learned_addr learned my addr 172.21.15.153:0/2108616831 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:32.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.883+0000 7facfaa00640 1 -- 172.21.15.153:0/2108616831 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3569060229 0 0) 0x7facfc0ae450 con 0x7facfc0721b0 2024-03-28T21:52:32.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.883+0000 7facfaa00640 1 -- 172.21.15.153:0/2108616831 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7face0003520 con 0x7facfc0721b0 2024-03-28T21:52:32.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.883+0000 7facf2a00640 1 -- 172.21.15.153:0/2108616831 >> v2:172.21.15.165:3300/0 conn(0x7facfc15e290 msgr2=0x7facfc06d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:32.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.883+0000 7facf2a00640 1 --2- 172.21.15.153:0/2108616831 >> v2:172.21.15.165:3300/0 conn(0x7facfc15e290 0x7facfc06d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.883+0000 7facf2a00640 1 -- 172.21.15.153:0/2108616831 >> v1:172.21.15.165:6789/0 conn(0x7facfc0721b0 legacy=0x7facfc0b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:32.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.883+0000 7facf2a00640 1 -- 172.21.15.153:0/2108616831 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc0ae730 con 0x7facfc0ade20 2024-03-28T21:52:32.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.883+0000 7facfb400640 1 --2- 172.21.15.153:0/2108616831 >> v2:172.21.15.165:3300/0 conn(0x7facfc15e290 0x7facfc06d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:52:32.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.885+0000 7facf2a00640 1 --2- 172.21.15.153:0/2108616831 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc0ade20 0x7facfc06c180 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7face4009870 tx=0x7face402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87283f0fa9e97f29 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:32.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.885+0000 7facfaa00640 1 -- 172.21.15.153:0/2108616831 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face40317c0 con 0x7facfc0ade20 2024-03-28T21:52:32.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.885+0000 7facfaa00640 1 -- 172.21.15.153:0/2108616831 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face4037070 con 0x7facfc0ade20 2024-03-28T21:52:32.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.885+0000 7facfaa00640 1 -- 172.21.15.153:0/2108616831 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4031b80 con 0x7facfc0ade20 2024-03-28T21:52:32.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.885+0000 7fad02400640 1 -- 172.21.15.153:0/2108616831 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc0ade20 msgr2=0x7facfc06c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:32.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.885+0000 7fad02400640 1 --2- 172.21.15.153:0/2108616831 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc0ade20 0x7facfc06c180 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7face4009870 tx=0x7face402b860 comp rx=0 tx=0).stop 2024-03-28T21:52:32.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.886+0000 7fad02400640 1 -- 172.21.15.153:0/2108616831 shutdown_connections 2024-03-28T21:52:32.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.886+0000 7fad02400640 1 --2- 172.21.15.153:0/2108616831 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc0ade20 0x7facfc06c180 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.886+0000 7fad02400640 1 --2- 172.21.15.153:0/2108616831 >> v2:172.21.15.165:3300/0 conn(0x7facfc15e290 0x7facfc06d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.886+0000 7fad02400640 1 -- 172.21.15.153:0/2108616831 >> 172.21.15.153:0/2108616831 conn(0x7facfc071690 msgr2=0x7facfc071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:32.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.886+0000 7fad02400640 1 -- 172.21.15.153:0/2108616831 shutdown_connections 2024-03-28T21:52:32.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.886+0000 7fad02400640 1 -- 172.21.15.153:0/2108616831 wait complete. 2024-03-28T21:52:32.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.887+0000 7fad02400640 1 Processor -- start 2024-03-28T21:52:32.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.887+0000 7fad02400640 1 -- start start 2024-03-28T21:52:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.888+0000 7fad02400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facfc0721b0 0x7facfc157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.888+0000 7fad02400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc0ade20 0x7facfc0ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.888+0000 7fad02400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc15e290 0x7facfc0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.888+0000 7fad02400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7facfc0aea10 con 0x7facfc0721b0 2024-03-28T21:52:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.888+0000 7fad02400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7facfc072870 con 0x7facfc15e290 2024-03-28T21:52:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.888+0000 7fad02400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7facfc06c6c0 con 0x7facfc0ade20 2024-03-28T21:52:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.889+0000 7facfb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facfc0721b0 0x7facfc157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.889+0000 7facfb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facfc0721b0 0x7facfc157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46184/0 (socket says 172.21.15.153:46184) 2024-03-28T21:52:32.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.889+0000 7facfb400640 1 -- 172.21.15.153:0/944877766 learned_addr learned my addr 172.21.15.153:0/944877766 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:32.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.889+0000 7facf2a00640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc0ade20 0x7facfc0ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:32.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.889+0000 7facfbe00640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc15e290 0x7facfc0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:32.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.889+0000 7facfb400640 1 -- 172.21.15.153:0/944877766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc0ade20 msgr2=0x7facfc0ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:32.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.889+0000 7facfb400640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc0ade20 0x7facfc0ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.889+0000 7facfb400640 1 -- 172.21.15.153:0/944877766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc15e290 msgr2=0x7facfc0cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:32.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.889+0000 7facfb400640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc15e290 0x7facfc0cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:32.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.889+0000 7facfb400640 1 -- 172.21.15.153:0/944877766 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc157f90 con 0x7facfc0721b0 2024-03-28T21:52:32.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.889+0000 7facf2a00640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc0ade20 0x7facfc0ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:32.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.889+0000 7facfbe00640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc15e290 0x7facfc0cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:32.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.889+0000 7facfb400640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facfc0721b0 0x7facfc157a50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7facec00e990 tx=0x7facec00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:32.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.890+0000 7facf3e00640 1 -- 172.21.15.153:0/944877766 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec017070 con 0x7facfc0721b0 2024-03-28T21:52:32.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.890+0000 7facf3e00640 1 -- 172.21.15.153:0/944877766 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facec00c9e0 con 0x7facfc0721b0 2024-03-28T21:52:32.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.890+0000 7facf3e00640 1 -- 172.21.15.153:0/944877766 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec00cdb0 con 0x7facfc0721b0 2024-03-28T21:52:32.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.890+0000 7fad02400640 1 -- 172.21.15.153:0/944877766 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facfc0c6190 con 0x7facfc0721b0 2024-03-28T21:52:32.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.890+0000 7fad02400640 1 -- 172.21.15.153:0/944877766 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facfc0c6750 con 0x7facfc0721b0 2024-03-28T21:52:32.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.891+0000 7fad02400640 1 -- 172.21.15.153:0/944877766 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facfc068ff0 con 0x7facfc0721b0 2024-03-28T21:52:32.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.893+0000 7facf3e00640 1 -- 172.21.15.153:0/944877766 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7facec01a070 con 0x7facfc0721b0 2024-03-28T21:52:32.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.894+0000 7facf3e00640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7facd806b4d0 0x7facd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:32.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.894+0000 7facf3e00640 1 -- 172.21.15.153:0/944877766 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7facec08a500 con 0x7facfc0721b0 2024-03-28T21:52:32.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.894+0000 7facf2a00640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7facd806b4d0 0x7facd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:32.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.895+0000 7facf2a00640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7facd806b4d0 0x7facd806d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7face4036000 tx=0x7face4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:32.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:32.901+0000 7facf3e00640 1 -- 172.21.15.153:0/944877766 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7facfc157f90 con 0x7facfc0721b0 2024-03-28T21:52:33.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.101+0000 7fad02400640 1 -- 172.21.15.153:0/944877766 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7facfc06ca90 con 0x7facfc0721b0 2024-03-28T21:52:33.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.102+0000 7facf3e00640 1 -- 172.21.15.153:0/944877766 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7facec0592e0 con 0x7facfc0721b0 2024-03-28T21:52:33.103 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-28T21:52:33.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.104+0000 7fad02400640 1 -- 172.21.15.153:0/944877766 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7facd806b4d0 msgr2=0x7facd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:33.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.104+0000 7fad02400640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7facd806b4d0 0x7facd806d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7face4036000 tx=0x7face4008030 comp rx=0 tx=0).stop 2024-03-28T21:52:33.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.104+0000 7fad02400640 1 -- 172.21.15.153:0/944877766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facfc0721b0 msgr2=0x7facfc157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:33.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.104+0000 7fad02400640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facfc0721b0 0x7facfc157a50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7facec00e990 tx=0x7facec00ee50 comp rx=0 tx=0).stop 2024-03-28T21:52:33.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.105+0000 7fad02400640 1 -- 172.21.15.153:0/944877766 shutdown_connections 2024-03-28T21:52:33.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.105+0000 7fad02400640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7facd806b4d0 0x7facd806d990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.105+0000 7fad02400640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc15e290 0x7facfc0cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.105+0000 7fad02400640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc0ade20 0x7facfc0ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.105+0000 7fad02400640 1 --2- 172.21.15.153:0/944877766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facfc0721b0 0x7facfc157a50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.105+0000 7fad02400640 1 -- 172.21.15.153:0/944877766 >> 172.21.15.153:0/944877766 conn(0x7facfc071690 msgr2=0x7facfc0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:33.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.105+0000 7fad02400640 1 -- 172.21.15.153:0/944877766 shutdown_connections 2024-03-28T21:52:33.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.105+0000 7fad02400640 1 -- 172.21.15.153:0/944877766 wait complete. 2024-03-28T21:52:33.126 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T21:52:33.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.332+0000 7f92c2600640 1 Processor -- start 2024-03-28T21:52:33.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.333+0000 7f92c2600640 1 -- start start 2024-03-28T21:52:33.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.334+0000 7f92c2600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92bc070d80 0x7f92bc0b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:33.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.334+0000 7f92c2600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92bc0b45c0 0x7f92bc06d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:33.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.334+0000 7f92c2600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92bc06ec70 con 0x7f92bc15e390 2024-03-28T21:52:33.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.334+0000 7f92c2600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f92bc0b4a50 con 0x7f92bc070d80 2024-03-28T21:52:33.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.334+0000 7f92c2600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f92bc0b3c90 con 0x7f92bc0b45c0 2024-03-28T21:52:33.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.335+0000 7f92bb400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92bc070d80 0x7f92bc0b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:33.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.335+0000 7f92bb400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92bc070d80 0x7f92bc0b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55892/0 (socket says 172.21.15.153:55892) 2024-03-28T21:52:33.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.335+0000 7f92bb400640 1 -- 172.21.15.153:0/3661619006 learned_addr learned my addr 172.21.15.153:0/3661619006 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:33.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.335+0000 7f92bbe00640 1 --2- 172.21.15.153:0/3661619006 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92bc0b45c0 0x7f92bc06d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:33.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.335+0000 7f92bb400640 1 -- 172.21.15.153:0/3661619006 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92bc0b45c0 msgr2=0x7f92bc06d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:33.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.335+0000 7f92bb400640 1 --2- 172.21.15.153:0/3661619006 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92bc0b45c0 0x7f92bc06d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.335+0000 7f92bb400640 1 -- 172.21.15.153:0/3661619006 >> v1:172.21.15.165:6789/0 conn(0x7f92bc15e390 legacy=0x7f92bc071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:33.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.335+0000 7f92bb400640 1 -- 172.21.15.153:0/3661619006 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc0b3f70 con 0x7f92bc070d80 2024-03-28T21:52:33.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.335+0000 7f92bbe00640 1 --2- 172.21.15.153:0/3661619006 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92bc0b45c0 0x7f92bc06d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:33.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.336+0000 7f92bb400640 1 --2- 172.21.15.153:0/3661619006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92bc070d80 0x7f92bc0b3660 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009870 tx=0x7f92ac02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a59b9e78817b7b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:33.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.337+0000 7f92baa00640 1 -- 172.21.15.153:0/3661619006 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac035020 con 0x7f92bc070d80 2024-03-28T21:52:33.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.337+0000 7f92baa00640 1 -- 172.21.15.153:0/3661619006 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ac031640 con 0x7f92bc070d80 2024-03-28T21:52:33.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.337+0000 7f92baa00640 1 -- 172.21.15.153:0/3661619006 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac02d040 con 0x7f92bc070d80 2024-03-28T21:52:33.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.338+0000 7f92c2600640 1 -- 172.21.15.153:0/3661619006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92bc070d80 msgr2=0x7f92bc0b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:33.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.338+0000 7f92c2600640 1 --2- 172.21.15.153:0/3661619006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92bc070d80 0x7f92bc0b3660 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009870 tx=0x7f92ac02b8f0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.338+0000 7f92c2600640 1 -- 172.21.15.153:0/3661619006 shutdown_connections 2024-03-28T21:52:33.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.338+0000 7f92c2600640 1 --2- 172.21.15.153:0/3661619006 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92bc0b45c0 0x7f92bc06d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.338+0000 7f92c2600640 1 --2- 172.21.15.153:0/3661619006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92bc070d80 0x7f92bc0b3660 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.338+0000 7f92c2600640 1 -- 172.21.15.153:0/3661619006 >> 172.21.15.153:0/3661619006 conn(0x7f92bc0b19a0 msgr2=0x7f92bc0b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:33.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.338+0000 7f92c2600640 1 -- 172.21.15.153:0/3661619006 shutdown_connections 2024-03-28T21:52:33.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.338+0000 7f92c2600640 1 -- 172.21.15.153:0/3661619006 wait complete. 2024-03-28T21:52:33.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.340+0000 7f92c2600640 1 Processor -- start 2024-03-28T21:52:33.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.340+0000 7f92c2600640 1 -- start start 2024-03-28T21:52:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92c2600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92bc070d80 0x7f92bc145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92c2600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92bc0b45c0 0x7f92bc145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92c2600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92bc15e390 0x7f92bc1484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92c2600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc0acd80 con 0x7f92bc070d80 2024-03-28T21:52:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92c2600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc06cf80 con 0x7f92bc0b45c0 2024-03-28T21:52:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92c2600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f92bc06d9e0 con 0x7f92bc15e390 2024-03-28T21:52:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92bb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92bc070d80 0x7f92bc145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92bb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92bc070d80 0x7f92bc145500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55902/0 (socket says 172.21.15.153:55902) 2024-03-28T21:52:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92bb400640 1 -- 172.21.15.153:0/3638700915 learned_addr learned my addr 172.21.15.153:0/3638700915 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92bb400640 1 -- 172.21.15.153:0/3638700915 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92bc15e390 msgr2=0x7f92bc1484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92bb400640 1 --2- 172.21.15.153:0/3638700915 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92bc15e390 0x7f92bc1484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92b3e00640 1 --2- 172.21.15.153:0/3638700915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92bc0b45c0 0x7f92bc145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:33.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92bb400640 1 -- 172.21.15.153:0/3638700915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92bc0b45c0 msgr2=0x7f92bc145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:33.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92bb400640 1 --2- 172.21.15.153:0/3638700915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92bc0b45c0 0x7f92bc145a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.341+0000 7f92bb400640 1 -- 172.21.15.153:0/3638700915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc161260 con 0x7f92bc070d80 2024-03-28T21:52:33.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.342+0000 7f92bb400640 1 --2- 172.21.15.153:0/3638700915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92bc070d80 0x7f92bc145500 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0097c0 tx=0x7f92ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:33.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.342+0000 7f92b3400640 1 -- 172.21.15.153:0/3638700915 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac040070 con 0x7f92bc070d80 2024-03-28T21:52:33.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.342+0000 7f92b3400640 1 -- 172.21.15.153:0/3638700915 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ac039cb0 con 0x7f92bc070d80 2024-03-28T21:52:33.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.342+0000 7f92c2600640 1 -- 172.21.15.153:0/3638700915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92bc161540 con 0x7f92bc070d80 2024-03-28T21:52:33.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.342+0000 7f92b3400640 1 -- 172.21.15.153:0/3638700915 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac035040 con 0x7f92bc070d80 2024-03-28T21:52:33.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.342+0000 7f92c2600640 1 -- 172.21.15.153:0/3638700915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92bc146660 con 0x7f92bc070d80 2024-03-28T21:52:33.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.343+0000 7f92c2600640 1 -- 172.21.15.153:0/3638700915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92bc068ff0 con 0x7f92bc070d80 2024-03-28T21:52:33.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.344+0000 7f92b3400640 1 -- 172.21.15.153:0/3638700915 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f92ac04b060 con 0x7f92bc070d80 2024-03-28T21:52:33.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.345+0000 7f92b3400640 1 --2- 172.21.15.153:0/3638700915 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f929806b4d0 0x7f929806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:33.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.345+0000 7f92b3400640 1 -- 172.21.15.153:0/3638700915 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f92ac0abd40 con 0x7f92bc070d80 2024-03-28T21:52:33.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.345+0000 7f92b3e00640 1 --2- 172.21.15.153:0/3638700915 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f929806b4d0 0x7f929806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:33.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.346+0000 7f92b3e00640 1 --2- 172.21.15.153:0/3638700915 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f929806b4d0 0x7f929806d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92bc1ea980 tx=0x7f92a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:33.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.350+0000 7f92b3400640 1 -- 172.21.15.153:0/3638700915 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f92ac02f300 con 0x7f92bc070d80 2024-03-28T21:52:33.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.547+0000 7f92c2600640 1 -- 172.21.15.153:0/3638700915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f92bc06e710 con 0x7f92bc070d80 2024-03-28T21:52:33.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.548+0000 7f92b3400640 1 -- 172.21.15.153:0/3638700915 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f92ac07abc0 con 0x7f92bc070d80 2024-03-28T21:52:33.550 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-03-28T21:52:33.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.550+0000 7f92c2600640 1 -- 172.21.15.153:0/3638700915 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f929806b4d0 msgr2=0x7f929806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:33.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.550+0000 7f92c2600640 1 --2- 172.21.15.153:0/3638700915 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f929806b4d0 0x7f929806d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92bc1ea980 tx=0x7f92a4008040 comp rx=0 tx=0).stop 2024-03-28T21:52:33.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.550+0000 7f92c2600640 1 -- 172.21.15.153:0/3638700915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92bc070d80 msgr2=0x7f92bc145500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:33.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.550+0000 7f92c2600640 1 --2- 172.21.15.153:0/3638700915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92bc070d80 0x7f92bc145500 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0097c0 tx=0x7f92ac0046c0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.551+0000 7f92c2600640 1 -- 172.21.15.153:0/3638700915 shutdown_connections 2024-03-28T21:52:33.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.551+0000 7f92c2600640 1 --2- 172.21.15.153:0/3638700915 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f929806b4d0 0x7f929806d990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.551+0000 7f92c2600640 1 --2- 172.21.15.153:0/3638700915 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92bc15e390 0x7f92bc1484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.551+0000 7f92c2600640 1 --2- 172.21.15.153:0/3638700915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92bc0b45c0 0x7f92bc145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.551+0000 7f92c2600640 1 --2- 172.21.15.153:0/3638700915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92bc070d80 0x7f92bc145500 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.551+0000 7f92c2600640 1 -- 172.21.15.153:0/3638700915 >> 172.21.15.153:0/3638700915 conn(0x7f92bc0b19a0 msgr2=0x7f92bc161ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:33.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.551+0000 7f92c2600640 1 -- 172.21.15.153:0/3638700915 shutdown_connections 2024-03-28T21:52:33.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.551+0000 7f92c2600640 1 -- 172.21.15.153:0/3638700915 wait complete. 2024-03-28T21:52:33.577 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T21:52:33.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.839+0000 7f3ab9200640 1 Processor -- start 2024-03-28T21:52:33.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.839+0000 7f3ab9200640 1 -- start start 2024-03-28T21:52:33.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.841+0000 7f3ab9200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3ab4141db0 0x7f3ab40ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:33.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.841+0000 7f3ab9200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ab4070df0 con 0x7f3ab413ef10 2024-03-28T21:52:33.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.841+0000 7f3ab9200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ab413f2f0 con 0x7f3ab40ce7e0 2024-03-28T21:52:33.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.841+0000 7f3ab9200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3ab40cf060 con 0x7f3ab4141db0 2024-03-28T21:52:33.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.841+0000 7f3ab3400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3ab413ef10 0x7f3ab41416a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42530/0 (socket says 172.21.15.153:42530) 2024-03-28T21:52:33.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.841+0000 7f3ab3400640 1 -- 172.21.15.153:0/3794519563 learned_addr learned my addr 172.21.15.153:0/3794519563 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:33.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2a00640 1 --2- 172.21.15.153:0/3794519563 >> v2:172.21.15.165:3300/0 conn(0x7f3ab4141db0 0x7f3ab40ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:33.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 -- 172.21.15.153:0/3794519563 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2394507201 0 0) 0x7f3ab4070df0 con 0x7f3ab413ef10 2024-03-28T21:52:33.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 -- 172.21.15.153:0/3794519563 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a98003520 con 0x7f3ab413ef10 2024-03-28T21:52:33.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 -- 172.21.15.153:0/3794519563 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3516542700 0 0) 0x7f3a98003520 con 0x7f3ab413ef10 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 -- 172.21.15.153:0/3794519563 >> v2:172.21.15.165:3300/0 conn(0x7f3ab4141db0 msgr2=0x7f3ab40ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 --2- 172.21.15.153:0/3794519563 >> v2:172.21.15.165:3300/0 conn(0x7f3ab4141db0 0x7f3ab40ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 -- 172.21.15.153:0/3794519563 >> v1:172.21.15.165:6789/0 conn(0x7f3ab40ce7e0 legacy=0x7f3ab40712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 -- 172.21.15.153:0/3794519563 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab40cf340 con 0x7f3ab413ef10 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 -- 172.21.15.153:0/3794519563 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f3aa4001670 con 0x7f3ab413ef10 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 -- 172.21.15.153:0/3794519563 >> v1:172.21.15.153:6789/0 conn(0x7f3ab413ef10 legacy=0x7f3ab41416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 --2- 172.21.15.153:0/3794519563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a98003a00 0x7f3a98003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 --2- 172.21.15.153:0/3794519563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3a98004800 0x7f3a98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 --2- 172.21.15.153:0/3794519563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a980051c0 0x7f3a9800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 -- 172.21.15.153:0/3794519563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab40cf060 con 0x7f3a980051c0 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 -- 172.21.15.153:0/3794519563 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9800c0c0 con 0x7f3a98003a00 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab2000640 1 -- 172.21.15.153:0/3794519563 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9800c2c0 con 0x7f3a98004800 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.842+0000 7f3ab3e00640 1 --2- 172.21.15.153:0/3794519563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a980051c0 0x7f3a9800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.843+0000 7f3ab3400640 1 --2- 172.21.15.153:0/3794519563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a98003a00 0x7f3a98003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:33.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.843+0000 7f3ab3e00640 1 -- 172.21.15.153:0/3794519563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3a98004800 msgr2=0x7f3a98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:33.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.843+0000 7f3ab3e00640 1 --2- 172.21.15.153:0/3794519563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3a98004800 0x7f3a98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.843+0000 7f3ab3e00640 1 -- 172.21.15.153:0/3794519563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a98003a00 msgr2=0x7f3a98003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:33.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.843+0000 7f3ab3e00640 1 --2- 172.21.15.153:0/3794519563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a98003a00 0x7f3a98003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.843+0000 7f3ab3e00640 1 -- 172.21.15.153:0/3794519563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a98003520 con 0x7f3a980051c0 2024-03-28T21:52:33.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.844+0000 7f3ab3e00640 1 -- 172.21.15.153:0/3794519563 reap_dead start 2024-03-28T21:52:33.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.844+0000 7f3ab3e00640 1 --2- 172.21.15.153:0/3794519563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a980051c0 0x7f3a9800b9c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3aac001e50 tx=0x7f3a98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00d58cfb8509c41 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:33.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.844+0000 7f3ab2000640 1 -- 172.21.15.153:0/3794519563 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac001a70 con 0x7f3a980051c0 2024-03-28T21:52:33.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.844+0000 7f3ab2000640 1 -- 172.21.15.153:0/3794519563 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aac003bb0 con 0x7f3a980051c0 2024-03-28T21:52:33.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.844+0000 7f3ab2000640 1 -- 172.21.15.153:0/3794519563 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac0050d0 con 0x7f3a980051c0 2024-03-28T21:52:33.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.845+0000 7f3ab9200640 1 -- 172.21.15.153:0/3794519563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a980051c0 msgr2=0x7f3a9800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:33.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.845+0000 7f3ab9200640 1 --2- 172.21.15.153:0/3794519563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a980051c0 0x7f3a9800b9c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3aac001e50 tx=0x7f3a98005830 comp rx=0 tx=0).stop 2024-03-28T21:52:33.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.845+0000 7f3ab9200640 1 -- 172.21.15.153:0/3794519563 shutdown_connections 2024-03-28T21:52:33.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.845+0000 7f3ab9200640 1 --2- 172.21.15.153:0/3794519563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a980051c0 0x7f3a9800b9c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.845+0000 7f3ab9200640 1 -- 172.21.15.153:0/3794519563 >> 172.21.15.153:0/3794519563 conn(0x7f3ab40b1820 msgr2=0x7f3ab40b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:33.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.845+0000 7f3ab9200640 1 -- 172.21.15.153:0/3794519563 shutdown_connections 2024-03-28T21:52:33.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.845+0000 7f3ab9200640 1 -- 172.21.15.153:0/3794519563 wait complete. 2024-03-28T21:52:33.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.847+0000 7f3ab9200640 1 Processor -- start 2024-03-28T21:52:33.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.847+0000 7f3ab9200640 1 -- start start 2024-03-28T21:52:33.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.848+0000 7f3ab9200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a980051c0 0x7f3ab413f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:33.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.848+0000 7f3ab9200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab41414d0 0x7f3ab413e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:33.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.848+0000 7f3ab9200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ab415bda0 0x7f3ab4137350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:33.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.848+0000 7f3ab9200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab40cebf0 con 0x7f3a980051c0 2024-03-28T21:52:33.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.848+0000 7f3ab9200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab40cf900 con 0x7f3ab415bda0 2024-03-28T21:52:33.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.848+0000 7f3ab9200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab40ced70 con 0x7f3ab41414d0 2024-03-28T21:52:33.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.848+0000 7f3ab3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a980051c0 0x7f3ab413f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:33.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.848+0000 7f3ab3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a980051c0 0x7f3ab413f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55912/0 (socket says 172.21.15.153:55912) 2024-03-28T21:52:33.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.848+0000 7f3ab3400640 1 -- 172.21.15.153:0/1903285833 learned_addr learned my addr 172.21.15.153:0/1903285833 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:33.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.848+0000 7f3ab3400640 1 -- 172.21.15.153:0/1903285833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab41414d0 msgr2=0x7f3ab413e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:33.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.848+0000 7f3ab3400640 1 --2- 172.21.15.153:0/1903285833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab41414d0 0x7f3ab413e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.848+0000 7f3ab3400640 1 -- 172.21.15.153:0/1903285833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ab415bda0 msgr2=0x7f3ab4137350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:33.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.848+0000 7f3ab3400640 1 --2- 172.21.15.153:0/1903285833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ab415bda0 0x7f3ab4137350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:33.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.848+0000 7f3ab3400640 1 -- 172.21.15.153:0/1903285833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab4135ba0 con 0x7f3a980051c0 2024-03-28T21:52:33.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.849+0000 7f3ab3400640 1 --2- 172.21.15.153:0/1903285833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a980051c0 0x7f3ab413f4c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400e730 tx=0x7f3aa400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:33.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.849+0000 7f3aab400640 1 -- 172.21.15.153:0/1903285833 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400ee40 con 0x7f3a980051c0 2024-03-28T21:52:33.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.849+0000 7f3aab400640 1 -- 172.21.15.153:0/1903285833 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa4018070 con 0x7f3a980051c0 2024-03-28T21:52:33.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.849+0000 7f3aab400640 1 -- 172.21.15.153:0/1903285833 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400cab0 con 0x7f3a980051c0 2024-03-28T21:52:33.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.849+0000 7f3ab9200640 1 -- 172.21.15.153:0/1903285833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab4139ef0 con 0x7f3a980051c0 2024-03-28T21:52:33.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.849+0000 7f3ab9200640 1 -- 172.21.15.153:0/1903285833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab413a4b0 con 0x7f3a980051c0 2024-03-28T21:52:33.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.850+0000 7f3ab9200640 1 -- 172.21.15.153:0/1903285833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ab4068ff0 con 0x7f3a980051c0 2024-03-28T21:52:33.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.852+0000 7f3aab400640 1 -- 172.21.15.153:0/1903285833 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f3aa400cc50 con 0x7f3a980051c0 2024-03-28T21:52:33.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.852+0000 7f3aab400640 1 --2- 172.21.15.153:0/1903285833 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3a9406b4d0 0x7f3a9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:33.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.852+0000 7f3aab400640 1 -- 172.21.15.153:0/1903285833 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3aa408a130 con 0x7f3a980051c0 2024-03-28T21:52:33.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.853+0000 7f3ab2a00640 1 --2- 172.21.15.153:0/1903285833 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3a9406b4d0 0x7f3a9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:33.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.853+0000 7f3ab2a00640 1 --2- 172.21.15.153:0/1903285833 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3a9406b4d0 0x7f3a9406d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0006a90 tx=0x7f3aa0006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:33.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:33.857+0000 7f3aab400640 1 -- 172.21.15.153:0/1903285833 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3aa4058f10 con 0x7f3a980051c0 2024-03-28T21:52:34.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.058+0000 7f3ab9200640 1 -- 172.21.15.153:0/1903285833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3ab4135d70 con 0x7f3a980051c0 2024-03-28T21:52:34.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.059+0000 7f3aab400640 1 -- 172.21.15.153:0/1903285833 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f3aa4058810 con 0x7f3a980051c0 2024-03-28T21:52:34.060 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-03-28T21:52:34.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.061+0000 7f3ab9200640 1 -- 172.21.15.153:0/1903285833 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3a9406b4d0 msgr2=0x7f3a9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:34.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.061+0000 7f3ab9200640 1 --2- 172.21.15.153:0/1903285833 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3a9406b4d0 0x7f3a9406d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0006a90 tx=0x7f3aa0006a20 comp rx=0 tx=0).stop 2024-03-28T21:52:34.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.061+0000 7f3ab9200640 1 -- 172.21.15.153:0/1903285833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a980051c0 msgr2=0x7f3ab413f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.061+0000 7f3ab9200640 1 --2- 172.21.15.153:0/1903285833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a980051c0 0x7f3ab413f4c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400e730 tx=0x7f3aa400ebf0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.062+0000 7f3ab9200640 1 -- 172.21.15.153:0/1903285833 shutdown_connections 2024-03-28T21:52:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.062+0000 7f3ab9200640 1 --2- 172.21.15.153:0/1903285833 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3a9406b4d0 0x7f3a9406d990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.062+0000 7f3ab9200640 1 --2- 172.21.15.153:0/1903285833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ab415bda0 0x7f3ab4137350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.062+0000 7f3ab9200640 1 --2- 172.21.15.153:0/1903285833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab41414d0 0x7f3ab413e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.062+0000 7f3ab9200640 1 --2- 172.21.15.153:0/1903285833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a980051c0 0x7f3ab413f4c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.062+0000 7f3ab9200640 1 -- 172.21.15.153:0/1903285833 >> 172.21.15.153:0/1903285833 conn(0x7f3ab40b1820 msgr2=0x7f3ab40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.062+0000 7f3ab9200640 1 -- 172.21.15.153:0/1903285833 shutdown_connections 2024-03-28T21:52:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.062+0000 7f3ab9200640 1 -- 172.21.15.153:0/1903285833 wait complete. 2024-03-28T21:52:34.082 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:34.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.281+0000 7fe62e400640 1 Processor -- start 2024-03-28T21:52:34.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.282+0000 7fe62e400640 1 -- start start 2024-03-28T21:52:34.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.283+0000 7fe62e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe62806c890 0x7fe6280ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:34.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.283+0000 7fe62e400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6280ce340 0x7fe6280aea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:34.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.283+0000 7fe62e400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe62815e670 con 0x7fe62815e290 2024-03-28T21:52:34.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.283+0000 7fe62e400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe6280b43a0 con 0x7fe6280ce340 2024-03-28T21:52:34.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.283+0000 7fe62e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe6280b4640 con 0x7fe62806c890 2024-03-28T21:52:34.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.284+0000 7fe62da00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6280ce340 0x7fe6280aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:34.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.284+0000 7fe62da00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6280ce340 0x7fe6280aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55914/0 (socket says 172.21.15.153:55914) 2024-03-28T21:52:34.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.284+0000 7fe62da00640 1 -- 172.21.15.153:0/3158660098 learned_addr learned my addr 172.21.15.153:0/3158660098 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:34.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.284+0000 7fe627e00640 1 --2- 172.21.15.153:0/3158660098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe62806c890 0x7fe6280ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:34.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.284+0000 7fe62da00640 1 -- 172.21.15.153:0/3158660098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe62806c890 msgr2=0x7fe6280ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:34.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.284+0000 7fe62da00640 1 --2- 172.21.15.153:0/3158660098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe62806c890 0x7fe6280ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.284+0000 7fe62da00640 1 -- 172.21.15.153:0/3158660098 >> v1:172.21.15.165:6789/0 conn(0x7fe62815e290 legacy=0x7fe62806c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:34.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.284+0000 7fe62da00640 1 -- 172.21.15.153:0/3158660098 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6280b4920 con 0x7fe6280ce340 2024-03-28T21:52:34.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.285+0000 7fe62da00640 1 --2- 172.21.15.153:0/3158660098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6280ce340 0x7fe6280aea00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe620009e50 tx=0x7fe62002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caaf7a36e246d94b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:34.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.286+0000 7fe627400640 1 -- 172.21.15.153:0/3158660098 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62002ca70 con 0x7fe6280ce340 2024-03-28T21:52:34.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.286+0000 7fe627400640 1 -- 172.21.15.153:0/3158660098 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe62002cc10 con 0x7fe6280ce340 2024-03-28T21:52:34.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.286+0000 7fe627400640 1 -- 172.21.15.153:0/3158660098 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6200343f0 con 0x7fe6280ce340 2024-03-28T21:52:34.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.286+0000 7fe62e400640 1 -- 172.21.15.153:0/3158660098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6280ce340 msgr2=0x7fe6280aea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:34.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.286+0000 7fe62e400640 1 --2- 172.21.15.153:0/3158660098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6280ce340 0x7fe6280aea00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe620009e50 tx=0x7fe62002bed0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.286+0000 7fe62e400640 1 -- 172.21.15.153:0/3158660098 shutdown_connections 2024-03-28T21:52:34.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.286+0000 7fe62e400640 1 --2- 172.21.15.153:0/3158660098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6280ce340 0x7fe6280aea00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.286+0000 7fe62e400640 1 --2- 172.21.15.153:0/3158660098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe62806c890 0x7fe6280ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.286+0000 7fe62e400640 1 -- 172.21.15.153:0/3158660098 >> 172.21.15.153:0/3158660098 conn(0x7fe6280cde30 msgr2=0x7fe628071600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:34.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.286+0000 7fe62e400640 1 -- 172.21.15.153:0/3158660098 shutdown_connections 2024-03-28T21:52:34.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.287+0000 7fe62e400640 1 -- 172.21.15.153:0/3158660098 wait complete. 2024-03-28T21:52:34.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.289+0000 7fe62e400640 1 Processor -- start 2024-03-28T21:52:34.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.289+0000 7fe62e400640 1 -- start start 2024-03-28T21:52:34.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.291+0000 7fe62e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe62806c890 0x7fe628151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:34.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.291+0000 7fe62e400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6280ce340 0x7fe6280cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:34.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.291+0000 7fe62e400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe62815e290 0x7fe6280c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:34.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.291+0000 7fe62e400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe62806fca0 con 0x7fe6280ce340 2024-03-28T21:52:34.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.291+0000 7fe62e400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe6280b4090 con 0x7fe62815e290 2024-03-28T21:52:34.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.291+0000 7fe62e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe62806fe20 con 0x7fe62806c890 2024-03-28T21:52:34.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.291+0000 7fe627e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6280ce340 0x7fe6280cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:34.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.291+0000 7fe627e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6280ce340 0x7fe6280cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55926/0 (socket says 172.21.15.153:55926) 2024-03-28T21:52:34.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.291+0000 7fe627e00640 1 -- 172.21.15.153:0/1117235446 learned_addr learned my addr 172.21.15.153:0/1117235446 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:34.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.292+0000 7fe62da00640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe62815e290 0x7fe6280c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:34.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.292+0000 7fe62d000640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe62806c890 0x7fe628151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:34.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.292+0000 7fe627e00640 1 -- 172.21.15.153:0/1117235446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe62806c890 msgr2=0x7fe628151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:34.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.292+0000 7fe627e00640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe62806c890 0x7fe628151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.292+0000 7fe627e00640 1 -- 172.21.15.153:0/1117235446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe62815e290 msgr2=0x7fe6280c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:34.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.292+0000 7fe627e00640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe62815e290 0x7fe6280c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.292+0000 7fe627e00640 1 -- 172.21.15.153:0/1117235446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6280b1d00 con 0x7fe6280ce340 2024-03-28T21:52:34.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.292+0000 7fe62d000640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe62806c890 0x7fe628151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:34.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.292+0000 7fe627e00640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6280ce340 0x7fe6280cb9d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe61400d5f0 tx=0x7fe61400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:34.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.292+0000 7fe624c00640 1 -- 172.21.15.153:0/1117235446 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6140125f0 con 0x7fe6280ce340 2024-03-28T21:52:34.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.292+0000 7fe624c00640 1 -- 172.21.15.153:0/1117235446 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe614019070 con 0x7fe6280ce340 2024-03-28T21:52:34.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.292+0000 7fe62e400640 1 -- 172.21.15.153:0/1117235446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6280c55e0 con 0x7fe6280ce340 2024-03-28T21:52:34.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.292+0000 7fe624c00640 1 -- 172.21.15.153:0/1117235446 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6140129d0 con 0x7fe6280ce340 2024-03-28T21:52:34.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.293+0000 7fe62e400640 1 -- 172.21.15.153:0/1117235446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6280c5ba0 con 0x7fe6280ce340 2024-03-28T21:52:34.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.294+0000 7fe62e400640 1 -- 172.21.15.153:0/1117235446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe62804f520 con 0x7fe6280ce340 2024-03-28T21:52:34.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.295+0000 7fe624c00640 1 -- 172.21.15.153:0/1117235446 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe614012b70 con 0x7fe6280ce340 2024-03-28T21:52:34.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.296+0000 7fe624c00640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe60806b500 0x7fe60806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:34.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.296+0000 7fe624c00640 1 -- 172.21.15.153:0/1117235446 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe61408a700 con 0x7fe6280ce340 2024-03-28T21:52:34.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.296+0000 7fe62d000640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe60806b500 0x7fe60806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:34.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.297+0000 7fe62d000640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe60806b500 0x7fe60806d9c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe61c001680 tx=0x7fe61c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:34.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.300+0000 7fe624c00640 1 -- 172.21.15.153:0/1117235446 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe614059450 con 0x7fe6280ce340 2024-03-28T21:52:34.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.500+0000 7fe62e400640 1 -- 172.21.15.153:0/1117235446 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6280cc6e0 con 0x7fe6280ce340 2024-03-28T21:52:34.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.503+0000 7fe624c00640 1 -- 172.21.15.153:0/1117235446 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7fe614058d50 con 0x7fe6280ce340 2024-03-28T21:52:34.505 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:34.505 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:57.716531+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:34.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.506+0000 7fe62e400640 1 -- 172.21.15.153:0/1117235446 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe60806b500 msgr2=0x7fe60806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:34.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.506+0000 7fe62e400640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe60806b500 0x7fe60806d9c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe61c001680 tx=0x7fe61c009040 comp rx=0 tx=0).stop 2024-03-28T21:52:34.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.506+0000 7fe62e400640 1 -- 172.21.15.153:0/1117235446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6280ce340 msgr2=0x7fe6280cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:34.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.506+0000 7fe62e400640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6280ce340 0x7fe6280cb9d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe61400d5f0 tx=0x7fe61400dab0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.506+0000 7fe62e400640 1 -- 172.21.15.153:0/1117235446 shutdown_connections 2024-03-28T21:52:34.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.506+0000 7fe62e400640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe60806b500 0x7fe60806d9c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.506+0000 7fe62e400640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe62815e290 0x7fe6280c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.506+0000 7fe62e400640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6280ce340 0x7fe6280cb9d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.506+0000 7fe62e400640 1 --2- 172.21.15.153:0/1117235446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe62806c890 0x7fe628151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.506+0000 7fe62e400640 1 -- 172.21.15.153:0/1117235446 >> 172.21.15.153:0/1117235446 conn(0x7fe6280cde30 msgr2=0x7fe6280cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:34.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.506+0000 7fe62e400640 1 -- 172.21.15.153:0/1117235446 shutdown_connections 2024-03-28T21:52:34.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.506+0000 7fe62e400640 1 -- 172.21.15.153:0/1117235446 wait complete. 2024-03-28T21:52:34.526 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T21:51:53.863931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T21:51:55.188736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T21:52:34.526 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T21:52:34.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.728+0000 7f8279a00640 1 Processor -- start 2024-03-28T21:52:34.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.728+0000 7f8279a00640 1 -- start start 2024-03-28T21:52:34.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.730+0000 7f8279a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f827415ad40 0x7f82740b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:34.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.730+0000 7f8279a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f827415b120 0x7f827406e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:34.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.730+0000 7f8279a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82740729c0 con 0x7f827406ebe0 2024-03-28T21:52:34.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.730+0000 7f8279a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f82740716d0 con 0x7f827415b120 2024-03-28T21:52:34.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.730+0000 7f8279a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f827406f010 con 0x7f827415ad40 2024-03-28T21:52:34.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.730+0000 7f826be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f827415b120 0x7f827406e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:34.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.730+0000 7f826be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f827415b120 0x7f827406e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55934/0 (socket says 172.21.15.153:55934) 2024-03-28T21:52:34.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.730+0000 7f826be00640 1 -- 172.21.15.153:0/623377 learned_addr learned my addr 172.21.15.153:0/623377 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:34.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.730+0000 7f8273e00640 1 --2- 172.21.15.153:0/623377 >> v2:172.21.15.165:3300/0 conn(0x7f827415ad40 0x7f82740b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:34.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.731+0000 7f826be00640 1 -- 172.21.15.153:0/623377 >> v2:172.21.15.165:3300/0 conn(0x7f827415ad40 msgr2=0x7f82740b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:34.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.731+0000 7f826be00640 1 --2- 172.21.15.153:0/623377 >> v2:172.21.15.165:3300/0 conn(0x7f827415ad40 0x7f82740b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.731+0000 7f826be00640 1 -- 172.21.15.153:0/623377 >> v1:172.21.15.165:6789/0 conn(0x7f827406ebe0 legacy=0x7f82740b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:34.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.731+0000 7f826be00640 1 -- 172.21.15.153:0/623377 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8274071920 con 0x7f827415b120 2024-03-28T21:52:34.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.732+0000 7f826be00640 1 --2- 172.21.15.153:0/623377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f827415b120 0x7f827406e6a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f827406ca90 tx=0x7f825c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a23e047aa246bc0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:34.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.732+0000 7f8273400640 1 -- 172.21.15.153:0/623377 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c035020 con 0x7f827415b120 2024-03-28T21:52:34.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.732+0000 7f8273400640 1 -- 172.21.15.153:0/623377 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f825c031870 con 0x7f827415b120 2024-03-28T21:52:34.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.732+0000 7f8273400640 1 -- 172.21.15.153:0/623377 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c031c40 con 0x7f827415b120 2024-03-28T21:52:34.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.733+0000 7f8279a00640 1 -- 172.21.15.153:0/623377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f827415b120 msgr2=0x7f827406e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:34.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.733+0000 7f8279a00640 1 --2- 172.21.15.153:0/623377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f827415b120 0x7f827406e6a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f827406ca90 tx=0x7f825c02b910 comp rx=0 tx=0).stop 2024-03-28T21:52:34.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.733+0000 7f8279a00640 1 -- 172.21.15.153:0/623377 shutdown_connections 2024-03-28T21:52:34.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.733+0000 7f8279a00640 1 --2- 172.21.15.153:0/623377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f827415b120 0x7f827406e6a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.733+0000 7f8279a00640 1 --2- 172.21.15.153:0/623377 >> v2:172.21.15.165:3300/0 conn(0x7f827415ad40 0x7f82740b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.733+0000 7f8279a00640 1 -- 172.21.15.153:0/623377 >> 172.21.15.153:0/623377 conn(0x7f82740b1820 msgr2=0x7f82740b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:34.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.733+0000 7f8279a00640 1 -- 172.21.15.153:0/623377 shutdown_connections 2024-03-28T21:52:34.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.733+0000 7f8279a00640 1 -- 172.21.15.153:0/623377 wait complete. 2024-03-28T21:52:34.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.736+0000 7f8279a00640 1 Processor -- start 2024-03-28T21:52:34.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.736+0000 7f8279a00640 1 -- start start 2024-03-28T21:52:34.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.737+0000 7f8279a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f827406ebe0 0x7f827415dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:34.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.737+0000 7f8279a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f827415ad40 0x7f827415b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:34.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.737+0000 7f8279a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f827415b120 0x7f82741f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:34.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.737+0000 7f8279a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82740721c0 con 0x7f827406ebe0 2024-03-28T21:52:34.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.737+0000 7f8279a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8274071ee0 con 0x7f827415b120 2024-03-28T21:52:34.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.737+0000 7f8279a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f82740724a0 con 0x7f827415ad40 2024-03-28T21:52:34.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.738+0000 7f8273e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f827406ebe0 0x7f827415dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:34.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.738+0000 7f8273e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f827406ebe0 0x7f827415dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55936/0 (socket says 172.21.15.153:55936) 2024-03-28T21:52:34.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.738+0000 7f8273e00640 1 -- 172.21.15.153:0/2530423159 learned_addr learned my addr 172.21.15.153:0/2530423159 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:34.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.738+0000 7f826be00640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f827415ad40 0x7f827415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:34.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.738+0000 7f8273e00640 1 -- 172.21.15.153:0/2530423159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f827415ad40 msgr2=0x7f827415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:34.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.738+0000 7f8279000640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f827415b120 0x7f82741f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:34.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.738+0000 7f8273e00640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f827415ad40 0x7f827415b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.738+0000 7f8273e00640 1 -- 172.21.15.153:0/2530423159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f827415b120 msgr2=0x7f82741f5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:34.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.738+0000 7f8273e00640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f827415b120 0x7f82741f5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.738+0000 7f8273e00640 1 -- 172.21.15.153:0/2530423159 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82740ce720 con 0x7f827406ebe0 2024-03-28T21:52:34.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.738+0000 7f8279000640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f827415b120 0x7f82741f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:34.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.738+0000 7f8273e00640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f827406ebe0 0x7f827415dd30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f826400d830 tx=0x7f826400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:34.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.739+0000 7f8270c00640 1 -- 172.21.15.153:0/2530423159 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826400b6c0 con 0x7f827406ebe0 2024-03-28T21:52:34.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.739+0000 7f8270c00640 1 -- 172.21.15.153:0/2530423159 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8264019070 con 0x7f827406ebe0 2024-03-28T21:52:34.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.739+0000 7f8279a00640 1 -- 172.21.15.153:0/2530423159 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82740cea00 con 0x7f827406ebe0 2024-03-28T21:52:34.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.739+0000 7f8270c00640 1 -- 172.21.15.153:0/2530423159 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826400ba80 con 0x7f827406ebe0 2024-03-28T21:52:34.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.739+0000 7f8279a00640 1 -- 172.21.15.153:0/2530423159 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f827415e270 con 0x7f827406ebe0 2024-03-28T21:52:34.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.740+0000 7f8279a00640 1 -- 172.21.15.153:0/2530423159 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8274068ff0 con 0x7f827406ebe0 2024-03-28T21:52:34.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.741+0000 7f8270c00640 1 -- 172.21.15.153:0/2530423159 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f826401e460 con 0x7f827406ebe0 2024-03-28T21:52:34.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.742+0000 7f8270c00640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f825006b4d0 0x7f825006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:34.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.742+0000 7f8270c00640 1 -- 172.21.15.153:0/2530423159 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f826408a8e0 con 0x7f827406ebe0 2024-03-28T21:52:34.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.742+0000 7f826be00640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f825006b4d0 0x7f825006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:34.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.743+0000 7f826be00640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f825006b4d0 0x7f825006d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f825c036000 tx=0x7f825c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:34.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.750+0000 7f8270c00640 1 -- 172.21.15.153:0/2530423159 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8264059760 con 0x7f827406ebe0 2024-03-28T21:52:34.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.946+0000 7f8279a00640 1 -- 172.21.15.153:0/2530423159 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f82740b1d00 con 0x7f827406ebe0 2024-03-28T21:52:34.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.947+0000 7f8270c00640 1 -- 172.21.15.153:0/2530423159 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f8264059060 con 0x7f827406ebe0 2024-03-28T21:52:34.951 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-28T21:52:34.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.949+0000 7f8279a00640 1 -- 172.21.15.153:0/2530423159 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f825006b4d0 msgr2=0x7f825006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:34.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.949+0000 7f8279a00640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f825006b4d0 0x7f825006d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f825c036000 tx=0x7f825c008030 comp rx=0 tx=0).stop 2024-03-28T21:52:34.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.949+0000 7f8279a00640 1 -- 172.21.15.153:0/2530423159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f827406ebe0 msgr2=0x7f827415dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:34.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.949+0000 7f8279a00640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f827406ebe0 0x7f827415dd30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f826400d830 tx=0x7f826400dcf0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.949+0000 7f8279a00640 1 -- 172.21.15.153:0/2530423159 shutdown_connections 2024-03-28T21:52:34.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.949+0000 7f8279a00640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f825006b4d0 0x7f825006d990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.949+0000 7f8279a00640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f827415b120 0x7f82741f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.949+0000 7f8279a00640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f827415ad40 0x7f827415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.949+0000 7f8279a00640 1 --2- 172.21.15.153:0/2530423159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f827406ebe0 0x7f827415dd30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:34.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.949+0000 7f8279a00640 1 -- 172.21.15.153:0/2530423159 >> 172.21.15.153:0/2530423159 conn(0x7f82740b1820 msgr2=0x7f827406d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:34.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.950+0000 7f8279a00640 1 -- 172.21.15.153:0/2530423159 shutdown_connections 2024-03-28T21:52:34.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:34.950+0000 7f8279a00640 1 -- 172.21.15.153:0/2530423159 wait complete. 2024-03-28T21:52:34.978 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T21:52:35.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.185+0000 7f569da00640 1 Processor -- start 2024-03-28T21:52:35.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.185+0000 7f569da00640 1 -- start start 2024-03-28T21:52:35.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.186+0000 7f569da00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f56980cef30 0x7f5698071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:35.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.187+0000 7f569da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56980728c0 0x7f569806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:35.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.187+0000 7f569da00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5698070f20 con 0x7f56980acd80 2024-03-28T21:52:35.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.187+0000 7f569da00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5698071200 con 0x7f56980cef30 2024-03-28T21:52:35.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.187+0000 7f569da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f56980714e0 con 0x7f56980728c0 2024-03-28T21:52:35.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.187+0000 7f5696a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f56980cef30 0x7f5698071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:35.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.187+0000 7f5696a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f56980cef30 0x7f5698071ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55938/0 (socket says 172.21.15.153:55938) 2024-03-28T21:52:35.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.187+0000 7f5696a00640 1 -- 172.21.15.153:0/1800419353 learned_addr learned my addr 172.21.15.153:0/1800419353 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:35.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.187+0000 7f5697400640 1 --2- 172.21.15.153:0/1800419353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56980728c0 0x7f569806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:35.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.187+0000 7f5696a00640 1 -- 172.21.15.153:0/1800419353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56980728c0 msgr2=0x7f569806cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:35.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.187+0000 7f5696a00640 1 --2- 172.21.15.153:0/1800419353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56980728c0 0x7f569806cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.188+0000 7f5696a00640 1 -- 172.21.15.153:0/1800419353 >> v1:172.21.15.165:6789/0 conn(0x7f56980acd80 legacy=0x7f56980cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:35.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.188+0000 7f5696a00640 1 -- 172.21.15.153:0/1800419353 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56980717c0 con 0x7f56980cef30 2024-03-28T21:52:35.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.189+0000 7f5696a00640 1 --2- 172.21.15.153:0/1800419353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56980cef30 0x7f5698071ce0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5688009870 tx=0x7f568802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9529ca1a00821e10 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:35.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.189+0000 7f5695600640 1 -- 172.21.15.153:0/1800419353 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688034070 con 0x7f56980cef30 2024-03-28T21:52:35.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.189+0000 7f5695600640 1 -- 172.21.15.153:0/1800419353 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5688030840 con 0x7f56980cef30 2024-03-28T21:52:35.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.189+0000 7f5695600640 1 -- 172.21.15.153:0/1800419353 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688030c10 con 0x7f56980cef30 2024-03-28T21:52:35.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.190+0000 7f569da00640 1 -- 172.21.15.153:0/1800419353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56980cef30 msgr2=0x7f5698071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:35.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.190+0000 7f569da00640 1 --2- 172.21.15.153:0/1800419353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56980cef30 0x7f5698071ce0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5688009870 tx=0x7f568802b980 comp rx=0 tx=0).stop 2024-03-28T21:52:35.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.190+0000 7f569da00640 1 -- 172.21.15.153:0/1800419353 shutdown_connections 2024-03-28T21:52:35.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.190+0000 7f569da00640 1 --2- 172.21.15.153:0/1800419353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56980728c0 0x7f569806cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.190+0000 7f569da00640 1 --2- 172.21.15.153:0/1800419353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56980cef30 0x7f5698071ce0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.190+0000 7f569da00640 1 -- 172.21.15.153:0/1800419353 >> 172.21.15.153:0/1800419353 conn(0x7f56980b19a0 msgr2=0x7f56980b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:35.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.190+0000 7f569da00640 1 -- 172.21.15.153:0/1800419353 shutdown_connections 2024-03-28T21:52:35.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.190+0000 7f569da00640 1 -- 172.21.15.153:0/1800419353 wait complete. 2024-03-28T21:52:35.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.192+0000 7f569da00640 1 Processor -- start 2024-03-28T21:52:35.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.192+0000 7f569da00640 1 -- start start 2024-03-28T21:52:35.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.193+0000 7f569da00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56980728c0 0x7f5698156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.193+0000 7f569da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56980acd80 0x7f56981489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.193+0000 7f569da00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56980cef30 0x7f5698148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.193+0000 7f569da00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f569815c370 con 0x7f56980728c0 2024-03-28T21:52:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.193+0000 7f569da00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f569815c1f0 con 0x7f56980cef30 2024-03-28T21:52:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.193+0000 7f569da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f569806d040 con 0x7f56980acd80 2024-03-28T21:52:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.193+0000 7f5696a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56980728c0 0x7f5698156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.193+0000 7f5696a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56980728c0 0x7f5698156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55952/0 (socket says 172.21.15.153:55952) 2024-03-28T21:52:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.193+0000 7f5696a00640 1 -- 172.21.15.153:0/2473567111 learned_addr learned my addr 172.21.15.153:0/2473567111 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.193+0000 7f5696a00640 1 -- 172.21.15.153:0/2473567111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56980acd80 msgr2=0x7f56981489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.193+0000 7f5696a00640 1 --2- 172.21.15.153:0/2473567111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56980acd80 0x7f56981489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.193+0000 7f5696a00640 1 -- 172.21.15.153:0/2473567111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56980cef30 msgr2=0x7f5698148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:35.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.193+0000 7f5696a00640 1 --2- 172.21.15.153:0/2473567111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56980cef30 0x7f5698148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.193+0000 7f5696a00640 1 -- 172.21.15.153:0/2473567111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56981570d0 con 0x7f56980728c0 2024-03-28T21:52:35.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.194+0000 7f5696a00640 1 --2- 172.21.15.153:0/2473567111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56980728c0 0x7f5698156b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5688000c00 tx=0x7f56880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:35.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.194+0000 7f568ea00640 1 -- 172.21.15.153:0/2473567111 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688034040 con 0x7f56980728c0 2024-03-28T21:52:35.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.194+0000 7f568ea00640 1 -- 172.21.15.153:0/2473567111 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5688039d90 con 0x7f56980728c0 2024-03-28T21:52:35.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.194+0000 7f568ea00640 1 -- 172.21.15.153:0/2473567111 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688043610 con 0x7f56980728c0 2024-03-28T21:52:35.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.194+0000 7f569da00640 1 -- 172.21.15.153:0/2473567111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5698146af0 con 0x7f56980728c0 2024-03-28T21:52:35.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.194+0000 7f569da00640 1 -- 172.21.15.153:0/2473567111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5698147090 con 0x7f56980728c0 2024-03-28T21:52:35.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.196+0000 7f569da00640 1 -- 172.21.15.153:0/2473567111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5698068ff0 con 0x7f56980728c0 2024-03-28T21:52:35.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.196+0000 7f568ea00640 1 -- 172.21.15.153:0/2473567111 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f568804a060 con 0x7f56980728c0 2024-03-28T21:52:35.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.197+0000 7f568ea00640 1 --2- 172.21.15.153:0/2473567111 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f567806b4d0 0x7f567806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:35.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.197+0000 7f568ea00640 1 -- 172.21.15.153:0/2473567111 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f56880ac280 con 0x7f56980728c0 2024-03-28T21:52:35.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.197+0000 7f5696000640 1 --2- 172.21.15.153:0/2473567111 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f567806b4d0 0x7f567806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:35.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.198+0000 7f5696000640 1 --2- 172.21.15.153:0/2473567111 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f567806b4d0 0x7f567806d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5684000f60 tx=0x7f56840079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:35.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.202+0000 7f568ea00640 1 -- 172.21.15.153:0/2473567111 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f568803e070 con 0x7f56980728c0 2024-03-28T21:52:35.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.443+0000 7f569da00640 1 -- 172.21.15.153:0/2473567111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f569815ba40 con 0x7f56980728c0 2024-03-28T21:52:35.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.444+0000 7f568ea00640 1 -- 172.21.15.153:0/2473567111 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f5688037e40 con 0x7f56980728c0 2024-03-28T21:52:35.446 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-03-28T21:52:35.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.447+0000 7f569da00640 1 -- 172.21.15.153:0/2473567111 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f567806b4d0 msgr2=0x7f567806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:35.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.447+0000 7f569da00640 1 --2- 172.21.15.153:0/2473567111 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f567806b4d0 0x7f567806d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5684000f60 tx=0x7f56840079d0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.447+0000 7f569da00640 1 -- 172.21.15.153:0/2473567111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56980728c0 msgr2=0x7f5698156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:35.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.447+0000 7f569da00640 1 --2- 172.21.15.153:0/2473567111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56980728c0 0x7f5698156b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5688000c00 tx=0x7f56880046c0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.447+0000 7f569da00640 1 -- 172.21.15.153:0/2473567111 shutdown_connections 2024-03-28T21:52:35.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.447+0000 7f569da00640 1 --2- 172.21.15.153:0/2473567111 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f567806b4d0 0x7f567806d990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.447+0000 7f569da00640 1 --2- 172.21.15.153:0/2473567111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56980cef30 0x7f5698148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.447+0000 7f569da00640 1 --2- 172.21.15.153:0/2473567111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56980acd80 0x7f56981489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.447+0000 7f569da00640 1 --2- 172.21.15.153:0/2473567111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56980728c0 0x7f5698156b90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.447+0000 7f569da00640 1 -- 172.21.15.153:0/2473567111 >> 172.21.15.153:0/2473567111 conn(0x7f56980b19a0 msgr2=0x7f56980ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:35.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.447+0000 7f569da00640 1 -- 172.21.15.153:0/2473567111 shutdown_connections 2024-03-28T21:52:35.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.447+0000 7f569da00640 1 -- 172.21.15.153:0/2473567111 wait complete. 2024-03-28T21:52:35.466 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T21:52:35.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.669+0000 7ffadec00640 1 Processor -- start 2024-03-28T21:52:35.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.669+0000 7ffadec00640 1 -- start start 2024-03-28T21:52:35.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.670+0000 7ffadec00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ffad815e0e0 0x7ffad80d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:35.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffadec00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffad80d2100 0x7ffad80d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:35.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffadec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffad80d08c0 0x7ffad80d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:35.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffadec00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ffad80cff40 con 0x7ffad80d2100 2024-03-28T21:52:35.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffadec00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ffad80cf980 con 0x7ffad815e0e0 2024-03-28T21:52:35.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffadec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffad80cfc60 con 0x7ffad80d08c0 2024-03-28T21:52:35.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffadce00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffad80d2100 0x7ffad80d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:35.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffadce00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffad80d2100 0x7ffad80d2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55954/0 (socket says 172.21.15.153:55954) 2024-03-28T21:52:35.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffadce00640 1 -- 172.21.15.153:0/2657062059 learned_addr learned my addr 172.21.15.153:0/2657062059 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:35.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffade200640 1 --2- 172.21.15.153:0/2657062059 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffad80d08c0 0x7ffad80d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:35.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffadd800640 1 --2- 172.21.15.153:0/2657062059 >> v2:172.21.15.165:3300/0 conn(0x7ffad815e0e0 0x7ffad80d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:35.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffadce00640 1 -- 172.21.15.153:0/2657062059 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffad80d08c0 msgr2=0x7ffad80d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:35.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffadce00640 1 --2- 172.21.15.153:0/2657062059 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffad80d08c0 0x7ffad80d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffadce00640 1 -- 172.21.15.153:0/2657062059 >> v2:172.21.15.165:3300/0 conn(0x7ffad815e0e0 msgr2=0x7ffad80d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:35.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffadce00640 1 --2- 172.21.15.153:0/2657062059 >> v2:172.21.15.165:3300/0 conn(0x7ffad815e0e0 0x7ffad80d1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.671+0000 7ffadce00640 1 -- 172.21.15.153:0/2657062059 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad80c7be0 con 0x7ffad80d2100 2024-03-28T21:52:35.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.673+0000 7ffadce00640 1 --2- 172.21.15.153:0/2657062059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffad80d2100 0x7ffad80d2560 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffad806e150 tx=0x7ffac402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d8e7c9ef5215b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:35.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.673+0000 7ffad7e00640 1 -- 172.21.15.153:0/2657062059 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4035020 con 0x7ffad80d2100 2024-03-28T21:52:35.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.673+0000 7ffad7e00640 1 -- 172.21.15.153:0/2657062059 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac4031870 con 0x7ffad80d2100 2024-03-28T21:52:35.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.673+0000 7ffad7e00640 1 -- 172.21.15.153:0/2657062059 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4031c40 con 0x7ffad80d2100 2024-03-28T21:52:35.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.674+0000 7ffadec00640 1 -- 172.21.15.153:0/2657062059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffad80d2100 msgr2=0x7ffad80d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:35.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.674+0000 7ffadec00640 1 --2- 172.21.15.153:0/2657062059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffad80d2100 0x7ffad80d2560 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffad806e150 tx=0x7ffac402b910 comp rx=0 tx=0).stop 2024-03-28T21:52:35.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.674+0000 7ffadec00640 1 -- 172.21.15.153:0/2657062059 shutdown_connections 2024-03-28T21:52:35.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.674+0000 7ffadec00640 1 --2- 172.21.15.153:0/2657062059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffad80d2100 0x7ffad80d2560 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.674+0000 7ffadec00640 1 --2- 172.21.15.153:0/2657062059 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffad80d08c0 0x7ffad80d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.674+0000 7ffadec00640 1 --2- 172.21.15.153:0/2657062059 >> v2:172.21.15.165:3300/0 conn(0x7ffad815e0e0 0x7ffad80d1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.674+0000 7ffadec00640 1 -- 172.21.15.153:0/2657062059 >> 172.21.15.153:0/2657062059 conn(0x7ffad80d3ff0 msgr2=0x7ffad80d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:35.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.674+0000 7ffadec00640 1 -- 172.21.15.153:0/2657062059 shutdown_connections 2024-03-28T21:52:35.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.674+0000 7ffadec00640 1 -- 172.21.15.153:0/2657062059 wait complete. 2024-03-28T21:52:35.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.677+0000 7ffadec00640 1 Processor -- start 2024-03-28T21:52:35.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.677+0000 7ffadec00640 1 -- start start 2024-03-28T21:52:35.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.678+0000 7ffadec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffad80d08c0 0x7ffad81610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:35.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.678+0000 7ffadec00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffad80d2100 0x7ffad81593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:35.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.678+0000 7ffadec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffad815e0e0 0x7ffad80c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:35.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.678+0000 7ffadec00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffad80cf610 con 0x7ffad80d2100 2024-03-28T21:52:35.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.678+0000 7ffadec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffad80d4d40 con 0x7ffad815e0e0 2024-03-28T21:52:35.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.678+0000 7ffadec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffad815e4c0 con 0x7ffad80d08c0 2024-03-28T21:52:35.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.679+0000 7ffadce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffad80d2100 0x7ffad81593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:35.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.679+0000 7ffadce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffad80d2100 0x7ffad81593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55960/0 (socket says 172.21.15.153:55960) 2024-03-28T21:52:35.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.679+0000 7ffadce00640 1 -- 172.21.15.153:0/4066595590 learned_addr learned my addr 172.21.15.153:0/4066595590 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:35.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.679+0000 7ffade200640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffad815e0e0 0x7ffad80c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:35.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.679+0000 7ffadce00640 1 -- 172.21.15.153:0/4066595590 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffad80d08c0 msgr2=0x7ffad81610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:35.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.679+0000 7ffadd800640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffad80d08c0 0x7ffad81610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:35.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.679+0000 7ffadce00640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffad80d08c0 0x7ffad81610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.679+0000 7ffadce00640 1 -- 172.21.15.153:0/4066595590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffad815e0e0 msgr2=0x7ffad80c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:35.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.679+0000 7ffadce00640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffad815e0e0 0x7ffad80c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.679+0000 7ffadce00640 1 -- 172.21.15.153:0/4066595590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad815ead0 con 0x7ffad80d2100 2024-03-28T21:52:35.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.679+0000 7ffade200640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffad815e0e0 0x7ffad80c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:35.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.679+0000 7ffadce00640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffad80d2100 0x7ffad81593f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffac402b950 tx=0x7ffac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:35.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.680+0000 7ffad5600640 1 -- 172.21.15.153:0/4066595590 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4040070 con 0x7ffad80d2100 2024-03-28T21:52:35.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.680+0000 7ffad5600640 1 -- 172.21.15.153:0/4066595590 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac403a420 con 0x7ffad80d2100 2024-03-28T21:52:35.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.680+0000 7ffad5600640 1 -- 172.21.15.153:0/4066595590 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac4035040 con 0x7ffad80d2100 2024-03-28T21:52:35.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.680+0000 7ffadec00640 1 -- 172.21.15.153:0/4066595590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad815edb0 con 0x7ffad80d2100 2024-03-28T21:52:35.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.680+0000 7ffadec00640 1 -- 172.21.15.153:0/4066595590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad8160ba0 con 0x7ffad80d2100 2024-03-28T21:52:35.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.681+0000 7ffadec00640 1 -- 172.21.15.153:0/4066595590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad8068ff0 con 0x7ffad80d2100 2024-03-28T21:52:35.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.682+0000 7ffad5600640 1 -- 172.21.15.153:0/4066595590 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ffac404b060 con 0x7ffad80d2100 2024-03-28T21:52:35.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.683+0000 7ffad5600640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ffab806b4d0 0x7ffab806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:35.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.683+0000 7ffad5600640 1 -- 172.21.15.153:0/4066595590 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ffac40ac1f0 con 0x7ffad80d2100 2024-03-28T21:52:35.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.684+0000 7ffadd800640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ffab806b4d0 0x7ffab806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:35.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.684+0000 7ffadd800640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ffab806b4d0 0x7ffab806d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffad80d1230 tx=0x7ffacc008460 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:35.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.687+0000 7ffad5600640 1 -- 172.21.15.153:0/4066595590 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ffac407afd0 con 0x7ffad80d2100 2024-03-28T21:52:35.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.885+0000 7ffadec00640 1 -- 172.21.15.153:0/4066595590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffad8155c30 con 0x7ffad80d2100 2024-03-28T21:52:35.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.886+0000 7ffad5600640 1 -- 172.21.15.153:0/4066595590 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7ffac407a8d0 con 0x7ffad80d2100 2024-03-28T21:52:35.888 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-03-28T21:52:35.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.888+0000 7ffadec00640 1 -- 172.21.15.153:0/4066595590 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ffab806b4d0 msgr2=0x7ffab806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:35.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.888+0000 7ffadec00640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ffab806b4d0 0x7ffab806d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffad80d1230 tx=0x7ffacc008460 comp rx=0 tx=0).stop 2024-03-28T21:52:35.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.888+0000 7ffadec00640 1 -- 172.21.15.153:0/4066595590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffad80d2100 msgr2=0x7ffad81593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:35.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.888+0000 7ffadec00640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffad80d2100 0x7ffad81593f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffac402b950 tx=0x7ffac40046c0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.889+0000 7ffadec00640 1 -- 172.21.15.153:0/4066595590 shutdown_connections 2024-03-28T21:52:35.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.889+0000 7ffadec00640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ffab806b4d0 0x7ffab806d990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.889+0000 7ffadec00640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffad815e0e0 0x7ffad80c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.889+0000 7ffadec00640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffad80d2100 0x7ffad81593f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.889+0000 7ffadec00640 1 --2- 172.21.15.153:0/4066595590 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffad80d08c0 0x7ffad81610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:35.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.889+0000 7ffadec00640 1 -- 172.21.15.153:0/4066595590 >> 172.21.15.153:0/4066595590 conn(0x7ffad80d3ff0 msgr2=0x7ffad815d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:35.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.889+0000 7ffadec00640 1 -- 172.21.15.153:0/4066595590 shutdown_connections 2024-03-28T21:52:35.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:35.889+0000 7ffadec00640 1 -- 172.21.15.153:0/4066595590 wait complete. 2024-03-28T21:52:35.910 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:36.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.116+0000 7f13c3000640 1 Processor -- start 2024-03-28T21:52:36.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.116+0000 7f13c3000640 1 -- start start 2024-03-28T21:52:36.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.118+0000 7f13c3000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f13bc159a10 0x7f13bc15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.118+0000 7f13c3000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f13bc06e440 0x7f13bc0b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.118+0000 7f13c3000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13bc0b2e60 con 0x7f13bc0ad830 2024-03-28T21:52:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.118+0000 7f13c3000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f13bc0adc70 con 0x7f13bc159a10 2024-03-28T21:52:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.118+0000 7f13c3000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f13bc159df0 con 0x7f13bc06e440 2024-03-28T21:52:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.118+0000 7f13bbe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f13bc159a10 0x7f13bc15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.118+0000 7f13bbe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f13bc159a10 0x7f13bc15cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55970/0 (socket says 172.21.15.153:55970) 2024-03-28T21:52:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.118+0000 7f13bbe00640 1 -- 172.21.15.153:0/4031841380 learned_addr learned my addr 172.21.15.153:0/4031841380 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.119+0000 7f13c1000640 1 --2- 172.21.15.153:0/4031841380 >> v2:172.21.15.165:3300/0 conn(0x7f13bc06e440 0x7f13bc0b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.119+0000 7f13bbe00640 1 -- 172.21.15.153:0/4031841380 >> v2:172.21.15.165:3300/0 conn(0x7f13bc06e440 msgr2=0x7f13bc0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.119+0000 7f13bbe00640 1 --2- 172.21.15.153:0/4031841380 >> v2:172.21.15.165:3300/0 conn(0x7f13bc06e440 0x7f13bc0b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.119+0000 7f13bbe00640 1 -- 172.21.15.153:0/4031841380 >> v1:172.21.15.153:6789/0 conn(0x7f13bc0ad830 legacy=0x7f13bc06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.119+0000 7f13baa00640 1 -- 172.21.15.153:0/4031841380 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1139091582 0 0) 0x7f13bc0b2e60 con 0x7f13bc0ad830 2024-03-28T21:52:36.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.119+0000 7f13bbe00640 1 -- 172.21.15.153:0/4031841380 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc0adf10 con 0x7f13bc159a10 2024-03-28T21:52:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.121+0000 7f13bbe00640 1 --2- 172.21.15.153:0/4031841380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13bc159a10 0x7f13bc15cf00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0b28b0 tx=0x7f13a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8088072cc30027bf server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.121+0000 7f13baa00640 1 -- 172.21.15.153:0/4031841380 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4035020 con 0x7f13bc159a10 2024-03-28T21:52:36.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.121+0000 7f13baa00640 1 -- 172.21.15.153:0/4031841380 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13a4031870 con 0x7f13bc159a10 2024-03-28T21:52:36.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.121+0000 7f13baa00640 1 -- 172.21.15.153:0/4031841380 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4031c40 con 0x7f13bc159a10 2024-03-28T21:52:36.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.122+0000 7f13c3000640 1 -- 172.21.15.153:0/4031841380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13bc159a10 msgr2=0x7f13bc15cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:36.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.122+0000 7f13c3000640 1 --2- 172.21.15.153:0/4031841380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13bc159a10 0x7f13bc15cf00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0b28b0 tx=0x7f13a402b910 comp rx=0 tx=0).stop 2024-03-28T21:52:36.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.122+0000 7f13c3000640 1 -- 172.21.15.153:0/4031841380 shutdown_connections 2024-03-28T21:52:36.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.122+0000 7f13c3000640 1 --2- 172.21.15.153:0/4031841380 >> v2:172.21.15.165:3300/0 conn(0x7f13bc06e440 0x7f13bc0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.122+0000 7f13c3000640 1 --2- 172.21.15.153:0/4031841380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13bc159a10 0x7f13bc15cf00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.122+0000 7f13c3000640 1 -- 172.21.15.153:0/4031841380 >> 172.21.15.153:0/4031841380 conn(0x7f13bc0b1a30 msgr2=0x7f13bc0b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:36.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.122+0000 7f13c3000640 1 -- 172.21.15.153:0/4031841380 shutdown_connections 2024-03-28T21:52:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.122+0000 7f13c3000640 1 -- 172.21.15.153:0/4031841380 wait complete. 2024-03-28T21:52:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.124+0000 7f13c3000640 1 Processor -- start 2024-03-28T21:52:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.124+0000 7f13c3000640 1 -- start start 2024-03-28T21:52:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.125+0000 7f13c3000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc06e440 0x7f13bc150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.125+0000 7f13c3000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0ad830 0x7f13bc0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.125+0000 7f13c3000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13bc159a10 0x7f13bc06cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.125+0000 7f13c3000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc0ae4d0 con 0x7f13bc159a10 2024-03-28T21:52:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.125+0000 7f13c3000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc0b3100 con 0x7f13bc06e440 2024-03-28T21:52:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.125+0000 7f13c3000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f13bc0b3b60 con 0x7f13bc0ad830 2024-03-28T21:52:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.125+0000 7f13c1000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13bc159a10 0x7f13bc06cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.125+0000 7f13c1000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13bc159a10 0x7f13bc06cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55980/0 (socket says 172.21.15.153:55980) 2024-03-28T21:52:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.125+0000 7f13c1000640 1 -- 172.21.15.153:0/1236089517 learned_addr learned my addr 172.21.15.153:0/1236089517 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.125+0000 7f13bb400640 1 --2- 172.21.15.153:0/1236089517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0ad830 0x7f13bc0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.126+0000 7f13c1000640 1 -- 172.21.15.153:0/1236089517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0ad830 msgr2=0x7f13bc0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:36.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.126+0000 7f13c1000640 1 --2- 172.21.15.153:0/1236089517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0ad830 0x7f13bc0cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.126+0000 7f13c1000640 1 -- 172.21.15.153:0/1236089517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc06e440 msgr2=0x7f13bc150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:36.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.126+0000 7f13c1000640 1 --2- 172.21.15.153:0/1236089517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc06e440 0x7f13bc150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.126+0000 7f13c1000640 1 -- 172.21.15.153:0/1236089517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc0cf7d0 con 0x7f13bc159a10 2024-03-28T21:52:36.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.126+0000 7f13c1000640 1 --2- 172.21.15.153:0/1236089517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13bc159a10 0x7f13bc06cf80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f13b400cd70 tx=0x7f13b400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:36.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.126+0000 7f13b3e00640 1 -- 172.21.15.153:0/1236089517 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4003b90 con 0x7f13bc159a10 2024-03-28T21:52:36.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.126+0000 7f13b3e00640 1 -- 172.21.15.153:0/1236089517 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b4003d30 con 0x7f13bc159a10 2024-03-28T21:52:36.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.126+0000 7f13c3000640 1 -- 172.21.15.153:0/1236089517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13bc09ad80 con 0x7f13bc159a10 2024-03-28T21:52:36.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.126+0000 7f13b3e00640 1 -- 172.21.15.153:0/1236089517 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4004240 con 0x7f13bc159a10 2024-03-28T21:52:36.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.126+0000 7f13c3000640 1 -- 172.21.15.153:0/1236089517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13bc09b340 con 0x7f13bc159a10 2024-03-28T21:52:36.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.128+0000 7f13c3000640 1 -- 172.21.15.153:0/1236089517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13bc068ff0 con 0x7f13bc159a10 2024-03-28T21:52:36.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.128+0000 7f13b3e00640 1 -- 172.21.15.153:0/1236089517 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f13b40043e0 con 0x7f13bc159a10 2024-03-28T21:52:36.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.130+0000 7f13b3e00640 1 --2- 172.21.15.153:0/1236089517 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f139806b4d0 0x7f139806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:36.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.130+0000 7f13b3e00640 1 -- 172.21.15.153:0/1236089517 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f13b408adf0 con 0x7f13bc159a10 2024-03-28T21:52:36.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.130+0000 7f13bbe00640 1 --2- 172.21.15.153:0/1236089517 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f139806b4d0 0x7f139806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:36.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.131+0000 7f13bbe00640 1 --2- 172.21.15.153:0/1236089517 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f139806b4d0 0x7f139806d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f13a4036000 tx=0x7f13a4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:36.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.133+0000 7f13b3e00640 1 -- 172.21.15.153:0/1236089517 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f13b401d340 con 0x7f13bc159a10 2024-03-28T21:52:36.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.329+0000 7f13c3000640 1 -- 172.21.15.153:0/1236089517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13bc1541a0 con 0x7f13bc159a10 2024-03-28T21:52:36.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.330+0000 7f13b3e00640 1 -- 172.21.15.153:0/1236089517 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f13b4059bd0 con 0x7f13bc159a10 2024-03-28T21:52:36.332 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:36.332 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:57.716531+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:36.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.332+0000 7f13c3000640 1 -- 172.21.15.153:0/1236089517 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f139806b4d0 msgr2=0x7f139806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:36.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.332+0000 7f13c3000640 1 --2- 172.21.15.153:0/1236089517 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f139806b4d0 0x7f139806d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f13a4036000 tx=0x7f13a4030000 comp rx=0 tx=0).stop 2024-03-28T21:52:36.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.332+0000 7f13c3000640 1 -- 172.21.15.153:0/1236089517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13bc159a10 msgr2=0x7f13bc06cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:36.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.332+0000 7f13c3000640 1 --2- 172.21.15.153:0/1236089517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13bc159a10 0x7f13bc06cf80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f13b400cd70 tx=0x7f13b400a660 comp rx=0 tx=0).stop 2024-03-28T21:52:36.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.333+0000 7f13c3000640 1 -- 172.21.15.153:0/1236089517 shutdown_connections 2024-03-28T21:52:36.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.333+0000 7f13c3000640 1 --2- 172.21.15.153:0/1236089517 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f139806b4d0 0x7f139806d990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.333+0000 7f13c3000640 1 --2- 172.21.15.153:0/1236089517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13bc159a10 0x7f13bc06cf80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.333+0000 7f13c3000640 1 --2- 172.21.15.153:0/1236089517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0ad830 0x7f13bc0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.333+0000 7f13c3000640 1 --2- 172.21.15.153:0/1236089517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc06e440 0x7f13bc150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.333+0000 7f13c3000640 1 -- 172.21.15.153:0/1236089517 >> 172.21.15.153:0/1236089517 conn(0x7f13bc0b1a30 msgr2=0x7f13bc071440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:36.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.333+0000 7f13c3000640 1 -- 172.21.15.153:0/1236089517 shutdown_connections 2024-03-28T21:52:36.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.333+0000 7f13c3000640 1 -- 172.21.15.153:0/1236089517 wait complete. 2024-03-28T21:52:36.358 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T21:51:53.863931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T21:51:55.188736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T21:52:36.358 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T21:52:36.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.562+0000 7fcdd0a00640 1 Processor -- start 2024-03-28T21:52:36.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.562+0000 7fcdd0a00640 1 -- start start 2024-03-28T21:52:36.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.564+0000 7fcdd0a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcdcc15e0e0 0x7fcdcc0d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:36.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.564+0000 7fcdd0a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdcc0cff40 con 0x7fcdcc0d2100 2024-03-28T21:52:36.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.564+0000 7fcdd0a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdcc0cf980 con 0x7fcdcc0c93f0 2024-03-28T21:52:36.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.564+0000 7fcdd0a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fcdcc0cfc60 con 0x7fcdcc15e0e0 2024-03-28T21:52:36.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.564+0000 7fcdc9e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcdcc0d2100 0x7fcdcc0d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42540/0 (socket says 172.21.15.153:42540) 2024-03-28T21:52:36.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.564+0000 7fcdc9e00640 1 -- 172.21.15.153:0/1222535816 learned_addr learned my addr 172.21.15.153:0/1222535816 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:36.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.564+0000 7fcdca800640 1 --2- 172.21.15.153:0/1222535816 >> v2:172.21.15.165:3300/0 conn(0x7fcdcc15e0e0 0x7fcdcc0d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:36.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 -- 172.21.15.153:0/1222535816 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2231611027 0 0) 0x7fcdcc0cff40 con 0x7fcdcc0d2100 2024-03-28T21:52:36.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 -- 172.21.15.153:0/1222535816 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdb0003520 con 0x7fcdcc0d2100 2024-03-28T21:52:36.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 -- 172.21.15.153:0/1222535816 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4264930722 0 0) 0x7fcdb0003520 con 0x7fcdcc0d2100 2024-03-28T21:52:36.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 -- 172.21.15.153:0/1222535816 >> v2:172.21.15.165:3300/0 conn(0x7fcdcc15e0e0 msgr2=0x7fcdcc0d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:36.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 --2- 172.21.15.153:0/1222535816 >> v2:172.21.15.165:3300/0 conn(0x7fcdcc15e0e0 0x7fcdcc0d1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 -- 172.21.15.153:0/1222535816 >> v1:172.21.15.165:6789/0 conn(0x7fcdcc0c93f0 legacy=0x7fcdcc0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:36.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 -- 172.21.15.153:0/1222535816 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc0c7be0 con 0x7fcdcc0d2100 2024-03-28T21:52:36.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 -- 172.21.15.153:0/1222535816 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fcdb8001670 con 0x7fcdcc0d2100 2024-03-28T21:52:36.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 -- 172.21.15.153:0/1222535816 >> v1:172.21.15.153:6789/0 conn(0x7fcdcc0d2100 legacy=0x7fcdcc0d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:36.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 --2- 172.21.15.153:0/1222535816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdb00039b0 0x7fcdb0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:36.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 --2- 172.21.15.153:0/1222535816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdb0004800 0x7fcdb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:36.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 --2- 172.21.15.153:0/1222535816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdb00051c0 0x7fcdb000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:36.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 -- 172.21.15.153:0/1222535816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0cfc60 con 0x7fcdb00051c0 2024-03-28T21:52:36.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 -- 172.21.15.153:0/1222535816 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb000c060 con 0x7fcdb00039b0 2024-03-28T21:52:36.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.565+0000 7fcdc9400640 1 -- 172.21.15.153:0/1222535816 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb000c260 con 0x7fcdb0004800 2024-03-28T21:52:36.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.566+0000 7fcdcb200640 1 --2- 172.21.15.153:0/1222535816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdb00051c0 0x7fcdb000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:36.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.566+0000 7fcdca800640 1 --2- 172.21.15.153:0/1222535816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdb00039b0 0x7fcdb0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:36.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.566+0000 7fcdc9e00640 1 --2- 172.21.15.153:0/1222535816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdb0004800 0x7fcdb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:36.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.566+0000 7fcdcb200640 1 -- 172.21.15.153:0/1222535816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdb0004800 msgr2=0x7fcdb0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:36.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.566+0000 7fcdcb200640 1 --2- 172.21.15.153:0/1222535816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdb0004800 0x7fcdb0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.566+0000 7fcdcb200640 1 -- 172.21.15.153:0/1222535816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdb00039b0 msgr2=0x7fcdb0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:36.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.566+0000 7fcdcb200640 1 --2- 172.21.15.153:0/1222535816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdb00039b0 0x7fcdb0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.566+0000 7fcdcb200640 1 -- 172.21.15.153:0/1222535816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb0003520 con 0x7fcdb00051c0 2024-03-28T21:52:36.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.567+0000 7fcdcb200640 1 -- 172.21.15.153:0/1222535816 reap_dead start 2024-03-28T21:52:36.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.567+0000 7fcdcb200640 1 --2- 172.21.15.153:0/1222535816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdb00051c0 0x7fcdb000b9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4001e20 tx=0x7fcdb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af6958f19d11e4c server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:36.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.567+0000 7fcdc9400640 1 -- 172.21.15.153:0/1222535816 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4001a70 con 0x7fcdb00051c0 2024-03-28T21:52:36.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.567+0000 7fcdc9400640 1 -- 172.21.15.153:0/1222535816 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc4003b70 con 0x7fcdb00051c0 2024-03-28T21:52:36.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.567+0000 7fcdc9400640 1 -- 172.21.15.153:0/1222535816 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc40050d0 con 0x7fcdb00051c0 2024-03-28T21:52:36.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.568+0000 7fcdd0a00640 1 -- 172.21.15.153:0/1222535816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdb00051c0 msgr2=0x7fcdb000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:36.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.568+0000 7fcdd0a00640 1 --2- 172.21.15.153:0/1222535816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdb00051c0 0x7fcdb000b9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4001e20 tx=0x7fcdb0005830 comp rx=0 tx=0).stop 2024-03-28T21:52:36.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.568+0000 7fcdd0a00640 1 -- 172.21.15.153:0/1222535816 shutdown_connections 2024-03-28T21:52:36.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.568+0000 7fcdd0a00640 1 --2- 172.21.15.153:0/1222535816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdb00051c0 0x7fcdb000b9c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.568+0000 7fcdd0a00640 1 -- 172.21.15.153:0/1222535816 >> 172.21.15.153:0/1222535816 conn(0x7fcdcc0d3ff0 msgr2=0x7fcdcc0d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:36.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.568+0000 7fcdd0a00640 1 -- 172.21.15.153:0/1222535816 shutdown_connections 2024-03-28T21:52:36.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.568+0000 7fcdd0a00640 1 -- 172.21.15.153:0/1222535816 wait complete. 2024-03-28T21:52:36.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.570+0000 7fcdd0a00640 1 Processor -- start 2024-03-28T21:52:36.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.570+0000 7fcdd0a00640 1 -- start start 2024-03-28T21:52:36.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.571+0000 7fcdd0a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdb00051c0 0x7fcdcc14ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:36.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.571+0000 7fcdd0a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdcc14e3c0 0x7fcdcc159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:36.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.571+0000 7fcdd0a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdcc159550 0x7fcdcc0d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:36.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.571+0000 7fcdd0a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0cf610 con 0x7fcdcc14e3c0 2024-03-28T21:52:36.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.571+0000 7fcdd0a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0d4d40 con 0x7fcdcc159550 2024-03-28T21:52:36.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.571+0000 7fcdd0a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcdcc15e4c0 con 0x7fcdb00051c0 2024-03-28T21:52:36.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.572+0000 7fcdc9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdcc14e3c0 0x7fcdcc159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.572+0000 7fcdc9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdcc14e3c0 0x7fcdcc159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55984/0 (socket says 172.21.15.153:55984) 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.572+0000 7fcdc9e00640 1 -- 172.21.15.153:0/2429123140 learned_addr learned my addr 172.21.15.153:0/2429123140 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.572+0000 7fcdca800640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdb00051c0 0x7fcdcc14ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.572+0000 7fcdcb200640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdcc159550 0x7fcdcc0d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.572+0000 7fcdc9e00640 1 -- 172.21.15.153:0/2429123140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdb00051c0 msgr2=0x7fcdcc14ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.572+0000 7fcdc9e00640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdb00051c0 0x7fcdcc14ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.572+0000 7fcdc9e00640 1 -- 172.21.15.153:0/2429123140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdcc159550 msgr2=0x7fcdcc0d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.572+0000 7fcdc9e00640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdcc159550 0x7fcdcc0d05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.572+0000 7fcdc9e00640 1 -- 172.21.15.153:0/2429123140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc1599f0 con 0x7fcdcc14e3c0 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.572+0000 7fcdca800640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdb00051c0 0x7fcdcc14ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.572+0000 7fcdc9e00640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdcc14e3c0 0x7fcdcc159010 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800e830 tx=0x7fcdb800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.573+0000 7fcdc2a00640 1 -- 172.21.15.153:0/2429123140 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb800c8d0 con 0x7fcdcc14e3c0 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.573+0000 7fcdc2a00640 1 -- 172.21.15.153:0/2429123140 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb8018070 con 0x7fcdcc14e3c0 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.573+0000 7fcdc2a00640 1 -- 172.21.15.153:0/2429123140 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb800ccb0 con 0x7fcdcc14e3c0 2024-03-28T21:52:36.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.573+0000 7fcdd0a00640 1 -- 172.21.15.153:0/2429123140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdcc0cc820 con 0x7fcdcc14e3c0 2024-03-28T21:52:36.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.573+0000 7fcdd0a00640 1 -- 172.21.15.153:0/2429123140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdcc14e820 con 0x7fcdcc14e3c0 2024-03-28T21:52:36.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.574+0000 7fcdd0a00640 1 -- 172.21.15.153:0/2429123140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdcc068ff0 con 0x7fcdcc14e3c0 2024-03-28T21:52:36.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.576+0000 7fcdc2a00640 1 -- 172.21.15.153:0/2429123140 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fcdb801d460 con 0x7fcdcc14e3c0 2024-03-28T21:52:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.577+0000 7fcdc2a00640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcdac06b4d0 0x7fcdac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.577+0000 7fcdc2a00640 1 -- 172.21.15.153:0/2429123140 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcdb808a1c0 con 0x7fcdcc14e3c0 2024-03-28T21:52:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.577+0000 7fcdca800640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcdac06b4d0 0x7fcdac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.578+0000 7fcdca800640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcdac06b4d0 0x7fcdac06d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009980 tx=0x7fcdbc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.582+0000 7fcdc2a00640 1 -- 172.21.15.153:0/2429123140 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcdb8058f10 con 0x7fcdcc14e3c0 2024-03-28T21:52:36.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.787+0000 7fcdd0a00640 1 -- 172.21.15.153:0/2429123140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcdcc0ca950 con 0x7fcdcc14e3c0 2024-03-28T21:52:36.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.788+0000 7fcdc2a00640 1 -- 172.21.15.153:0/2429123140 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fcdb8058810 con 0x7fcdcc14e3c0 2024-03-28T21:52:36.789 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-28T21:52:36.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.790+0000 7fcdd0a00640 1 -- 172.21.15.153:0/2429123140 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcdac06b4d0 msgr2=0x7fcdac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:36.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.790+0000 7fcdd0a00640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcdac06b4d0 0x7fcdac06d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009980 tx=0x7fcdbc008040 comp rx=0 tx=0).stop 2024-03-28T21:52:36.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.790+0000 7fcdd0a00640 1 -- 172.21.15.153:0/2429123140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdcc14e3c0 msgr2=0x7fcdcc159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:36.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.790+0000 7fcdd0a00640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdcc14e3c0 0x7fcdcc159010 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800e830 tx=0x7fcdb800ec30 comp rx=0 tx=0).stop 2024-03-28T21:52:36.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.790+0000 7fcdd0a00640 1 -- 172.21.15.153:0/2429123140 shutdown_connections 2024-03-28T21:52:36.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.790+0000 7fcdd0a00640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcdac06b4d0 0x7fcdac06d990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.790+0000 7fcdd0a00640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdcc159550 0x7fcdcc0d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.790+0000 7fcdd0a00640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdcc14e3c0 0x7fcdcc159010 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.790+0000 7fcdd0a00640 1 --2- 172.21.15.153:0/2429123140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdb00051c0 0x7fcdcc14ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:36.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.790+0000 7fcdd0a00640 1 -- 172.21.15.153:0/2429123140 >> 172.21.15.153:0/2429123140 conn(0x7fcdcc0d3ff0 msgr2=0x7fcdcc0c82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:36.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.790+0000 7fcdd0a00640 1 -- 172.21.15.153:0/2429123140 shutdown_connections 2024-03-28T21:52:36.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:36.790+0000 7fcdd0a00640 1 -- 172.21.15.153:0/2429123140 wait complete. 2024-03-28T21:52:36.815 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T21:52:37.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.014+0000 7f18a7a00640 1 Processor -- start 2024-03-28T21:52:37.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.014+0000 7f18a7a00640 1 -- start start 2024-03-28T21:52:37.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.016+0000 7f18a7a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f18a00cef30 0x7f18a0071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.016+0000 7f18a7a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18a00acd80 0x7f18a00cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.016+0000 7f18a7a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18a00728c0 0x7f18a006cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.016+0000 7f18a7a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f18a00cf850 con 0x7f18a00acd80 2024-03-28T21:52:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.016+0000 7f18a7a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f18a0070f20 con 0x7f18a00cef30 2024-03-28T21:52:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.016+0000 7f18a7a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f18a0071200 con 0x7f18a00728c0 2024-03-28T21:52:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.016+0000 7f189fe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18a00acd80 0x7f18a00cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.016+0000 7f189fe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18a00acd80 0x7f18a00cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55998/0 (socket says 172.21.15.153:55998) 2024-03-28T21:52:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.016+0000 7f189fe00640 1 -- 172.21.15.153:0/969872715 learned_addr learned my addr 172.21.15.153:0/969872715 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.016+0000 7f18a5000640 1 --2- 172.21.15.153:0/969872715 >> v2:172.21.15.165:3300/0 conn(0x7f18a00cef30 0x7f18a0071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.016+0000 7f18a5a00640 1 --2- 172.21.15.153:0/969872715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18a00728c0 0x7f18a006cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.016+0000 7f189fe00640 1 -- 172.21.15.153:0/969872715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18a00728c0 msgr2=0x7f18a006cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.016+0000 7f189fe00640 1 --2- 172.21.15.153:0/969872715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18a00728c0 0x7f18a006cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.017+0000 7f189fe00640 1 -- 172.21.15.153:0/969872715 >> v2:172.21.15.165:3300/0 conn(0x7f18a00cef30 msgr2=0x7f18a0071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.017+0000 7f189fe00640 1 --2- 172.21.15.153:0/969872715 >> v2:172.21.15.165:3300/0 conn(0x7f18a00cef30 0x7f18a0071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.017+0000 7f189fe00640 1 -- 172.21.15.153:0/969872715 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a00714e0 con 0x7f18a00acd80 2024-03-28T21:52:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.017+0000 7f18a5000640 1 --2- 172.21.15.153:0/969872715 >> v2:172.21.15.165:3300/0 conn(0x7f18a00cef30 0x7f18a0071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.018+0000 7f189fe00640 1 --2- 172.21.15.153:0/969872715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18a00acd80 0x7f18a00cf310 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f18a00cfc60 tx=0x7f188c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a5b09a9546e4b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.018+0000 7f189f400640 1 -- 172.21.15.153:0/969872715 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c035020 con 0x7f18a00acd80 2024-03-28T21:52:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.018+0000 7f189f400640 1 -- 172.21.15.153:0/969872715 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188c031870 con 0x7f18a00acd80 2024-03-28T21:52:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.018+0000 7f189f400640 1 -- 172.21.15.153:0/969872715 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c031c40 con 0x7f18a00acd80 2024-03-28T21:52:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.019+0000 7f18a7a00640 1 -- 172.21.15.153:0/969872715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18a00acd80 msgr2=0x7f18a00cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.019+0000 7f18a7a00640 1 --2- 172.21.15.153:0/969872715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18a00acd80 0x7f18a00cf310 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f18a00cfc60 tx=0x7f188c02b910 comp rx=0 tx=0).stop 2024-03-28T21:52:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.019+0000 7f18a7a00640 1 -- 172.21.15.153:0/969872715 shutdown_connections 2024-03-28T21:52:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.019+0000 7f18a7a00640 1 --2- 172.21.15.153:0/969872715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18a00acd80 0x7f18a00cf310 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.019+0000 7f18a7a00640 1 --2- 172.21.15.153:0/969872715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18a00728c0 0x7f18a006cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.019+0000 7f18a7a00640 1 --2- 172.21.15.153:0/969872715 >> v2:172.21.15.165:3300/0 conn(0x7f18a00cef30 0x7f18a0071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.019+0000 7f18a7a00640 1 -- 172.21.15.153:0/969872715 >> 172.21.15.153:0/969872715 conn(0x7f18a00b19a0 msgr2=0x7f18a00b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:37.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.019+0000 7f18a7a00640 1 -- 172.21.15.153:0/969872715 shutdown_connections 2024-03-28T21:52:37.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.019+0000 7f18a7a00640 1 -- 172.21.15.153:0/969872715 wait complete. 2024-03-28T21:52:37.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.021+0000 7f18a7a00640 1 Processor -- start 2024-03-28T21:52:37.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.021+0000 7f18a7a00640 1 -- start start 2024-03-28T21:52:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.022+0000 7f18a7a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18a00728c0 0x7f18a01f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.022+0000 7f18a7a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18a00acd80 0x7f18a0150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.022+0000 7f18a7a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18a00cef30 0x7f18a015c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.022+0000 7f18a7a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f18a0072ed0 con 0x7f18a00728c0 2024-03-28T21:52:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.022+0000 7f18a7a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f18a0072d50 con 0x7f18a00cef30 2024-03-28T21:52:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.022+0000 7f18a7a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f18a015c1f0 con 0x7f18a00acd80 2024-03-28T21:52:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.023+0000 7f18a5000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18a00728c0 0x7f18a01f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.023+0000 7f18a5000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18a00728c0 0x7f18a01f4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56014/0 (socket says 172.21.15.153:56014) 2024-03-28T21:52:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.023+0000 7f18a5000640 1 -- 172.21.15.153:0/3709288649 learned_addr learned my addr 172.21.15.153:0/3709288649 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.023+0000 7f189fe00640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18a00acd80 0x7f18a0150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.023+0000 7f18a5a00640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18a00cef30 0x7f18a015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.023+0000 7f18a5000640 1 -- 172.21.15.153:0/3709288649 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18a00acd80 msgr2=0x7f18a0150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.023+0000 7f18a5000640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18a00acd80 0x7f18a0150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.023+0000 7f18a5000640 1 -- 172.21.15.153:0/3709288649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18a00cef30 msgr2=0x7f18a015c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:37.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.023+0000 7f18a5000640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18a00cef30 0x7f18a015c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.023+0000 7f18a5000640 1 -- 172.21.15.153:0/3709288649 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a015ca70 con 0x7f18a00728c0 2024-03-28T21:52:37.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.023+0000 7f18a5a00640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18a00cef30 0x7f18a015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:37.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.023+0000 7f18a5000640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18a00728c0 0x7f18a01f4520 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f189400c820 tx=0x7f189400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:37.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.024+0000 7f189cc00640 1 -- 172.21.15.153:0/3709288649 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1894015070 con 0x7f18a00728c0 2024-03-28T21:52:37.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.024+0000 7f189cc00640 1 -- 172.21.15.153:0/3709288649 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18940079d0 con 0x7f18a00728c0 2024-03-28T21:52:37.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.024+0000 7f189cc00640 1 -- 172.21.15.153:0/3709288649 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1894007d80 con 0x7f18a00728c0 2024-03-28T21:52:37.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.024+0000 7f18a7a00640 1 -- 172.21.15.153:0/3709288649 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a015f0e0 con 0x7f18a00728c0 2024-03-28T21:52:37.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.024+0000 7f18a7a00640 1 -- 172.21.15.153:0/3709288649 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a01f3d20 con 0x7f18a00728c0 2024-03-28T21:52:37.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.025+0000 7f18a7a00640 1 -- 172.21.15.153:0/3709288649 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a0068ff0 con 0x7f18a00728c0 2024-03-28T21:52:37.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.026+0000 7f189cc00640 1 -- 172.21.15.153:0/3709288649 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f1894018070 con 0x7f18a00728c0 2024-03-28T21:52:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.027+0000 7f189cc00640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f188006b4d0 0x7f188006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.027+0000 7f189cc00640 1 -- 172.21.15.153:0/3709288649 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f189408a050 con 0x7f18a00728c0 2024-03-28T21:52:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.027+0000 7f189fe00640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f188006b4d0 0x7f188006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:37.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.028+0000 7f189fe00640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f188006b4d0 0x7f188006d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f188c036000 tx=0x7f188c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:37.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.031+0000 7f189cc00640 1 -- 172.21.15.153:0/3709288649 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f18a015ca70 con 0x7f18a00728c0 2024-03-28T21:52:37.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.241+0000 7f18a7a00640 1 -- 172.21.15.153:0/3709288649 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f18a00ceb00 con 0x7f18a00728c0 2024-03-28T21:52:37.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.242+0000 7f189cc00640 1 -- 172.21.15.153:0/3709288649 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f1894058e30 con 0x7f18a00728c0 2024-03-28T21:52:37.243 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-03-28T21:52:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.245+0000 7f18a7a00640 1 -- 172.21.15.153:0/3709288649 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f188006b4d0 msgr2=0x7f188006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.245+0000 7f18a7a00640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f188006b4d0 0x7f188006d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f188c036000 tx=0x7f188c03c040 comp rx=0 tx=0).stop 2024-03-28T21:52:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.245+0000 7f18a7a00640 1 -- 172.21.15.153:0/3709288649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18a00728c0 msgr2=0x7f18a01f4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.245+0000 7f18a7a00640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18a00728c0 0x7f18a01f4520 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f189400c820 tx=0x7f189400cce0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.245+0000 7f18a7a00640 1 -- 172.21.15.153:0/3709288649 shutdown_connections 2024-03-28T21:52:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.245+0000 7f18a7a00640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f188006b4d0 0x7f188006d990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.245+0000 7f18a7a00640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18a00cef30 0x7f18a015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.245+0000 7f18a7a00640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18a00acd80 0x7f18a0150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.245+0000 7f18a7a00640 1 --2- 172.21.15.153:0/3709288649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18a00728c0 0x7f18a01f4520 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.245+0000 7f18a7a00640 1 -- 172.21.15.153:0/3709288649 >> 172.21.15.153:0/3709288649 conn(0x7f18a00b19a0 msgr2=0x7f18a00b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:37.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.245+0000 7f18a7a00640 1 -- 172.21.15.153:0/3709288649 shutdown_connections 2024-03-28T21:52:37.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.246+0000 7f18a7a00640 1 -- 172.21.15.153:0/3709288649 wait complete. 2024-03-28T21:52:37.264 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T21:52:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.507+0000 7f91b4c00640 1 Processor -- start 2024-03-28T21:52:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.507+0000 7f91b4c00640 1 -- start start 2024-03-28T21:52:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.508+0000 7f91b4c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f91b013ef10 0x7f91b01416a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.508+0000 7f91b4c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b0070df0 con 0x7f91b0141be0 2024-03-28T21:52:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.508+0000 7f91b4c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b00cedc0 con 0x7f91b00ce9b0 2024-03-28T21:52:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.508+0000 7f91b4c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f91b013f2f0 con 0x7f91b013ef10 2024-03-28T21:52:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.509+0000 7f91a7e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f91b0141be0 0x7f91b00ce2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42552/0 (socket says 172.21.15.153:42552) 2024-03-28T21:52:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.509+0000 7f91a7e00640 1 -- 172.21.15.153:0/1774875004 learned_addr learned my addr 172.21.15.153:0/1774875004 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.509+0000 7f91af400640 1 --2- 172.21.15.153:0/1774875004 >> v2:172.21.15.165:3300/0 conn(0x7f91b013ef10 0x7f91b01416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.509+0000 7f91aea00640 1 -- 172.21.15.153:0/1774875004 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321474828 0 0) 0x7f91b0070df0 con 0x7f91b0141be0 2024-03-28T21:52:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.509+0000 7f91aea00640 1 -- 172.21.15.153:0/1774875004 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9194003520 con 0x7f91b0141be0 2024-03-28T21:52:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.509+0000 7f91aea00640 1 -- 172.21.15.153:0/1774875004 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2809327638 0 0) 0x7f9194003520 con 0x7f91b0141be0 2024-03-28T21:52:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.509+0000 7f91aea00640 1 -- 172.21.15.153:0/1774875004 >> v2:172.21.15.165:3300/0 conn(0x7f91b013ef10 msgr2=0x7f91b01416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.509+0000 7f91aea00640 1 --2- 172.21.15.153:0/1774875004 >> v2:172.21.15.165:3300/0 conn(0x7f91b013ef10 0x7f91b01416a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.510+0000 7f91aea00640 1 -- 172.21.15.153:0/1774875004 >> v1:172.21.15.165:6789/0 conn(0x7f91b00ce9b0 legacy=0x7f91b00712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.510+0000 7f91aea00640 1 -- 172.21.15.153:0/1774875004 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b00cf060 con 0x7f91b0141be0 2024-03-28T21:52:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.510+0000 7f91aea00640 1 -- 172.21.15.153:0/1774875004 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f9198001670 con 0x7f91b0141be0 2024-03-28T21:52:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.510+0000 7f91aea00640 1 -- 172.21.15.153:0/1774875004 >> v1:172.21.15.153:6789/0 conn(0x7f91b0141be0 legacy=0x7f91b00ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.510+0000 7f91aea00640 1 --2- 172.21.15.153:0/1774875004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9194003a00 0x7f9194003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.510+0000 7f91aea00640 1 --2- 172.21.15.153:0/1774875004 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9194004800 0x7f9194004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.510+0000 7f91aea00640 1 --2- 172.21.15.153:0/1774875004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91940051c0 0x7f919400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.510+0000 7f91aea00640 1 -- 172.21.15.153:0/1774875004 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91b013f2f0 con 0x7f9194003a00 2024-03-28T21:52:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.510+0000 7f91aea00640 1 -- 172.21.15.153:0/1774875004 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f919400c0c0 con 0x7f91940051c0 2024-03-28T21:52:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.510+0000 7f91aea00640 1 -- 172.21.15.153:0/1774875004 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f919400c2c0 con 0x7f9194004800 2024-03-28T21:52:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.510+0000 7f91af400640 1 --2- 172.21.15.153:0/1774875004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9194003a00 0x7f9194003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.510+0000 7f91a7e00640 1 --2- 172.21.15.153:0/1774875004 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9194004800 0x7f9194004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.510+0000 7f91af400640 1 -- 172.21.15.153:0/1774875004 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9194004800 msgr2=0x7f9194004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.511+0000 7f91af400640 1 --2- 172.21.15.153:0/1774875004 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9194004800 0x7f9194004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.511+0000 7f91af400640 1 -- 172.21.15.153:0/1774875004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91940051c0 msgr2=0x7f919400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.511+0000 7f91af400640 1 --2- 172.21.15.153:0/1774875004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91940051c0 0x7f919400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.511+0000 7f91af400640 1 -- 172.21.15.153:0/1774875004 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9194003520 con 0x7f9194003a00 2024-03-28T21:52:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.511+0000 7f91afe00640 1 -- 172.21.15.153:0/1774875004 reap_dead start 2024-03-28T21:52:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.512+0000 7f91af400640 1 --2- 172.21.15.153:0/1774875004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9194003a00 0x7f9194003e20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009ac0 tx=0x7f9194005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f18b251e09f40e server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.512+0000 7f91aea00640 1 -- 172.21.15.153:0/1774875004 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0039070 con 0x7f9194003a00 2024-03-28T21:52:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.512+0000 7f91aea00640 1 -- 172.21.15.153:0/1774875004 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a002c710 con 0x7f9194003a00 2024-03-28T21:52:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.512+0000 7f91aea00640 1 -- 172.21.15.153:0/1774875004 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0009690 con 0x7f9194003a00 2024-03-28T21:52:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.513+0000 7f91b4c00640 1 -- 172.21.15.153:0/1774875004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9194003a00 msgr2=0x7f9194003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.513+0000 7f91b4c00640 1 --2- 172.21.15.153:0/1774875004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9194003a00 0x7f9194003e20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009ac0 tx=0x7f9194005830 comp rx=0 tx=0).stop 2024-03-28T21:52:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.513+0000 7f91b4c00640 1 -- 172.21.15.153:0/1774875004 shutdown_connections 2024-03-28T21:52:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.513+0000 7f91b4c00640 1 --2- 172.21.15.153:0/1774875004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9194003a00 0x7f9194003e20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.513+0000 7f91b4c00640 1 -- 172.21.15.153:0/1774875004 >> 172.21.15.153:0/1774875004 conn(0x7f91b00b1820 msgr2=0x7f91b00b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.513+0000 7f91b4c00640 1 -- 172.21.15.153:0/1774875004 shutdown_connections 2024-03-28T21:52:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.513+0000 7f91b4c00640 1 -- 172.21.15.153:0/1774875004 wait complete. 2024-03-28T21:52:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.515+0000 7f91b4c00640 1 Processor -- start 2024-03-28T21:52:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.515+0000 7f91b4c00640 1 -- start start 2024-03-28T21:52:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.516+0000 7f91b4c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9194003a00 0x7f91b013d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.516+0000 7f91b4c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91b013c560 0x7f91b01f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.516+0000 7f91b4c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015eec0 0x7f91b015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.516+0000 7f91b4c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91b00cf900 con 0x7f91b015eec0 2024-03-28T21:52:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.516+0000 7f91b4c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f91b00cf620 con 0x7f91b013c560 2024-03-28T21:52:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.516+0000 7f91b4c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f91b01416a0 con 0x7f9194003a00 2024-03-28T21:52:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.516+0000 7f91afe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015eec0 0x7f91b015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.516+0000 7f91afe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015eec0 0x7f91b015bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56034/0 (socket says 172.21.15.153:56034) 2024-03-28T21:52:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.516+0000 7f91afe00640 1 -- 172.21.15.153:0/1593691096 learned_addr learned my addr 172.21.15.153:0/1593691096 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.516+0000 7f91af400640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9194003a00 0x7f91b013d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.516+0000 7f91a7e00640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91b013c560 0x7f91b01f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.517+0000 7f91afe00640 1 -- 172.21.15.153:0/1593691096 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9194003a00 msgr2=0x7f91b013d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.517+0000 7f91afe00640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9194003a00 0x7f91b013d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.517+0000 7f91afe00640 1 -- 172.21.15.153:0/1593691096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91b013c560 msgr2=0x7f91b01f5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.517+0000 7f91afe00640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91b013c560 0x7f91b01f5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.517+0000 7f91afe00640 1 -- 172.21.15.153:0/1593691096 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b013c9e0 con 0x7f91b015eec0 2024-03-28T21:52:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.517+0000 7f91af400640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9194003a00 0x7f91b013d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.517+0000 7f91a7e00640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91b013c560 0x7f91b01f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.517+0000 7f91afe00640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015eec0 0x7f91b015bec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f91b006ca90 tx=0x7f91a800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.517+0000 7f91a7400640 1 -- 172.21.15.153:0/1593691096 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8017070 con 0x7f91b015eec0 2024-03-28T21:52:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.517+0000 7f91a7400640 1 -- 172.21.15.153:0/1593691096 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a80070d0 con 0x7f91b015eec0 2024-03-28T21:52:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.517+0000 7f91b4c00640 1 -- 172.21.15.153:0/1593691096 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b013de50 con 0x7f91b015eec0 2024-03-28T21:52:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.517+0000 7f91a7400640 1 -- 172.21.15.153:0/1593691096 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a80074c0 con 0x7f91b015eec0 2024-03-28T21:52:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.517+0000 7f91b4c00640 1 -- 172.21.15.153:0/1593691096 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b015e6c0 con 0x7f91b015eec0 2024-03-28T21:52:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.519+0000 7f91b4c00640 1 -- 172.21.15.153:0/1593691096 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b0068ff0 con 0x7f91b015eec0 2024-03-28T21:52:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.520+0000 7f91a7400640 1 -- 172.21.15.153:0/1593691096 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f91a801a070 con 0x7f91b015eec0 2024-03-28T21:52:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.522+0000 7f91a7400640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f918c06b4d0 0x7f918c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.522+0000 7f91a7400640 1 -- 172.21.15.153:0/1593691096 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f91a80894b0 con 0x7f91b015eec0 2024-03-28T21:52:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.522+0000 7f91af400640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f918c06b4d0 0x7f918c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.523+0000 7f91af400640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f918c06b4d0 0x7f918c06d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f91a0036000 tx=0x7f91a0030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:37.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.527+0000 7f91a7400640 1 -- 172.21.15.153:0/1593691096 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f91a8058330 con 0x7f91b015eec0 2024-03-28T21:52:37.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.921+0000 7f91b4c00640 1 -- 172.21.15.153:0/1593691096 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f91b0072c10 con 0x7f91b015eec0 2024-03-28T21:52:37.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.921+0000 7f91a7400640 1 -- 172.21.15.153:0/1593691096 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f91a8057c30 con 0x7f91b015eec0 2024-03-28T21:52:37.924 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-03-28T21:52:37.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.925+0000 7f91b4c00640 1 -- 172.21.15.153:0/1593691096 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f918c06b4d0 msgr2=0x7f918c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:37.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.925+0000 7f91b4c00640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f918c06b4d0 0x7f918c06d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f91a0036000 tx=0x7f91a0030000 comp rx=0 tx=0).stop 2024-03-28T21:52:37.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.925+0000 7f91b4c00640 1 -- 172.21.15.153:0/1593691096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015eec0 msgr2=0x7f91b015bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:37.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.925+0000 7f91b4c00640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015eec0 0x7f91b015bec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f91b006ca90 tx=0x7f91a800c960 comp rx=0 tx=0).stop 2024-03-28T21:52:37.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.925+0000 7f91b4c00640 1 -- 172.21.15.153:0/1593691096 shutdown_connections 2024-03-28T21:52:37.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.925+0000 7f91b4c00640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f918c06b4d0 0x7f918c06d990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.925+0000 7f91b4c00640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015eec0 0x7f91b015bec0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.925+0000 7f91b4c00640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91b013c560 0x7f91b01f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.925+0000 7f91b4c00640 1 --2- 172.21.15.153:0/1593691096 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9194003a00 0x7f91b013d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:37.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.925+0000 7f91b4c00640 1 -- 172.21.15.153:0/1593691096 >> 172.21.15.153:0/1593691096 conn(0x7f91b00b1820 msgr2=0x7f91b0140ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:37.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.925+0000 7f91b4c00640 1 -- 172.21.15.153:0/1593691096 shutdown_connections 2024-03-28T21:52:37.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:37.925+0000 7f91b4c00640 1 -- 172.21.15.153:0/1593691096 wait complete. 2024-03-28T21:52:37.956 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-28T21:52:37.957 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:38.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.145+0000 7fa233400640 1 Processor -- start 2024-03-28T21:52:38.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.145+0000 7fa233400640 1 -- start start 2024-03-28T21:52:38.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.147+0000 7fa233400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa22c072ae0 0x7fa22c0afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:38.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.147+0000 7fa233400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa22c145b50 con 0x7fa22c06b880 2024-03-28T21:52:38.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.147+0000 7fa233400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa22c0af3f0 con 0x7fa22c0d05b0 2024-03-28T21:52:38.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.147+0000 7fa233400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa22c0b0410 con 0x7fa22c072ae0 2024-03-28T21:52:38.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.147+0000 7fa22be00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa22c06b880 0x7fa22c0cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42560/0 (socket says 172.21.15.153:42560) 2024-03-28T21:52:38.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.147+0000 7fa22be00640 1 -- 172.21.15.153:0/1901378613 learned_addr learned my addr 172.21.15.153:0/1901378613 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:38.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.147+0000 7fa231400640 1 --2- 172.21.15.153:0/1901378613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa22c072ae0 0x7fa22c0afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:38.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.147+0000 7fa22b400640 1 -- 172.21.15.153:0/1901378613 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3867695371 0 0) 0x7fa22c145b50 con 0x7fa22c06b880 2024-03-28T21:52:38.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.147+0000 7fa22b400640 1 -- 172.21.15.153:0/1901378613 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa214003520 con 0x7fa22c06b880 2024-03-28T21:52:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.148+0000 7fa22b400640 1 -- 172.21.15.153:0/1901378613 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 693674720 0 0) 0x7fa214003520 con 0x7fa22c06b880 2024-03-28T21:52:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.148+0000 7fa22b400640 1 -- 172.21.15.153:0/1901378613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa22c072ae0 msgr2=0x7fa22c0afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.148+0000 7fa22b400640 1 --2- 172.21.15.153:0/1901378613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa22c072ae0 0x7fa22c0afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.148+0000 7fa22b400640 1 -- 172.21.15.153:0/1901378613 >> v1:172.21.15.165:6789/0 conn(0x7fa22c0d05b0 legacy=0x7fa22c06b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.148+0000 7fa22b400640 1 -- 172.21.15.153:0/1901378613 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22c0af6d0 con 0x7fa22c06b880 2024-03-28T21:52:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.148+0000 7fa22b400640 1 -- 172.21.15.153:0/1901378613 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fa218001670 con 0x7fa22c06b880 2024-03-28T21:52:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.148+0000 7fa22b400640 1 -- 172.21.15.153:0/1901378613 >> v1:172.21.15.153:6789/0 conn(0x7fa22c06b880 legacy=0x7fa22c0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.148+0000 7fa22b400640 1 --2- 172.21.15.153:0/1901378613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2140039e0 0x7fa214003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.148+0000 7fa22b400640 1 --2- 172.21.15.153:0/1901378613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa22c072ae0 0x7fa214004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.148+0000 7fa22b400640 1 --2- 172.21.15.153:0/1901378613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa214004d40 0x7fa2140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.148+0000 7fa22b400640 1 -- 172.21.15.153:0/1901378613 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c0b0410 con 0x7fa214004d40 2024-03-28T21:52:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.148+0000 7fa22b400640 1 -- 172.21.15.153:0/1901378613 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa21400bb50 con 0x7fa2140039e0 2024-03-28T21:52:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.148+0000 7fa22b400640 1 -- 172.21.15.153:0/1901378613 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa21400bd50 con 0x7fa22c072ae0 2024-03-28T21:52:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.148+0000 7fa231400640 1 --2- 172.21.15.153:0/1901378613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa214004d40 0x7fa2140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.149+0000 7fa231400640 1 -- 172.21.15.153:0/1901378613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa22c072ae0 msgr2=0x7fa214004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.149+0000 7fa231400640 1 --2- 172.21.15.153:0/1901378613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa22c072ae0 0x7fa214004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.149+0000 7fa231400640 1 -- 172.21.15.153:0/1901378613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2140039e0 msgr2=0x7fa214003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.149+0000 7fa230a00640 1 --2- 172.21.15.153:0/1901378613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2140039e0 0x7fa214003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.149+0000 7fa231400640 1 --2- 172.21.15.153:0/1901378613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2140039e0 0x7fa214003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.149+0000 7fa231400640 1 -- 172.21.15.153:0/1901378613 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa214003520 con 0x7fa214004d40 2024-03-28T21:52:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.149+0000 7fa230a00640 1 --2- 172.21.15.153:0/1901378613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2140039e0 0x7fa214003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.150+0000 7fa231400640 1 --2- 172.21.15.153:0/1901378613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa214004d40 0x7fa2140051c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa224009fc0 tx=0x7fa214005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940a202c796675c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:38.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.150+0000 7fa22b400640 1 -- 172.21.15.153:0/1901378613 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224039070 con 0x7fa214004d40 2024-03-28T21:52:38.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.150+0000 7fa22b400640 1 -- 172.21.15.153:0/1901378613 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa22402cc60 con 0x7fa214004d40 2024-03-28T21:52:38.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.150+0000 7fa22b400640 1 -- 172.21.15.153:0/1901378613 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224009c10 con 0x7fa214004d40 2024-03-28T21:52:38.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.151+0000 7fa233400640 1 -- 172.21.15.153:0/1901378613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa214004d40 msgr2=0x7fa2140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:38.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.151+0000 7fa233400640 1 --2- 172.21.15.153:0/1901378613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa214004d40 0x7fa2140051c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa224009fc0 tx=0x7fa214005830 comp rx=0 tx=0).stop 2024-03-28T21:52:38.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.151+0000 7fa231400640 1 -- 172.21.15.153:0/1901378613 reap_dead start 2024-03-28T21:52:38.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.151+0000 7fa233400640 1 -- 172.21.15.153:0/1901378613 shutdown_connections 2024-03-28T21:52:38.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.151+0000 7fa233400640 1 -- 172.21.15.153:0/1901378613 >> 172.21.15.153:0/1901378613 conn(0x7fa22c0d0d20 msgr2=0x7fa22c0d1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:38.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.151+0000 7fa233400640 1 -- 172.21.15.153:0/1901378613 shutdown_connections 2024-03-28T21:52:38.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.151+0000 7fa233400640 1 -- 172.21.15.153:0/1901378613 wait complete. 2024-03-28T21:52:38.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.153+0000 7fa233400640 1 Processor -- start 2024-03-28T21:52:38.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.153+0000 7fa233400640 1 -- start start 2024-03-28T21:52:38.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.154+0000 7fa233400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa214004d40 0x7fa22c09ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:38.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.154+0000 7fa233400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22c09baa0 0x7fa22c15fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:38.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.154+0000 7fa233400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa22c1602d0 0x7fa22c06c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:38.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.154+0000 7fa233400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c0af190 con 0x7fa22c09baa0 2024-03-28T21:52:38.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.154+0000 7fa233400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c0af010 con 0x7fa214004d40 2024-03-28T21:52:38.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.154+0000 7fa233400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa22c0afed0 con 0x7fa22c1602d0 2024-03-28T21:52:38.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.155+0000 7fa22be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22c09baa0 0x7fa22c15fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:38.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.155+0000 7fa22be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22c09baa0 0x7fa22c15fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56050/0 (socket says 172.21.15.153:56050) 2024-03-28T21:52:38.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.155+0000 7fa22be00640 1 -- 172.21.15.153:0/4106280546 learned_addr learned my addr 172.21.15.153:0/4106280546 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:38.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.155+0000 7fa230a00640 1 --2- 172.21.15.153:0/4106280546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa214004d40 0x7fa22c09ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:38.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.155+0000 7fa231400640 1 --2- 172.21.15.153:0/4106280546 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa22c1602d0 0x7fa22c06c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:38.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.155+0000 7fa22be00640 1 -- 172.21.15.153:0/4106280546 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa22c1602d0 msgr2=0x7fa22c06c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:38.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.155+0000 7fa22be00640 1 --2- 172.21.15.153:0/4106280546 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa22c1602d0 0x7fa22c06c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.155+0000 7fa22be00640 1 -- 172.21.15.153:0/4106280546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa214004d40 msgr2=0x7fa22c09ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:38.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.155+0000 7fa22be00640 1 --2- 172.21.15.153:0/4106280546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa214004d40 0x7fa22c09ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.155+0000 7fa22be00640 1 -- 172.21.15.153:0/4106280546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22c09cf50 con 0x7fa22c09baa0 2024-03-28T21:52:38.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.156+0000 7fa22be00640 1 --2- 172.21.15.153:0/4106280546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22c09baa0 0x7fa22c15fd90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa21800c730 tx=0x7fa21800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:38.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.156+0000 7fa228c00640 1 -- 172.21.15.153:0/4106280546 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218018070 con 0x7fa22c09baa0 2024-03-28T21:52:38.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.156+0000 7fa228c00640 1 -- 172.21.15.153:0/4106280546 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2180072d0 con 0x7fa22c09baa0 2024-03-28T21:52:38.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.156+0000 7fa228c00640 1 -- 172.21.15.153:0/4106280546 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2180047e0 con 0x7fa22c09baa0 2024-03-28T21:52:38.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.156+0000 7fa233400640 1 -- 172.21.15.153:0/4106280546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22c13fe80 con 0x7fa22c09baa0 2024-03-28T21:52:38.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.156+0000 7fa233400640 1 -- 172.21.15.153:0/4106280546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22c09dc00 con 0x7fa22c09baa0 2024-03-28T21:52:38.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.157+0000 7fa233400640 1 -- 172.21.15.153:0/4106280546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa22c068ff0 con 0x7fa22c09baa0 2024-03-28T21:52:38.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.158+0000 7fa228c00640 1 -- 172.21.15.153:0/4106280546 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa218004b90 con 0x7fa22c09baa0 2024-03-28T21:52:38.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.159+0000 7fa228c00640 1 --2- 172.21.15.153:0/4106280546 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa20c06b4d0 0x7fa20c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:38.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.159+0000 7fa228c00640 1 -- 172.21.15.153:0/4106280546 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa2180899a0 con 0x7fa22c09baa0 2024-03-28T21:52:38.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.159+0000 7fa230a00640 1 --2- 172.21.15.153:0/4106280546 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa20c06b4d0 0x7fa20c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:38.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.160+0000 7fa230a00640 1 --2- 172.21.15.153:0/4106280546 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa20c06b4d0 0x7fa20c06d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa220000f60 tx=0x7fa220009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:38.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.165+0000 7fa228c00640 1 -- 172.21.15.153:0/4106280546 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa218058820 con 0x7fa22c09baa0 2024-03-28T21:52:38.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.353+0000 7fa233400640 1 -- 172.21.15.153:0/4106280546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa22c06bca0 con 0x7fa22c09baa0 2024-03-28T21:52:38.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.355+0000 7fa228c00640 1 -- 172.21.15.153:0/4106280546 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7fa218058120 con 0x7fa22c09baa0 2024-03-28T21:52:38.358 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:38.358 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:57.716531+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:38.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.358+0000 7fa233400640 1 -- 172.21.15.153:0/4106280546 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa20c06b4d0 msgr2=0x7fa20c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:38.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.358+0000 7fa233400640 1 --2- 172.21.15.153:0/4106280546 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa20c06b4d0 0x7fa20c06d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa220000f60 tx=0x7fa220009040 comp rx=0 tx=0).stop 2024-03-28T21:52:38.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.358+0000 7fa233400640 1 -- 172.21.15.153:0/4106280546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22c09baa0 msgr2=0x7fa22c15fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:38.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.358+0000 7fa233400640 1 --2- 172.21.15.153:0/4106280546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22c09baa0 0x7fa22c15fd90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa21800c730 tx=0x7fa21800cbf0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.358+0000 7fa233400640 1 -- 172.21.15.153:0/4106280546 shutdown_connections 2024-03-28T21:52:38.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.358+0000 7fa233400640 1 --2- 172.21.15.153:0/4106280546 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa20c06b4d0 0x7fa20c06d990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.358+0000 7fa233400640 1 --2- 172.21.15.153:0/4106280546 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa22c1602d0 0x7fa22c06c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.358+0000 7fa233400640 1 --2- 172.21.15.153:0/4106280546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22c09baa0 0x7fa22c15fd90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.358+0000 7fa233400640 1 --2- 172.21.15.153:0/4106280546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa214004d40 0x7fa22c09ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.358+0000 7fa233400640 1 -- 172.21.15.153:0/4106280546 >> 172.21.15.153:0/4106280546 conn(0x7fa22c0d0d20 msgr2=0x7fa22c06e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:38.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.358+0000 7fa233400640 1 -- 172.21.15.153:0/4106280546 shutdown_connections 2024-03-28T21:52:38.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.358+0000 7fa233400640 1 -- 172.21.15.153:0/4106280546 wait complete. 2024-03-28T21:52:38.377 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T21:51:53.863931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T21:51:55.188736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T21:52:38.378 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T21:52:38.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.565+0000 7fb8b5c00640 1 Processor -- start 2024-03-28T21:52:38.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.565+0000 7fb8b5c00640 1 -- start start 2024-03-28T21:52:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.567+0000 7fb8b5c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb8b00cef30 0x7fb8b0071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.567+0000 7fb8b5c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8b00acd80 0x7fb8b00cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.567+0000 7fb8b5c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b00cf850 con 0x7fb8b00728c0 2024-03-28T21:52:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.567+0000 7fb8b5c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb8b0070f20 con 0x7fb8b00cef30 2024-03-28T21:52:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.567+0000 7fb8b5c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b0071200 con 0x7fb8b00acd80 2024-03-28T21:52:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.567+0000 7fb8aea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb8b00cef30 0x7fb8b0071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.567+0000 7fb8aea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb8b00cef30 0x7fb8b0071ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56056/0 (socket says 172.21.15.153:56056) 2024-03-28T21:52:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.567+0000 7fb8aea00640 1 -- 172.21.15.153:0/2580181151 learned_addr learned my addr 172.21.15.153:0/2580181151 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.567+0000 7fb8af400640 1 --1- 172.21.15.153:0/2580181151 >> v1:172.21.15.153:6789/0 conn(0x7fb8b00728c0 0x7fb8b006cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42562/0 (socket says 172.21.15.153:42562) 2024-03-28T21:52:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.567+0000 7fb8a6000640 1 --2- 172.21.15.153:0/2580181151 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8b00acd80 0x7fb8b00cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:38.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.567+0000 7fb8aea00640 1 -- 172.21.15.153:0/2580181151 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8b00acd80 msgr2=0x7fb8b00cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:38.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.567+0000 7fb8aea00640 1 --2- 172.21.15.153:0/2580181151 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8b00acd80 0x7fb8b00cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.567+0000 7fb8aea00640 1 -- 172.21.15.153:0/2580181151 >> v1:172.21.15.153:6789/0 conn(0x7fb8b00728c0 legacy=0x7fb8b006cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:38.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.568+0000 7fb8aea00640 1 -- 172.21.15.153:0/2580181151 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b00714e0 con 0x7fb8b00cef30 2024-03-28T21:52:38.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.568+0000 7fb8ae000640 1 -- 172.21.15.153:0/2580181151 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322945330 0 0) 0x7fb8b00cf850 con 0x7fb8b00728c0 2024-03-28T21:52:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.569+0000 7fb8aea00640 1 --2- 172.21.15.153:0/2580181151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b00cef30 0x7fb8b0071ce0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009870 tx=0x7fb8a002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1857ea67865d130a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.569+0000 7fb8ae000640 1 -- 172.21.15.153:0/2580181151 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0034070 con 0x7fb8b00cef30 2024-03-28T21:52:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.569+0000 7fb8ae000640 1 -- 172.21.15.153:0/2580181151 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a0030840 con 0x7fb8b00cef30 2024-03-28T21:52:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.569+0000 7fb8ae000640 1 -- 172.21.15.153:0/2580181151 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0030c10 con 0x7fb8b00cef30 2024-03-28T21:52:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.569+0000 7fb8b5c00640 1 -- 172.21.15.153:0/2580181151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b00cef30 msgr2=0x7fb8b0071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.569+0000 7fb8b5c00640 1 --2- 172.21.15.153:0/2580181151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b00cef30 0x7fb8b0071ce0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009870 tx=0x7fb8a002b980 comp rx=0 tx=0).stop 2024-03-28T21:52:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.569+0000 7fb8b5c00640 1 -- 172.21.15.153:0/2580181151 shutdown_connections 2024-03-28T21:52:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.569+0000 7fb8b5c00640 1 --2- 172.21.15.153:0/2580181151 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8b00acd80 0x7fb8b00cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.569+0000 7fb8b5c00640 1 --2- 172.21.15.153:0/2580181151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b00cef30 0x7fb8b0071ce0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.569+0000 7fb8b5c00640 1 -- 172.21.15.153:0/2580181151 >> 172.21.15.153:0/2580181151 conn(0x7fb8b00b19a0 msgr2=0x7fb8b00b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.570+0000 7fb8b5c00640 1 -- 172.21.15.153:0/2580181151 shutdown_connections 2024-03-28T21:52:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.570+0000 7fb8b5c00640 1 -- 172.21.15.153:0/2580181151 wait complete. 2024-03-28T21:52:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.571+0000 7fb8b5c00640 1 Processor -- start 2024-03-28T21:52:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.571+0000 7fb8b5c00640 1 -- start start 2024-03-28T21:52:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.572+0000 7fb8b5c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8b00728c0 0x7fb8b006d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.572+0000 7fb8b5c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8b00acd80 0x7fb8b014a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.572+0000 7fb8b5c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b00cef30 0x7fb8b0149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.572+0000 7fb8b5c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b0072ed0 con 0x7fb8b00cef30 2024-03-28T21:52:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.572+0000 7fb8b5c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b0072d50 con 0x7fb8b00728c0 2024-03-28T21:52:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.572+0000 7fb8b5c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b015c1f0 con 0x7fb8b00acd80 2024-03-28T21:52:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.572+0000 7fb8af400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b00cef30 0x7fb8b0149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.573+0000 7fb8af400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b00cef30 0x7fb8b0149e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56062/0 (socket says 172.21.15.153:56062) 2024-03-28T21:52:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.573+0000 7fb8af400640 1 -- 172.21.15.153:0/3411979685 learned_addr learned my addr 172.21.15.153:0/3411979685 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.573+0000 7fb8a6000640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8b00acd80 0x7fb8b014a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.573+0000 7fb8af400640 1 -- 172.21.15.153:0/3411979685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8b00acd80 msgr2=0x7fb8b014a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.573+0000 7fb8aea00640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8b00728c0 0x7fb8b006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.573+0000 7fb8af400640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8b00acd80 0x7fb8b014a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.573+0000 7fb8af400640 1 -- 172.21.15.153:0/3411979685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8b00728c0 msgr2=0x7fb8b006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.573+0000 7fb8af400640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8b00728c0 0x7fb8b006d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.573+0000 7fb8af400640 1 -- 172.21.15.153:0/3411979685 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b014aec0 con 0x7fb8b00cef30 2024-03-28T21:52:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.573+0000 7fb8a6000640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8b00acd80 0x7fb8b014a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.573+0000 7fb8af400640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b00cef30 0x7fb8b0149e60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800c480 tx=0x7fb8a800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.573+0000 7fb8a7400640 1 -- 172.21.15.153:0/3411979685 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8018070 con 0x7fb8b00cef30 2024-03-28T21:52:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.573+0000 7fb8a7400640 1 -- 172.21.15.153:0/3411979685 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a8007500 con 0x7fb8b00cef30 2024-03-28T21:52:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.573+0000 7fb8a7400640 1 -- 172.21.15.153:0/3411979685 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8004a20 con 0x7fb8b00cef30 2024-03-28T21:52:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.574+0000 7fb8b5c00640 1 -- 172.21.15.153:0/3411979685 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b014b1a0 con 0x7fb8b00cef30 2024-03-28T21:52:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.574+0000 7fb8b5c00640 1 -- 172.21.15.153:0/3411979685 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b014b760 con 0x7fb8b00cef30 2024-03-28T21:52:38.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.575+0000 7fb8b5c00640 1 -- 172.21.15.153:0/3411979685 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8b0068ff0 con 0x7fb8b00cef30 2024-03-28T21:52:38.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.576+0000 7fb8a7400640 1 -- 172.21.15.153:0/3411979685 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb8a801b070 con 0x7fb8b00cef30 2024-03-28T21:52:38.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.576+0000 7fb8a7400640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb88c06b500 0x7fb88c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:38.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.577+0000 7fb8a7400640 1 -- 172.21.15.153:0/3411979685 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb8a8089480 con 0x7fb8b00cef30 2024-03-28T21:52:38.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.577+0000 7fb8aea00640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb88c06b500 0x7fb88c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:38.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.577+0000 7fb8aea00640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb88c06b500 0x7fb88c06d9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0036000 tx=0x7fb8a003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:38.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.581+0000 7fb8a7400640 1 -- 172.21.15.153:0/3411979685 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb8a8058390 con 0x7fb8b00cef30 2024-03-28T21:52:38.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.889+0000 7fb8b5c00640 1 -- 172.21.15.153:0/3411979685 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb8b006e460 con 0x7fb8b00cef30 2024-03-28T21:52:38.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.890+0000 7fb8a7400640 1 -- 172.21.15.153:0/3411979685 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fb8a8057c90 con 0x7fb8b00cef30 2024-03-28T21:52:38.892 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-28T21:52:38.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.893+0000 7fb8b5c00640 1 -- 172.21.15.153:0/3411979685 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb88c06b500 msgr2=0x7fb88c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:38.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.893+0000 7fb8b5c00640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb88c06b500 0x7fb88c06d9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0036000 tx=0x7fb8a003b040 comp rx=0 tx=0).stop 2024-03-28T21:52:38.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.893+0000 7fb8b5c00640 1 -- 172.21.15.153:0/3411979685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b00cef30 msgr2=0x7fb8b0149e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:38.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.893+0000 7fb8b5c00640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b00cef30 0x7fb8b0149e60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800c480 tx=0x7fb8a800c940 comp rx=0 tx=0).stop 2024-03-28T21:52:38.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.893+0000 7fb8b5c00640 1 -- 172.21.15.153:0/3411979685 shutdown_connections 2024-03-28T21:52:38.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.893+0000 7fb8b5c00640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb88c06b500 0x7fb88c06d9c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.893+0000 7fb8b5c00640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b00cef30 0x7fb8b0149e60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.893+0000 7fb8b5c00640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8b00acd80 0x7fb8b014a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.893+0000 7fb8b5c00640 1 --2- 172.21.15.153:0/3411979685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8b00728c0 0x7fb8b006d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:38.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.893+0000 7fb8b5c00640 1 -- 172.21.15.153:0/3411979685 >> 172.21.15.153:0/3411979685 conn(0x7fb8b00b19a0 msgr2=0x7fb8b0071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:38.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.893+0000 7fb8b5c00640 1 -- 172.21.15.153:0/3411979685 shutdown_connections 2024-03-28T21:52:38.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:38.893+0000 7fb8b5c00640 1 -- 172.21.15.153:0/3411979685 wait complete. 2024-03-28T21:52:38.913 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T21:52:39.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.118+0000 7f4704400640 1 Processor -- start 2024-03-28T21:52:39.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.118+0000 7f4704400640 1 -- start start 2024-03-28T21:52:39.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.120+0000 7f4704400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f46fc161a20 0x7f46fc0d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:39.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.120+0000 7f4704400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46fc0cfd70 0x7f46fc0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:39.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.120+0000 7f4704400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46fc0d1470 con 0x7f46fc0d1010 2024-03-28T21:52:39.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.120+0000 7f4704400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f46fc0b3320 con 0x7f46fc0cfd70 2024-03-28T21:52:39.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.120+0000 7f4704400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f46fc0d2910 con 0x7f46fc161a20 2024-03-28T21:52:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.120+0000 7f4702400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46fc0cfd70 0x7f46fc0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.120+0000 7f4702400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46fc0cfd70 0x7f46fc0b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56066/0 (socket says 172.21.15.153:56066) 2024-03-28T21:52:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.120+0000 7f4702400640 1 -- 172.21.15.153:0/3344679565 learned_addr learned my addr 172.21.15.153:0/3344679565 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.121+0000 7f4701a00640 1 --2- 172.21.15.153:0/3344679565 >> v2:172.21.15.165:3300/0 conn(0x7f46fc161a20 0x7f46fc0d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.121+0000 7f4702400640 1 -- 172.21.15.153:0/3344679565 >> v2:172.21.15.165:3300/0 conn(0x7f46fc161a20 msgr2=0x7f46fc0d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.121+0000 7f4702400640 1 --2- 172.21.15.153:0/3344679565 >> v2:172.21.15.165:3300/0 conn(0x7f46fc161a20 0x7f46fc0d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.121+0000 7f4702400640 1 -- 172.21.15.153:0/3344679565 >> v1:172.21.15.165:6789/0 conn(0x7f46fc0d1010 legacy=0x7f46fc0b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.121+0000 7f4702400640 1 -- 172.21.15.153:0/3344679565 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46fc0d2bf0 con 0x7f46fc0cfd70 2024-03-28T21:52:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.122+0000 7f4702400640 1 --2- 172.21.15.153:0/3344679565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc0cfd70 0x7f46fc0b47c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f46fc08e690 tx=0x7f46f402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922a17faca72c107 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.122+0000 7f46fbe00640 1 -- 172.21.15.153:0/3344679565 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f402c9f0 con 0x7f46fc0cfd70 2024-03-28T21:52:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.122+0000 7f46fbe00640 1 -- 172.21.15.153:0/3344679565 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f402cb90 con 0x7f46fc0cfd70 2024-03-28T21:52:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.122+0000 7f46fbe00640 1 -- 172.21.15.153:0/3344679565 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f40343f0 con 0x7f46fc0cfd70 2024-03-28T21:52:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.123+0000 7f4704400640 1 -- 172.21.15.153:0/3344679565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc0cfd70 msgr2=0x7f46fc0b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.123+0000 7f4704400640 1 --2- 172.21.15.153:0/3344679565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc0cfd70 0x7f46fc0b47c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f46fc08e690 tx=0x7f46f402be50 comp rx=0 tx=0).stop 2024-03-28T21:52:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.123+0000 7f4704400640 1 -- 172.21.15.153:0/3344679565 shutdown_connections 2024-03-28T21:52:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.123+0000 7f4704400640 1 --2- 172.21.15.153:0/3344679565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc0cfd70 0x7f46fc0b47c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.123+0000 7f4704400640 1 --2- 172.21.15.153:0/3344679565 >> v2:172.21.15.165:3300/0 conn(0x7f46fc161a20 0x7f46fc0d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.123+0000 7f4704400640 1 -- 172.21.15.153:0/3344679565 >> 172.21.15.153:0/3344679565 conn(0x7f46fc09d430 msgr2=0x7f46fc0d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.123+0000 7f4704400640 1 -- 172.21.15.153:0/3344679565 shutdown_connections 2024-03-28T21:52:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.123+0000 7f4704400640 1 -- 172.21.15.153:0/3344679565 wait complete. 2024-03-28T21:52:39.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.125+0000 7f4704400640 1 Processor -- start 2024-03-28T21:52:39.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.125+0000 7f4704400640 1 -- start start 2024-03-28T21:52:39.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4704400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46fc0cfd70 0x7f46fc0c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:39.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4704400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc0d1010 0x7f46fc1e7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:39.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4704400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46fc161a20 0x7f46fc1e76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:39.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4704400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc0d31b0 con 0x7f46fc0d1010 2024-03-28T21:52:39.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4704400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc0b3b90 con 0x7f46fc161a20 2024-03-28T21:52:39.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4704400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f46fc161e00 con 0x7f46fc0cfd70 2024-03-28T21:52:39.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4701000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc0d1010 0x7f46fc1e7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:39.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4701000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc0d1010 0x7f46fc1e7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56070/0 (socket says 172.21.15.153:56070) 2024-03-28T21:52:39.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4701000640 1 -- 172.21.15.153:0/84417663 learned_addr learned my addr 172.21.15.153:0/84417663 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4702400640 1 --2- 172.21.15.153:0/84417663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46fc161a20 0x7f46fc1e76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4701000640 1 -- 172.21.15.153:0/84417663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46fc0cfd70 msgr2=0x7f46fc0c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4701a00640 1 --2- 172.21.15.153:0/84417663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46fc0cfd70 0x7f46fc0c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4701000640 1 --2- 172.21.15.153:0/84417663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46fc0cfd70 0x7f46fc0c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4701000640 1 -- 172.21.15.153:0/84417663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46fc161a20 msgr2=0x7f46fc1e76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.126+0000 7f4701000640 1 --2- 172.21.15.153:0/84417663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46fc161a20 0x7f46fc1e76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.127+0000 7f4701000640 1 -- 172.21.15.153:0/84417663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46fc1e8d90 con 0x7f46fc0d1010 2024-03-28T21:52:39.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.127+0000 7f4701000640 1 --2- 172.21.15.153:0/84417663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc0d1010 0x7f46fc1e7180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f46e800b420 tx=0x7f46e800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:39.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.127+0000 7f46f9600640 1 -- 172.21.15.153:0/84417663 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8011830 con 0x7f46fc0d1010 2024-03-28T21:52:39.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.127+0000 7f46f9600640 1 -- 172.21.15.153:0/84417663 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e8016070 con 0x7f46fc0d1010 2024-03-28T21:52:39.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.127+0000 7f46f9600640 1 -- 172.21.15.153:0/84417663 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8011c10 con 0x7f46fc0d1010 2024-03-28T21:52:39.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.127+0000 7f4704400640 1 -- 172.21.15.153:0/84417663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46fc0ca420 con 0x7f46fc0d1010 2024-03-28T21:52:39.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.127+0000 7f4704400640 1 -- 172.21.15.153:0/84417663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46fc1e7fd0 con 0x7f46fc0d1010 2024-03-28T21:52:39.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.128+0000 7f4704400640 1 -- 172.21.15.153:0/84417663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46fc068ff0 con 0x7f46fc0d1010 2024-03-28T21:52:39.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.129+0000 7f46f9600640 1 -- 172.21.15.153:0/84417663 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f46e801b460 con 0x7f46fc0d1010 2024-03-28T21:52:39.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.130+0000 7f46f9600640 1 --2- 172.21.15.153:0/84417663 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f46dc06b4d0 0x7f46dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:39.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.130+0000 7f46f9600640 1 -- 172.21.15.153:0/84417663 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f46e8089d40 con 0x7f46fc0d1010 2024-03-28T21:52:39.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.131+0000 7f4701a00640 1 --2- 172.21.15.153:0/84417663 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f46dc06b4d0 0x7f46dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:39.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.131+0000 7f4701a00640 1 --2- 172.21.15.153:0/84417663 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f46dc06b4d0 0x7f46dc06d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f46f0006fd0 tx=0x7f46f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:39.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.139+0000 7f46f9600640 1 -- 172.21.15.153:0/84417663 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f46e8020020 con 0x7f46fc0d1010 2024-03-28T21:52:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.334+0000 7f4704400640 1 -- 172.21.15.153:0/84417663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f46fc1e8a20 con 0x7f46fc0d1010 2024-03-28T21:52:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.335+0000 7f46f9600640 1 -- 172.21.15.153:0/84417663 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f46e8058b20 con 0x7f46fc0d1010 2024-03-28T21:52:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-03-28T21:52:39.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.337+0000 7f4704400640 1 -- 172.21.15.153:0/84417663 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f46dc06b4d0 msgr2=0x7f46dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:39.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.337+0000 7f4704400640 1 --2- 172.21.15.153:0/84417663 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f46dc06b4d0 0x7f46dc06d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f46f0006fd0 tx=0x7f46f0008040 comp rx=0 tx=0).stop 2024-03-28T21:52:39.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.337+0000 7f4704400640 1 -- 172.21.15.153:0/84417663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc0d1010 msgr2=0x7f46fc1e7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:39.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.337+0000 7f4704400640 1 --2- 172.21.15.153:0/84417663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc0d1010 0x7f46fc1e7180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f46e800b420 tx=0x7f46e800b8e0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.337+0000 7f4704400640 1 -- 172.21.15.153:0/84417663 shutdown_connections 2024-03-28T21:52:39.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.337+0000 7f4704400640 1 --2- 172.21.15.153:0/84417663 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f46dc06b4d0 0x7f46dc06d990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.337+0000 7f4704400640 1 --2- 172.21.15.153:0/84417663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46fc161a20 0x7f46fc1e76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.337+0000 7f4704400640 1 --2- 172.21.15.153:0/84417663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc0d1010 0x7f46fc1e7180 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.337+0000 7f4704400640 1 --2- 172.21.15.153:0/84417663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46fc0cfd70 0x7f46fc0c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.337+0000 7f4704400640 1 -- 172.21.15.153:0/84417663 >> 172.21.15.153:0/84417663 conn(0x7f46fc09d430 msgr2=0x7f46fc15e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:39.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.337+0000 7f4704400640 1 -- 172.21.15.153:0/84417663 shutdown_connections 2024-03-28T21:52:39.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.337+0000 7f4704400640 1 -- 172.21.15.153:0/84417663 wait complete. 2024-03-28T21:52:39.364 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T21:52:39.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.560+0000 7f9134600640 1 Processor -- start 2024-03-28T21:52:39.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.560+0000 7f9134600640 1 -- start start 2024-03-28T21:52:39.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.561+0000 7f9134600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f912c161990 0x7f912c0d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:39.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.561+0000 7f9134600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f912c0b3a60 0x7f912c0d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:39.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.561+0000 7f9134600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f912c0ceca0 con 0x7f912c0d2900 2024-03-28T21:52:39.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.561+0000 7f9134600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f912c0d1a20 con 0x7f912c161990 2024-03-28T21:52:39.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.561+0000 7f9134600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f912c0d4810 con 0x7f912c0b3a60 2024-03-28T21:52:39.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.562+0000 7f9131c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f912c161990 0x7f912c0d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:39.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.562+0000 7f9131c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f912c161990 0x7f912c0d14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56084/0 (socket says 172.21.15.153:56084) 2024-03-28T21:52:39.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.562+0000 7f9131c00640 1 -- 172.21.15.153:0/293656728 learned_addr learned my addr 172.21.15.153:0/293656728 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:39.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.562+0000 7f9131c00640 1 -- 172.21.15.153:0/293656728 >> v2:172.21.15.165:3300/0 conn(0x7f912c0b3a60 msgr2=0x7f912c0d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:39.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.562+0000 7f9131200640 1 --2- 172.21.15.153:0/293656728 >> v2:172.21.15.165:3300/0 conn(0x7f912c0b3a60 0x7f912c0d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.562+0000 7f9131c00640 1 --2- 172.21.15.153:0/293656728 >> v2:172.21.15.165:3300/0 conn(0x7f912c0b3a60 0x7f912c0d23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.562+0000 7f9131c00640 1 -- 172.21.15.153:0/293656728 >> v1:172.21.15.165:6789/0 conn(0x7f912c0d2900 legacy=0x7f912c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.562+0000 7f9131c00640 1 -- 172.21.15.153:0/293656728 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912c0d4af0 con 0x7f912c161990 2024-03-28T21:52:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.562+0000 7f9131200640 1 --2- 172.21.15.153:0/293656728 >> v2:172.21.15.165:3300/0 conn(0x7f912c0b3a60 0x7f912c0d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.563+0000 7f9131c00640 1 --2- 172.21.15.153:0/293656728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f912c161990 0x7f912c0d14e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f912c08cf00 tx=0x7f912002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add068fa63f94764 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.563+0000 7f912be00640 1 -- 172.21.15.153:0/293656728 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912002ca80 con 0x7f912c161990 2024-03-28T21:52:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.563+0000 7f912be00640 1 -- 172.21.15.153:0/293656728 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f912002cc20 con 0x7f912c161990 2024-03-28T21:52:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.563+0000 7f912be00640 1 -- 172.21.15.153:0/293656728 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91200343f0 con 0x7f912c161990 2024-03-28T21:52:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.564+0000 7f9134600640 1 -- 172.21.15.153:0/293656728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f912c161990 msgr2=0x7f912c0d14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.564+0000 7f9134600640 1 --2- 172.21.15.153:0/293656728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f912c161990 0x7f912c0d14e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f912c08cf00 tx=0x7f912002bee0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.564+0000 7f9134600640 1 -- 172.21.15.153:0/293656728 shutdown_connections 2024-03-28T21:52:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.564+0000 7f9134600640 1 --2- 172.21.15.153:0/293656728 >> v2:172.21.15.165:3300/0 conn(0x7f912c0b3a60 0x7f912c0d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.564+0000 7f9134600640 1 --2- 172.21.15.153:0/293656728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f912c161990 0x7f912c0d14e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.564+0000 7f9134600640 1 -- 172.21.15.153:0/293656728 >> 172.21.15.153:0/293656728 conn(0x7f912c09d430 msgr2=0x7f912c0d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:39.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.564+0000 7f9134600640 1 -- 172.21.15.153:0/293656728 shutdown_connections 2024-03-28T21:52:39.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.564+0000 7f9134600640 1 -- 172.21.15.153:0/293656728 wait complete. 2024-03-28T21:52:39.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.566+0000 7f9134600640 1 Processor -- start 2024-03-28T21:52:39.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.566+0000 7f9134600640 1 -- start start 2024-03-28T21:52:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.567+0000 7f9134600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f912c0b3a60 0x7f912c0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.567+0000 7f9134600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f912c0d2900 0x7f912c159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9134600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f912c161990 0x7f912c15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9134600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f912c0cf200 con 0x7f912c161990 2024-03-28T21:52:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9134600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f912c0cef20 con 0x7f912c0b3a60 2024-03-28T21:52:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9134600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f912c0b3ec0 con 0x7f912c0d2900 2024-03-28T21:52:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9132600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f912c161990 0x7f912c15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9132600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f912c161990 0x7f912c15a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56098/0 (socket says 172.21.15.153:56098) 2024-03-28T21:52:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9132600640 1 -- 172.21.15.153:0/1615573526 learned_addr learned my addr 172.21.15.153:0/1615573526 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9131c00640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f912c0b3a60 0x7f912c0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9131200640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f912c0d2900 0x7f912c159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9132600640 1 -- 172.21.15.153:0/1615573526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f912c0d2900 msgr2=0x7f912c159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:39.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9132600640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f912c0d2900 0x7f912c159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9132600640 1 -- 172.21.15.153:0/1615573526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f912c0b3a60 msgr2=0x7f912c0cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:39.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9132600640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f912c0b3a60 0x7f912c0cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9132600640 1 -- 172.21.15.153:0/1615573526 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912c0cd0d0 con 0x7f912c161990 2024-03-28T21:52:39.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.568+0000 7f9131200640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f912c0d2900 0x7f912c159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:39.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.569+0000 7f9132600640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f912c161990 0x7f912c15a0f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f912400b4c0 tx=0x7f912400b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:39.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.569+0000 7f9129600640 1 -- 172.21.15.153:0/1615573526 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124015020 con 0x7f912c161990 2024-03-28T21:52:39.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.569+0000 7f9129600640 1 -- 172.21.15.153:0/1615573526 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9124011850 con 0x7f912c161990 2024-03-28T21:52:39.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.569+0000 7f9129600640 1 -- 172.21.15.153:0/1615573526 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124011c40 con 0x7f912c161990 2024-03-28T21:52:39.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.569+0000 7f9134600640 1 -- 172.21.15.153:0/1615573526 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f912c0b96b0 con 0x7f912c161990 2024-03-28T21:52:39.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.569+0000 7f9134600640 1 -- 172.21.15.153:0/1615573526 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f912c0b9c70 con 0x7f912c161990 2024-03-28T21:52:39.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.570+0000 7f9134600640 1 -- 172.21.15.153:0/1615573526 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f912c068ff0 con 0x7f912c161990 2024-03-28T21:52:39.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.571+0000 7f9129600640 1 -- 172.21.15.153:0/1615573526 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f9124018020 con 0x7f912c161990 2024-03-28T21:52:39.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.572+0000 7f9129600640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f910c06b4d0 0x7f910c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:39.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.572+0000 7f9129600640 1 -- 172.21.15.153:0/1615573526 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f912408a020 con 0x7f912c161990 2024-03-28T21:52:39.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.572+0000 7f9131c00640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f910c06b4d0 0x7f910c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:39.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.573+0000 7f9131c00640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f910c06b4d0 0x7f910c06d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9120035000 tx=0x7f9120030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:39.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.577+0000 7f9129600640 1 -- 172.21.15.153:0/1615573526 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f912401f020 con 0x7f912c161990 2024-03-28T21:52:39.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.770+0000 7f9134600640 1 -- 172.21.15.153:0/1615573526 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f912c0cc4f0 con 0x7f912c161990 2024-03-28T21:52:39.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.771+0000 7f9129600640 1 -- 172.21.15.153:0/1615573526 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f91240172c0 con 0x7f912c161990 2024-03-28T21:52:39.774 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-03-28T21:52:39.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.774+0000 7f9134600640 1 -- 172.21.15.153:0/1615573526 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f910c06b4d0 msgr2=0x7f910c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:39.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.774+0000 7f9134600640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f910c06b4d0 0x7f910c06d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9120035000 tx=0x7f9120030000 comp rx=0 tx=0).stop 2024-03-28T21:52:39.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.774+0000 7f9134600640 1 -- 172.21.15.153:0/1615573526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f912c161990 msgr2=0x7f912c15a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:39.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.774+0000 7f9134600640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f912c161990 0x7f912c15a0f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f912400b4c0 tx=0x7f912400b980 comp rx=0 tx=0).stop 2024-03-28T21:52:39.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.774+0000 7f9134600640 1 -- 172.21.15.153:0/1615573526 shutdown_connections 2024-03-28T21:52:39.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.774+0000 7f9134600640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f910c06b4d0 0x7f910c06d990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.774+0000 7f9134600640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f912c161990 0x7f912c15a0f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.774+0000 7f9134600640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f912c0d2900 0x7f912c159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.774+0000 7f9134600640 1 --2- 172.21.15.153:0/1615573526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f912c0b3a60 0x7f912c0cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:39.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.774+0000 7f9134600640 1 -- 172.21.15.153:0/1615573526 >> 172.21.15.153:0/1615573526 conn(0x7f912c09d430 msgr2=0x7f912c161d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:39.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.774+0000 7f9134600640 1 -- 172.21.15.153:0/1615573526 shutdown_connections 2024-03-28T21:52:39.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:39.774+0000 7f9134600640 1 -- 172.21.15.153:0/1615573526 wait complete. 2024-03-28T21:52:39.798 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-03-28T21:52:40.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.013+0000 7f062f400640 1 Processor -- start 2024-03-28T21:52:40.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.013+0000 7f062f400640 1 -- start start 2024-03-28T21:52:40.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.015+0000 7f062f400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f062815cf00 0x7f06280ad830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:40.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.015+0000 7f062f400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062815d340 con 0x7f062806e440 2024-03-28T21:52:40.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.015+0000 7f062f400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06280b2e60 con 0x7f0628159a10 2024-03-28T21:52:40.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.015+0000 7f062f400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0628159df0 con 0x7f062815cf00 2024-03-28T21:52:40.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.015+0000 7f0627e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f062806e440 0x7f06280b3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42572/0 (socket says 172.21.15.153:42572) 2024-03-28T21:52:40.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.015+0000 7f0627e00640 1 -- 172.21.15.153:0/2078421718 learned_addr learned my addr 172.21.15.153:0/2078421718 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:40.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.015+0000 7f0627400640 1 -- 172.21.15.153:0/2078421718 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036882693 0 0) 0x7f062815d340 con 0x7f062806e440 2024-03-28T21:52:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.015+0000 7f062d400640 1 --2- 172.21.15.153:0/2078421718 >> v2:172.21.15.165:3300/0 conn(0x7f062815cf00 0x7f06280ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f0627400640 1 -- 172.21.15.153:0/2078421718 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f060c003520 con 0x7f062806e440 2024-03-28T21:52:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f0627400640 1 -- 172.21.15.153:0/2078421718 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3656162064 0 0) 0x7f060c003520 con 0x7f062806e440 2024-03-28T21:52:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f0627400640 1 -- 172.21.15.153:0/2078421718 >> v2:172.21.15.165:3300/0 conn(0x7f062815cf00 msgr2=0x7f06280ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f0627400640 1 --2- 172.21.15.153:0/2078421718 >> v2:172.21.15.165:3300/0 conn(0x7f062815cf00 0x7f06280ad830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f0627400640 1 -- 172.21.15.153:0/2078421718 >> v1:172.21.15.165:6789/0 conn(0x7f0628159a10 legacy=0x7f062806dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f0627400640 1 -- 172.21.15.153:0/2078421718 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06280adf10 con 0x7f062806e440 2024-03-28T21:52:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f0627400640 1 -- 172.21.15.153:0/2078421718 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f0610001670 con 0x7f062806e440 2024-03-28T21:52:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f0627400640 1 -- 172.21.15.153:0/2078421718 >> v1:172.21.15.153:6789/0 conn(0x7f062806e440 legacy=0x7f06280b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f0627400640 1 --2- 172.21.15.153:0/2078421718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f060c0039b0 0x7f060c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f0627400640 1 --2- 172.21.15.153:0/2078421718 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f060c004800 0x7f060c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:40.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f0627400640 1 --2- 172.21.15.153:0/2078421718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f060c0052e0 0x7f060c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f0627400640 1 -- 172.21.15.153:0/2078421718 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0628159df0 con 0x7f060c0052e0 2024-03-28T21:52:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f0627400640 1 -- 172.21.15.153:0/2078421718 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f060c00c1b0 con 0x7f060c0039b0 2024-03-28T21:52:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f0627400640 1 -- 172.21.15.153:0/2078421718 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f060c00c3b0 con 0x7f060c004800 2024-03-28T21:52:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.016+0000 7f062d400640 1 --2- 172.21.15.153:0/2078421718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f060c0052e0 0x7f060c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.017+0000 7f062ca00640 1 --2- 172.21.15.153:0/2078421718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f060c0039b0 0x7f060c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.017+0000 7f0627e00640 1 --2- 172.21.15.153:0/2078421718 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f060c004800 0x7f060c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.017+0000 7f062d400640 1 -- 172.21.15.153:0/2078421718 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f060c004800 msgr2=0x7f060c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.017+0000 7f062d400640 1 --2- 172.21.15.153:0/2078421718 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f060c004800 0x7f060c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.017+0000 7f062d400640 1 -- 172.21.15.153:0/2078421718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f060c0039b0 msgr2=0x7f060c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.017+0000 7f062d400640 1 --2- 172.21.15.153:0/2078421718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f060c0039b0 0x7f060c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.017+0000 7f062d400640 1 -- 172.21.15.153:0/2078421718 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060c003520 con 0x7f060c0052e0 2024-03-28T21:52:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.018+0000 7f062d400640 1 -- 172.21.15.153:0/2078421718 reap_dead start 2024-03-28T21:52:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.018+0000 7f062d400640 1 --2- 172.21.15.153:0/2078421718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f060c0052e0 0x7f060c00b9c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f062000ba00 tx=0x7f060c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3c4bfafa512e35 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.018+0000 7f0627400640 1 -- 172.21.15.153:0/2078421718 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0620036030 con 0x7f060c0052e0 2024-03-28T21:52:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.018+0000 7f0627400640 1 -- 172.21.15.153:0/2078421718 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0620004020 con 0x7f060c0052e0 2024-03-28T21:52:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.018+0000 7f0627400640 1 -- 172.21.15.153:0/2078421718 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062000b600 con 0x7f060c0052e0 2024-03-28T21:52:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.019+0000 7f062f400640 1 -- 172.21.15.153:0/2078421718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f060c0052e0 msgr2=0x7f060c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.019+0000 7f062f400640 1 --2- 172.21.15.153:0/2078421718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f060c0052e0 0x7f060c00b9c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f062000ba00 tx=0x7f060c005830 comp rx=0 tx=0).stop 2024-03-28T21:52:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.019+0000 7f062f400640 1 -- 172.21.15.153:0/2078421718 shutdown_connections 2024-03-28T21:52:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.019+0000 7f062f400640 1 --2- 172.21.15.153:0/2078421718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f060c0052e0 0x7f060c00b9c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.019+0000 7f062f400640 1 -- 172.21.15.153:0/2078421718 >> 172.21.15.153:0/2078421718 conn(0x7f06280b1a30 msgr2=0x7f06280b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.019+0000 7f062f400640 1 -- 172.21.15.153:0/2078421718 shutdown_connections 2024-03-28T21:52:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.019+0000 7f062f400640 1 -- 172.21.15.153:0/2078421718 wait complete. 2024-03-28T21:52:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.022+0000 7f062f400640 1 Processor -- start 2024-03-28T21:52:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.022+0000 7f062f400640 1 -- start start 2024-03-28T21:52:40.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f060c0052e0 0x7f06281546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:40.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062f400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06281f4790 0x7f062809bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0628071e00 0x7f06280722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062f400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f06280ae4d0 con 0x7f0628071e00 2024-03-28T21:52:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062f400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f06280b3100 con 0x7f06281f4790 2024-03-28T21:52:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062f400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f06280ad830 con 0x7f060c0052e0 2024-03-28T21:52:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0628071e00 0x7f06280722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0628071e00 0x7f06280722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56126/0 (socket says 172.21.15.153:56126) 2024-03-28T21:52:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062d400640 1 -- 172.21.15.153:0/1234558177 learned_addr learned my addr 172.21.15.153:0/1234558177 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062ca00640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f060c0052e0 0x7f06281546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f0627e00640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06281f4790 0x7f062809bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062d400640 1 -- 172.21.15.153:0/1234558177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f060c0052e0 msgr2=0x7f06281546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062d400640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f060c0052e0 0x7f06281546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062d400640 1 -- 172.21.15.153:0/1234558177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06281f4790 msgr2=0x7f062809bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062d400640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06281f4790 0x7f062809bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f062d400640 1 -- 172.21.15.153:0/1234558177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0628154be0 con 0x7f0628071e00 2024-03-28T21:52:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.024+0000 7f0627e00640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06281f4790 0x7f062809bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.025+0000 7f062d400640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0628071e00 0x7f06280722b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f062000ba00 tx=0x7f0620004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.025+0000 7f0624c00640 1 -- 172.21.15.153:0/1234558177 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0620040030 con 0x7f0628071e00 2024-03-28T21:52:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.025+0000 7f0624c00640 1 -- 172.21.15.153:0/1234558177 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0620003c30 con 0x7f0628071e00 2024-03-28T21:52:40.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.025+0000 7f0624c00640 1 -- 172.21.15.153:0/1234558177 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0620036040 con 0x7f0628071e00 2024-03-28T21:52:40.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.025+0000 7f062f400640 1 -- 172.21.15.153:0/1234558177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062809c520 con 0x7f0628071e00 2024-03-28T21:52:40.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.025+0000 7f062f400640 1 -- 172.21.15.153:0/1234558177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f062809cae0 con 0x7f0628071e00 2024-03-28T21:52:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.026+0000 7f062f400640 1 -- 172.21.15.153:0/1234558177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f062815c080 con 0x7f0628071e00 2024-03-28T21:52:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.028+0000 7f0624c00640 1 -- 172.21.15.153:0/1234558177 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0620043030 con 0x7f0628071e00 2024-03-28T21:52:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.028+0000 7f0624c00640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f060406b500 0x7f060406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.029+0000 7f0624c00640 1 -- 172.21.15.153:0/1234558177 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f06200ab9d0 con 0x7f0628071e00 2024-03-28T21:52:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.029+0000 7f062ca00640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f060406b500 0x7f060406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:40.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.030+0000 7f062ca00640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f060406b500 0x7f060406d9c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0618007fd0 tx=0x7f0618009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:40.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.033+0000 7f0624c00640 1 -- 172.21.15.153:0/1234558177 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f062815c080 con 0x7f0628071e00 2024-03-28T21:52:40.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.306+0000 7f062f400640 1 -- 172.21.15.153:0/1234558177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f06280aeaa0 con 0x7f0628071e00 2024-03-28T21:52:40.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.961+0000 7f0624c00640 1 -- 172.21.15.153:0/1234558177 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v59) ==== 147+0+0 (secure 0 0 0) 0x7f06280aeaa0 con 0x7f0628071e00 2024-03-28T21:52:40.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.965+0000 7f062f400640 1 -- 172.21.15.153:0/1234558177 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f060406b500 msgr2=0x7f060406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:40.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.965+0000 7f062f400640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f060406b500 0x7f060406d9c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0618007fd0 tx=0x7f0618009040 comp rx=0 tx=0).stop 2024-03-28T21:52:40.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.965+0000 7f062f400640 1 -- 172.21.15.153:0/1234558177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0628071e00 msgr2=0x7f06280722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:40.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.965+0000 7f062f400640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0628071e00 0x7f06280722b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f062000ba00 tx=0x7f0620004730 comp rx=0 tx=0).stop 2024-03-28T21:52:40.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.965+0000 7f062f400640 1 -- 172.21.15.153:0/1234558177 shutdown_connections 2024-03-28T21:52:40.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.965+0000 7f062f400640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f060406b500 0x7f060406d9c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:40.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.965+0000 7f062f400640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0628071e00 0x7f06280722b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:40.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.965+0000 7f062f400640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06281f4790 0x7f062809bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:40.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.965+0000 7f062f400640 1 --2- 172.21.15.153:0/1234558177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f060c0052e0 0x7f06281546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:40.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.965+0000 7f062f400640 1 -- 172.21.15.153:0/1234558177 >> 172.21.15.153:0/1234558177 conn(0x7f06280b1a30 msgr2=0x7f06280b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:40.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.965+0000 7f062f400640 1 -- 172.21.15.153:0/1234558177 shutdown_connections 2024-03-28T21:52:40.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:40.965+0000 7f062f400640 1 -- 172.21.15.153:0/1234558177 wait complete. 2024-03-28T21:52:40.990 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-28T21:52:41.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.195+0000 7ff049a00640 1 Processor -- start 2024-03-28T21:52:41.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.196+0000 7ff049a00640 1 -- start start 2024-03-28T21:52:41.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.198+0000 7ff049a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff04415b1c0 0x7ff04415eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:41.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.198+0000 7ff049a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff0440af3b0 0x7ff04415f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:41.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.198+0000 7ff049a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff04415f5a0 0x7ff0440b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:41.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.198+0000 7ff049a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff0440ae310 con 0x7ff04415b1c0 2024-03-28T21:52:41.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.198+0000 7ff049a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff0440ae5f0 con 0x7ff0440af3b0 2024-03-28T21:52:41.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.198+0000 7ff049a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff0440ae8d0 con 0x7ff04415f5a0 2024-03-28T21:52:41.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.199+0000 7ff042a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff04415b1c0 0x7ff04415eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:41.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.199+0000 7ff042a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff04415b1c0 0x7ff04415eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56128/0 (socket says 172.21.15.153:56128) 2024-03-28T21:52:41.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.199+0000 7ff042a00640 1 -- 172.21.15.153:0/407027429 learned_addr learned my addr 172.21.15.153:0/407027429 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:41.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.199+0000 7ff043400640 1 --2- 172.21.15.153:0/407027429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff04415f5a0 0x7ff0440b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:41.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.199+0000 7ff042a00640 1 -- 172.21.15.153:0/407027429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff04415f5a0 msgr2=0x7ff0440b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:41.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.199+0000 7ff042000640 1 --2- 172.21.15.153:0/407027429 >> v2:172.21.15.165:3300/0 conn(0x7ff0440af3b0 0x7ff04415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:41.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.199+0000 7ff042a00640 1 --2- 172.21.15.153:0/407027429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff04415f5a0 0x7ff0440b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:41.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.199+0000 7ff042a00640 1 -- 172.21.15.153:0/407027429 >> v2:172.21.15.165:3300/0 conn(0x7ff0440af3b0 msgr2=0x7ff04415f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:41.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.199+0000 7ff042a00640 1 --2- 172.21.15.153:0/407027429 >> v2:172.21.15.165:3300/0 conn(0x7ff0440af3b0 0x7ff04415f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:41.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.199+0000 7ff042a00640 1 -- 172.21.15.153:0/407027429 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0440aebb0 con 0x7ff04415b1c0 2024-03-28T21:52:41.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.200+0000 7ff042a00640 1 --2- 172.21.15.153:0/407027429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff04415b1c0 0x7ff04415eb20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff04406f820 tx=0x7ff03402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b6063f43d3b475 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:41.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.201+0000 7ff041600640 1 -- 172.21.15.153:0/407027429 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034035020 con 0x7ff04415b1c0 2024-03-28T21:52:41.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.201+0000 7ff041600640 1 -- 172.21.15.153:0/407027429 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff034031870 con 0x7ff04415b1c0 2024-03-28T21:52:41.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.201+0000 7ff041600640 1 -- 172.21.15.153:0/407027429 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034031c40 con 0x7ff04415b1c0 2024-03-28T21:52:41.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.201+0000 7ff049a00640 1 -- 172.21.15.153:0/407027429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff04415b1c0 msgr2=0x7ff04415eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:41.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.201+0000 7ff049a00640 1 --2- 172.21.15.153:0/407027429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff04415b1c0 0x7ff04415eb20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff04406f820 tx=0x7ff03402b910 comp rx=0 tx=0).stop 2024-03-28T21:52:41.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.201+0000 7ff049a00640 1 -- 172.21.15.153:0/407027429 shutdown_connections 2024-03-28T21:52:41.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.201+0000 7ff049a00640 1 --2- 172.21.15.153:0/407027429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff04415f5a0 0x7ff0440b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:41.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.201+0000 7ff049a00640 1 --2- 172.21.15.153:0/407027429 >> v2:172.21.15.165:3300/0 conn(0x7ff0440af3b0 0x7ff04415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:41.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.201+0000 7ff049a00640 1 --2- 172.21.15.153:0/407027429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff04415b1c0 0x7ff04415eb20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:41.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.201+0000 7ff049a00640 1 -- 172.21.15.153:0/407027429 >> 172.21.15.153:0/407027429 conn(0x7ff0440b19a0 msgr2=0x7ff0440b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:41.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.201+0000 7ff049a00640 1 -- 172.21.15.153:0/407027429 shutdown_connections 2024-03-28T21:52:41.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.201+0000 7ff049a00640 1 -- 172.21.15.153:0/407027429 wait complete. 2024-03-28T21:52:41.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.203+0000 7ff049a00640 1 Processor -- start 2024-03-28T21:52:41.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.203+0000 7ff049a00640 1 -- start start 2024-03-28T21:52:41.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.205+0000 7ff049a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0440af3b0 0x7ff04415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:41.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.205+0000 7ff049a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff04415f5a0 0x7ff0441f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:41.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.205+0000 7ff049a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff04409d220 0x7ff044070d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:41.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.205+0000 7ff049a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff0440b31e0 con 0x7ff04409d220 2024-03-28T21:52:41.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.205+0000 7ff049a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff04406d120 con 0x7ff0440af3b0 2024-03-28T21:52:41.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.205+0000 7ff049a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff0440b3360 con 0x7ff04415f5a0 2024-03-28T21:52:41.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.205+0000 7ff043400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff04409d220 0x7ff044070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:41.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.205+0000 7ff043400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff04409d220 0x7ff044070d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56130/0 (socket says 172.21.15.153:56130) 2024-03-28T21:52:41.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.205+0000 7ff043400640 1 -- 172.21.15.153:0/2310064893 learned_addr learned my addr 172.21.15.153:0/2310064893 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:41.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.205+0000 7ff042a00640 1 --2- 172.21.15.153:0/2310064893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0440af3b0 0x7ff04415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:41.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.206+0000 7ff042000640 1 --2- 172.21.15.153:0/2310064893 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff04415f5a0 0x7ff0441f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:41.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.206+0000 7ff043400640 1 -- 172.21.15.153:0/2310064893 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff04415f5a0 msgr2=0x7ff0441f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:41.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.206+0000 7ff043400640 1 --2- 172.21.15.153:0/2310064893 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff04415f5a0 0x7ff0441f3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:41.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.206+0000 7ff043400640 1 -- 172.21.15.153:0/2310064893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0440af3b0 msgr2=0x7ff04415bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:41.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.206+0000 7ff043400640 1 --2- 172.21.15.153:0/2310064893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0440af3b0 0x7ff04415bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:41.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.206+0000 7ff043400640 1 -- 172.21.15.153:0/2310064893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04415c810 con 0x7ff04409d220 2024-03-28T21:52:41.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.206+0000 7ff043400640 1 --2- 172.21.15.153:0/2310064893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff04409d220 0x7ff044070d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00cc30 tx=0x7ff03c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:41.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.206+0000 7ff03aa00640 1 -- 172.21.15.153:0/2310064893 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00ce40 con 0x7ff04409d220 2024-03-28T21:52:41.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.206+0000 7ff03aa00640 1 -- 172.21.15.153:0/2310064893 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03c003990 con 0x7ff04409d220 2024-03-28T21:52:41.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.206+0000 7ff049a00640 1 -- 172.21.15.153:0/2310064893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04415caf0 con 0x7ff04409d220 2024-03-28T21:52:41.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.206+0000 7ff03aa00640 1 -- 172.21.15.153:0/2310064893 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c003d40 con 0x7ff04409d220 2024-03-28T21:52:41.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.207+0000 7ff049a00640 1 -- 172.21.15.153:0/2310064893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff04415d0b0 con 0x7ff04409d220 2024-03-28T21:52:41.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.208+0000 7ff049a00640 1 -- 172.21.15.153:0/2310064893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff044068ff0 con 0x7ff04409d220 2024-03-28T21:52:41.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.209+0000 7ff03aa00640 1 -- 172.21.15.153:0/2310064893 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff03c004000 con 0x7ff04409d220 2024-03-28T21:52:41.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.210+0000 7ff03aa00640 1 --2- 172.21.15.153:0/2310064893 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff02406b4d0 0x7ff02406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:41.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.210+0000 7ff03aa00640 1 -- 172.21.15.153:0/2310064893 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff03c08a630 con 0x7ff04409d220 2024-03-28T21:52:41.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.210+0000 7ff042a00640 1 --2- 172.21.15.153:0/2310064893 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff02406b4d0 0x7ff02406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:41.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.211+0000 7ff042a00640 1 --2- 172.21.15.153:0/2310064893 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff02406b4d0 0x7ff02406d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff034036000 tx=0x7ff03403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:41.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.214+0000 7ff03aa00640 1 -- 172.21.15.153:0/2310064893 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff03c014030 con 0x7ff04409d220 2024-03-28T21:52:41.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.414+0000 7ff049a00640 1 -- 172.21.15.153:0/2310064893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff04406e2f0 con 0x7ff04409d220 2024-03-28T21:52:41.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.419+0000 7ff03aa00640 1 -- 172.21.15.153:0/2310064893 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7ff03c05de20 con 0x7ff04409d220 2024-03-28T21:52:41.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.422+0000 7ff049a00640 1 -- 172.21.15.153:0/2310064893 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff02406b4d0 msgr2=0x7ff02406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:41.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.422+0000 7ff049a00640 1 --2- 172.21.15.153:0/2310064893 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff02406b4d0 0x7ff02406d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff034036000 tx=0x7ff03403c040 comp rx=0 tx=0).stop 2024-03-28T21:52:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.422+0000 7ff049a00640 1 -- 172.21.15.153:0/2310064893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff04409d220 msgr2=0x7ff044070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.422+0000 7ff049a00640 1 --2- 172.21.15.153:0/2310064893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff04409d220 0x7ff044070d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00cc30 tx=0x7ff03c00a5c0 comp rx=0 tx=0).stop 2024-03-28T21:52:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.422+0000 7ff049a00640 1 -- 172.21.15.153:0/2310064893 shutdown_connections 2024-03-28T21:52:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.422+0000 7ff049a00640 1 --2- 172.21.15.153:0/2310064893 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff02406b4d0 0x7ff02406d990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.422+0000 7ff049a00640 1 --2- 172.21.15.153:0/2310064893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff04409d220 0x7ff044070d80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.422+0000 7ff049a00640 1 --2- 172.21.15.153:0/2310064893 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff04415f5a0 0x7ff0441f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.422+0000 7ff049a00640 1 --2- 172.21.15.153:0/2310064893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0440af3b0 0x7ff04415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.422+0000 7ff049a00640 1 -- 172.21.15.153:0/2310064893 >> 172.21.15.153:0/2310064893 conn(0x7ff0440b19a0 msgr2=0x7ff04415eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.422+0000 7ff049a00640 1 -- 172.21.15.153:0/2310064893 shutdown_connections 2024-03-28T21:52:41.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:41.422+0000 7ff049a00640 1 -- 172.21.15.153:0/2310064893 wait complete. 2024-03-28T21:52:41.443 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-28T21:52:41.444 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-28T21:52:41.541 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-28T21:52:41.662 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-28T21:52:41.663 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:52:41.663 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:41.714 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:52:41.714 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:41.808 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:52:41.808 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:41.856 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:42.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.106+0000 7f020fc00640 1 Processor -- start 2024-03-28T21:52:42.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.106+0000 7f020fc00640 1 -- start start 2024-03-28T21:52:42.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.107+0000 7f020fc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0208159a10 0x7f020815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:42.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.107+0000 7f020fc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f02080ad830 0x7f020806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:42.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.107+0000 7f020fc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f020806e690 con 0x7f020806e270 2024-03-28T21:52:42.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.107+0000 7f020fc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f02080b2e60 con 0x7f0208159a10 2024-03-28T21:52:42.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.107+0000 7f020fc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f02080adc70 con 0x7f02080ad830 2024-03-28T21:52:42.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.108+0000 7f020d200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0208159a10 0x7f020815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:42.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.108+0000 7f020d200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0208159a10 0x7f020815cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56146/0 (socket says 172.21.15.153:56146) 2024-03-28T21:52:42.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.108+0000 7f020d200640 1 -- 172.21.15.153:0/3952086882 learned_addr learned my addr 172.21.15.153:0/3952086882 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:42.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.108+0000 7f020dc00640 1 --1- 172.21.15.153:0/3952086882 >> v1:172.21.15.153:6789/0 conn(0x7f020806e270 0x7f020815fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42584/0 (socket says 172.21.15.153:42584) 2024-03-28T21:52:42.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.108+0000 7f0207e00640 1 --2- 172.21.15.153:0/3952086882 >> v2:172.21.15.165:3300/0 conn(0x7f02080ad830 0x7f020806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:42.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.108+0000 7f020d200640 1 -- 172.21.15.153:0/3952086882 >> v2:172.21.15.165:3300/0 conn(0x7f02080ad830 msgr2=0x7f020806dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:42.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.108+0000 7f020d200640 1 --2- 172.21.15.153:0/3952086882 >> v2:172.21.15.165:3300/0 conn(0x7f02080ad830 0x7f020806dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.108+0000 7f020d200640 1 -- 172.21.15.153:0/3952086882 >> v1:172.21.15.153:6789/0 conn(0x7f020806e270 legacy=0x7f020815fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:42.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.108+0000 7f0207400640 1 -- 172.21.15.153:0/3952086882 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3537740779 0 0) 0x7f020806e690 con 0x7f020806e270 2024-03-28T21:52:42.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.108+0000 7f020d200640 1 -- 172.21.15.153:0/3952086882 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0208159df0 con 0x7f0208159a10 2024-03-28T21:52:42.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.108+0000 7f0207e00640 1 --2- 172.21.15.153:0/3952086882 >> v2:172.21.15.165:3300/0 conn(0x7f02080ad830 0x7f020806dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.109+0000 7f020d200640 1 --2- 172.21.15.153:0/3952086882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0208159a10 0x7f020815cf00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f02080736e0 tx=0x7f01fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992ec97db8a42118 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.110+0000 7f0207400640 1 -- 172.21.15.153:0/3952086882 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc035020 con 0x7f0208159a10 2024-03-28T21:52:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.110+0000 7f0207400640 1 -- 172.21.15.153:0/3952086882 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01fc031870 con 0x7f0208159a10 2024-03-28T21:52:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.110+0000 7f0207400640 1 -- 172.21.15.153:0/3952086882 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc031c40 con 0x7f0208159a10 2024-03-28T21:52:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.110+0000 7f020fc00640 1 -- 172.21.15.153:0/3952086882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0208159a10 msgr2=0x7f020815cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.110+0000 7f020fc00640 1 --2- 172.21.15.153:0/3952086882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0208159a10 0x7f020815cf00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f02080736e0 tx=0x7f01fc02b910 comp rx=0 tx=0).stop 2024-03-28T21:52:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.110+0000 7f020fc00640 1 -- 172.21.15.153:0/3952086882 shutdown_connections 2024-03-28T21:52:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.110+0000 7f020fc00640 1 --2- 172.21.15.153:0/3952086882 >> v2:172.21.15.165:3300/0 conn(0x7f02080ad830 0x7f020806dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.110+0000 7f020fc00640 1 --2- 172.21.15.153:0/3952086882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0208159a10 0x7f020815cf00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.110+0000 7f020fc00640 1 -- 172.21.15.153:0/3952086882 >> 172.21.15.153:0/3952086882 conn(0x7f02080b1a30 msgr2=0x7f02080b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:42.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.111+0000 7f020fc00640 1 -- 172.21.15.153:0/3952086882 shutdown_connections 2024-03-28T21:52:42.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.111+0000 7f020fc00640 1 -- 172.21.15.153:0/3952086882 wait complete. 2024-03-28T21:52:42.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.112+0000 7f020fc00640 1 Processor -- start 2024-03-28T21:52:42.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.112+0000 7f020fc00640 1 -- start start 2024-03-28T21:52:42.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.113+0000 7f020fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f020806e270 0x7f020814d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:42.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.113+0000 7f020fc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02080ad830 0x7f02081f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.113+0000 7f020fc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0208159a10 0x7f02080ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.113+0000 7f020fc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f02080b3100 con 0x7f0208159a10 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.113+0000 7f020fc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f02080ae1f0 con 0x7f02080ad830 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.113+0000 7f020fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f02080ae4d0 con 0x7f020806e270 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.114+0000 7f020dc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0208159a10 0x7f02080ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.114+0000 7f020dc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0208159a10 0x7f02080ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56156/0 (socket says 172.21.15.153:56156) 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.114+0000 7f020dc00640 1 -- 172.21.15.153:0/3852484679 learned_addr learned my addr 172.21.15.153:0/3852484679 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.114+0000 7f020d200640 1 --2- 172.21.15.153:0/3852484679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f020806e270 0x7f020814d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.114+0000 7f020dc00640 1 -- 172.21.15.153:0/3852484679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f020806e270 msgr2=0x7f020814d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.114+0000 7f020dc00640 1 --2- 172.21.15.153:0/3852484679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f020806e270 0x7f020814d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.114+0000 7f020dc00640 1 -- 172.21.15.153:0/3852484679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02080ad830 msgr2=0x7f02081f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.114+0000 7f020dc00640 1 --2- 172.21.15.153:0/3852484679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02080ad830 0x7f02081f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.114+0000 7f020dc00640 1 -- 172.21.15.153:0/3852484679 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02081f2a10 con 0x7f0208159a10 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.114+0000 7f020dc00640 1 --2- 172.21.15.153:0/3852484679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0208159a10 0x7f02080ccda0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f020000c730 tx=0x7f020000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.114+0000 7f0204c00640 1 -- 172.21.15.153:0/3852484679 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0200018070 con 0x7f0208159a10 2024-03-28T21:52:42.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.115+0000 7f0204c00640 1 -- 172.21.15.153:0/3852484679 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f020000ce40 con 0x7f0208159a10 2024-03-28T21:52:42.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.115+0000 7f0204c00640 1 -- 172.21.15.153:0/3852484679 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020000a860 con 0x7f0208159a10 2024-03-28T21:52:42.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.115+0000 7f020fc00640 1 -- 172.21.15.153:0/3852484679 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02080ce330 con 0x7f0208159a10 2024-03-28T21:52:42.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.115+0000 7f020fc00640 1 -- 172.21.15.153:0/3852484679 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02080ce8f0 con 0x7f0208159a10 2024-03-28T21:52:42.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.116+0000 7f020fc00640 1 -- 172.21.15.153:0/3852484679 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0208068ff0 con 0x7f0208159a10 2024-03-28T21:52:42.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.117+0000 7f0204c00640 1 -- 172.21.15.153:0/3852484679 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f020000aa00 con 0x7f0208159a10 2024-03-28T21:52:42.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.118+0000 7f0204c00640 1 --2- 172.21.15.153:0/3852484679 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f01e806b4d0 0x7f01e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:42.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.118+0000 7f0204c00640 1 -- 172.21.15.153:0/3852484679 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f02000898a0 con 0x7f0208159a10 2024-03-28T21:52:42.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.118+0000 7f020d200640 1 --2- 172.21.15.153:0/3852484679 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f01e806b4d0 0x7f01e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:42.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.119+0000 7f020d200640 1 --2- 172.21.15.153:0/3852484679 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f01e806b4d0 0x7f01e806d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f01fc036000 tx=0x7f01fc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:42.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.127+0000 7f0204c00640 1 -- 172.21.15.153:0/3852484679 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f02081f2a10 con 0x7f0208159a10 2024-03-28T21:52:42.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.324+0000 7f020fc00640 1 -- 172.21.15.153:0/3852484679 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02080b4690 con 0x7f0208159a10 2024-03-28T21:52:42.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.326+0000 7f0204c00640 1 -- 172.21.15.153:0/3852484679 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f0200058680 con 0x7f0208159a10 2024-03-28T21:52:42.329 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:42.330 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:51:57.716531+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:42.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.330+0000 7f020fc00640 1 -- 172.21.15.153:0/3852484679 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f01e806b4d0 msgr2=0x7f01e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.330+0000 7f020fc00640 1 --2- 172.21.15.153:0/3852484679 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f01e806b4d0 0x7f01e806d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f01fc036000 tx=0x7f01fc008030 comp rx=0 tx=0).stop 2024-03-28T21:52:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.330+0000 7f020fc00640 1 -- 172.21.15.153:0/3852484679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0208159a10 msgr2=0x7f02080ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.330+0000 7f020fc00640 1 --2- 172.21.15.153:0/3852484679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0208159a10 0x7f02080ccda0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f020000c730 tx=0x7f020000cbf0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.330+0000 7f020fc00640 1 -- 172.21.15.153:0/3852484679 shutdown_connections 2024-03-28T21:52:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.330+0000 7f020fc00640 1 --2- 172.21.15.153:0/3852484679 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f01e806b4d0 0x7f01e806d990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.330+0000 7f020fc00640 1 --2- 172.21.15.153:0/3852484679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0208159a10 0x7f02080ccda0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.330+0000 7f020fc00640 1 --2- 172.21.15.153:0/3852484679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02080ad830 0x7f02081f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.330+0000 7f020fc00640 1 --2- 172.21.15.153:0/3852484679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f020806e270 0x7f020814d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.330+0000 7f020fc00640 1 -- 172.21.15.153:0/3852484679 >> 172.21.15.153:0/3852484679 conn(0x7f02080b1a30 msgr2=0x7f020806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.330+0000 7f020fc00640 1 -- 172.21.15.153:0/3852484679 shutdown_connections 2024-03-28T21:52:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.330+0000 7f020fc00640 1 -- 172.21.15.153:0/3852484679 wait complete. 2024-03-28T21:52:42.350 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T21:51:53.863931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T21:51:55.188736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T21:52:42.351 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T21:52:42.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.563+0000 7f2ab1000640 1 Processor -- start 2024-03-28T21:52:42.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.563+0000 7f2ab1000640 1 -- start start 2024-03-28T21:52:42.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.565+0000 7f2ab1000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2aac144ac0 0x7f2aac162a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:42.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.565+0000 7f2ab1000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2aac15ea20 0x7f2aac15ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:42.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.565+0000 7f2ab1000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aac15f4e0 con 0x7f2aac06b170 2024-03-28T21:52:42.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.565+0000 7f2ab1000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2aac161ff0 con 0x7f2aac144ac0 2024-03-28T21:52:42.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.565+0000 7f2ab1000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2aac1625b0 con 0x7f2aac15ea20 2024-03-28T21:52:42.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.565+0000 7f2aa9e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2aac144ac0 0x7f2aac162a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:42.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.565+0000 7f2aa9e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2aac144ac0 0x7f2aac162a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56172/0 (socket says 172.21.15.153:56172) 2024-03-28T21:52:42.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.566+0000 7f2aa9e00640 1 -- 172.21.15.153:0/4184377929 learned_addr learned my addr 172.21.15.153:0/4184377929 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:42.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.566+0000 7f2aa3e00640 1 --2- 172.21.15.153:0/4184377929 >> v2:172.21.15.165:3300/0 conn(0x7f2aac15ea20 0x7f2aac15ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:42.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.566+0000 7f2aa9e00640 1 -- 172.21.15.153:0/4184377929 >> v2:172.21.15.165:3300/0 conn(0x7f2aac15ea20 msgr2=0x7f2aac15ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:42.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.566+0000 7f2aa9e00640 1 --2- 172.21.15.153:0/4184377929 >> v2:172.21.15.165:3300/0 conn(0x7f2aac15ea20 0x7f2aac15ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.566+0000 7f2aa9e00640 1 -- 172.21.15.153:0/4184377929 >> v1:172.21.15.165:6789/0 conn(0x7f2aac06b170 legacy=0x7f2aac06df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:42.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.566+0000 7f2aa9e00640 1 -- 172.21.15.153:0/4184377929 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac15f7c0 con 0x7f2aac144ac0 2024-03-28T21:52:42.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.567+0000 7f2aa9e00640 1 --2- 172.21.15.153:0/4184377929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aac144ac0 0x7f2aac162a40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2aac148300 tx=0x7f2a9c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e48b06d734d760e server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:42.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.567+0000 7f2aa9400640 1 -- 172.21.15.153:0/4184377929 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c038070 con 0x7f2aac144ac0 2024-03-28T21:52:42.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.568+0000 7f2aa9400640 1 -- 172.21.15.153:0/4184377929 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a9c02f050 con 0x7f2aac144ac0 2024-03-28T21:52:42.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.568+0000 7f2aa9400640 1 -- 172.21.15.153:0/4184377929 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c031970 con 0x7f2aac144ac0 2024-03-28T21:52:42.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.568+0000 7f2ab1000640 1 -- 172.21.15.153:0/4184377929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aac144ac0 msgr2=0x7f2aac162a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:42.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.568+0000 7f2ab1000640 1 --2- 172.21.15.153:0/4184377929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aac144ac0 0x7f2aac162a40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2aac148300 tx=0x7f2a9c02b7f0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.568+0000 7f2ab1000640 1 -- 172.21.15.153:0/4184377929 shutdown_connections 2024-03-28T21:52:42.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.568+0000 7f2ab1000640 1 --2- 172.21.15.153:0/4184377929 >> v2:172.21.15.165:3300/0 conn(0x7f2aac15ea20 0x7f2aac15ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.568+0000 7f2ab1000640 1 --2- 172.21.15.153:0/4184377929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aac144ac0 0x7f2aac162a40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.568+0000 7f2ab1000640 1 -- 172.21.15.153:0/4184377929 >> 172.21.15.153:0/4184377929 conn(0x7f2aac0b2ab0 msgr2=0x7f2aac0b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:42.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.568+0000 7f2ab1000640 1 -- 172.21.15.153:0/4184377929 shutdown_connections 2024-03-28T21:52:42.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.568+0000 7f2ab1000640 1 -- 172.21.15.153:0/4184377929 wait complete. 2024-03-28T21:52:42.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.570+0000 7f2ab1000640 1 Processor -- start 2024-03-28T21:52:42.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.570+0000 7f2ab1000640 1 -- start start 2024-03-28T21:52:42.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.571+0000 7f2ab1000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aac06b170 0x7f2aac154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:42.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.571+0000 7f2ab1000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aac144ac0 0x7f2aac1603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:42.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.571+0000 7f2ab1000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aac15ea20 0x7f2aac160930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:42.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.571+0000 7f2ab1000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac0b5fc0 con 0x7f2aac15ea20 2024-03-28T21:52:42.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.571+0000 7f2ab1000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac0b5e40 con 0x7f2aac06b170 2024-03-28T21:52:42.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.571+0000 7f2ab1000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2aac06b5e0 con 0x7f2aac144ac0 2024-03-28T21:52:42.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.571+0000 7f2aaa800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aac15ea20 0x7f2aac160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:42.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.571+0000 7f2aaa800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aac15ea20 0x7f2aac160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56178/0 (socket says 172.21.15.153:56178) 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.571+0000 7f2aaa800640 1 -- 172.21.15.153:0/1967465088 learned_addr learned my addr 172.21.15.153:0/1967465088 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.572+0000 7f2aa9e00640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aac06b170 0x7f2aac154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.572+0000 7f2aa3e00640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aac144ac0 0x7f2aac1603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.572+0000 7f2aaa800640 1 -- 172.21.15.153:0/1967465088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aac144ac0 msgr2=0x7f2aac1603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.572+0000 7f2aaa800640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aac144ac0 0x7f2aac1603f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.572+0000 7f2aaa800640 1 -- 172.21.15.153:0/1967465088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aac06b170 msgr2=0x7f2aac154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.572+0000 7f2aaa800640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aac06b170 0x7f2aac154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.572+0000 7f2aaa800640 1 -- 172.21.15.153:0/1967465088 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac154560 con 0x7f2aac15ea20 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.572+0000 7f2aa9e00640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aac06b170 0x7f2aac154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.572+0000 7f2aaa800640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aac15ea20 0x7f2aac160930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c7b0 tx=0x7f2aa400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.572+0000 7f2aa2000640 1 -- 172.21.15.153:0/1967465088 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4004b60 con 0x7f2aac15ea20 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.572+0000 7f2aa2000640 1 -- 172.21.15.153:0/1967465088 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa4004d00 con 0x7f2aac15ea20 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.572+0000 7f2aa2000640 1 -- 172.21.15.153:0/1967465088 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa400aa90 con 0x7f2aac15ea20 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.573+0000 7f2ab1000640 1 -- 172.21.15.153:0/1967465088 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aac156240 con 0x7f2aac15ea20 2024-03-28T21:52:42.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.573+0000 7f2ab1000640 1 -- 172.21.15.153:0/1967465088 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aac0aff60 con 0x7f2aac15ea20 2024-03-28T21:52:42.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.574+0000 7f2ab1000640 1 -- 172.21.15.153:0/1967465088 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aac068ff0 con 0x7f2aac15ea20 2024-03-28T21:52:42.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.576+0000 7f2aa2000640 1 -- 172.21.15.153:0/1967465088 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f2aa400ac30 con 0x7f2aac15ea20 2024-03-28T21:52:42.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.577+0000 7f2aa2000640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2a8806b4d0 0x7f2a8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:42.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.577+0000 7f2aa2000640 1 -- 172.21.15.153:0/1967465088 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2aa408a500 con 0x7f2aac15ea20 2024-03-28T21:52:42.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.577+0000 7f2aa9e00640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2a8806b4d0 0x7f2a8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:42.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.578+0000 7f2aa9e00640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2a8806b4d0 0x7f2a8806d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c035000 tx=0x7f2a9c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:42.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.582+0000 7f2aa2000640 1 -- 172.21.15.153:0/1967465088 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2aa4020070 con 0x7f2aac15ea20 2024-03-28T21:52:42.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.776+0000 7f2ab1000640 1 -- 172.21.15.153:0/1967465088 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2aac06bf20 con 0x7f2aac15ea20 2024-03-28T21:52:42.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.777+0000 7f2aa2000640 1 -- 172.21.15.153:0/1967465088 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f2aa4059300 con 0x7f2aac15ea20 2024-03-28T21:52:42.780 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-28T21:52:42.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.779+0000 7f2ab1000640 1 -- 172.21.15.153:0/1967465088 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2a8806b4d0 msgr2=0x7f2a8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:42.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.780+0000 7f2ab1000640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2a8806b4d0 0x7f2a8806d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c035000 tx=0x7f2a9c008030 comp rx=0 tx=0).stop 2024-03-28T21:52:42.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.780+0000 7f2ab1000640 1 -- 172.21.15.153:0/1967465088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aac15ea20 msgr2=0x7f2aac160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:42.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.780+0000 7f2ab1000640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aac15ea20 0x7f2aac160930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c7b0 tx=0x7f2aa400cc70 comp rx=0 tx=0).stop 2024-03-28T21:52:42.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.780+0000 7f2ab1000640 1 -- 172.21.15.153:0/1967465088 shutdown_connections 2024-03-28T21:52:42.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.780+0000 7f2ab1000640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2a8806b4d0 0x7f2a8806d990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.780+0000 7f2ab1000640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aac15ea20 0x7f2aac160930 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.780+0000 7f2ab1000640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aac144ac0 0x7f2aac1603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.780+0000 7f2ab1000640 1 --2- 172.21.15.153:0/1967465088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aac06b170 0x7f2aac154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:42.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.780+0000 7f2ab1000640 1 -- 172.21.15.153:0/1967465088 >> 172.21.15.153:0/1967465088 conn(0x7f2aac0b2ab0 msgr2=0x7f2aac06df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:42.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.780+0000 7f2ab1000640 1 -- 172.21.15.153:0/1967465088 shutdown_connections 2024-03-28T21:52:42.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.780+0000 7f2ab1000640 1 -- 172.21.15.153:0/1967465088 wait complete. 2024-03-28T21:52:42.800 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T21:52:43.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.998+0000 7fa6a3800640 1 Processor -- start 2024-03-28T21:52:43.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.998+0000 7fa6a3800640 1 -- start start 2024-03-28T21:52:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:42.999+0000 7fa6a3800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69c0cef30 0x7fa69c071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.000+0000 7fa6a3800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c070f20 con 0x7fa69c0acd80 2024-03-28T21:52:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.000+0000 7fa6a3800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c071200 con 0x7fa69c0728c0 2024-03-28T21:52:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.000+0000 7fa6a3800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa69c0714e0 con 0x7fa69c0cef30 2024-03-28T21:52:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.000+0000 7fa69be00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa69c0acd80 0x7fa69c0cf310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:57204/0 (socket says 172.21.15.153:57204) 2024-03-28T21:52:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.000+0000 7fa69be00640 1 -- 172.21.15.153:0/3621186767 learned_addr learned my addr 172.21.15.153:0/3621186767 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:43.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.000+0000 7fa6a0e00640 1 --2- 172.21.15.153:0/3621186767 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69c0cef30 0x7fa69c071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.000+0000 7fa69b400640 1 -- 172.21.15.153:0/3621186767 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3581933594 0 0) 0x7fa69c070f20 con 0x7fa69c0acd80 2024-03-28T21:52:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.000+0000 7fa69b400640 1 -- 172.21.15.153:0/3621186767 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa684003520 con 0x7fa69c0acd80 2024-03-28T21:52:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.001+0000 7fa69b400640 1 -- 172.21.15.153:0/3621186767 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2339796199 0 0) 0x7fa684003520 con 0x7fa69c0acd80 2024-03-28T21:52:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.001+0000 7fa69b400640 1 -- 172.21.15.153:0/3621186767 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69c0cef30 msgr2=0x7fa69c071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.001+0000 7fa69b400640 1 --2- 172.21.15.153:0/3621186767 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69c0cef30 0x7fa69c071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.001+0000 7fa69b400640 1 -- 172.21.15.153:0/3621186767 >> v1:172.21.15.165:6789/0 conn(0x7fa69c0728c0 legacy=0x7fa69c06cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.001+0000 7fa69b400640 1 -- 172.21.15.153:0/3621186767 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c0717c0 con 0x7fa69c0acd80 2024-03-28T21:52:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.001+0000 7fa69b400640 1 -- 172.21.15.153:0/3621186767 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fa688001670 con 0x7fa69c0acd80 2024-03-28T21:52:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.001+0000 7fa69b400640 1 -- 172.21.15.153:0/3621186767 >> v1:172.21.15.153:6789/0 conn(0x7fa69c0acd80 legacy=0x7fa69c0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.001+0000 7fa69b400640 1 --2- 172.21.15.153:0/3621186767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6840039e0 0x7fa684003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.001+0000 7fa69b400640 1 --2- 172.21.15.153:0/3621186767 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69c0cef30 0x7fa684004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.001+0000 7fa69b400640 1 --2- 172.21.15.153:0/3621186767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa684004d40 0x7fa6840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.001+0000 7fa69b400640 1 -- 172.21.15.153:0/3621186767 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c0714e0 con 0x7fa684004d40 2024-03-28T21:52:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.001+0000 7fa69b400640 1 -- 172.21.15.153:0/3621186767 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa68400baa0 con 0x7fa6840039e0 2024-03-28T21:52:43.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.001+0000 7fa69b400640 1 -- 172.21.15.153:0/3621186767 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa68400bca0 con 0x7fa69c0cef30 2024-03-28T21:52:43.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.001+0000 7fa6a1800640 1 --2- 172.21.15.153:0/3621186767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa684004d40 0x7fa6840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.002+0000 7fa69be00640 1 --2- 172.21.15.153:0/3621186767 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69c0cef30 0x7fa684004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.002+0000 7fa6a0e00640 1 --2- 172.21.15.153:0/3621186767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6840039e0 0x7fa684003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.002+0000 7fa6a1800640 1 -- 172.21.15.153:0/3621186767 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69c0cef30 msgr2=0x7fa684004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:43.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.002+0000 7fa6a1800640 1 --2- 172.21.15.153:0/3621186767 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69c0cef30 0x7fa684004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.002+0000 7fa6a1800640 1 -- 172.21.15.153:0/3621186767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6840039e0 msgr2=0x7fa684003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:43.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.002+0000 7fa6a1800640 1 --2- 172.21.15.153:0/3621186767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6840039e0 0x7fa684003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.002+0000 7fa6a1800640 1 -- 172.21.15.153:0/3621186767 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa684003520 con 0x7fa684004d40 2024-03-28T21:52:43.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.002+0000 7fa6a0e00640 1 --2- 172.21.15.153:0/3621186767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6840039e0 0x7fa684003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:43.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.003+0000 7fa6a1800640 1 --2- 172.21.15.153:0/3621186767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa684004d40 0x7fa6840051c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa694001e20 tx=0x7fa684005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9801b5a6d0aa740 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:43.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.003+0000 7fa69b400640 1 -- 172.21.15.153:0/3621186767 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694001a70 con 0x7fa684004d40 2024-03-28T21:52:43.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.003+0000 7fa69b400640 1 -- 172.21.15.153:0/3621186767 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa694003b70 con 0x7fa684004d40 2024-03-28T21:52:43.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.003+0000 7fa69b400640 1 -- 172.21.15.153:0/3621186767 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6940050d0 con 0x7fa684004d40 2024-03-28T21:52:43.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.004+0000 7fa6a3800640 1 -- 172.21.15.153:0/3621186767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa684004d40 msgr2=0x7fa6840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.004+0000 7fa6a3800640 1 --2- 172.21.15.153:0/3621186767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa684004d40 0x7fa6840051c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa694001e20 tx=0x7fa684005830 comp rx=0 tx=0).stop 2024-03-28T21:52:43.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.004+0000 7fa6a1800640 1 -- 172.21.15.153:0/3621186767 reap_dead start 2024-03-28T21:52:43.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.004+0000 7fa6a3800640 1 -- 172.21.15.153:0/3621186767 shutdown_connections 2024-03-28T21:52:43.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.004+0000 7fa6a3800640 1 -- 172.21.15.153:0/3621186767 >> 172.21.15.153:0/3621186767 conn(0x7fa69c0b19a0 msgr2=0x7fa69c0b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:43.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.004+0000 7fa6a3800640 1 -- 172.21.15.153:0/3621186767 shutdown_connections 2024-03-28T21:52:43.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.004+0000 7fa6a3800640 1 -- 172.21.15.153:0/3621186767 wait complete. 2024-03-28T21:52:43.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.006+0000 7fa6a3800640 1 Processor -- start 2024-03-28T21:52:43.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.006+0000 7fa6a3800640 1 -- start start 2024-03-28T21:52:43.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.007+0000 7fa6a3800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa684004d40 0x7fa69c14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.007+0000 7fa6a3800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69c1e4e30 0x7fa69c0b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.007+0000 7fa6a3800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa69c1e77c0 0x7fa69c14c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.007+0000 7fa6a3800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c15c370 con 0x7fa684004d40 2024-03-28T21:52:43.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.007+0000 7fa6a3800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c15c1f0 con 0x7fa69c1e77c0 2024-03-28T21:52:43.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.007+0000 7fa6a3800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa69c071ce0 con 0x7fa69c1e4e30 2024-03-28T21:52:43.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.007+0000 7fa6a0e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa684004d40 0x7fa69c14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.007+0000 7fa6a0e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa684004d40 0x7fa69c14d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47972/0 (socket says 172.21.15.153:47972) 2024-03-28T21:52:43.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.007+0000 7fa6a0e00640 1 -- 172.21.15.153:0/3785118467 learned_addr learned my addr 172.21.15.153:0/3785118467 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:43.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.007+0000 7fa6a0e00640 1 -- 172.21.15.153:0/3785118467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69c1e4e30 msgr2=0x7fa69c0b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.007+0000 7fa6a0e00640 1 --2- 172.21.15.153:0/3785118467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69c1e4e30 0x7fa69c0b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.007+0000 7fa6a0e00640 1 -- 172.21.15.153:0/3785118467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa69c1e77c0 msgr2=0x7fa69c14c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.007+0000 7fa6a0e00640 1 --2- 172.21.15.153:0/3785118467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa69c1e77c0 0x7fa69c14c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.007+0000 7fa6a0e00640 1 -- 172.21.15.153:0/3785118467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c14d5e0 con 0x7fa684004d40 2024-03-28T21:52:43.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.008+0000 7fa6a0e00640 1 --2- 172.21.15.153:0/3785118467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa684004d40 0x7fa69c14d0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa6900108b0 tx=0x7fa690010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:43.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.008+0000 7fa698c00640 1 -- 172.21.15.153:0/3785118467 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69000f040 con 0x7fa684004d40 2024-03-28T21:52:43.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.008+0000 7fa698c00640 1 -- 172.21.15.153:0/3785118467 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa69000eae0 con 0x7fa684004d40 2024-03-28T21:52:43.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.008+0000 7fa6a3800640 1 -- 172.21.15.153:0/3785118467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa69c1e5330 con 0x7fa684004d40 2024-03-28T21:52:43.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.008+0000 7fa698c00640 1 -- 172.21.15.153:0/3785118467 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69000ee90 con 0x7fa684004d40 2024-03-28T21:52:43.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.008+0000 7fa6a3800640 1 -- 172.21.15.153:0/3785118467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa69c1e58f0 con 0x7fa684004d40 2024-03-28T21:52:43.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.010+0000 7fa6a3800640 1 -- 172.21.15.153:0/3785118467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa69c068ff0 con 0x7fa684004d40 2024-03-28T21:52:43.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.010+0000 7fa698c00640 1 -- 172.21.15.153:0/3785118467 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa69001c400 con 0x7fa684004d40 2024-03-28T21:52:43.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.011+0000 7fa698c00640 1 --2- 172.21.15.153:0/3785118467 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa67c06b670 0x7fa67c06db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.011+0000 7fa698c00640 1 -- 172.21.15.153:0/3785118467 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa69008a940 con 0x7fa684004d40 2024-03-28T21:52:43.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.011+0000 7fa69be00640 1 --2- 172.21.15.153:0/3785118467 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa67c06b670 0x7fa67c06db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.012+0000 7fa69be00640 1 --2- 172.21.15.153:0/3785118467 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa67c06b670 0x7fa67c06db30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0ce7a0 tx=0x7fa688000ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:43.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.019+0000 7fa698c00640 1 -- 172.21.15.153:0/3785118467 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa690018030 con 0x7fa684004d40 2024-03-28T21:52:43.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.221+0000 7fa6a3800640 1 -- 172.21.15.153:0/3785118467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa69c15cd50 con 0x7fa684004d40 2024-03-28T21:52:43.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.222+0000 7fa698c00640 1 -- 172.21.15.153:0/3785118467 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fa690059730 con 0x7fa684004d40 2024-03-28T21:52:43.224 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-03-28T21:52:43.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.224+0000 7fa6a3800640 1 -- 172.21.15.153:0/3785118467 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa67c06b670 msgr2=0x7fa67c06db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.224+0000 7fa6a3800640 1 --2- 172.21.15.153:0/3785118467 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa67c06b670 0x7fa67c06db30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0ce7a0 tx=0x7fa688000ef0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.224+0000 7fa6a3800640 1 -- 172.21.15.153:0/3785118467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa684004d40 msgr2=0x7fa69c14d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.224+0000 7fa6a3800640 1 --2- 172.21.15.153:0/3785118467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa684004d40 0x7fa69c14d0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa6900108b0 tx=0x7fa690010d70 comp rx=0 tx=0).stop 2024-03-28T21:52:43.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.224+0000 7fa6a3800640 1 -- 172.21.15.153:0/3785118467 shutdown_connections 2024-03-28T21:52:43.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.224+0000 7fa6a3800640 1 --2- 172.21.15.153:0/3785118467 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa67c06b670 0x7fa67c06db30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.224+0000 7fa6a3800640 1 --2- 172.21.15.153:0/3785118467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa69c1e77c0 0x7fa69c14c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.224+0000 7fa6a3800640 1 --2- 172.21.15.153:0/3785118467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69c1e4e30 0x7fa69c0b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.224+0000 7fa6a3800640 1 --2- 172.21.15.153:0/3785118467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa684004d40 0x7fa69c14d0a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.224+0000 7fa6a3800640 1 -- 172.21.15.153:0/3785118467 >> 172.21.15.153:0/3785118467 conn(0x7fa69c0b19a0 msgr2=0x7fa69c0aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:43.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.224+0000 7fa6a3800640 1 -- 172.21.15.153:0/3785118467 shutdown_connections 2024-03-28T21:52:43.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.224+0000 7fa6a3800640 1 -- 172.21.15.153:0/3785118467 wait complete. 2024-03-28T21:52:43.246 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T21:52:43.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.440+0000 7f4bbd400640 1 Processor -- start 2024-03-28T21:52:43.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.440+0000 7f4bbd400640 1 -- start start 2024-03-28T21:52:43.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.442+0000 7f4bbd400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bb815a950 0x7f4bb80aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.442+0000 7f4bbd400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4bb80af0f0 0x7f4bb8071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.442+0000 7f4bbd400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bb80adb10 con 0x7f4bb8071c60 2024-03-28T21:52:43.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.442+0000 7f4bbd400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb80addf0 con 0x7f4bb80af0f0 2024-03-28T21:52:43.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.442+0000 7f4bbd400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb80ae0d0 con 0x7f4bb815a950 2024-03-28T21:52:43.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.443+0000 7f4bb5e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4bb80af0f0 0x7f4bb8071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.443+0000 7f4bb5e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4bb80af0f0 0x7f4bb8071720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47974/0 (socket says 172.21.15.153:47974) 2024-03-28T21:52:43.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.443+0000 7f4bb5e00640 1 -- 172.21.15.153:0/3190259448 learned_addr learned my addr 172.21.15.153:0/3190259448 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:43.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.443+0000 7f4bb5e00640 1 -- 172.21.15.153:0/3190259448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bb815a950 msgr2=0x7f4bb80aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:43.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.443+0000 7f4bb5e00640 1 --2- 172.21.15.153:0/3190259448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bb815a950 0x7f4bb80aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.443+0000 7f4bb5e00640 1 -- 172.21.15.153:0/3190259448 >> v1:172.21.15.165:6789/0 conn(0x7f4bb8071c60 legacy=0x7f4bb806d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:43.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.443+0000 7f4bb5e00640 1 -- 172.21.15.153:0/3190259448 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb80ae3b0 con 0x7f4bb80af0f0 2024-03-28T21:52:43.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.444+0000 7f4bb5e00640 1 --2- 172.21.15.153:0/3190259448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb80af0f0 0x7f4bb8071720 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400bb00 tx=0x7f4ba402de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fec0a3b2378e11a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:43.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.444+0000 7f4bb5400640 1 -- 172.21.15.153:0/3190259448 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4034070 con 0x7f4bb80af0f0 2024-03-28T21:52:43.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.445+0000 7f4bb5400640 1 -- 172.21.15.153:0/3190259448 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba402ebc0 con 0x7f4bb80af0f0 2024-03-28T21:52:43.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.445+0000 7f4bb5400640 1 -- 172.21.15.153:0/3190259448 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4038400 con 0x7f4bb80af0f0 2024-03-28T21:52:43.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.445+0000 7f4bbd400640 1 -- 172.21.15.153:0/3190259448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb80af0f0 msgr2=0x7f4bb8071720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.445+0000 7f4bbd400640 1 --2- 172.21.15.153:0/3190259448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb80af0f0 0x7f4bb8071720 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400bb00 tx=0x7f4ba402de10 comp rx=0 tx=0).stop 2024-03-28T21:52:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.446+0000 7f4bbd400640 1 -- 172.21.15.153:0/3190259448 shutdown_connections 2024-03-28T21:52:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.446+0000 7f4bbd400640 1 --2- 172.21.15.153:0/3190259448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb80af0f0 0x7f4bb8071720 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.446+0000 7f4bbd400640 1 --2- 172.21.15.153:0/3190259448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bb815a950 0x7f4bb80aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.446+0000 7f4bbd400640 1 -- 172.21.15.153:0/3190259448 >> 172.21.15.153:0/3190259448 conn(0x7f4bb80b19a0 msgr2=0x7f4bb80b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.446+0000 7f4bbd400640 1 -- 172.21.15.153:0/3190259448 shutdown_connections 2024-03-28T21:52:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.446+0000 7f4bbd400640 1 -- 172.21.15.153:0/3190259448 wait complete. 2024-03-28T21:52:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.448+0000 7f4bbd400640 1 Processor -- start 2024-03-28T21:52:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.448+0000 7f4bbd400640 1 -- start start 2024-03-28T21:52:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.449+0000 7f4bbd400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bb8071c60 0x7f4bb81e7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.449+0000 7f4bbd400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb80af0f0 0x7f4bb80b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.449+0000 7f4bbd400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bb815a950 0x7f4bb80b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.449+0000 7f4bbd400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb806dc20 con 0x7f4bb80af0f0 2024-03-28T21:52:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.449+0000 7f4bbd400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb806daa0 con 0x7f4bb815a950 2024-03-28T21:52:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.449+0000 7f4bbd400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb806cb00 con 0x7f4bb8071c60 2024-03-28T21:52:43.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.449+0000 7f4bb5e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb80af0f0 0x7f4bb80b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.449+0000 7f4bb5e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb80af0f0 0x7f4bb80b0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47982/0 (socket says 172.21.15.153:47982) 2024-03-28T21:52:43.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.449+0000 7f4bb5e00640 1 -- 172.21.15.153:0/1246782213 learned_addr learned my addr 172.21.15.153:0/1246782213 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:43.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.450+0000 7f4bb6800640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bb8071c60 0x7f4bb81e7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.450+0000 7f4bb7200640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bb815a950 0x7f4bb80b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.450+0000 7f4bb5e00640 1 -- 172.21.15.153:0/1246782213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bb8071c60 msgr2=0x7f4bb81e7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.450+0000 7f4bb5e00640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bb8071c60 0x7f4bb81e7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.450+0000 7f4bb5e00640 1 -- 172.21.15.153:0/1246782213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bb815a950 msgr2=0x7f4bb80b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.450+0000 7f4bb5e00640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bb815a950 0x7f4bb80b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.450+0000 7f4bb5e00640 1 -- 172.21.15.153:0/1246782213 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb81f7790 con 0x7f4bb80af0f0 2024-03-28T21:52:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.450+0000 7f4bb6800640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bb8071c60 0x7f4bb81e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.450+0000 7f4bb5e00640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb80af0f0 0x7f4bb80b0800 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4ba403a040 tx=0x7f4ba40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.450+0000 7f4baea00640 1 -- 172.21.15.153:0/1246782213 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40417a0 con 0x7f4bb80af0f0 2024-03-28T21:52:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.450+0000 7f4baea00640 1 -- 172.21.15.153:0/1246782213 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba4047070 con 0x7f4bb80af0f0 2024-03-28T21:52:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.450+0000 7f4bbd400640 1 -- 172.21.15.153:0/1246782213 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb81f7a70 con 0x7f4bb80af0f0 2024-03-28T21:52:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.451+0000 7f4baea00640 1 -- 172.21.15.153:0/1246782213 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4041ba0 con 0x7f4bb80af0f0 2024-03-28T21:52:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.451+0000 7f4bbd400640 1 -- 172.21.15.153:0/1246782213 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb81f8030 con 0x7f4bb80af0f0 2024-03-28T21:52:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.452+0000 7f4bbd400640 1 -- 172.21.15.153:0/1246782213 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb8068ff0 con 0x7f4bb80af0f0 2024-03-28T21:52:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.453+0000 7f4baea00640 1 -- 172.21.15.153:0/1246782213 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f4ba403f070 con 0x7f4bb80af0f0 2024-03-28T21:52:43.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.454+0000 7f4baea00640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4b9806b4d0 0x7f4b9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.454+0000 7f4baea00640 1 -- 172.21.15.153:0/1246782213 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f4ba40ac860 con 0x7f4bb80af0f0 2024-03-28T21:52:43.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.454+0000 7f4bb6800640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4b9806b4d0 0x7f4b9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.455+0000 7f4bb6800640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4b9806b4d0 0x7f4b9806d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800a870 tx=0x7f4ba8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.463+0000 7f4baea00640 1 -- 172.21.15.153:0/1246782213 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4ba407b720 con 0x7f4bb80af0f0 2024-03-28T21:52:43.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.679+0000 7f4bbd400640 1 -- 172.21.15.153:0/1246782213 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4bb806d580 con 0x7f4bb80af0f0 2024-03-28T21:52:43.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.680+0000 7f4baea00640 1 -- 172.21.15.153:0/1246782213 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f4ba407b020 con 0x7f4bb80af0f0 2024-03-28T21:52:43.682 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-03-28T21:52:43.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.683+0000 7f4bbd400640 1 -- 172.21.15.153:0/1246782213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4b9806b4d0 msgr2=0x7f4b9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.683+0000 7f4bbd400640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4b9806b4d0 0x7f4b9806d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800a870 tx=0x7f4ba8008040 comp rx=0 tx=0).stop 2024-03-28T21:52:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.683+0000 7f4bbd400640 1 -- 172.21.15.153:0/1246782213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb80af0f0 msgr2=0x7f4bb80b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.683+0000 7f4bbd400640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb80af0f0 0x7f4bb80b0800 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4ba403a040 tx=0x7f4ba40046c0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.683+0000 7f4bbd400640 1 -- 172.21.15.153:0/1246782213 shutdown_connections 2024-03-28T21:52:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.683+0000 7f4bbd400640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4b9806b4d0 0x7f4b9806d990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.683+0000 7f4bbd400640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bb815a950 0x7f4bb80b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.683+0000 7f4bbd400640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bb80af0f0 0x7f4bb80b0800 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.683+0000 7f4bbd400640 1 --2- 172.21.15.153:0/1246782213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bb8071c60 0x7f4bb81e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.683+0000 7f4bbd400640 1 -- 172.21.15.153:0/1246782213 >> 172.21.15.153:0/1246782213 conn(0x7f4bb80b19a0 msgr2=0x7f4bb8159600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.683+0000 7f4bbd400640 1 -- 172.21.15.153:0/1246782213 shutdown_connections 2024-03-28T21:52:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.683+0000 7f4bbd400640 1 -- 172.21.15.153:0/1246782213 wait complete. 2024-03-28T21:52:43.705 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-28T21:52:43.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.906+0000 7fe867e00640 1 Processor -- start 2024-03-28T21:52:43.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.906+0000 7fe867e00640 1 -- start start 2024-03-28T21:52:43.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.908+0000 7fe867e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe86815e180 0x7fe8680d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.908+0000 7fe867e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe8680d4680 0x7fe8680d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.908+0000 7fe867e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe86815e560 0x7fe8680d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.908+0000 7fe867e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe8680d4e60 con 0x7fe86815e180 2024-03-28T21:52:43.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.908+0000 7fe867e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe8680d4b80 con 0x7fe8680d4680 2024-03-28T21:52:43.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.908+0000 7fe867e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8680b34e0 con 0x7fe86815e560 2024-03-28T21:52:43.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.908+0000 7fe866a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe86815e180 0x7fe8680d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.908+0000 7fe866a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe86815e180 0x7fe8680d2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47994/0 (socket says 172.21.15.153:47994) 2024-03-28T21:52:43.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.908+0000 7fe866a00640 1 -- 172.21.15.153:0/1947111762 learned_addr learned my addr 172.21.15.153:0/1947111762 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:43.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.908+0000 7fe866a00640 1 -- 172.21.15.153:0/1947111762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe86815e560 msgr2=0x7fe8680d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:43.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.909+0000 7fe866a00640 1 --2- 172.21.15.153:0/1947111762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe86815e560 0x7fe8680d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.909+0000 7fe866a00640 1 -- 172.21.15.153:0/1947111762 >> v2:172.21.15.165:3300/0 conn(0x7fe8680d4680 msgr2=0x7fe8680d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:43.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.909+0000 7fe85e000640 1 --2- 172.21.15.153:0/1947111762 >> v2:172.21.15.165:3300/0 conn(0x7fe8680d4680 0x7fe8680d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.909+0000 7fe866a00640 1 --2- 172.21.15.153:0/1947111762 >> v2:172.21.15.165:3300/0 conn(0x7fe8680d4680 0x7fe8680d0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.909+0000 7fe866a00640 1 -- 172.21.15.153:0/1947111762 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8680b37c0 con 0x7fe86815e180 2024-03-28T21:52:43.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.909+0000 7fe85e000640 1 --2- 172.21.15.153:0/1947111762 >> v2:172.21.15.165:3300/0 conn(0x7fe8680d4680 0x7fe8680d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:43.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.910+0000 7fe866a00640 1 --2- 172.21.15.153:0/1947111762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe86815e180 0x7fe8680d2c30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe86808e410 tx=0x7fe85802be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9682b8d96663214d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:43.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.910+0000 7fe866000640 1 -- 172.21.15.153:0/1947111762 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85802ca10 con 0x7fe86815e180 2024-03-28T21:52:43.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.910+0000 7fe866000640 1 -- 172.21.15.153:0/1947111762 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85802cbb0 con 0x7fe86815e180 2024-03-28T21:52:43.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.910+0000 7fe866000640 1 -- 172.21.15.153:0/1947111762 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8580343f0 con 0x7fe86815e180 2024-03-28T21:52:43.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.911+0000 7fe867e00640 1 -- 172.21.15.153:0/1947111762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe86815e180 msgr2=0x7fe8680d2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.911+0000 7fe867e00640 1 --2- 172.21.15.153:0/1947111762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe86815e180 0x7fe8680d2c30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe86808e410 tx=0x7fe85802be70 comp rx=0 tx=0).stop 2024-03-28T21:52:43.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.911+0000 7fe867e00640 1 -- 172.21.15.153:0/1947111762 shutdown_connections 2024-03-28T21:52:43.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.911+0000 7fe867e00640 1 --2- 172.21.15.153:0/1947111762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe86815e560 0x7fe8680d0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.911+0000 7fe867e00640 1 --2- 172.21.15.153:0/1947111762 >> v2:172.21.15.165:3300/0 conn(0x7fe8680d4680 0x7fe8680d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.911+0000 7fe867e00640 1 --2- 172.21.15.153:0/1947111762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe86815e180 0x7fe8680d2c30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.911+0000 7fe867e00640 1 -- 172.21.15.153:0/1947111762 >> 172.21.15.153:0/1947111762 conn(0x7fe86809d1e0 msgr2=0x7fe8680d3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:43.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.911+0000 7fe867e00640 1 -- 172.21.15.153:0/1947111762 shutdown_connections 2024-03-28T21:52:43.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.911+0000 7fe867e00640 1 -- 172.21.15.153:0/1947111762 wait complete. 2024-03-28T21:52:43.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.912+0000 7fe867e00640 1 Processor -- start 2024-03-28T21:52:43.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.913+0000 7fe867e00640 1 -- start start 2024-03-28T21:52:43.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.913+0000 7fe867e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8680d4680 0x7fe868157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.913+0000 7fe867e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe86815e180 0x7fe8680ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.913+0000 7fe867e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe86815e560 0x7fe8680ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.913+0000 7fe867e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8680d1e70 con 0x7fe8680d4680 2024-03-28T21:52:43.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.913+0000 7fe867e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8680d1cf0 con 0x7fe86815e180 2024-03-28T21:52:43.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.913+0000 7fe867e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8680cec30 con 0x7fe86815e560 2024-03-28T21:52:43.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.914+0000 7fe866a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8680d4680 0x7fe868157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.914+0000 7fe866a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8680d4680 0x7fe868157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47996/0 (socket says 172.21.15.153:47996) 2024-03-28T21:52:43.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.914+0000 7fe866a00640 1 -- 172.21.15.153:0/1545534616 learned_addr learned my addr 172.21.15.153:0/1545534616 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:43.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.914+0000 7fe85e000640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe86815e180 0x7fe8680ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.914+0000 7fe867400640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe86815e560 0x7fe8680ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.914+0000 7fe866a00640 1 -- 172.21.15.153:0/1545534616 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe86815e560 msgr2=0x7fe8680ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.914+0000 7fe866a00640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe86815e560 0x7fe8680ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.914+0000 7fe866a00640 1 -- 172.21.15.153:0/1545534616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe86815e180 msgr2=0x7fe8680ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:43.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.914+0000 7fe866a00640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe86815e180 0x7fe8680ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:43.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.914+0000 7fe866a00640 1 -- 172.21.15.153:0/1545534616 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8680c8690 con 0x7fe8680d4680 2024-03-28T21:52:43.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.914+0000 7fe85e000640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe86815e180 0x7fe8680ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:43.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.914+0000 7fe866a00640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8680d4680 0x7fe868157440 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe858036040 tx=0x7fe858004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:43.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.915+0000 7fe85f400640 1 -- 172.21.15.153:0/1545534616 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858043020 con 0x7fe8680d4680 2024-03-28T21:52:43.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.915+0000 7fe85f400640 1 -- 172.21.15.153:0/1545534616 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85803e450 con 0x7fe8680d4680 2024-03-28T21:52:43.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.915+0000 7fe867e00640 1 -- 172.21.15.153:0/1545534616 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8680c8970 con 0x7fe8680d4680 2024-03-28T21:52:43.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.915+0000 7fe85f400640 1 -- 172.21.15.153:0/1545534616 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85803e840 con 0x7fe8680d4680 2024-03-28T21:52:43.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.915+0000 7fe867e00640 1 -- 172.21.15.153:0/1545534616 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8680c8f30 con 0x7fe8680d4680 2024-03-28T21:52:43.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.916+0000 7fe867e00640 1 -- 172.21.15.153:0/1545534616 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86804f4b0 con 0x7fe8680d4680 2024-03-28T21:52:43.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.917+0000 7fe85f400640 1 -- 172.21.15.153:0/1545534616 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe858046020 con 0x7fe8680d4680 2024-03-28T21:52:43.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.918+0000 7fe85f400640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe84406b4d0 0x7fe84406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:43.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.918+0000 7fe85f400640 1 -- 172.21.15.153:0/1545534616 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fe8580acd00 con 0x7fe8680d4680 2024-03-28T21:52:43.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.918+0000 7fe85e000640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe84406b4d0 0x7fe84406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:43.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.919+0000 7fe85e000640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe84406b4d0 0x7fe84406d990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe8680a1f70 tx=0x7fe850008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:43.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:43.922+0000 7fe85f400640 1 -- 172.21.15.153:0/1545534616 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe85804d030 con 0x7fe8680d4680 2024-03-28T21:52:44.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.149+0000 7fe867e00640 1 -- 172.21.15.153:0/1545534616 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe8680cff90 con 0x7fe8680d4680 2024-03-28T21:52:44.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.150+0000 7fe85f400640 1 -- 172.21.15.153:0/1545534616 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fe85807ba60 con 0x7fe8680d4680 2024-03-28T21:52:44.152 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2024-03-28T21:52:44.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.152+0000 7fe867e00640 1 -- 172.21.15.153:0/1545534616 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe84406b4d0 msgr2=0x7fe84406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:44.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.152+0000 7fe867e00640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe84406b4d0 0x7fe84406d990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe8680a1f70 tx=0x7fe850008040 comp rx=0 tx=0).stop 2024-03-28T21:52:44.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.152+0000 7fe867e00640 1 -- 172.21.15.153:0/1545534616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8680d4680 msgr2=0x7fe868157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:44.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.152+0000 7fe867e00640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8680d4680 0x7fe868157440 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe858036040 tx=0x7fe858004a40 comp rx=0 tx=0).stop 2024-03-28T21:52:44.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.152+0000 7fe867e00640 1 -- 172.21.15.153:0/1545534616 shutdown_connections 2024-03-28T21:52:44.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.152+0000 7fe867e00640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe84406b4d0 0x7fe84406d990 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.152+0000 7fe867e00640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe86815e560 0x7fe8680ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.152+0000 7fe867e00640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe86815e180 0x7fe8680ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.152+0000 7fe867e00640 1 --2- 172.21.15.153:0/1545534616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8680d4680 0x7fe868157440 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.152+0000 7fe867e00640 1 -- 172.21.15.153:0/1545534616 >> 172.21.15.153:0/1545534616 conn(0x7fe86809d1e0 msgr2=0x7fe86806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:44.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.153+0000 7fe867e00640 1 -- 172.21.15.153:0/1545534616 shutdown_connections 2024-03-28T21:52:44.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.153+0000 7fe867e00640 1 -- 172.21.15.153:0/1545534616 wait complete. 2024-03-28T21:52:44.180 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-28T21:52:44.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:44.180 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-28T21:52:44.274 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-03-28T21:52:44.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:44.274 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-28T21:52:44.320 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:52:44.320 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:44.379 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:52:44.379 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:44.432 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:52:44.432 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:44.481 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:44.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.687+0000 7f908c200640 1 Processor -- start 2024-03-28T21:52:44.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.688+0000 7f908c200640 1 -- start start 2024-03-28T21:52:44.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.689+0000 7f908c200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f908406dd30 0x7f908406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:44.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.689+0000 7f908c200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9084071cb0 0x7f9084072130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:44.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.689+0000 7f908c200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f90840ad800 0x7f90840adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:44.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.689+0000 7f908c200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f908406e650 con 0x7f90840ad800 2024-03-28T21:52:44.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.689+0000 7f908c200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f90840727d0 con 0x7f9084071cb0 2024-03-28T21:52:44.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.689+0000 7f908c200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f90840b2dd0 con 0x7f908406dd30 2024-03-28T21:52:44.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.690+0000 7f908a200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f90840ad800 0x7f90840adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:44.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.690+0000 7f908a200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f90840ad800 0x7f90840adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48008/0 (socket says 172.21.15.153:48008) 2024-03-28T21:52:44.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.690+0000 7f908a200640 1 -- 172.21.15.153:0/991534721 learned_addr learned my addr 172.21.15.153:0/991534721 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:44.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.690+0000 7f9088e00640 1 --2- 172.21.15.153:0/991534721 >> v2:172.21.15.165:3300/0 conn(0x7f9084071cb0 0x7f9084072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:44.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.690+0000 7f9089800640 1 --2- 172.21.15.153:0/991534721 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f908406dd30 0x7f908406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:44.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.690+0000 7f908a200640 1 -- 172.21.15.153:0/991534721 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f908406dd30 msgr2=0x7f908406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:44.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.690+0000 7f908a200640 1 --2- 172.21.15.153:0/991534721 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f908406dd30 0x7f908406e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.690+0000 7f908a200640 1 -- 172.21.15.153:0/991534721 >> v2:172.21.15.165:3300/0 conn(0x7f9084071cb0 msgr2=0x7f9084072130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:44.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.690+0000 7f908a200640 1 --2- 172.21.15.153:0/991534721 >> v2:172.21.15.165:3300/0 conn(0x7f9084071cb0 0x7f9084072130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.690+0000 7f908a200640 1 -- 172.21.15.153:0/991534721 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90840b30b0 con 0x7f90840ad800 2024-03-28T21:52:44.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.691+0000 7f908a200640 1 --2- 172.21.15.153:0/991534721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90840ad800 0x7f90840adc60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9084073760 tx=0x7f907c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6ed8be2ef63f97 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:44.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.692+0000 7f9083e00640 1 -- 172.21.15.153:0/991534721 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c02ca70 con 0x7f90840ad800 2024-03-28T21:52:44.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.692+0000 7f9083e00640 1 -- 172.21.15.153:0/991534721 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f907c02cc10 con 0x7f90840ad800 2024-03-28T21:52:44.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.692+0000 7f9083e00640 1 -- 172.21.15.153:0/991534721 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c0343f0 con 0x7f90840ad800 2024-03-28T21:52:44.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.692+0000 7f908c200640 1 -- 172.21.15.153:0/991534721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90840ad800 msgr2=0x7f90840adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:44.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.692+0000 7f908c200640 1 --2- 172.21.15.153:0/991534721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90840ad800 0x7f90840adc60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9084073760 tx=0x7f907c02bed0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.692+0000 7f908c200640 1 -- 172.21.15.153:0/991534721 shutdown_connections 2024-03-28T21:52:44.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.692+0000 7f908c200640 1 --2- 172.21.15.153:0/991534721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90840ad800 0x7f90840adc60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.692+0000 7f908c200640 1 --2- 172.21.15.153:0/991534721 >> v2:172.21.15.165:3300/0 conn(0x7f9084071cb0 0x7f9084072130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.692+0000 7f908c200640 1 --2- 172.21.15.153:0/991534721 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f908406dd30 0x7f908406e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.693+0000 7f908c200640 1 -- 172.21.15.153:0/991534721 >> 172.21.15.153:0/991534721 conn(0x7f90840b1a30 msgr2=0x7f90840b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:44.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.693+0000 7f908c200640 1 -- 172.21.15.153:0/991534721 shutdown_connections 2024-03-28T21:52:44.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.693+0000 7f908c200640 1 -- 172.21.15.153:0/991534721 wait complete. 2024-03-28T21:52:44.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.694+0000 7f908c200640 1 Processor -- start 2024-03-28T21:52:44.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.694+0000 7f908c200640 1 -- start start 2024-03-28T21:52:44.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.695+0000 7f908c200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f908406dd30 0x7f908414eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:44.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.695+0000 7f908c200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9084071cb0 0x7f90840cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:44.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.695+0000 7f908c200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90840ad800 0x7f908415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:44.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.695+0000 7f908c200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9084071120 con 0x7f908406dd30 2024-03-28T21:52:44.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.695+0000 7f908c200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9084070fa0 con 0x7f9084071cb0 2024-03-28T21:52:44.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.695+0000 7f908c200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f90841629a0 con 0x7f90840ad800 2024-03-28T21:52:44.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.696+0000 7f9089800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f908406dd30 0x7f908414eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:44.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.696+0000 7f9089800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f908406dd30 0x7f908414eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48022/0 (socket says 172.21.15.153:48022) 2024-03-28T21:52:44.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.696+0000 7f9089800640 1 -- 172.21.15.153:0/2184224600 learned_addr learned my addr 172.21.15.153:0/2184224600 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:44.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.696+0000 7f908a200640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90840ad800 0x7f908415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:44.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.696+0000 7f9088e00640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9084071cb0 0x7f90840cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:44.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.696+0000 7f9089800640 1 -- 172.21.15.153:0/2184224600 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90840ad800 msgr2=0x7f908415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:44.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.696+0000 7f9089800640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90840ad800 0x7f908415a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.696+0000 7f9089800640 1 -- 172.21.15.153:0/2184224600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9084071cb0 msgr2=0x7f90840cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:44.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.696+0000 7f9089800640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9084071cb0 0x7f90840cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.696+0000 7f9089800640 1 -- 172.21.15.153:0/2184224600 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90840cd280 con 0x7f908406dd30 2024-03-28T21:52:44.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.696+0000 7f908a200640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90840ad800 0x7f908415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:44.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.696+0000 7f9088e00640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9084071cb0 0x7f90840cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:44.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.696+0000 7f9089800640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f908406dd30 0x7f908414eff0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f907800d830 tx=0x7f907800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:44.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.697+0000 7f9081600640 1 -- 172.21.15.153:0/2184224600 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078018030 con 0x7f908406dd30 2024-03-28T21:52:44.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.697+0000 7f9081600640 1 -- 172.21.15.153:0/2184224600 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f907800be10 con 0x7f908406dd30 2024-03-28T21:52:44.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.697+0000 7f9081600640 1 -- 172.21.15.153:0/2184224600 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90780098b0 con 0x7f908406dd30 2024-03-28T21:52:44.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.697+0000 7f908c200640 1 -- 172.21.15.153:0/2184224600 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90840cd560 con 0x7f908406dd30 2024-03-28T21:52:44.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.697+0000 7f908c200640 1 -- 172.21.15.153:0/2184224600 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90840cdb20 con 0x7f908406dd30 2024-03-28T21:52:44.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.698+0000 7f908c200640 1 -- 172.21.15.153:0/2184224600 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9084068ff0 con 0x7f908406dd30 2024-03-28T21:52:44.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.699+0000 7f9081600640 1 -- 172.21.15.153:0/2184224600 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f907801b070 con 0x7f908406dd30 2024-03-28T21:52:44.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.700+0000 7f9081600640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f906406b500 0x7f906406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:44.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.700+0000 7f9081600640 1 -- 172.21.15.153:0/2184224600 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f907808a450 con 0x7f908406dd30 2024-03-28T21:52:44.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.700+0000 7f9088e00640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f906406b500 0x7f906406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:44.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.701+0000 7f9088e00640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f906406b500 0x7f906406d9c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9070006fd0 tx=0x7f9070008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:44.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.704+0000 7f9081600640 1 -- 172.21.15.153:0/2184224600 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9078059240 con 0x7f908406dd30 2024-03-28T21:52:44.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.916+0000 7f908c200640 1 -- 172.21.15.153:0/2184224600 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90840cc480 con 0x7f908406dd30 2024-03-28T21:52:44.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.918+0000 7f9081600640 1 -- 172.21.15.153:0/2184224600 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16902 (secure 0 0 0) 0x7f9078058b40 con 0x7f908406dd30 2024-03-28T21:52:44.921 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:44.921 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":24,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:52:43.430328+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:44.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.921+0000 7f908c200640 1 -- 172.21.15.153:0/2184224600 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f906406b500 msgr2=0x7f906406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:44.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.921+0000 7f908c200640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f906406b500 0x7f906406d9c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9070006fd0 tx=0x7f9070008040 comp rx=0 tx=0).stop 2024-03-28T21:52:44.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.921+0000 7f908c200640 1 -- 172.21.15.153:0/2184224600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f908406dd30 msgr2=0x7f908414eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:44.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.921+0000 7f908c200640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f908406dd30 0x7f908414eff0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f907800d830 tx=0x7f907800dcf0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.921+0000 7f908c200640 1 -- 172.21.15.153:0/2184224600 shutdown_connections 2024-03-28T21:52:44.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.921+0000 7f908c200640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f906406b500 0x7f906406d9c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.921+0000 7f908c200640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90840ad800 0x7f908415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.921+0000 7f908c200640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9084071cb0 0x7f90840cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.921+0000 7f908c200640 1 --2- 172.21.15.153:0/2184224600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f908406dd30 0x7f908414eff0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:44.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.921+0000 7f908c200640 1 -- 172.21.15.153:0/2184224600 >> 172.21.15.153:0/2184224600 conn(0x7f90840b1a30 msgr2=0x7f90840adbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:44.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.921+0000 7f908c200640 1 -- 172.21.15.153:0/2184224600 shutdown_connections 2024-03-28T21:52:44.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:44.921+0000 7f908c200640 1 -- 172.21.15.153:0/2184224600 wait complete. 2024-03-28T21:52:44.942 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T21:51:53.863931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T21:51:55.188736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T21:52:44.942 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T21:52:45.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.179+0000 7f0c3cc00640 1 Processor -- start 2024-03-28T21:52:45.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.179+0000 7f0c3cc00640 1 -- start start 2024-03-28T21:52:45.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.180+0000 7f0c3cc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0c3806b880 0x7f0c380cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:45.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.180+0000 7f0c3cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c380d0450 0x7f0c3806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:45.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.180+0000 7f0c3cc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c380b55f0 con 0x7f0c3815e270 2024-03-28T21:52:45.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.180+0000 7f0c3cc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0c380b5f20 con 0x7f0c3806b880 2024-03-28T21:52:45.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.180+0000 7f0c3cc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c380b58d0 con 0x7f0c380d0450 2024-03-28T21:52:45.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.181+0000 7f0c35400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0c3806b880 0x7f0c380cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:45.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.181+0000 7f0c36800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c380d0450 0x7f0c3806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:45.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.181+0000 7f0c35400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0c3806b880 0x7f0c380cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:44022/0 (socket says 172.21.15.153:44022) 2024-03-28T21:52:45.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.181+0000 7f0c35400640 1 -- 172.21.15.153:0/2503982228 learned_addr learned my addr 172.21.15.153:0/2503982228 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:45.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.182+0000 7f0c35400640 1 -- 172.21.15.153:0/2503982228 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c380d0450 msgr2=0x7f0c3806ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.182+0000 7f0c35400640 1 --2- 172.21.15.153:0/2503982228 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c380d0450 0x7f0c3806ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.182+0000 7f0c35400640 1 -- 172.21.15.153:0/2503982228 >> v1:172.21.15.165:6789/0 conn(0x7f0c3815e270 legacy=0x7f0c3806b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.182+0000 7f0c35400640 1 -- 172.21.15.153:0/2503982228 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c380b5bb0 con 0x7f0c3806b880 2024-03-28T21:52:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.182+0000 7f0c36800640 1 --2- 172.21.15.153:0/2503982228 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c380d0450 0x7f0c3806ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:52:45.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.184+0000 7f0c35400640 1 --2- 172.21.15.153:0/2503982228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c3806b880 0x7f0c380cff10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009870 tx=0x7f0c2002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b409b3f601e7acf9 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:45.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.184+0000 7f0c34a00640 1 -- 172.21.15.153:0/2503982228 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c20034070 con 0x7f0c3806b880 2024-03-28T21:52:45.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.184+0000 7f0c34a00640 1 -- 172.21.15.153:0/2503982228 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c20030840 con 0x7f0c3806b880 2024-03-28T21:52:45.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.184+0000 7f0c34a00640 1 -- 172.21.15.153:0/2503982228 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c20030c10 con 0x7f0c3806b880 2024-03-28T21:52:45.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.185+0000 7f0c3cc00640 1 -- 172.21.15.153:0/2503982228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c3806b880 msgr2=0x7f0c380cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:45.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.185+0000 7f0c3cc00640 1 --2- 172.21.15.153:0/2503982228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c3806b880 0x7f0c380cff10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009870 tx=0x7f0c2002b980 comp rx=0 tx=0).stop 2024-03-28T21:52:45.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.185+0000 7f0c3cc00640 1 -- 172.21.15.153:0/2503982228 shutdown_connections 2024-03-28T21:52:45.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.185+0000 7f0c3cc00640 1 --2- 172.21.15.153:0/2503982228 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c380d0450 0x7f0c3806ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.185+0000 7f0c3cc00640 1 --2- 172.21.15.153:0/2503982228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c3806b880 0x7f0c380cff10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.185+0000 7f0c3cc00640 1 -- 172.21.15.153:0/2503982228 >> 172.21.15.153:0/2503982228 conn(0x7f0c380b3430 msgr2=0x7f0c380d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:45.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.186+0000 7f0c3cc00640 1 -- 172.21.15.153:0/2503982228 shutdown_connections 2024-03-28T21:52:45.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.186+0000 7f0c3cc00640 1 -- 172.21.15.153:0/2503982228 wait complete. 2024-03-28T21:52:45.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.188+0000 7f0c3cc00640 1 Processor -- start 2024-03-28T21:52:45.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.189+0000 7f0c3cc00640 1 -- start start 2024-03-28T21:52:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.190+0000 7f0c3cc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c3806b880 0x7f0c38159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.190+0000 7f0c3cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c380d0450 0x7f0c381477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.190+0000 7f0c3cc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c3815e270 0x7f0c381552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.190+0000 7f0c3cc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c380d0a20 con 0x7f0c3815e270 2024-03-28T21:52:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.190+0000 7f0c3cc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0c380d08a0 con 0x7f0c3806b880 2024-03-28T21:52:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.190+0000 7f0c3cc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c380b5210 con 0x7f0c380d0450 2024-03-28T21:52:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.190+0000 7f0c36800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c3815e270 0x7f0c381552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.190+0000 7f0c36800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c3815e270 0x7f0c381552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48030/0 (socket says 172.21.15.153:48030) 2024-03-28T21:52:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.190+0000 7f0c36800640 1 -- 172.21.15.153:0/883384113 learned_addr learned my addr 172.21.15.153:0/883384113 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.191+0000 7f0c35400640 1 --2- 172.21.15.153:0/883384113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c380d0450 0x7f0c381477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:45.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.191+0000 7f0c35e00640 1 --2- 172.21.15.153:0/883384113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c3806b880 0x7f0c38159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.191+0000 7f0c36800640 1 -- 172.21.15.153:0/883384113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c380d0450 msgr2=0x7f0c381477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.191+0000 7f0c36800640 1 --2- 172.21.15.153:0/883384113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c380d0450 0x7f0c381477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.191+0000 7f0c36800640 1 -- 172.21.15.153:0/883384113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c3806b880 msgr2=0x7f0c38159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.191+0000 7f0c36800640 1 --2- 172.21.15.153:0/883384113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c3806b880 0x7f0c38159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.191+0000 7f0c36800640 1 -- 172.21.15.153:0/883384113 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c38147d00 con 0x7f0c3815e270 2024-03-28T21:52:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.191+0000 7f0c36800640 1 --2- 172.21.15.153:0/883384113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c3815e270 0x7f0c381552e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000e930 tx=0x7f0c3000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.191+0000 7f0c2e000640 1 -- 172.21.15.153:0/883384113 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c30017070 con 0x7f0c3815e270 2024-03-28T21:52:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.192+0000 7f0c2e000640 1 -- 172.21.15.153:0/883384113 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c30004020 con 0x7f0c3815e270 2024-03-28T21:52:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.192+0000 7f0c3cc00640 1 -- 172.21.15.153:0/883384113 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c38158690 con 0x7f0c3815e270 2024-03-28T21:52:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.192+0000 7f0c2e000640 1 -- 172.21.15.153:0/883384113 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c300043f0 con 0x7f0c3815e270 2024-03-28T21:52:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.192+0000 7f0c3cc00640 1 -- 172.21.15.153:0/883384113 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c38158c50 con 0x7f0c3815e270 2024-03-28T21:52:45.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.193+0000 7f0c3cc00640 1 -- 172.21.15.153:0/883384113 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c380681c0 con 0x7f0c3815e270 2024-03-28T21:52:45.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.195+0000 7f0c2e000640 1 -- 172.21.15.153:0/883384113 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0c3000c9a0 con 0x7f0c3815e270 2024-03-28T21:52:45.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.195+0000 7f0c2e000640 1 --2- 172.21.15.153:0/883384113 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c1406b4d0 0x7f0c1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:45.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.196+0000 7f0c2e000640 1 -- 172.21.15.153:0/883384113 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f0c3008a060 con 0x7f0c3815e270 2024-03-28T21:52:45.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.196+0000 7f0c35e00640 1 --2- 172.21.15.153:0/883384113 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c1406b4d0 0x7f0c1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:45.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.196+0000 7f0c35e00640 1 --2- 172.21.15.153:0/883384113 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c1406b4d0 0x7f0c1406d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0c38068980 tx=0x7f0c28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:45.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.200+0000 7f0c2e000640 1 -- 172.21.15.153:0/883384113 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0c38147d00 con 0x7f0c3815e270 2024-03-28T21:52:45.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.399+0000 7f0c3cc00640 1 -- 172.21.15.153:0/883384113 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0c38161560 con 0x7f0c3815e270 2024-03-28T21:52:45.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.399+0000 7f0c2e000640 1 -- 172.21.15.153:0/883384113 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f0c30058f20 con 0x7f0c3815e270 2024-03-28T21:52:45.402 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-28T21:52:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.402+0000 7f0c3cc00640 1 -- 172.21.15.153:0/883384113 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c1406b4d0 msgr2=0x7f0c1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.402+0000 7f0c3cc00640 1 --2- 172.21.15.153:0/883384113 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c1406b4d0 0x7f0c1406d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0c38068980 tx=0x7f0c28009040 comp rx=0 tx=0).stop 2024-03-28T21:52:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.402+0000 7f0c3cc00640 1 -- 172.21.15.153:0/883384113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c3815e270 msgr2=0x7f0c381552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.402+0000 7f0c3cc00640 1 --2- 172.21.15.153:0/883384113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c3815e270 0x7f0c381552e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000e930 tx=0x7f0c3000edf0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.402+0000 7f0c3cc00640 1 -- 172.21.15.153:0/883384113 shutdown_connections 2024-03-28T21:52:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.402+0000 7f0c3cc00640 1 --2- 172.21.15.153:0/883384113 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c1406b4d0 0x7f0c1406d990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.402+0000 7f0c3cc00640 1 --2- 172.21.15.153:0/883384113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c3815e270 0x7f0c381552e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.402+0000 7f0c3cc00640 1 --2- 172.21.15.153:0/883384113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c380d0450 0x7f0c381477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.402+0000 7f0c3cc00640 1 --2- 172.21.15.153:0/883384113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c3806b880 0x7f0c38159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.402+0000 7f0c3cc00640 1 -- 172.21.15.153:0/883384113 >> 172.21.15.153:0/883384113 conn(0x7f0c380b3430 msgr2=0x7f0c3815f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:45.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.402+0000 7f0c3cc00640 1 -- 172.21.15.153:0/883384113 shutdown_connections 2024-03-28T21:52:45.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.403+0000 7f0c3cc00640 1 -- 172.21.15.153:0/883384113 wait complete. 2024-03-28T21:52:45.423 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T21:52:45.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.654+0000 7fcf52c00640 1 Processor -- start 2024-03-28T21:52:45.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.654+0000 7fcf52c00640 1 -- start start 2024-03-28T21:52:45.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.656+0000 7fcf52c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c0d0100 0x7fcf4c0d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:45.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.656+0000 7fcf52c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf4c0cda20 con 0x7fcf4c0b4cb0 2024-03-28T21:52:45.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.656+0000 7fcf52c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf4c0d0a20 con 0x7fcf4c0cfc90 2024-03-28T21:52:45.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.656+0000 7fcf52c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcf4c0b2bd0 con 0x7fcf4c0d0100 2024-03-28T21:52:45.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.657+0000 7fcf52200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcf4c0b4cb0 0x7fcf4c0b5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:57216/0 (socket says 172.21.15.153:57216) 2024-03-28T21:52:45.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.657+0000 7fcf52200640 1 -- 172.21.15.153:0/3784177691 learned_addr learned my addr 172.21.15.153:0/3784177691 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:45.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.657+0000 7fcf51800640 1 --2- 172.21.15.153:0/3784177691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c0d0100 0x7fcf4c0d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:45.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.657+0000 7fcf4be00640 1 -- 172.21.15.153:0/3784177691 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966047700 0 0) 0x7fcf4c0cda20 con 0x7fcf4c0b4cb0 2024-03-28T21:52:45.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.657+0000 7fcf4be00640 1 -- 172.21.15.153:0/3784177691 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf34003520 con 0x7fcf4c0b4cb0 2024-03-28T21:52:45.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf4be00640 1 -- 172.21.15.153:0/3784177691 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2864682531 0 0) 0x7fcf34003520 con 0x7fcf4c0b4cb0 2024-03-28T21:52:45.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf4be00640 1 -- 172.21.15.153:0/3784177691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c0d0100 msgr2=0x7fcf4c0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:45.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf4be00640 1 --2- 172.21.15.153:0/3784177691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c0d0100 0x7fcf4c0d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf4be00640 1 -- 172.21.15.153:0/3784177691 >> v1:172.21.15.165:6789/0 conn(0x7fcf4c0cfc90 legacy=0x7fcf4c0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf4be00640 1 -- 172.21.15.153:0/3784177691 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4c0cdcb0 con 0x7fcf4c0b4cb0 2024-03-28T21:52:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf4be00640 1 -- 172.21.15.153:0/3784177691 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fcf440019f0 con 0x7fcf4c0b4cb0 2024-03-28T21:52:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf4be00640 1 -- 172.21.15.153:0/3784177691 >> v1:172.21.15.153:6789/0 conn(0x7fcf4c0b4cb0 legacy=0x7fcf4c0b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf4be00640 1 --2- 172.21.15.153:0/3784177691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf340039e0 0x7fcf34003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf4be00640 1 --2- 172.21.15.153:0/3784177691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c0d0100 0x7fcf34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf4be00640 1 --2- 172.21.15.153:0/3784177691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf34004d40 0x7fcf340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf4be00640 1 -- 172.21.15.153:0/3784177691 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c0b2bd0 con 0x7fcf34004d40 2024-03-28T21:52:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf4be00640 1 -- 172.21.15.153:0/3784177691 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3400baa0 con 0x7fcf340039e0 2024-03-28T21:52:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf4be00640 1 -- 172.21.15.153:0/3784177691 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3400bca0 con 0x7fcf4c0d0100 2024-03-28T21:52:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf52200640 1 --2- 172.21.15.153:0/3784177691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf34004d40 0x7fcf340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf50e00640 1 --2- 172.21.15.153:0/3784177691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c0d0100 0x7fcf34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.658+0000 7fcf51800640 1 --2- 172.21.15.153:0/3784177691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf340039e0 0x7fcf34003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.659+0000 7fcf52200640 1 -- 172.21.15.153:0/3784177691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c0d0100 msgr2=0x7fcf34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.659+0000 7fcf52200640 1 --2- 172.21.15.153:0/3784177691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c0d0100 0x7fcf34004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.659+0000 7fcf52200640 1 -- 172.21.15.153:0/3784177691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf340039e0 msgr2=0x7fcf34003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:45.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.659+0000 7fcf52200640 1 --2- 172.21.15.153:0/3784177691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf340039e0 0x7fcf34003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.659+0000 7fcf52200640 1 -- 172.21.15.153:0/3784177691 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf34003520 con 0x7fcf34004d40 2024-03-28T21:52:45.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.660+0000 7fcf52200640 1 --2- 172.21.15.153:0/3784177691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf34004d40 0x7fcf340051c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcf4400a780 tx=0x7fcf34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed855ccfe724d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:45.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.660+0000 7fcf4be00640 1 -- 172.21.15.153:0/3784177691 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4400a3d0 con 0x7fcf34004d40 2024-03-28T21:52:45.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.660+0000 7fcf4be00640 1 -- 172.21.15.153:0/3784177691 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf44034630 con 0x7fcf34004d40 2024-03-28T21:52:45.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.660+0000 7fcf4be00640 1 -- 172.21.15.153:0/3784177691 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44034a60 con 0x7fcf34004d40 2024-03-28T21:52:45.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.661+0000 7fcf52c00640 1 -- 172.21.15.153:0/3784177691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf34004d40 msgr2=0x7fcf340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:45.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.661+0000 7fcf52c00640 1 --2- 172.21.15.153:0/3784177691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf34004d40 0x7fcf340051c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcf4400a780 tx=0x7fcf34005830 comp rx=0 tx=0).stop 2024-03-28T21:52:45.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.661+0000 7fcf52200640 1 -- 172.21.15.153:0/3784177691 reap_dead start 2024-03-28T21:52:45.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.661+0000 7fcf52c00640 1 -- 172.21.15.153:0/3784177691 shutdown_connections 2024-03-28T21:52:45.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.661+0000 7fcf52c00640 1 -- 172.21.15.153:0/3784177691 >> 172.21.15.153:0/3784177691 conn(0x7fcf4c0b39b0 msgr2=0x7fcf4c0b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:45.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.661+0000 7fcf52c00640 1 -- 172.21.15.153:0/3784177691 shutdown_connections 2024-03-28T21:52:45.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.661+0000 7fcf52c00640 1 -- 172.21.15.153:0/3784177691 wait complete. 2024-03-28T21:52:45.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.662+0000 7fcf52c00640 1 Processor -- start 2024-03-28T21:52:45.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.663+0000 7fcf52c00640 1 -- start start 2024-03-28T21:52:45.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.663+0000 7fcf52c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c1450f0 0x7fcf4c0b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:45.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.663+0000 7fcf52c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf4c0aed70 0x7fcf4c148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:45.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.663+0000 7fcf52c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf4c1454d0 0x7fcf4c0ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:45.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.663+0000 7fcf52c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c0b3100 con 0x7fcf4c1454d0 2024-03-28T21:52:45.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.663+0000 7fcf52c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c0b7de0 con 0x7fcf4c0aed70 2024-03-28T21:52:45.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.664+0000 7fcf52c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcf4c0b33e0 con 0x7fcf4c1450f0 2024-03-28T21:52:45.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.664+0000 7fcf52200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf4c1454d0 0x7fcf4c0ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:45.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.664+0000 7fcf52200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf4c1454d0 0x7fcf4c0ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48046/0 (socket says 172.21.15.153:48046) 2024-03-28T21:52:45.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.664+0000 7fcf52200640 1 -- 172.21.15.153:0/3023230512 learned_addr learned my addr 172.21.15.153:0/3023230512 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:45.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.664+0000 7fcf51800640 1 --2- 172.21.15.153:0/3023230512 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c1450f0 0x7fcf4c0b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:45.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.664+0000 7fcf50e00640 1 --2- 172.21.15.153:0/3023230512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf4c0aed70 0x7fcf4c148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:45.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.664+0000 7fcf52200640 1 -- 172.21.15.153:0/3023230512 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c1450f0 msgr2=0x7fcf4c0b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:45.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.664+0000 7fcf52200640 1 --2- 172.21.15.153:0/3023230512 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c1450f0 0x7fcf4c0b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.664+0000 7fcf52200640 1 -- 172.21.15.153:0/3023230512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf4c0aed70 msgr2=0x7fcf4c148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:45.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.664+0000 7fcf52200640 1 --2- 172.21.15.153:0/3023230512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf4c0aed70 0x7fcf4c148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.664+0000 7fcf52200640 1 -- 172.21.15.153:0/3023230512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4c148a40 con 0x7fcf4c1454d0 2024-03-28T21:52:45.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.665+0000 7fcf52200640 1 --2- 172.21.15.153:0/3023230512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf4c1454d0 0x7fcf4c0ce810 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcf4400a8a0 tx=0x7fcf44001cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:45.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.665+0000 7fcf49600640 1 -- 172.21.15.153:0/3023230512 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4400a3d0 con 0x7fcf4c1454d0 2024-03-28T21:52:45.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.665+0000 7fcf49600640 1 -- 172.21.15.153:0/3023230512 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf44044070 con 0x7fcf4c1454d0 2024-03-28T21:52:45.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.665+0000 7fcf49600640 1 -- 172.21.15.153:0/3023230512 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44001940 con 0x7fcf4c1454d0 2024-03-28T21:52:45.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.665+0000 7fcf52c00640 1 -- 172.21.15.153:0/3023230512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf4c0b0c80 con 0x7fcf4c1454d0 2024-03-28T21:52:45.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.665+0000 7fcf52c00640 1 -- 172.21.15.153:0/3023230512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf4c0b1240 con 0x7fcf4c1454d0 2024-03-28T21:52:45.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.666+0000 7fcf52c00640 1 -- 172.21.15.153:0/3023230512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf4c0d14b0 con 0x7fcf4c1454d0 2024-03-28T21:52:45.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.668+0000 7fcf49600640 1 -- 172.21.15.153:0/3023230512 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fcf4403c070 con 0x7fcf4c1454d0 2024-03-28T21:52:45.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.669+0000 7fcf49600640 1 --2- 172.21.15.153:0/3023230512 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcf2c06b4d0 0x7fcf2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:45.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.670+0000 7fcf49600640 1 -- 172.21.15.153:0/3023230512 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fcf440ab8b0 con 0x7fcf4c1454d0 2024-03-28T21:52:45.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.670+0000 7fcf51800640 1 --2- 172.21.15.153:0/3023230512 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcf2c06b4d0 0x7fcf2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:45.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.670+0000 7fcf51800640 1 --2- 172.21.15.153:0/3023230512 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcf2c06b4d0 0x7fcf2c06d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009a10 tx=0x7fcf40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:45.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.674+0000 7fcf49600640 1 -- 172.21.15.153:0/3023230512 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcf4c0d14b0 con 0x7fcf4c1454d0 2024-03-28T21:52:45.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.870+0000 7fcf52c00640 1 -- 172.21.15.153:0/3023230512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcf4c0681c0 con 0x7fcf4c1454d0 2024-03-28T21:52:45.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.871+0000 7fcf49600640 1 -- 172.21.15.153:0/3023230512 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fcf4c148a40 con 0x7fcf4c1454d0 2024-03-28T21:52:45.874 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-03-28T21:52:45.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.873+0000 7fcf52c00640 1 -- 172.21.15.153:0/3023230512 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcf2c06b4d0 msgr2=0x7fcf2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:45.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.873+0000 7fcf52c00640 1 --2- 172.21.15.153:0/3023230512 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcf2c06b4d0 0x7fcf2c06d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009a10 tx=0x7fcf40008040 comp rx=0 tx=0).stop 2024-03-28T21:52:45.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.873+0000 7fcf52c00640 1 -- 172.21.15.153:0/3023230512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf4c1454d0 msgr2=0x7fcf4c0ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:45.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.873+0000 7fcf52c00640 1 --2- 172.21.15.153:0/3023230512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf4c1454d0 0x7fcf4c0ce810 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcf4400a8a0 tx=0x7fcf44001cf0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.874+0000 7fcf52c00640 1 -- 172.21.15.153:0/3023230512 shutdown_connections 2024-03-28T21:52:45.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.874+0000 7fcf52c00640 1 --2- 172.21.15.153:0/3023230512 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcf2c06b4d0 0x7fcf2c06d990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.874+0000 7fcf52c00640 1 --2- 172.21.15.153:0/3023230512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf4c1454d0 0x7fcf4c0ce810 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.874+0000 7fcf52c00640 1 --2- 172.21.15.153:0/3023230512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf4c0aed70 0x7fcf4c148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.874+0000 7fcf52c00640 1 --2- 172.21.15.153:0/3023230512 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c1450f0 0x7fcf4c0b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:45.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.874+0000 7fcf52c00640 1 -- 172.21.15.153:0/3023230512 >> 172.21.15.153:0/3023230512 conn(0x7fcf4c0b39b0 msgr2=0x7fcf4c06c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:45.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.874+0000 7fcf52c00640 1 -- 172.21.15.153:0/3023230512 shutdown_connections 2024-03-28T21:52:45.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:45.874+0000 7fcf52c00640 1 -- 172.21.15.153:0/3023230512 wait complete. 2024-03-28T21:52:45.894 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T21:52:46.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.100+0000 7f9b7e600640 1 Processor -- start 2024-03-28T21:52:46.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.100+0000 7f9b7e600640 1 -- start start 2024-03-28T21:52:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.103+0000 7f9b7e600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b7815b1c0 0x7f9b7815eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.103+0000 7f9b7e600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9b78070d80 0x7f9b78071200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.103+0000 7f9b7e600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b780ae310 con 0x7f9b780af3b0 2024-03-28T21:52:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.103+0000 7f9b7e600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9b780ae5f0 con 0x7f9b78070d80 2024-03-28T21:52:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.103+0000 7f9b7e600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9b780ae8d0 con 0x7f9b7815b1c0 2024-03-28T21:52:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.104+0000 7f9b77e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9b78070d80 0x7f9b78071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.104+0000 7f9b77e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9b78070d80 0x7f9b78071200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48050/0 (socket says 172.21.15.153:48050) 2024-03-28T21:52:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.104+0000 7f9b77e00640 1 -- 172.21.15.153:0/4212668026 learned_addr learned my addr 172.21.15.153:0/4212668026 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:46.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.104+0000 7f9b77400640 1 --2- 172.21.15.153:0/4212668026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b7815b1c0 0x7f9b7815eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:46.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.104+0000 7f9b77e00640 1 -- 172.21.15.153:0/4212668026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b7815b1c0 msgr2=0x7f9b7815eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:46.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.104+0000 7f9b77e00640 1 --2- 172.21.15.153:0/4212668026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b7815b1c0 0x7f9b7815eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.104+0000 7f9b77e00640 1 -- 172.21.15.153:0/4212668026 >> v1:172.21.15.165:6789/0 conn(0x7f9b780af3b0 legacy=0x7f9b7815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:46.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.104+0000 7f9b77e00640 1 -- 172.21.15.153:0/4212668026 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b780aebb0 con 0x7f9b78070d80 2024-03-28T21:52:46.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.104+0000 7f9b77400640 1 --2- 172.21.15.153:0/4212668026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b7815b1c0 0x7f9b7815eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:46.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.105+0000 7f9b77e00640 1 --2- 172.21.15.153:0/4212668026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b78070d80 0x7f9b78071200 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009870 tx=0x7f9b7002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3be6ec267d3a75 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:46.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.106+0000 7f9b76a00640 1 -- 172.21.15.153:0/4212668026 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70035020 con 0x7f9b78070d80 2024-03-28T21:52:46.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.106+0000 7f9b76a00640 1 -- 172.21.15.153:0/4212668026 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b70031640 con 0x7f9b78070d80 2024-03-28T21:52:46.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.106+0000 7f9b76a00640 1 -- 172.21.15.153:0/4212668026 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7002d040 con 0x7f9b78070d80 2024-03-28T21:52:46.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.107+0000 7f9b7e600640 1 -- 172.21.15.153:0/4212668026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b78070d80 msgr2=0x7f9b78071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:46.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.107+0000 7f9b7e600640 1 --2- 172.21.15.153:0/4212668026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b78070d80 0x7f9b78071200 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009870 tx=0x7f9b7002b8f0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.107+0000 7f9b7e600640 1 -- 172.21.15.153:0/4212668026 shutdown_connections 2024-03-28T21:52:46.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.107+0000 7f9b7e600640 1 --2- 172.21.15.153:0/4212668026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b78070d80 0x7f9b78071200 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.107+0000 7f9b7e600640 1 --2- 172.21.15.153:0/4212668026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b7815b1c0 0x7f9b7815eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.107+0000 7f9b7e600640 1 -- 172.21.15.153:0/4212668026 >> 172.21.15.153:0/4212668026 conn(0x7f9b780b19a0 msgr2=0x7f9b780b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:46.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.107+0000 7f9b7e600640 1 -- 172.21.15.153:0/4212668026 shutdown_connections 2024-03-28T21:52:46.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.107+0000 7f9b7e600640 1 -- 172.21.15.153:0/4212668026 wait complete. 2024-03-28T21:52:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.109+0000 7f9b7e600640 1 Processor -- start 2024-03-28T21:52:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.109+0000 7f9b7e600640 1 -- start start 2024-03-28T21:52:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.110+0000 7f9b7e600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b78070d80 0x7f9b780b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.110+0000 7f9b7e600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b780af3b0 0x7f9b781f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.110+0000 7f9b7e600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b781f7240 0x7f9b7815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.110+0000 7f9b7e600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7815f770 con 0x7f9b780af3b0 2024-03-28T21:52:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.110+0000 7f9b7e600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7806d120 con 0x7f9b78070d80 2024-03-28T21:52:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.110+0000 7f9b7e600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9b7815f8f0 con 0x7f9b781f7240 2024-03-28T21:52:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.110+0000 7f9b6ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b780af3b0 0x7f9b781f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.110+0000 7f9b6ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b780af3b0 0x7f9b781f6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48064/0 (socket says 172.21.15.153:48064) 2024-03-28T21:52:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.110+0000 7f9b6ea00640 1 -- 172.21.15.153:0/4194871825 learned_addr learned my addr 172.21.15.153:0/4194871825 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.110+0000 7f9b77e00640 1 --2- 172.21.15.153:0/4194871825 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b781f7240 0x7f9b7815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.110+0000 7f9b77400640 1 --2- 172.21.15.153:0/4194871825 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b78070d80 0x7f9b780b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.111+0000 7f9b6ea00640 1 -- 172.21.15.153:0/4194871825 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b781f7240 msgr2=0x7f9b7815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.111+0000 7f9b6ea00640 1 --2- 172.21.15.153:0/4194871825 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b781f7240 0x7f9b7815d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.111+0000 7f9b6ea00640 1 -- 172.21.15.153:0/4194871825 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b78070d80 msgr2=0x7f9b780b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.111+0000 7f9b6ea00640 1 --2- 172.21.15.153:0/4194871825 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b78070d80 0x7f9b780b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.111+0000 7f9b6ea00640 1 -- 172.21.15.153:0/4194871825 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b781f76d0 con 0x7f9b780af3b0 2024-03-28T21:52:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.111+0000 7f9b6ea00640 1 --2- 172.21.15.153:0/4194871825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b780af3b0 0x7f9b781f6d00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000c430 tx=0x7f9b6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.111+0000 7f9b6fe00640 1 -- 172.21.15.153:0/4194871825 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b60011790 con 0x7f9b780af3b0 2024-03-28T21:52:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.111+0000 7f9b6fe00640 1 -- 172.21.15.153:0/4194871825 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b60017070 con 0x7f9b780af3b0 2024-03-28T21:52:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.111+0000 7f9b6fe00640 1 -- 172.21.15.153:0/4194871825 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b60011bb0 con 0x7f9b780af3b0 2024-03-28T21:52:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.111+0000 7f9b7e600640 1 -- 172.21.15.153:0/4194871825 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7815e840 con 0x7f9b780af3b0 2024-03-28T21:52:46.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.112+0000 7f9b7e600640 1 -- 172.21.15.153:0/4194871825 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b7809b200 con 0x7f9b780af3b0 2024-03-28T21:52:46.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.113+0000 7f9b7e600640 1 -- 172.21.15.153:0/4194871825 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b78072cc0 con 0x7f9b780af3b0 2024-03-28T21:52:46.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.114+0000 7f9b6fe00640 1 -- 172.21.15.153:0/4194871825 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f9b6001c460 con 0x7f9b780af3b0 2024-03-28T21:52:46.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.115+0000 7f9b6fe00640 1 --2- 172.21.15.153:0/4194871825 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9b5406b4d0 0x7f9b5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:46.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.115+0000 7f9b6fe00640 1 -- 172.21.15.153:0/4194871825 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f9b6008a200 con 0x7f9b780af3b0 2024-03-28T21:52:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.115+0000 7f9b77400640 1 --2- 172.21.15.153:0/4194871825 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9b5406b4d0 0x7f9b5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:46.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.116+0000 7f9b77400640 1 --2- 172.21.15.153:0/4194871825 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9b5406b4d0 0x7f9b5406d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9b680075b0 tx=0x7f9b68007540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:46.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.119+0000 7f9b6fe00640 1 -- 172.21.15.153:0/4194871825 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9b78072cc0 con 0x7f9b780af3b0 2024-03-28T21:52:46.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.314+0000 7f9b7e600640 1 -- 172.21.15.153:0/4194871825 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9b7806cbd0 con 0x7f9b780af3b0 2024-03-28T21:52:46.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.315+0000 7f9b6fe00640 1 -- 172.21.15.153:0/4194871825 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f9b781f76d0 con 0x7f9b780af3b0 2024-03-28T21:52:46.318 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-03-28T21:52:46.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.318+0000 7f9b7e600640 1 -- 172.21.15.153:0/4194871825 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9b5406b4d0 msgr2=0x7f9b5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:46.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.318+0000 7f9b7e600640 1 --2- 172.21.15.153:0/4194871825 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9b5406b4d0 0x7f9b5406d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9b680075b0 tx=0x7f9b68007540 comp rx=0 tx=0).stop 2024-03-28T21:52:46.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.318+0000 7f9b7e600640 1 -- 172.21.15.153:0/4194871825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b780af3b0 msgr2=0x7f9b781f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:46.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.318+0000 7f9b7e600640 1 --2- 172.21.15.153:0/4194871825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b780af3b0 0x7f9b781f6d00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000c430 tx=0x7f9b6000c8f0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.318+0000 7f9b7e600640 1 -- 172.21.15.153:0/4194871825 shutdown_connections 2024-03-28T21:52:46.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.318+0000 7f9b7e600640 1 --2- 172.21.15.153:0/4194871825 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9b5406b4d0 0x7f9b5406d990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.318+0000 7f9b7e600640 1 --2- 172.21.15.153:0/4194871825 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b781f7240 0x7f9b7815d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.318+0000 7f9b7e600640 1 --2- 172.21.15.153:0/4194871825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b780af3b0 0x7f9b781f6d00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.318+0000 7f9b7e600640 1 --2- 172.21.15.153:0/4194871825 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b78070d80 0x7f9b780b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.318+0000 7f9b7e600640 1 -- 172.21.15.153:0/4194871825 >> 172.21.15.153:0/4194871825 conn(0x7f9b780b19a0 msgr2=0x7f9b780d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:46.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.318+0000 7f9b7e600640 1 -- 172.21.15.153:0/4194871825 shutdown_connections 2024-03-28T21:52:46.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.318+0000 7f9b7e600640 1 -- 172.21.15.153:0/4194871825 wait complete. 2024-03-28T21:52:46.338 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-28T21:52:46.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.546+0000 7f0c23e00640 1 Processor -- start 2024-03-28T21:52:46.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.546+0000 7f0c23e00640 1 -- start start 2024-03-28T21:52:46.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.548+0000 7f0c23e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c2415e180 0x7f0c240d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:46.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.548+0000 7f0c23e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c240d4b80 con 0x7f0c240d1070 2024-03-28T21:52:46.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.548+0000 7f0c23e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c240b34e0 con 0x7f0c240d4680 2024-03-28T21:52:46.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.548+0000 7f0c23e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c240d4e60 con 0x7f0c2415e180 2024-03-28T21:52:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.548+0000 7f0c23400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0c240d1070 0x7f0c240b3fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:57228/0 (socket says 172.21.15.153:57228) 2024-03-28T21:52:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.548+0000 7f0c23400640 1 -- 172.21.15.153:0/1330922589 learned_addr learned my addr 172.21.15.153:0/1330922589 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c22a00640 1 --2- 172.21.15.153:0/1330922589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c2415e180 0x7f0c240d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 -- 172.21.15.153:0/1330922589 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189581009 0 0) 0x7f0c240d4b80 con 0x7f0c240d1070 2024-03-28T21:52:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 -- 172.21.15.153:0/1330922589 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c08003520 con 0x7f0c240d1070 2024-03-28T21:52:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 -- 172.21.15.153:0/1330922589 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2237337883 0 0) 0x7f0c08003520 con 0x7f0c240d1070 2024-03-28T21:52:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 -- 172.21.15.153:0/1330922589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c2415e180 msgr2=0x7f0c240d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 --2- 172.21.15.153:0/1330922589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c2415e180 0x7f0c240d2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 -- 172.21.15.153:0/1330922589 >> v1:172.21.15.165:6789/0 conn(0x7f0c240d4680 legacy=0x7f0c240d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 -- 172.21.15.153:0/1330922589 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c240b37c0 con 0x7f0c240d1070 2024-03-28T21:52:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 -- 172.21.15.153:0/1330922589 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f0c1c0019f0 con 0x7f0c240d1070 2024-03-28T21:52:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 -- 172.21.15.153:0/1330922589 >> v1:172.21.15.153:6789/0 conn(0x7f0c240d1070 legacy=0x7f0c240b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 --2- 172.21.15.153:0/1330922589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c080039e0 0x7f0c08003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 --2- 172.21.15.153:0/1330922589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c2415e180 0x7f0c08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 --2- 172.21.15.153:0/1330922589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c08004d40 0x7f0c080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 -- 172.21.15.153:0/1330922589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c240d4e60 con 0x7f0c08004d40 2024-03-28T21:52:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 -- 172.21.15.153:0/1330922589 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0800baf0 con 0x7f0c080039e0 2024-03-28T21:52:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.549+0000 7f0c21600640 1 -- 172.21.15.153:0/1330922589 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c0800bcf0 con 0x7f0c2415e180 2024-03-28T21:52:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.550+0000 7f0c23400640 1 --2- 172.21.15.153:0/1330922589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c08004d40 0x7f0c080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.550+0000 7f0c22000640 1 --2- 172.21.15.153:0/1330922589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c2415e180 0x7f0c08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.550+0000 7f0c22a00640 1 --2- 172.21.15.153:0/1330922589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c080039e0 0x7f0c08003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.550+0000 7f0c23400640 1 -- 172.21.15.153:0/1330922589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c2415e180 msgr2=0x7f0c08004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.550+0000 7f0c23400640 1 --2- 172.21.15.153:0/1330922589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c2415e180 0x7f0c08004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.550+0000 7f0c23400640 1 -- 172.21.15.153:0/1330922589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c080039e0 msgr2=0x7f0c08003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.550+0000 7f0c23400640 1 --2- 172.21.15.153:0/1330922589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c080039e0 0x7f0c08003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.550+0000 7f0c23400640 1 -- 172.21.15.153:0/1330922589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c08003520 con 0x7f0c08004d40 2024-03-28T21:52:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.551+0000 7f0c23400640 1 --2- 172.21.15.153:0/1330922589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c08004d40 0x7f0c080051c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0c240d1870 tx=0x7f0c08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64745cc1951b83b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:46.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.551+0000 7f0c21600640 1 -- 172.21.15.153:0/1330922589 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c00a460 con 0x7f0c08004d40 2024-03-28T21:52:46.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.551+0000 7f0c21600640 1 -- 172.21.15.153:0/1330922589 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c034650 con 0x7f0c08004d40 2024-03-28T21:52:46.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.551+0000 7f0c21600640 1 -- 172.21.15.153:0/1330922589 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c034a40 con 0x7f0c08004d40 2024-03-28T21:52:46.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.552+0000 7f0c23e00640 1 -- 172.21.15.153:0/1330922589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c08004d40 msgr2=0x7f0c080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:46.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.552+0000 7f0c23e00640 1 --2- 172.21.15.153:0/1330922589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c08004d40 0x7f0c080051c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0c240d1870 tx=0x7f0c08005830 comp rx=0 tx=0).stop 2024-03-28T21:52:46.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.552+0000 7f0c23400640 1 -- 172.21.15.153:0/1330922589 reap_dead start 2024-03-28T21:52:46.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.552+0000 7f0c23e00640 1 -- 172.21.15.153:0/1330922589 shutdown_connections 2024-03-28T21:52:46.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.552+0000 7f0c23e00640 1 -- 172.21.15.153:0/1330922589 >> 172.21.15.153:0/1330922589 conn(0x7f0c2409d1e0 msgr2=0x7f0c240d3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:46.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.552+0000 7f0c23e00640 1 -- 172.21.15.153:0/1330922589 shutdown_connections 2024-03-28T21:52:46.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.552+0000 7f0c23e00640 1 -- 172.21.15.153:0/1330922589 wait complete. 2024-03-28T21:52:46.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.554+0000 7f0c23e00640 1 Processor -- start 2024-03-28T21:52:46.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.554+0000 7f0c23e00640 1 -- start start 2024-03-28T21:52:46.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.555+0000 7f0c23e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c241542e0 0x7f0c240cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:46.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.555+0000 7f0c23e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c241546c0 0x7f0c240c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:46.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.555+0000 7f0c23e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c240c8d60 0x7f0c240c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:46.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.555+0000 7f0c23e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c240d1e70 con 0x7f0c240c8d60 2024-03-28T21:52:46.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.555+0000 7f0c23e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0c240d1cf0 con 0x7f0c241542e0 2024-03-28T21:52:46.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.555+0000 7f0c23e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2415e560 con 0x7f0c241546c0 2024-03-28T21:52:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.555+0000 7f0c23400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c240c8d60 0x7f0c240c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.555+0000 7f0c23400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c240c8d60 0x7f0c240c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48078/0 (socket says 172.21.15.153:48078) 2024-03-28T21:52:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.555+0000 7f0c23400640 1 -- 172.21.15.153:0/2505645579 learned_addr learned my addr 172.21.15.153:0/2505645579 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.556+0000 7f0c22a00640 1 --2- 172.21.15.153:0/2505645579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c241542e0 0x7f0c240cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.556+0000 7f0c23400640 1 -- 172.21.15.153:0/2505645579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c241546c0 msgr2=0x7f0c240c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.556+0000 7f0c23400640 1 --2- 172.21.15.153:0/2505645579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c241546c0 0x7f0c240c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.556+0000 7f0c23400640 1 -- 172.21.15.153:0/2505645579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c241542e0 msgr2=0x7f0c240cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.556+0000 7f0c23400640 1 --2- 172.21.15.153:0/2505645579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c241542e0 0x7f0c240cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.556+0000 7f0c23400640 1 -- 172.21.15.153:0/2505645579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c240ce4f0 con 0x7f0c240c8d60 2024-03-28T21:52:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.556+0000 7f0c23400640 1 --2- 172.21.15.153:0/2505645579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c240c8d60 0x7f0c240c91e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c02cc00 tx=0x7f0c240b3990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.556+0000 7f0c1aa00640 1 -- 172.21.15.153:0/2505645579 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c045070 con 0x7f0c240c8d60 2024-03-28T21:52:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.556+0000 7f0c1aa00640 1 -- 172.21.15.153:0/2505645579 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c03a040 con 0x7f0c240c8d60 2024-03-28T21:52:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.556+0000 7f0c1aa00640 1 -- 172.21.15.153:0/2505645579 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c034c00 con 0x7f0c240c8d60 2024-03-28T21:52:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.557+0000 7f0c23e00640 1 -- 172.21.15.153:0/2505645579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c240cdf30 con 0x7f0c240c8d60 2024-03-28T21:52:46.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.557+0000 7f0c23e00640 1 -- 172.21.15.153:0/2505645579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c240b6d60 con 0x7f0c240c8d60 2024-03-28T21:52:46.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.558+0000 7f0c23e00640 1 -- 172.21.15.153:0/2505645579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2404f4b0 con 0x7f0c240c8d60 2024-03-28T21:52:46.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.559+0000 7f0c1aa00640 1 -- 172.21.15.153:0/2505645579 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0c1c048070 con 0x7f0c240c8d60 2024-03-28T21:52:46.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.560+0000 7f0c1aa00640 1 --2- 172.21.15.153:0/2505645579 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c0406b4d0 0x7f0c0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:46.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.560+0000 7f0c1aa00640 1 -- 172.21.15.153:0/2505645579 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f0c1c0abeb0 con 0x7f0c240c8d60 2024-03-28T21:52:46.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.560+0000 7f0c22a00640 1 --2- 172.21.15.153:0/2505645579 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c0406b4d0 0x7f0c0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:46.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.561+0000 7f0c22a00640 1 --2- 172.21.15.153:0/2505645579 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c0406b4d0 0x7f0c0406d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009950 tx=0x7f0c14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:46.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.565+0000 7f0c1aa00640 1 -- 172.21.15.153:0/2505645579 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0c1c07a6f0 con 0x7f0c240c8d60 2024-03-28T21:52:46.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.773+0000 7f0c23e00640 1 -- 172.21.15.153:0/2505645579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0c2406c710 con 0x7f0c240c8d60 2024-03-28T21:52:46.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.774+0000 7f0c1aa00640 1 -- 172.21.15.153:0/2505645579 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f0c1c07e790 con 0x7f0c240c8d60 2024-03-28T21:52:46.776 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2024-03-28T21:52:46.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.776+0000 7f0c23e00640 1 -- 172.21.15.153:0/2505645579 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c0406b4d0 msgr2=0x7f0c0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:46.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.776+0000 7f0c23e00640 1 --2- 172.21.15.153:0/2505645579 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c0406b4d0 0x7f0c0406d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009950 tx=0x7f0c14008040 comp rx=0 tx=0).stop 2024-03-28T21:52:46.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.776+0000 7f0c23e00640 1 -- 172.21.15.153:0/2505645579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c240c8d60 msgr2=0x7f0c240c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:46.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.776+0000 7f0c23e00640 1 --2- 172.21.15.153:0/2505645579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c240c8d60 0x7f0c240c91e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c02cc00 tx=0x7f0c240b3990 comp rx=0 tx=0).stop 2024-03-28T21:52:46.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.776+0000 7f0c23e00640 1 -- 172.21.15.153:0/2505645579 shutdown_connections 2024-03-28T21:52:46.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.776+0000 7f0c23e00640 1 --2- 172.21.15.153:0/2505645579 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c0406b4d0 0x7f0c0406d990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.776+0000 7f0c23e00640 1 --2- 172.21.15.153:0/2505645579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c240c8d60 0x7f0c240c91e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.776+0000 7f0c23e00640 1 --2- 172.21.15.153:0/2505645579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c241546c0 0x7f0c240c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.776+0000 7f0c23e00640 1 --2- 172.21.15.153:0/2505645579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c241542e0 0x7f0c240cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:46.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.776+0000 7f0c23e00640 1 -- 172.21.15.153:0/2505645579 >> 172.21.15.153:0/2505645579 conn(0x7f0c2409d1e0 msgr2=0x7f0c2406cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:46.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.777+0000 7f0c23e00640 1 -- 172.21.15.153:0/2505645579 shutdown_connections 2024-03-28T21:52:46.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:46.777+0000 7f0c23e00640 1 -- 172.21.15.153:0/2505645579 wait complete. 2024-03-28T21:52:46.799 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-28T21:52:46.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:46.799 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-03-28T21:52:46.907 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-03-28T21:52:46.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:46.907 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-28T21:52:46.963 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:52:46.964 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:47.015 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:52:47.015 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:47.063 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:52:47.063 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:47.156 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:47.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.352+0000 7f8402e00640 1 Processor -- start 2024-03-28T21:52:47.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.352+0000 7f8402e00640 1 -- start start 2024-03-28T21:52:47.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.354+0000 7f8402e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f83fc0cde20 0x7f83fc072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:47.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.354+0000 7f8402e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83fc06db60 con 0x7f83fc142720 2024-03-28T21:52:47.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.354+0000 7f8402e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83fc06eff0 con 0x7f83fc072100 2024-03-28T21:52:47.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.354+0000 7f8402e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f83fc071d60 con 0x7f83fc0cde20 2024-03-28T21:52:47.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.354+0000 7f8401a00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f83fc142720 0x7f83fc06e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:57232/0 (socket says 172.21.15.153:57232) 2024-03-28T21:52:47.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.354+0000 7f8401a00640 1 -- 172.21.15.153:0/1198419826 learned_addr learned my addr 172.21.15.153:0/1198419826 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:47.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.354+0000 7f8402400640 1 --2- 172.21.15.153:0/1198419826 >> v2:172.21.15.165:3300/0 conn(0x7f83fc0cde20 0x7f83fc072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:47.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.354+0000 7f83fbe00640 1 -- 172.21.15.153:0/1198419826 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1841893311 0 0) 0x7f83fc06db60 con 0x7f83fc142720 2024-03-28T21:52:47.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.355+0000 7f83fbe00640 1 -- 172.21.15.153:0/1198419826 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83e4003520 con 0x7f83fc142720 2024-03-28T21:52:47.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.355+0000 7f83fbe00640 1 -- 172.21.15.153:0/1198419826 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3648571379 0 0) 0x7f83e4003520 con 0x7f83fc142720 2024-03-28T21:52:47.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.355+0000 7f83fbe00640 1 -- 172.21.15.153:0/1198419826 >> v2:172.21.15.165:3300/0 conn(0x7f83fc0cde20 msgr2=0x7f83fc072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:47.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.355+0000 7f83fbe00640 1 --2- 172.21.15.153:0/1198419826 >> v2:172.21.15.165:3300/0 conn(0x7f83fc0cde20 0x7f83fc072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.355+0000 7f83fbe00640 1 -- 172.21.15.153:0/1198419826 >> v1:172.21.15.165:6789/0 conn(0x7f83fc072100 legacy=0x7f83fc0cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:47.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.355+0000 7f83fbe00640 1 -- 172.21.15.153:0/1198419826 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83fc071a80 con 0x7f83fc142720 2024-03-28T21:52:47.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.355+0000 7f83fbe00640 1 -- 172.21.15.153:0/1198419826 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f83f0001670 con 0x7f83fc142720 2024-03-28T21:52:47.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.355+0000 7f83fbe00640 1 -- 172.21.15.153:0/1198419826 >> v1:172.21.15.153:6789/0 conn(0x7f83fc142720 legacy=0x7f83fc06e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:47.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.355+0000 7f83fbe00640 1 --2- 172.21.15.153:0/1198419826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e4003a20 0x7f83e4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:47.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.355+0000 7f83fbe00640 1 --2- 172.21.15.153:0/1198419826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83e4004800 0x7f83e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:47.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.355+0000 7f83fbe00640 1 --2- 172.21.15.153:0/1198419826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4005230 0x7f83e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:47.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.355+0000 7f83fbe00640 1 -- 172.21.15.153:0/1198419826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f83e400c160 con 0x7f83e4005230 2024-03-28T21:52:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.355+0000 7f83fbe00640 1 -- 172.21.15.153:0/1198419826 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f83e400c310 con 0x7f83e4004800 2024-03-28T21:52:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.355+0000 7f83fbe00640 1 -- 172.21.15.153:0/1198419826 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f83e400c510 con 0x7f83e4003a20 2024-03-28T21:52:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.356+0000 7f8402400640 1 --2- 172.21.15.153:0/1198419826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4005230 0x7f83e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.356+0000 7f8401a00640 1 --2- 172.21.15.153:0/1198419826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e4003a20 0x7f83e4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.356+0000 7f8401000640 1 --2- 172.21.15.153:0/1198419826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83e4004800 0x7f83e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.356+0000 7f8402400640 1 -- 172.21.15.153:0/1198419826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e4003a20 msgr2=0x7f83e4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.356+0000 7f8402400640 1 --2- 172.21.15.153:0/1198419826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e4003a20 0x7f83e4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.356+0000 7f8402400640 1 -- 172.21.15.153:0/1198419826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83e4004800 msgr2=0x7f83e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.356+0000 7f8402400640 1 --2- 172.21.15.153:0/1198419826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83e4004800 0x7f83e4004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.356+0000 7f8402400640 1 -- 172.21.15.153:0/1198419826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e4003520 con 0x7f83e4005230 2024-03-28T21:52:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.357+0000 7f8402400640 1 -- 172.21.15.153:0/1198419826 reap_dead start 2024-03-28T21:52:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.357+0000 7f8402400640 1 --2- 172.21.15.153:0/1198419826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4005230 0x7f83e400b9c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009fc0 tx=0x7f83e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4529434a1b91ef4 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.357+0000 7f83fbe00640 1 -- 172.21.15.153:0/1198419826 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f4009c10 con 0x7f83e4005230 2024-03-28T21:52:47.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.357+0000 7f83fbe00640 1 -- 172.21.15.153:0/1198419826 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f4003bd0 con 0x7f83e4005230 2024-03-28T21:52:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.357+0000 7f83fbe00640 1 -- 172.21.15.153:0/1198419826 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f402c990 con 0x7f83e4005230 2024-03-28T21:52:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.358+0000 7f8402e00640 1 -- 172.21.15.153:0/1198419826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4005230 msgr2=0x7f83e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.358+0000 7f8402e00640 1 --2- 172.21.15.153:0/1198419826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4005230 0x7f83e400b9c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009fc0 tx=0x7f83e4005830 comp rx=0 tx=0).stop 2024-03-28T21:52:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.358+0000 7f8402e00640 1 -- 172.21.15.153:0/1198419826 shutdown_connections 2024-03-28T21:52:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.358+0000 7f8402e00640 1 --2- 172.21.15.153:0/1198419826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4005230 0x7f83e400b9c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.358+0000 7f8402e00640 1 -- 172.21.15.153:0/1198419826 >> 172.21.15.153:0/1198419826 conn(0x7f83fc0b1890 msgr2=0x7f83fc0b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.358+0000 7f8402e00640 1 -- 172.21.15.153:0/1198419826 shutdown_connections 2024-03-28T21:52:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.358+0000 7f8402e00640 1 -- 172.21.15.153:0/1198419826 wait complete. 2024-03-28T21:52:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.360+0000 7f8402e00640 1 Processor -- start 2024-03-28T21:52:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.360+0000 7f8402e00640 1 -- start start 2024-03-28T21:52:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.361+0000 7f8402e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4005230 0x7f83fc1e48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.361+0000 7f8402e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83fc142c80 0x7f83fc15b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.361+0000 7f8402e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83fc143100 0x7f83fc15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.361+0000 7f8402e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc06e0e0 con 0x7f83e4005230 2024-03-28T21:52:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.361+0000 7f8402e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc142b00 con 0x7f83fc142c80 2024-03-28T21:52:47.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.361+0000 7f8402e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f83fc06e3c0 con 0x7f83fc143100 2024-03-28T21:52:47.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.361+0000 7f8401a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4005230 0x7f83fc1e48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:47.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.361+0000 7f8401a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4005230 0x7f83fc1e48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48092/0 (socket says 172.21.15.153:48092) 2024-03-28T21:52:47.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.361+0000 7f8401a00640 1 -- 172.21.15.153:0/415736597 learned_addr learned my addr 172.21.15.153:0/415736597 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:47.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.361+0000 7f8402400640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83fc143100 0x7f83fc15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:47.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.361+0000 7f8401000640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83fc142c80 0x7f83fc15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:47.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.362+0000 7f8401a00640 1 -- 172.21.15.153:0/415736597 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83fc143100 msgr2=0x7f83fc15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:47.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.362+0000 7f8401a00640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83fc143100 0x7f83fc15b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.362+0000 7f8401a00640 1 -- 172.21.15.153:0/415736597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83fc142c80 msgr2=0x7f83fc15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:47.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.362+0000 7f8401a00640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83fc142c80 0x7f83fc15b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.362+0000 7f8401a00640 1 -- 172.21.15.153:0/415736597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83fc144690 con 0x7f83e4005230 2024-03-28T21:52:47.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.362+0000 7f8401000640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83fc142c80 0x7f83fc15b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:47.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.362+0000 7f8401a00640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4005230 0x7f83fc1e48d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f83f000e730 tx=0x7f83f000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:47.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.362+0000 7f83f9600640 1 -- 172.21.15.153:0/415736597 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f000ee40 con 0x7f83e4005230 2024-03-28T21:52:47.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.362+0000 7f83f9600640 1 -- 172.21.15.153:0/415736597 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f0018070 con 0x7f83e4005230 2024-03-28T21:52:47.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.362+0000 7f83f9600640 1 -- 172.21.15.153:0/415736597 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f000cab0 con 0x7f83e4005230 2024-03-28T21:52:47.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.362+0000 7f8402e00640 1 -- 172.21.15.153:0/415736597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83fc1435f0 con 0x7f83e4005230 2024-03-28T21:52:47.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.362+0000 7f8402e00640 1 -- 172.21.15.153:0/415736597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83fc143bb0 con 0x7f83e4005230 2024-03-28T21:52:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.364+0000 7f8402e00640 1 -- 172.21.15.153:0/415736597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83fc04f520 con 0x7f83e4005230 2024-03-28T21:52:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.364+0000 7f83f9600640 1 -- 172.21.15.153:0/415736597 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f83f000cc50 con 0x7f83e4005230 2024-03-28T21:52:47.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.365+0000 7f83f9600640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f83dc06b4d0 0x7f83dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:47.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.365+0000 7f83f9600640 1 -- 172.21.15.153:0/415736597 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f83f008a070 con 0x7f83e4005230 2024-03-28T21:52:47.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.366+0000 7f8401000640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f83dc06b4d0 0x7f83dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:47.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.366+0000 7f8401000640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f83dc06b4d0 0x7f83dc06d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f83e8000c00 tx=0x7f83e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:47.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.373+0000 7f83f9600640 1 -- 172.21.15.153:0/415736597 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f83f0058e70 con 0x7f83e4005230 2024-03-28T21:52:47.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.571+0000 7f8402e00640 1 -- 172.21.15.153:0/415736597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83fc074180 con 0x7f83e4005230 2024-03-28T21:52:47.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.573+0000 7f83f9600640 1 -- 172.21.15.153:0/415736597 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16902 (secure 0 0 0) 0x7f83f0058770 con 0x7f83e4005230 2024-03-28T21:52:47.575 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:47.576 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":24,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:52:43.430328+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:47.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.575+0000 7f8402e00640 1 -- 172.21.15.153:0/415736597 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f83dc06b4d0 msgr2=0x7f83dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:47.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.575+0000 7f8402e00640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f83dc06b4d0 0x7f83dc06d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f83e8000c00 tx=0x7f83e8009040 comp rx=0 tx=0).stop 2024-03-28T21:52:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.575+0000 7f8402e00640 1 -- 172.21.15.153:0/415736597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4005230 msgr2=0x7f83fc1e48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.575+0000 7f8402e00640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4005230 0x7f83fc1e48d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f83f000e730 tx=0x7f83f000ebf0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.575+0000 7f8402e00640 1 -- 172.21.15.153:0/415736597 shutdown_connections 2024-03-28T21:52:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.575+0000 7f8402e00640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f83dc06b4d0 0x7f83dc06d990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.575+0000 7f8402e00640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83fc143100 0x7f83fc15b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.575+0000 7f8402e00640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83fc142c80 0x7f83fc15b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.575+0000 7f8402e00640 1 --2- 172.21.15.153:0/415736597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4005230 0x7f83fc1e48d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.575+0000 7f8402e00640 1 -- 172.21.15.153:0/415736597 >> 172.21.15.153:0/415736597 conn(0x7f83fc0b1890 msgr2=0x7f83fc0b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.576+0000 7f8402e00640 1 -- 172.21.15.153:0/415736597 shutdown_connections 2024-03-28T21:52:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.576+0000 7f8402e00640 1 -- 172.21.15.153:0/415736597 wait complete. 2024-03-28T21:52:47.598 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T21:51:53.863931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T21:51:55.188736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T21:52:47.598 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T21:52:47.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.795+0000 7f1e4b200640 1 Processor -- start 2024-03-28T21:52:47.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.795+0000 7f1e4b200640 1 -- start start 2024-03-28T21:52:47.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.796+0000 7f1e4b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e4c141db0 0x7f1e4c0ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:47.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.796+0000 7f1e4b200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e4c0ce7e0 0x7f1e4c0712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:47.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.796+0000 7f1e4b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4c070df0 con 0x7f1e4c13ef10 2024-03-28T21:52:47.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.796+0000 7f1e4b200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1e4c13f2f0 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.796+0000 7f1e4b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4c0cf060 con 0x7f1e4c141db0 2024-03-28T21:52:47.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.797+0000 7f1e4a800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e4c0ce7e0 0x7f1e4c0712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:47.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.797+0000 7f1e4a800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e4c0ce7e0 0x7f1e4c0712a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48098/0 (socket says 172.21.15.153:48098) 2024-03-28T21:52:47.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.797+0000 7f1e4a800640 1 -- 172.21.15.153:0/3075057400 learned_addr learned my addr 172.21.15.153:0/3075057400 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:47.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.797+0000 7f1e43e00640 1 --2- 172.21.15.153:0/3075057400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e4c141db0 0x7f1e4c0ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:47.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.797+0000 7f1e4a800640 1 -- 172.21.15.153:0/3075057400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e4c141db0 msgr2=0x7f1e4c0ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:47.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.797+0000 7f1e4a800640 1 --2- 172.21.15.153:0/3075057400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e4c141db0 0x7f1e4c0ce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.797+0000 7f1e4a800640 1 -- 172.21.15.153:0/3075057400 >> v1:172.21.15.165:6789/0 conn(0x7f1e4c13ef10 legacy=0x7f1e4c1416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:47.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.797+0000 7f1e4a800640 1 -- 172.21.15.153:0/3075057400 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c0cf340 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.799+0000 7f1e4a800640 1 --2- 172.21.15.153:0/3075057400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e4c0ce7e0 0x7f1e4c0712a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009e50 tx=0x7f1e4402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a919ad0d04fc6767 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:47.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.799+0000 7f1e49400640 1 -- 172.21.15.153:0/3075057400 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4402ca70 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.799+0000 7f1e49400640 1 -- 172.21.15.153:0/3075057400 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4402cc10 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.799+0000 7f1e49400640 1 -- 172.21.15.153:0/3075057400 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440343f0 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.800+0000 7f1e4b200640 1 -- 172.21.15.153:0/3075057400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e4c0ce7e0 msgr2=0x7f1e4c0712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:47.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.800+0000 7f1e4b200640 1 --2- 172.21.15.153:0/3075057400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e4c0ce7e0 0x7f1e4c0712a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009e50 tx=0x7f1e4402bed0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.800+0000 7f1e4b200640 1 -- 172.21.15.153:0/3075057400 shutdown_connections 2024-03-28T21:52:47.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.800+0000 7f1e4b200640 1 --2- 172.21.15.153:0/3075057400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e4c0ce7e0 0x7f1e4c0712a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.800+0000 7f1e4b200640 1 --2- 172.21.15.153:0/3075057400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e4c141db0 0x7f1e4c0ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.800+0000 7f1e4b200640 1 -- 172.21.15.153:0/3075057400 >> 172.21.15.153:0/3075057400 conn(0x7f1e4c0b1820 msgr2=0x7f1e4c0b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:47.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.800+0000 7f1e4b200640 1 -- 172.21.15.153:0/3075057400 shutdown_connections 2024-03-28T21:52:47.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.800+0000 7f1e4b200640 1 -- 172.21.15.153:0/3075057400 wait complete. 2024-03-28T21:52:47.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.802+0000 7f1e4b200640 1 Processor -- start 2024-03-28T21:52:47.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.802+0000 7f1e4b200640 1 -- start start 2024-03-28T21:52:47.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.803+0000 7f1e4b200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e4c0ce7e0 0x7f1e4c159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:47.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.803+0000 7f1e4b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e4c13ef10 0x7f1e4c13d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:47.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.803+0000 7f1e4b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e4c141db0 0x7f1e4c13f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:47.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.803+0000 7f1e4b200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c0cec50 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.803+0000 7f1e4b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c0cf900 con 0x7f1e4c13ef10 2024-03-28T21:52:47.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.803+0000 7f1e4b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4c0cedd0 con 0x7f1e4c141db0 2024-03-28T21:52:47.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.803+0000 7f1e49e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e4c0ce7e0 0x7f1e4c159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:47.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.804+0000 7f1e49e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e4c0ce7e0 0x7f1e4c159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48104/0 (socket says 172.21.15.153:48104) 2024-03-28T21:52:47.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.804+0000 7f1e49e00640 1 -- 172.21.15.153:0/3066514958 learned_addr learned my addr 172.21.15.153:0/3066514958 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:47.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.804+0000 7f1e4a800640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e4c141db0 0x7f1e4c13f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:47.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.804+0000 7f1e43e00640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e4c13ef10 0x7f1e4c13d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:47.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.804+0000 7f1e49e00640 1 -- 172.21.15.153:0/3066514958 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e4c141db0 msgr2=0x7f1e4c13f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:47.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.804+0000 7f1e49e00640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e4c141db0 0x7f1e4c13f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.804+0000 7f1e49e00640 1 -- 172.21.15.153:0/3066514958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e4c13ef10 msgr2=0x7f1e4c13d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:47.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.804+0000 7f1e49e00640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e4c13ef10 0x7f1e4c13d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:47.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.804+0000 7f1e49e00640 1 -- 172.21.15.153:0/3066514958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c140240 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.804+0000 7f1e43e00640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e4c13ef10 0x7f1e4c13d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:47.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.804+0000 7f1e49e00640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e4c0ce7e0 0x7f1e4c159120 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c430 tx=0x7f1e3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:47.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.805+0000 7f1e42000640 1 -- 172.21.15.153:0/3066514958 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c011790 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.805+0000 7f1e42000640 1 -- 172.21.15.153:0/3066514958 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c017070 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.805+0000 7f1e4b200640 1 -- 172.21.15.153:0/3066514958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4c13ff60 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.805+0000 7f1e42000640 1 -- 172.21.15.153:0/3066514958 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c011bb0 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.805+0000 7f1e4b200640 1 -- 172.21.15.153:0/3066514958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4c13c980 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.806+0000 7f1e4b200640 1 -- 172.21.15.153:0/3066514958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e4c068ff0 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.807+0000 7f1e42000640 1 -- 172.21.15.153:0/3066514958 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f1e3c01c460 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.808+0000 7f1e42000640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1e2806b500 0x7f1e2806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:47.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.808+0000 7f1e42000640 1 -- 172.21.15.153:0/3066514958 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f1e3c08a0b0 con 0x7f1e4c0ce7e0 2024-03-28T21:52:47.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.808+0000 7f1e43e00640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1e2806b500 0x7f1e2806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:47.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.809+0000 7f1e43e00640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1e2806b500 0x7f1e2806d9c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c160630 tx=0x7f1e34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:47.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:47.812+0000 7f1e42000640 1 -- 172.21.15.153:0/3066514958 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1e3c058ea0 con 0x7f1e4c0ce7e0 2024-03-28T21:52:48.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.034+0000 7f1e4b200640 1 -- 172.21.15.153:0/3066514958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1e4c06f030 con 0x7f1e4c0ce7e0 2024-03-28T21:52:48.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.035+0000 7f1e42000640 1 -- 172.21.15.153:0/3066514958 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f1e3c0587a0 con 0x7f1e4c0ce7e0 2024-03-28T21:52:48.038 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-28T21:52:48.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.038+0000 7f1e4b200640 1 -- 172.21.15.153:0/3066514958 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1e2806b500 msgr2=0x7f1e2806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.038+0000 7f1e4b200640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1e2806b500 0x7f1e2806d9c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c160630 tx=0x7f1e34008040 comp rx=0 tx=0).stop 2024-03-28T21:52:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.038+0000 7f1e4b200640 1 -- 172.21.15.153:0/3066514958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e4c0ce7e0 msgr2=0x7f1e4c159120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.038+0000 7f1e4b200640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e4c0ce7e0 0x7f1e4c159120 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c430 tx=0x7f1e3c00c8f0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.038+0000 7f1e4b200640 1 -- 172.21.15.153:0/3066514958 shutdown_connections 2024-03-28T21:52:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.038+0000 7f1e4b200640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f1e2806b500 0x7f1e2806d9c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.038+0000 7f1e4b200640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e4c141db0 0x7f1e4c13f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.038+0000 7f1e4b200640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e4c13ef10 0x7f1e4c13d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.038+0000 7f1e4b200640 1 --2- 172.21.15.153:0/3066514958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e4c0ce7e0 0x7f1e4c159120 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.038+0000 7f1e4b200640 1 -- 172.21.15.153:0/3066514958 >> 172.21.15.153:0/3066514958 conn(0x7f1e4c0b1820 msgr2=0x7f1e4c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.038+0000 7f1e4b200640 1 -- 172.21.15.153:0/3066514958 shutdown_connections 2024-03-28T21:52:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.038+0000 7f1e4b200640 1 -- 172.21.15.153:0/3066514958 wait complete. 2024-03-28T21:52:48.059 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T21:52:48.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.255+0000 7ff0a3200640 1 Processor -- start 2024-03-28T21:52:48.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.255+0000 7ff0a3200640 1 -- start start 2024-03-28T21:52:48.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.257+0000 7ff0a3200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff0a415e0e0 0x7ff0a40d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.257+0000 7ff0a3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0a40d2100 0x7ff0a40d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.257+0000 7ff0a3200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff0a40d08c0 0x7ff0a40d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.257+0000 7ff0a3200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a40cff40 con 0x7ff0a40d08c0 2024-03-28T21:52:48.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.257+0000 7ff0a3200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a40cf980 con 0x7ff0a415e0e0 2024-03-28T21:52:48.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.257+0000 7ff0a3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a40cfc60 con 0x7ff0a40d2100 2024-03-28T21:52:48.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.257+0000 7ff0a2800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff0a40d08c0 0x7ff0a40d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:48.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.257+0000 7ff0a2800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff0a40d08c0 0x7ff0a40d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48114/0 (socket says 172.21.15.153:48114) 2024-03-28T21:52:48.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.257+0000 7ff0a2800640 1 -- 172.21.15.153:0/3335371834 learned_addr learned my addr 172.21.15.153:0/3335371834 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:48.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.258+0000 7ff0a2800640 1 -- 172.21.15.153:0/3335371834 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0a40d2100 msgr2=0x7ff0a40d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:48.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.258+0000 7ff0a2800640 1 --2- 172.21.15.153:0/3335371834 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0a40d2100 0x7ff0a40d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.258+0000 7ff0a2800640 1 -- 172.21.15.153:0/3335371834 >> v2:172.21.15.165:3300/0 conn(0x7ff0a415e0e0 msgr2=0x7ff0a40d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:48.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.258+0000 7ff0a2800640 1 --2- 172.21.15.153:0/3335371834 >> v2:172.21.15.165:3300/0 conn(0x7ff0a415e0e0 0x7ff0a40d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.258+0000 7ff0a2800640 1 -- 172.21.15.153:0/3335371834 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a40c7be0 con 0x7ff0a40d08c0 2024-03-28T21:52:48.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.259+0000 7ff0a2800640 1 --2- 172.21.15.153:0/3335371834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0a40d08c0 0x7ff0a40d0d50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff0a406e150 tx=0x7ff09c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67281e5159527a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:48.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.259+0000 7ff0a1400640 1 -- 172.21.15.153:0/3335371834 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c02ca80 con 0x7ff0a40d08c0 2024-03-28T21:52:48.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.259+0000 7ff0a1400640 1 -- 172.21.15.153:0/3335371834 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff09c02cc20 con 0x7ff0a40d08c0 2024-03-28T21:52:48.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.259+0000 7ff0a1400640 1 -- 172.21.15.153:0/3335371834 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c0343f0 con 0x7ff0a40d08c0 2024-03-28T21:52:48.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.260+0000 7ff0a3200640 1 -- 172.21.15.153:0/3335371834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0a40d08c0 msgr2=0x7ff0a40d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:48.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.260+0000 7ff0a3200640 1 --2- 172.21.15.153:0/3335371834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0a40d08c0 0x7ff0a40d0d50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff0a406e150 tx=0x7ff09c02bee0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.260+0000 7ff0a3200640 1 -- 172.21.15.153:0/3335371834 shutdown_connections 2024-03-28T21:52:48.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.260+0000 7ff0a3200640 1 --2- 172.21.15.153:0/3335371834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0a40d08c0 0x7ff0a40d0d50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.260+0000 7ff0a3200640 1 --2- 172.21.15.153:0/3335371834 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0a40d2100 0x7ff0a40d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.260+0000 7ff0a3200640 1 --2- 172.21.15.153:0/3335371834 >> v2:172.21.15.165:3300/0 conn(0x7ff0a415e0e0 0x7ff0a40d1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.260+0000 7ff0a3200640 1 -- 172.21.15.153:0/3335371834 >> 172.21.15.153:0/3335371834 conn(0x7ff0a40d3ff0 msgr2=0x7ff0a40d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:48.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.260+0000 7ff0a3200640 1 -- 172.21.15.153:0/3335371834 shutdown_connections 2024-03-28T21:52:48.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.260+0000 7ff0a3200640 1 -- 172.21.15.153:0/3335371834 wait complete. 2024-03-28T21:52:48.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.262+0000 7ff0a3200640 1 Processor -- start 2024-03-28T21:52:48.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.262+0000 7ff0a3200640 1 -- start start 2024-03-28T21:52:48.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.263+0000 7ff0a3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0a40d08c0 0x7ff0a40ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.263+0000 7ff0a3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0a40d2100 0x7ff0a406cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.263+0000 7ff0a3200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0a415e0e0 0x7ff0a40b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.263+0000 7ff0a3200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a40cf610 con 0x7ff0a415e0e0 2024-03-28T21:52:48.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.263+0000 7ff0a3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a40d4d40 con 0x7ff0a40d2100 2024-03-28T21:52:48.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.263+0000 7ff0a3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a415e4c0 con 0x7ff0a40d08c0 2024-03-28T21:52:48.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.263+0000 7ff0a2800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0a415e0e0 0x7ff0a40b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:48.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.263+0000 7ff0a2800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0a415e0e0 0x7ff0a40b1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48116/0 (socket says 172.21.15.153:48116) 2024-03-28T21:52:48.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.263+0000 7ff0a2800640 1 -- 172.21.15.153:0/3728411613 learned_addr learned my addr 172.21.15.153:0/3728411613 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:48.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.263+0000 7ff0a1e00640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0a40d08c0 0x7ff0a40ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:48.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.263+0000 7ff0a2800640 1 -- 172.21.15.153:0/3728411613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0a40d08c0 msgr2=0x7ff0a40ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:48.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.263+0000 7ff0a2800640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0a40d08c0 0x7ff0a40ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.263+0000 7ff0a2800640 1 -- 172.21.15.153:0/3728411613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0a40d2100 msgr2=0x7ff0a406cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:48.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.263+0000 7ff099400640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0a40d2100 0x7ff0a406cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:48.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.264+0000 7ff0a2800640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0a40d2100 0x7ff0a406cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.264+0000 7ff0a2800640 1 -- 172.21.15.153:0/3728411613 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a40cd3d0 con 0x7ff0a415e0e0 2024-03-28T21:52:48.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.264+0000 7ff0a1e00640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0a40d08c0 0x7ff0a40ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:48.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.264+0000 7ff0a2800640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0a415e0e0 0x7ff0a40b1930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff09c036040 tx=0x7ff09c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:48.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.264+0000 7ff09aa00640 1 -- 172.21.15.153:0/3728411613 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c043020 con 0x7ff0a415e0e0 2024-03-28T21:52:48.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.264+0000 7ff09aa00640 1 -- 172.21.15.153:0/3728411613 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff09c03e450 con 0x7ff0a415e0e0 2024-03-28T21:52:48.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.264+0000 7ff09aa00640 1 -- 172.21.15.153:0/3728411613 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c03e820 con 0x7ff0a415e0e0 2024-03-28T21:52:48.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.264+0000 7ff0a3200640 1 -- 172.21.15.153:0/3728411613 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a40cd6b0 con 0x7ff0a415e0e0 2024-03-28T21:52:48.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.264+0000 7ff0a3200640 1 -- 172.21.15.153:0/3728411613 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a40cb310 con 0x7ff0a415e0e0 2024-03-28T21:52:48.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.266+0000 7ff0a3200640 1 -- 172.21.15.153:0/3728411613 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a4068ff0 con 0x7ff0a415e0e0 2024-03-28T21:52:48.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.267+0000 7ff09aa00640 1 -- 172.21.15.153:0/3728411613 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff09c046020 con 0x7ff0a415e0e0 2024-03-28T21:52:48.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.268+0000 7ff09aa00640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff08006b500 0x7ff08006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.268+0000 7ff09aa00640 1 -- 172.21.15.153:0/3728411613 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7ff09c0ac8d0 con 0x7ff0a415e0e0 2024-03-28T21:52:48.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.268+0000 7ff0a1e00640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff08006b500 0x7ff08006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:48.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.269+0000 7ff0a1e00640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff08006b500 0x7ff08006d9c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff094006fd0 tx=0x7ff094008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:48.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.273+0000 7ff09aa00640 1 -- 172.21.15.153:0/3728411613 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff09c04d070 con 0x7ff0a415e0e0 2024-03-28T21:52:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.472+0000 7ff0a3200640 1 -- 172.21.15.153:0/3728411613 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff0a40b9e30 con 0x7ff0a415e0e0 2024-03-28T21:52:48.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.473+0000 7ff09aa00640 1 -- 172.21.15.153:0/3728411613 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7ff09c07b760 con 0x7ff0a415e0e0 2024-03-28T21:52:48.478 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-03-28T21:52:48.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.475+0000 7ff0a3200640 1 -- 172.21.15.153:0/3728411613 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff08006b500 msgr2=0x7ff08006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:48.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.475+0000 7ff0a3200640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff08006b500 0x7ff08006d9c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff094006fd0 tx=0x7ff094008040 comp rx=0 tx=0).stop 2024-03-28T21:52:48.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.475+0000 7ff0a3200640 1 -- 172.21.15.153:0/3728411613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0a415e0e0 msgr2=0x7ff0a40b1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:48.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.475+0000 7ff0a3200640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0a415e0e0 0x7ff0a40b1930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff09c036040 tx=0x7ff09c004a40 comp rx=0 tx=0).stop 2024-03-28T21:52:48.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.476+0000 7ff0a3200640 1 -- 172.21.15.153:0/3728411613 shutdown_connections 2024-03-28T21:52:48.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.476+0000 7ff0a3200640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff08006b500 0x7ff08006d9c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.476+0000 7ff0a3200640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0a415e0e0 0x7ff0a40b1930 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.476+0000 7ff0a3200640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0a40d2100 0x7ff0a406cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.476+0000 7ff0a3200640 1 --2- 172.21.15.153:0/3728411613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0a40d08c0 0x7ff0a40ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.476+0000 7ff0a3200640 1 -- 172.21.15.153:0/3728411613 >> 172.21.15.153:0/3728411613 conn(0x7ff0a40d3ff0 msgr2=0x7ff0a415a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:48.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.476+0000 7ff0a3200640 1 -- 172.21.15.153:0/3728411613 shutdown_connections 2024-03-28T21:52:48.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.476+0000 7ff0a3200640 1 -- 172.21.15.153:0/3728411613 wait complete. 2024-03-28T21:52:48.499 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T21:52:48.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.706+0000 7fee28200640 1 Processor -- start 2024-03-28T21:52:48.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.706+0000 7fee28200640 1 -- start start 2024-03-28T21:52:48.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.708+0000 7fee28200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee200cef30 0x7fee20071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.708+0000 7fee28200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee20070f20 con 0x7fee200acd80 2024-03-28T21:52:48.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.708+0000 7fee28200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee20071200 con 0x7fee200728c0 2024-03-28T21:52:48.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.708+0000 7fee28200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fee200714e0 con 0x7fee200cef30 2024-03-28T21:52:48.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.708+0000 7fee24e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fee200acd80 0x7fee200cf310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:57234/0 (socket says 172.21.15.153:57234) 2024-03-28T21:52:48.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.708+0000 7fee24e00640 1 -- 172.21.15.153:0/3818886990 learned_addr learned my addr 172.21.15.153:0/3818886990 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:48.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.709+0000 7fee25800640 1 --2- 172.21.15.153:0/3818886990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee200cef30 0x7fee20071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:48.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.709+0000 7fee1fe00640 1 -- 172.21.15.153:0/3818886990 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077368755 0 0) 0x7fee20070f20 con 0x7fee200acd80 2024-03-28T21:52:48.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.709+0000 7fee1fe00640 1 -- 172.21.15.153:0/3818886990 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee08003520 con 0x7fee200acd80 2024-03-28T21:52:48.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.709+0000 7fee1fe00640 1 -- 172.21.15.153:0/3818886990 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2893838513 0 0) 0x7fee08003520 con 0x7fee200acd80 2024-03-28T21:52:48.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.709+0000 7fee1fe00640 1 -- 172.21.15.153:0/3818886990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee200cef30 msgr2=0x7fee20071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:48.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.709+0000 7fee1fe00640 1 --2- 172.21.15.153:0/3818886990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee200cef30 0x7fee20071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.709+0000 7fee1fe00640 1 -- 172.21.15.153:0/3818886990 >> v1:172.21.15.165:6789/0 conn(0x7fee200728c0 legacy=0x7fee2006cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:48.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.709+0000 7fee1fe00640 1 -- 172.21.15.153:0/3818886990 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee200717c0 con 0x7fee200acd80 2024-03-28T21:52:48.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.709+0000 7fee1fe00640 1 -- 172.21.15.153:0/3818886990 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fee0c001670 con 0x7fee200acd80 2024-03-28T21:52:48.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.709+0000 7fee1fe00640 1 -- 172.21.15.153:0/3818886990 >> v1:172.21.15.153:6789/0 conn(0x7fee200acd80 legacy=0x7fee200cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:48.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.709+0000 7fee1fe00640 1 --2- 172.21.15.153:0/3818886990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee080039e0 0x7fee08003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.710+0000 7fee1fe00640 1 --2- 172.21.15.153:0/3818886990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee200cef30 0x7fee08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.710+0000 7fee1fe00640 1 --2- 172.21.15.153:0/3818886990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee08004d40 0x7fee080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.710+0000 7fee1fe00640 1 -- 172.21.15.153:0/3818886990 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fee200714e0 con 0x7fee080039e0 2024-03-28T21:52:48.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.710+0000 7fee1fe00640 1 -- 172.21.15.153:0/3818886990 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fee0800ba70 con 0x7fee08004d40 2024-03-28T21:52:48.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.710+0000 7fee1fe00640 1 -- 172.21.15.153:0/3818886990 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fee0800bc70 con 0x7fee200cef30 2024-03-28T21:52:48.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.710+0000 7fee25800640 1 --2- 172.21.15.153:0/3818886990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee080039e0 0x7fee08003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:48.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.710+0000 7fee26200640 1 --2- 172.21.15.153:0/3818886990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee08004d40 0x7fee080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:48.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.710+0000 7fee25800640 1 -- 172.21.15.153:0/3818886990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee200cef30 msgr2=0x7fee08004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:48.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.710+0000 7fee25800640 1 --2- 172.21.15.153:0/3818886990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee200cef30 0x7fee08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.710+0000 7fee25800640 1 -- 172.21.15.153:0/3818886990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee08004d40 msgr2=0x7fee080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:48.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.710+0000 7fee25800640 1 --2- 172.21.15.153:0/3818886990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee08004d40 0x7fee080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.710+0000 7fee25800640 1 -- 172.21.15.153:0/3818886990 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee08003520 con 0x7fee080039e0 2024-03-28T21:52:48.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.710+0000 7fee26200640 1 --2- 172.21.15.153:0/3818886990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee08004d40 0x7fee080051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:48.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.712+0000 7fee25800640 1 --2- 172.21.15.153:0/3818886990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee080039e0 0x7fee08003e00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fee14009a90 tx=0x7fee08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c92aec311d6570a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:48.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.712+0000 7fee1fe00640 1 -- 172.21.15.153:0/3818886990 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14039070 con 0x7fee080039e0 2024-03-28T21:52:48.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.712+0000 7fee1fe00640 1 -- 172.21.15.153:0/3818886990 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1402c6b0 con 0x7fee080039e0 2024-03-28T21:52:48.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.712+0000 7fee1fe00640 1 -- 172.21.15.153:0/3818886990 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14009690 con 0x7fee080039e0 2024-03-28T21:52:48.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.712+0000 7fee28200640 1 -- 172.21.15.153:0/3818886990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee080039e0 msgr2=0x7fee08003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:48.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.712+0000 7fee28200640 1 --2- 172.21.15.153:0/3818886990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee080039e0 0x7fee08003e00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fee14009a90 tx=0x7fee08005830 comp rx=0 tx=0).stop 2024-03-28T21:52:48.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.712+0000 7fee26200640 1 -- 172.21.15.153:0/3818886990 reap_dead start 2024-03-28T21:52:48.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.713+0000 7fee28200640 1 -- 172.21.15.153:0/3818886990 shutdown_connections 2024-03-28T21:52:48.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.713+0000 7fee28200640 1 -- 172.21.15.153:0/3818886990 >> 172.21.15.153:0/3818886990 conn(0x7fee200b19a0 msgr2=0x7fee200b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:48.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.713+0000 7fee28200640 1 -- 172.21.15.153:0/3818886990 shutdown_connections 2024-03-28T21:52:48.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.713+0000 7fee28200640 1 -- 172.21.15.153:0/3818886990 wait complete. 2024-03-28T21:52:48.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.715+0000 7fee28200640 1 Processor -- start 2024-03-28T21:52:48.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.716+0000 7fee28200640 1 -- start start 2024-03-28T21:52:48.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.717+0000 7fee28200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee080039e0 0x7fee2009bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.717+0000 7fee28200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee200c4e80 0x7fee2006cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.717+0000 7fee28200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee2009d6a0 0x7fee2014d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.717+0000 7fee28200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fee2015c370 con 0x7fee2009d6a0 2024-03-28T21:52:48.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.717+0000 7fee28200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fee2015c1f0 con 0x7fee200c4e80 2024-03-28T21:52:48.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.717+0000 7fee28200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fee20071ce0 con 0x7fee080039e0 2024-03-28T21:52:48.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.718+0000 7fee26200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee2009d6a0 0x7fee2014d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:48.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.718+0000 7fee26200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee2009d6a0 0x7fee2014d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48146/0 (socket says 172.21.15.153:48146) 2024-03-28T21:52:48.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.718+0000 7fee26200640 1 -- 172.21.15.153:0/2659775905 learned_addr learned my addr 172.21.15.153:0/2659775905 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:48.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.718+0000 7fee25800640 1 --2- 172.21.15.153:0/2659775905 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee080039e0 0x7fee2009bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:48.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.718+0000 7fee24e00640 1 --2- 172.21.15.153:0/2659775905 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee200c4e80 0x7fee2006cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:48.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.718+0000 7fee26200640 1 -- 172.21.15.153:0/2659775905 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee080039e0 msgr2=0x7fee2009bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:48.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.718+0000 7fee26200640 1 --2- 172.21.15.153:0/2659775905 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee080039e0 0x7fee2009bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.718+0000 7fee26200640 1 -- 172.21.15.153:0/2659775905 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee200c4e80 msgr2=0x7fee2006cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:48.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.718+0000 7fee26200640 1 --2- 172.21.15.153:0/2659775905 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee200c4e80 0x7fee2006cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.718+0000 7fee26200640 1 -- 172.21.15.153:0/2659775905 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee200c5300 con 0x7fee2009d6a0 2024-03-28T21:52:48.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.718+0000 7fee26200640 1 --2- 172.21.15.153:0/2659775905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee2009d6a0 0x7fee2014d2e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fee200cfc60 tx=0x7fee1800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:48.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.719+0000 7fee1d600640 1 -- 172.21.15.153:0/2659775905 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18006d50 con 0x7fee2009d6a0 2024-03-28T21:52:48.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.719+0000 7fee1d600640 1 -- 172.21.15.153:0/2659775905 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee18003970 con 0x7fee2009d6a0 2024-03-28T21:52:48.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.719+0000 7fee28200640 1 -- 172.21.15.153:0/2659775905 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee2009c600 con 0x7fee2009d6a0 2024-03-28T21:52:48.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.719+0000 7fee1d600640 1 -- 172.21.15.153:0/2659775905 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18003d60 con 0x7fee2009d6a0 2024-03-28T21:52:48.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.719+0000 7fee28200640 1 -- 172.21.15.153:0/2659775905 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee2009cbc0 con 0x7fee2009d6a0 2024-03-28T21:52:48.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.720+0000 7fee28200640 1 -- 172.21.15.153:0/2659775905 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee200cf310 con 0x7fee2009d6a0 2024-03-28T21:52:48.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.721+0000 7fee1d600640 1 -- 172.21.15.153:0/2659775905 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fee1801b020 con 0x7fee2009d6a0 2024-03-28T21:52:48.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.722+0000 7fee1d600640 1 --2- 172.21.15.153:0/2659775905 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fee0006b500 0x7fee0006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:48.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.722+0000 7fee1d600640 1 -- 172.21.15.153:0/2659775905 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fee18089ef0 con 0x7fee2009d6a0 2024-03-28T21:52:48.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.722+0000 7fee25800640 1 --2- 172.21.15.153:0/2659775905 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fee0006b500 0x7fee0006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:48.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.723+0000 7fee25800640 1 --2- 172.21.15.153:0/2659775905 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fee0006b500 0x7fee0006d9c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fee14036000 tx=0x7fee14030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:48.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.726+0000 7fee1d600640 1 -- 172.21.15.153:0/2659775905 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fee200cf310 con 0x7fee2009d6a0 2024-03-28T21:52:48.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.922+0000 7fee28200640 1 -- 172.21.15.153:0/2659775905 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fee200723f0 con 0x7fee2009d6a0 2024-03-28T21:52:48.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.923+0000 7fee1d600640 1 -- 172.21.15.153:0/2659775905 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fee18058cf0 con 0x7fee2009d6a0 2024-03-28T21:52:48.925 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-03-28T21:52:48.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.925+0000 7fee28200640 1 -- 172.21.15.153:0/2659775905 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fee0006b500 msgr2=0x7fee0006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:48.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.925+0000 7fee28200640 1 --2- 172.21.15.153:0/2659775905 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fee0006b500 0x7fee0006d9c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fee14036000 tx=0x7fee14030000 comp rx=0 tx=0).stop 2024-03-28T21:52:48.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.925+0000 7fee28200640 1 -- 172.21.15.153:0/2659775905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee2009d6a0 msgr2=0x7fee2014d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:48.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.925+0000 7fee28200640 1 --2- 172.21.15.153:0/2659775905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee2009d6a0 0x7fee2014d2e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fee200cfc60 tx=0x7fee1800dc00 comp rx=0 tx=0).stop 2024-03-28T21:52:48.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.926+0000 7fee28200640 1 -- 172.21.15.153:0/2659775905 shutdown_connections 2024-03-28T21:52:48.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.926+0000 7fee28200640 1 --2- 172.21.15.153:0/2659775905 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fee0006b500 0x7fee0006d9c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.926+0000 7fee28200640 1 --2- 172.21.15.153:0/2659775905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee2009d6a0 0x7fee2014d2e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.926+0000 7fee28200640 1 --2- 172.21.15.153:0/2659775905 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee200c4e80 0x7fee2006cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.926+0000 7fee28200640 1 --2- 172.21.15.153:0/2659775905 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee080039e0 0x7fee2009bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:48.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.926+0000 7fee28200640 1 -- 172.21.15.153:0/2659775905 >> 172.21.15.153:0/2659775905 conn(0x7fee200b19a0 msgr2=0x7fee200ada30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:48.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.926+0000 7fee28200640 1 -- 172.21.15.153:0/2659775905 shutdown_connections 2024-03-28T21:52:48.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:48.926+0000 7fee28200640 1 -- 172.21.15.153:0/2659775905 wait complete. 2024-03-28T21:52:48.945 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-28T21:52:49.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.170+0000 7fdc53200640 1 Processor -- start 2024-03-28T21:52:49.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.170+0000 7fdc53200640 1 -- start start 2024-03-28T21:52:49.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.172+0000 7fdc53200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc540d0410 0x7fdc540cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:49.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.172+0000 7fdc53200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc540ce1f0 con 0x7fdc54144cc0 2024-03-28T21:52:49.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.172+0000 7fdc53200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc540ce490 con 0x7fdc541448e0 2024-03-28T21:52:49.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.172+0000 7fdc53200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdc540ce770 con 0x7fdc540d0410 2024-03-28T21:52:49.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.172+0000 7fdc52800640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fdc54144cc0 0x7fdc540b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:57244/0 (socket says 172.21.15.153:57244) 2024-03-28T21:52:49.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.172+0000 7fdc52800640 1 -- 172.21.15.153:0/597240466 learned_addr learned my addr 172.21.15.153:0/597240466 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:49.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.172+0000 7fdc51400640 1 --2- 172.21.15.153:0/597240466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc540d0410 0x7fdc540cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:49.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.173+0000 7fdc50a00640 1 -- 172.21.15.153:0/597240466 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 550196116 0 0) 0x7fdc540ce1f0 con 0x7fdc54144cc0 2024-03-28T21:52:49.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.173+0000 7fdc50a00640 1 -- 172.21.15.153:0/597240466 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc38003520 con 0x7fdc54144cc0 2024-03-28T21:52:49.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.173+0000 7fdc50a00640 1 -- 172.21.15.153:0/597240466 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2161800400 0 0) 0x7fdc38003520 con 0x7fdc54144cc0 2024-03-28T21:52:49.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.173+0000 7fdc50a00640 1 -- 172.21.15.153:0/597240466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc540d0410 msgr2=0x7fdc540cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:49.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.173+0000 7fdc50a00640 1 --2- 172.21.15.153:0/597240466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc540d0410 0x7fdc540cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:49.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.173+0000 7fdc50a00640 1 -- 172.21.15.153:0/597240466 >> v1:172.21.15.165:6789/0 conn(0x7fdc541448e0 legacy=0x7fdc540cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:49.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.173+0000 7fdc50a00640 1 -- 172.21.15.153:0/597240466 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc540cea50 con 0x7fdc54144cc0 2024-03-28T21:52:49.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.173+0000 7fdc50a00640 1 -- 172.21.15.153:0/597240466 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fdc4c0019f0 con 0x7fdc54144cc0 2024-03-28T21:52:49.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.173+0000 7fdc50a00640 1 -- 172.21.15.153:0/597240466 >> v1:172.21.15.153:6789/0 conn(0x7fdc54144cc0 legacy=0x7fdc540b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:49.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.173+0000 7fdc50a00640 1 --2- 172.21.15.153:0/597240466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc380039e0 0x7fdc38003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:49.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.174+0000 7fdc50a00640 1 --2- 172.21.15.153:0/597240466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc540d0410 0x7fdc38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:49.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.174+0000 7fdc50a00640 1 --2- 172.21.15.153:0/597240466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc38004d40 0x7fdc380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:49.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.174+0000 7fdc50a00640 1 -- 172.21.15.153:0/597240466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc540ce770 con 0x7fdc38004d40 2024-03-28T21:52:49.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.174+0000 7fdc50a00640 1 -- 172.21.15.153:0/597240466 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3800b9f0 con 0x7fdc380039e0 2024-03-28T21:52:49.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.174+0000 7fdc50a00640 1 -- 172.21.15.153:0/597240466 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdc3800bbf0 con 0x7fdc540d0410 2024-03-28T21:52:49.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.174+0000 7fdc52800640 1 --2- 172.21.15.153:0/597240466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc38004d40 0x7fdc380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:49.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.174+0000 7fdc51e00640 1 --2- 172.21.15.153:0/597240466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc380039e0 0x7fdc38003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:49.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.174+0000 7fdc51400640 1 --2- 172.21.15.153:0/597240466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc540d0410 0x7fdc38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:49.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.174+0000 7fdc52800640 1 -- 172.21.15.153:0/597240466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc540d0410 msgr2=0x7fdc38004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:49.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.174+0000 7fdc52800640 1 --2- 172.21.15.153:0/597240466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc540d0410 0x7fdc38004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:49.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.174+0000 7fdc52800640 1 -- 172.21.15.153:0/597240466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc380039e0 msgr2=0x7fdc38003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:49.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.174+0000 7fdc52800640 1 --2- 172.21.15.153:0/597240466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc380039e0 0x7fdc38003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:49.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.174+0000 7fdc52800640 1 -- 172.21.15.153:0/597240466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc38003520 con 0x7fdc38004d40 2024-03-28T21:52:49.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.174+0000 7fdc51400640 1 --2- 172.21.15.153:0/597240466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc540d0410 0x7fdc38004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:49.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.175+0000 7fdc52800640 1 --2- 172.21.15.153:0/597240466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc38004d40 0x7fdc380051c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00a880 tx=0x7fdc38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ce13a4ed9fd522 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:49.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.176+0000 7fdc50a00640 1 -- 172.21.15.153:0/597240466 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c00a4a0 con 0x7fdc38004d40 2024-03-28T21:52:49.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.176+0000 7fdc50a00640 1 -- 172.21.15.153:0/597240466 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c034650 con 0x7fdc38004d40 2024-03-28T21:52:49.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.176+0000 7fdc50a00640 1 -- 172.21.15.153:0/597240466 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c034a40 con 0x7fdc38004d40 2024-03-28T21:52:49.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.176+0000 7fdc53200640 1 -- 172.21.15.153:0/597240466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc38004d40 msgr2=0x7fdc380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:49.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.176+0000 7fdc53200640 1 --2- 172.21.15.153:0/597240466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc38004d40 0x7fdc380051c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00a880 tx=0x7fdc38005830 comp rx=0 tx=0).stop 2024-03-28T21:52:49.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.176+0000 7fdc52800640 1 -- 172.21.15.153:0/597240466 reap_dead start 2024-03-28T21:52:49.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.176+0000 7fdc53200640 1 -- 172.21.15.153:0/597240466 shutdown_connections 2024-03-28T21:52:49.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.176+0000 7fdc53200640 1 -- 172.21.15.153:0/597240466 >> 172.21.15.153:0/597240466 conn(0x7fdc5406b350 msgr2=0x7fdc5406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:49.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.176+0000 7fdc53200640 1 -- 172.21.15.153:0/597240466 shutdown_connections 2024-03-28T21:52:49.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.176+0000 7fdc53200640 1 -- 172.21.15.153:0/597240466 wait complete. 2024-03-28T21:52:49.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.178+0000 7fdc53200640 1 Processor -- start 2024-03-28T21:52:49.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.178+0000 7fdc53200640 1 -- start start 2024-03-28T21:52:49.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.179+0000 7fdc53200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc38004d40 0x7fdc5415f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:49.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.179+0000 7fdc53200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc54157910 0x7fdc5415e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:49.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.179+0000 7fdc53200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc5415e620 0x7fdc5415eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:49.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.179+0000 7fdc53200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc540cf0f0 con 0x7fdc5415e620 2024-03-28T21:52:49.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.179+0000 7fdc53200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdc540cef70 con 0x7fdc54157910 2024-03-28T21:52:49.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.179+0000 7fdc53200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdc540cf270 con 0x7fdc38004d40 2024-03-28T21:52:49.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.180+0000 7fdc52800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc5415e620 0x7fdc5415eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:49.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.180+0000 7fdc52800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc5415e620 0x7fdc5415eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48164/0 (socket says 172.21.15.153:48164) 2024-03-28T21:52:49.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.180+0000 7fdc52800640 1 -- 172.21.15.153:0/2590315947 learned_addr learned my addr 172.21.15.153:0/2590315947 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:49.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.180+0000 7fdc51e00640 1 --2- 172.21.15.153:0/2590315947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc38004d40 0x7fdc5415f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:49.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.180+0000 7fdc51400640 1 --2- 172.21.15.153:0/2590315947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc54157910 0x7fdc5415e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:49.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.180+0000 7fdc52800640 1 -- 172.21.15.153:0/2590315947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc38004d40 msgr2=0x7fdc5415f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:49.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.180+0000 7fdc52800640 1 --2- 172.21.15.153:0/2590315947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc38004d40 0x7fdc5415f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:49.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.180+0000 7fdc52800640 1 -- 172.21.15.153:0/2590315947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc54157910 msgr2=0x7fdc5415e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:49.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.180+0000 7fdc52800640 1 --2- 172.21.15.153:0/2590315947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc54157910 0x7fdc5415e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:49.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.180+0000 7fdc52800640 1 -- 172.21.15.153:0/2590315947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5415efe0 con 0x7fdc5415e620 2024-03-28T21:52:49.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.180+0000 7fdc52800640 1 --2- 172.21.15.153:0/2590315947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc5415e620 0x7fdc5415eaa0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00a9a0 tx=0x7fdc540cec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:49.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.181+0000 7fdc4a000640 1 -- 172.21.15.153:0/2590315947 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c00a4a0 con 0x7fdc5415e620 2024-03-28T21:52:49.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.181+0000 7fdc4a000640 1 -- 172.21.15.153:0/2590315947 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c03a040 con 0x7fdc5415e620 2024-03-28T21:52:49.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.181+0000 7fdc4a000640 1 -- 172.21.15.153:0/2590315947 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c004d60 con 0x7fdc5415e620 2024-03-28T21:52:49.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.181+0000 7fdc53200640 1 -- 172.21.15.153:0/2590315947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc54157e40 con 0x7fdc5415e620 2024-03-28T21:52:49.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.181+0000 7fdc53200640 1 -- 172.21.15.153:0/2590315947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc54158400 con 0x7fdc5415e620 2024-03-28T21:52:49.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.182+0000 7fdc53200640 1 -- 172.21.15.153:0/2590315947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc5404f4b0 con 0x7fdc5415e620 2024-03-28T21:52:49.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.184+0000 7fdc4a000640 1 -- 172.21.15.153:0/2590315947 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fdc4c034650 con 0x7fdc5415e620 2024-03-28T21:52:49.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.185+0000 7fdc4a000640 1 --2- 172.21.15.153:0/2590315947 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdc3406f910 0x7fdc34071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:49.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.185+0000 7fdc4a000640 1 -- 172.21.15.153:0/2590315947 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fdc4c0ac3c0 con 0x7fdc5415e620 2024-03-28T21:52:49.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.185+0000 7fdc51e00640 1 --2- 172.21.15.153:0/2590315947 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdc3406f910 0x7fdc34071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:49.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.186+0000 7fdc51e00640 1 --2- 172.21.15.153:0/2590315947 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdc3406f910 0x7fdc34071dd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdc44005540 tx=0x7fdc44007c50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:49.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.189+0000 7fdc4a000640 1 -- 172.21.15.153:0/2590315947 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdc4c07b110 con 0x7fdc5415e620 2024-03-28T21:52:49.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.425+0000 7fdc53200640 1 -- 172.21.15.153:0/2590315947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdc5406ea10 con 0x7fdc5415e620 2024-03-28T21:52:49.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.426+0000 7fdc4a000640 1 -- 172.21.15.153:0/2590315947 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fdc4c07aa10 con 0x7fdc5415e620 2024-03-28T21:52:49.428 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2024-03-28T21:52:49.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.428+0000 7fdc53200640 1 -- 172.21.15.153:0/2590315947 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdc3406f910 msgr2=0x7fdc34071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:49.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.428+0000 7fdc53200640 1 --2- 172.21.15.153:0/2590315947 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdc3406f910 0x7fdc34071dd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdc44005540 tx=0x7fdc44007c50 comp rx=0 tx=0).stop 2024-03-28T21:52:49.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.428+0000 7fdc53200640 1 -- 172.21.15.153:0/2590315947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc5415e620 msgr2=0x7fdc5415eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:49.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.428+0000 7fdc53200640 1 --2- 172.21.15.153:0/2590315947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc5415e620 0x7fdc5415eaa0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00a9a0 tx=0x7fdc540cec20 comp rx=0 tx=0).stop 2024-03-28T21:52:49.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.428+0000 7fdc53200640 1 -- 172.21.15.153:0/2590315947 shutdown_connections 2024-03-28T21:52:49.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.428+0000 7fdc53200640 1 --2- 172.21.15.153:0/2590315947 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdc3406f910 0x7fdc34071dd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:49.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.428+0000 7fdc53200640 1 --2- 172.21.15.153:0/2590315947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc5415e620 0x7fdc5415eaa0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:49.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.428+0000 7fdc53200640 1 --2- 172.21.15.153:0/2590315947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc54157910 0x7fdc5415e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:49.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.428+0000 7fdc53200640 1 --2- 172.21.15.153:0/2590315947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc38004d40 0x7fdc5415f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:49.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.428+0000 7fdc53200640 1 -- 172.21.15.153:0/2590315947 >> 172.21.15.153:0/2590315947 conn(0x7fdc5406b350 msgr2=0x7fdc5413ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:49.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.429+0000 7fdc53200640 1 -- 172.21.15.153:0/2590315947 shutdown_connections 2024-03-28T21:52:49.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.429+0000 7fdc53200640 1 -- 172.21.15.153:0/2590315947 wait complete. 2024-03-28T21:52:49.448 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-03-28T21:52:49.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:49.449 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-03-28T21:52:49.527 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-03-28T21:52:49.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:49.528 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-28T21:52:49.570 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:52:49.570 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:49.627 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:52:49.627 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:49.679 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-28T21:52:49.680 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:52:49.734 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:49.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.942+0000 7fb740800640 1 Processor -- start 2024-03-28T21:52:49.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.942+0000 7fb740800640 1 -- start start 2024-03-28T21:52:49.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.944+0000 7fb740800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb738161bc0 0x7fb7380b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:49.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.944+0000 7fb740800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7380b30c0 0x7fb7380cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:49.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.944+0000 7fb740800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7380d0ff0 con 0x7fb7381617e0 2024-03-28T21:52:49.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.944+0000 7fb740800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb7380d12d0 con 0x7fb738161bc0 2024-03-28T21:52:49.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.944+0000 7fb740800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb7380cef40 con 0x7fb7380b30c0 2024-03-28T21:52:49.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.944+0000 7fb73d400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb738161bc0 0x7fb7380b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:49.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.944+0000 7fb73d400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb738161bc0 0x7fb7380b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48172/0 (socket says 172.21.15.153:48172) 2024-03-28T21:52:49.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.944+0000 7fb73d400640 1 -- 172.21.15.153:0/4053659679 learned_addr learned my addr 172.21.15.153:0/4053659679 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:49.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.944+0000 7fb73e800640 1 --2- 172.21.15.153:0/4053659679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7380b30c0 0x7fb7380cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:49.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.944+0000 7fb73d400640 1 -- 172.21.15.153:0/4053659679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7380b30c0 msgr2=0x7fb7380cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:49.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.944+0000 7fb73d400640 1 --2- 172.21.15.153:0/4053659679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7380b30c0 0x7fb7380cf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:49.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.945+0000 7fb73d400640 1 -- 172.21.15.153:0/4053659679 >> v1:172.21.15.165:6789/0 conn(0x7fb7381617e0 legacy=0x7fb7380d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:49.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.945+0000 7fb73d400640 1 -- 172.21.15.153:0/4053659679 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7380cf220 con 0x7fb738161bc0 2024-03-28T21:52:49.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.946+0000 7fb73d400640 1 --2- 172.21.15.153:0/4053659679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb738161bc0 0x7fb7380b0d10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb73809db00 tx=0x7fb72802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc578364d98c0c4a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:49.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.946+0000 7fb73ca00640 1 -- 172.21.15.153:0/4053659679 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7280315a0 con 0x7fb738161bc0 2024-03-28T21:52:49.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.946+0000 7fb73ca00640 1 -- 172.21.15.153:0/4053659679 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb728037070 con 0x7fb738161bc0 2024-03-28T21:52:49.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.946+0000 7fb73ca00640 1 -- 172.21.15.153:0/4053659679 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728031960 con 0x7fb738161bc0 2024-03-28T21:52:49.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.946+0000 7fb740800640 1 -- 172.21.15.153:0/4053659679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb738161bc0 msgr2=0x7fb7380b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:49.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.946+0000 7fb740800640 1 --2- 172.21.15.153:0/4053659679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb738161bc0 0x7fb7380b0d10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb73809db00 tx=0x7fb72802b840 comp rx=0 tx=0).stop 2024-03-28T21:52:49.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.947+0000 7fb740800640 1 -- 172.21.15.153:0/4053659679 shutdown_connections 2024-03-28T21:52:49.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.947+0000 7fb740800640 1 --2- 172.21.15.153:0/4053659679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7380b30c0 0x7fb7380cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:49.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.947+0000 7fb740800640 1 --2- 172.21.15.153:0/4053659679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb738161bc0 0x7fb7380b0d10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:49.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.947+0000 7fb740800640 1 -- 172.21.15.153:0/4053659679 >> 172.21.15.153:0/4053659679 conn(0x7fb73809d420 msgr2=0x7fb7380d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:49.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.947+0000 7fb740800640 1 -- 172.21.15.153:0/4053659679 shutdown_connections 2024-03-28T21:52:49.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.947+0000 7fb740800640 1 -- 172.21.15.153:0/4053659679 wait complete. 2024-03-28T21:52:49.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.948+0000 7fb740800640 1 Processor -- start 2024-03-28T21:52:49.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.949+0000 7fb740800640 1 -- start start 2024-03-28T21:52:49.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.949+0000 7fb740800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7380b30c0 0x7fb7380b93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:49.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.949+0000 7fb740800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7381617e0 0x7fb7380cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:49.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.949+0000 7fb740800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb738161bc0 0x7fb7380c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:49.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.949+0000 7fb740800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb7380b13d0 con 0x7fb738161bc0 2024-03-28T21:52:49.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.949+0000 7fb740800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb7380b1250 con 0x7fb7380b30c0 2024-03-28T21:52:49.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.949+0000 7fb740800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb7380b1550 con 0x7fb7381617e0 2024-03-28T21:52:49.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.950+0000 7fb73e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb738161bc0 0x7fb7380c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:49.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.950+0000 7fb73e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb738161bc0 0x7fb7380c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48176/0 (socket says 172.21.15.153:48176) 2024-03-28T21:52:49.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.950+0000 7fb73e800640 1 -- 172.21.15.153:0/1566570132 learned_addr learned my addr 172.21.15.153:0/1566570132 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:49.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.950+0000 7fb73d400640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7381617e0 0x7fb7380cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:49.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.950+0000 7fb73de00640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7380b30c0 0x7fb7380b93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:49.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.950+0000 7fb73e800640 1 -- 172.21.15.153:0/1566570132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7381617e0 msgr2=0x7fb7380cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:49.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.950+0000 7fb73e800640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7381617e0 0x7fb7380cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:49.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.950+0000 7fb73e800640 1 -- 172.21.15.153:0/1566570132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7380b30c0 msgr2=0x7fb7380b93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:49.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.950+0000 7fb73e800640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7380b30c0 0x7fb7380b93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:49.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.950+0000 7fb73e800640 1 -- 172.21.15.153:0/1566570132 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7380cca10 con 0x7fb738161bc0 2024-03-28T21:52:49.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.950+0000 7fb73de00640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7380b30c0 0x7fb7380b93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:49.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.950+0000 7fb73e800640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb738161bc0 0x7fb7380c8ed0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb73400cc30 tx=0x7fb73400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:49.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.951+0000 7fb732000640 1 -- 172.21.15.153:0/1566570132 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73400ce40 con 0x7fb738161bc0 2024-03-28T21:52:49.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.951+0000 7fb732000640 1 -- 172.21.15.153:0/1566570132 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb734003990 con 0x7fb738161bc0 2024-03-28T21:52:49.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.951+0000 7fb732000640 1 -- 172.21.15.153:0/1566570132 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb734003d40 con 0x7fb738161bc0 2024-03-28T21:52:49.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.951+0000 7fb740800640 1 -- 172.21.15.153:0/1566570132 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7380cccf0 con 0x7fb738161bc0 2024-03-28T21:52:49.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.951+0000 7fb740800640 1 -- 172.21.15.153:0/1566570132 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7380cd2b0 con 0x7fb738161bc0 2024-03-28T21:52:49.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.952+0000 7fb740800640 1 -- 172.21.15.153:0/1566570132 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb738068ff0 con 0x7fb738161bc0 2024-03-28T21:52:49.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.953+0000 7fb732000640 1 -- 172.21.15.153:0/1566570132 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb734003ee0 con 0x7fb738161bc0 2024-03-28T21:52:49.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.954+0000 7fb732000640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb71c06b4d0 0x7fb71c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:49.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.954+0000 7fb732000640 1 -- 172.21.15.153:0/1566570132 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fb73408a760 con 0x7fb738161bc0 2024-03-28T21:52:49.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.954+0000 7fb73de00640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb71c06b4d0 0x7fb71c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:49.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.955+0000 7fb73de00640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb71c06b4d0 0x7fb71c06d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb7380d4b10 tx=0x7fb72c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:49.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:49.958+0000 7fb732000640 1 -- 172.21.15.153:0/1566570132 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb734014030 con 0x7fb738161bc0 2024-03-28T21:52:50.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.217+0000 7fb740800640 1 -- 172.21.15.153:0/1566570132 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7380d1690 con 0x7fb738161bc0 2024-03-28T21:52:50.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.219+0000 7fb732000640 1 -- 172.21.15.153:0/1566570132 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16902 (secure 0 0 0) 0x7fb734059560 con 0x7fb738161bc0 2024-03-28T21:52:50.222 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:50.222 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":24,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:52:43.430328+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.221+0000 7fb740800640 1 -- 172.21.15.153:0/1566570132 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb71c06b4d0 msgr2=0x7fb71c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.221+0000 7fb740800640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb71c06b4d0 0x7fb71c06d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb7380d4b10 tx=0x7fb72c008040 comp rx=0 tx=0).stop 2024-03-28T21:52:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.221+0000 7fb740800640 1 -- 172.21.15.153:0/1566570132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb738161bc0 msgr2=0x7fb7380c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:50.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.221+0000 7fb740800640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb738161bc0 0x7fb7380c8ed0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb73400cc30 tx=0x7fb73400a5c0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.222+0000 7fb740800640 1 -- 172.21.15.153:0/1566570132 shutdown_connections 2024-03-28T21:52:50.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.222+0000 7fb740800640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb71c06b4d0 0x7fb71c06d990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.222+0000 7fb740800640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb738161bc0 0x7fb7380c8ed0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.222+0000 7fb740800640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7381617e0 0x7fb7380cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.222+0000 7fb740800640 1 --2- 172.21.15.153:0/1566570132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7380b30c0 0x7fb7380b93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.222+0000 7fb740800640 1 -- 172.21.15.153:0/1566570132 >> 172.21.15.153:0/1566570132 conn(0x7fb73809d420 msgr2=0x7fb73815f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:50.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.222+0000 7fb740800640 1 -- 172.21.15.153:0/1566570132 shutdown_connections 2024-03-28T21:52:50.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.222+0000 7fb740800640 1 -- 172.21.15.153:0/1566570132 wait complete. 2024-03-28T21:52:50.242 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T21:51:53.863931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T21:51:55.188736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T21:52:50.243 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T21:52:50.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.474+0000 7fbc05a00640 1 Processor -- start 2024-03-28T21:52:50.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.474+0000 7fbc05a00640 1 -- start start 2024-03-28T21:52:50.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.476+0000 7fbc05a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc000b3150 0x7fbc0015e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:50.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.476+0000 7fbc05a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbc0015ea60 0x7fbc0006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:50.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.476+0000 7fbc05a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0006cf10 con 0x7fbc0015e140 2024-03-28T21:52:50.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.476+0000 7fbc05a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbc00071fd0 con 0x7fbc0015ea60 2024-03-28T21:52:50.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.476+0000 7fbc05a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbc000b3590 con 0x7fbc000b3150 2024-03-28T21:52:50.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.477+0000 7fbc05000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbc0015ea60 0x7fbc0006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:50.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.477+0000 7fbc05000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbc0015ea60 0x7fbc0006d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48186/0 (socket says 172.21.15.153:48186) 2024-03-28T21:52:50.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.477+0000 7fbc05000640 1 -- 172.21.15.153:0/3236736264 learned_addr learned my addr 172.21.15.153:0/3236736264 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:50.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.477+0000 7fbbff400640 1 --2- 172.21.15.153:0/3236736264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc000b3150 0x7fbc0015e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:50.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.477+0000 7fbc05000640 1 -- 172.21.15.153:0/3236736264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc000b3150 msgr2=0x7fbc0015e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:50.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.477+0000 7fbc05000640 1 --2- 172.21.15.153:0/3236736264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc000b3150 0x7fbc0015e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.477+0000 7fbc05000640 1 -- 172.21.15.153:0/3236736264 >> v1:172.21.15.153:6789/0 conn(0x7fbc0015e140 legacy=0x7fbc00070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:50.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.477+0000 7fbc05000640 1 -- 172.21.15.153:0/3236736264 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc00071460 con 0x7fbc0015ea60 2024-03-28T21:52:50.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.477+0000 7fbbff400640 1 --2- 172.21.15.153:0/3236736264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc000b3150 0x7fbc0015e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:50.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.477+0000 7fbbfea00640 1 -- 172.21.15.153:0/3236736264 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2729325456 0 0) 0x7fbc0006cf10 con 0x7fbc0015e140 2024-03-28T21:52:50.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.478+0000 7fbc05000640 1 --2- 172.21.15.153:0/3236736264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc0015ea60 0x7fbc0006d6d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009e50 tx=0x7fbbf802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cdeef74ed33641 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:50.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.478+0000 7fbbfea00640 1 -- 172.21.15.153:0/3236736264 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf802cb90 con 0x7fbc0015ea60 2024-03-28T21:52:50.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.479+0000 7fbbfea00640 1 -- 172.21.15.153:0/3236736264 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf802cd30 con 0x7fbc0015ea60 2024-03-28T21:52:50.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.479+0000 7fbbfea00640 1 -- 172.21.15.153:0/3236736264 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8034610 con 0x7fbc0015ea60 2024-03-28T21:52:50.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.479+0000 7fbc05a00640 1 -- 172.21.15.153:0/3236736264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc0015ea60 msgr2=0x7fbc0006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:50.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.479+0000 7fbc05a00640 1 --2- 172.21.15.153:0/3236736264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc0015ea60 0x7fbc0006d6d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009e50 tx=0x7fbbf802bff0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.479+0000 7fbc05a00640 1 -- 172.21.15.153:0/3236736264 shutdown_connections 2024-03-28T21:52:50.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.479+0000 7fbc05a00640 1 --2- 172.21.15.153:0/3236736264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc0015ea60 0x7fbc0006d6d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.479+0000 7fbc05a00640 1 --2- 172.21.15.153:0/3236736264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc000b3150 0x7fbc0015e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.479+0000 7fbc05a00640 1 -- 172.21.15.153:0/3236736264 >> 172.21.15.153:0/3236736264 conn(0x7fbc000b1820 msgr2=0x7fbc000b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:50.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.479+0000 7fbc05a00640 1 -- 172.21.15.153:0/3236736264 shutdown_connections 2024-03-28T21:52:50.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.479+0000 7fbc05a00640 1 -- 172.21.15.153:0/3236736264 wait complete. 2024-03-28T21:52:50.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.481+0000 7fbc05a00640 1 Processor -- start 2024-03-28T21:52:50.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.481+0000 7fbc05a00640 1 -- start start 2024-03-28T21:52:50.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.482+0000 7fbc05a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc000b3150 0x7fbc000c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:50.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.482+0000 7fbc05a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc0015e140 0x7fbc001609e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:50.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.482+0000 7fbc05a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc0015ea60 0x7fbc00160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:50.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.482+0000 7fbc05a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbc00071cf0 con 0x7fbc0015e140 2024-03-28T21:52:50.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.482+0000 7fbc05a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbc00071a10 con 0x7fbc000b3150 2024-03-28T21:52:50.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.482+0000 7fbc05a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbc0006d1b0 con 0x7fbc0015ea60 2024-03-28T21:52:50.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.482+0000 7fbbff400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc0015e140 0x7fbc001609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.483+0000 7fbbff400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc0015e140 0x7fbc001609e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48192/0 (socket says 172.21.15.153:48192) 2024-03-28T21:52:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.483+0000 7fbbff400640 1 -- 172.21.15.153:0/2809788191 learned_addr learned my addr 172.21.15.153:0/2809788191 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.483+0000 7fbc05000640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc0015ea60 0x7fbc00160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.483+0000 7fbbff400640 1 -- 172.21.15.153:0/2809788191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc0015ea60 msgr2=0x7fbc00160f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.483+0000 7fbbffe00640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc000b3150 0x7fbc000c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.483+0000 7fbbff400640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc0015ea60 0x7fbc00160f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.483+0000 7fbbff400640 1 -- 172.21.15.153:0/2809788191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc000b3150 msgr2=0x7fbc000c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.483+0000 7fbbff400640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc000b3150 0x7fbc000c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.483+0000 7fbbff400640 1 -- 172.21.15.153:0/2809788191 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc000c54e0 con 0x7fbc0015e140 2024-03-28T21:52:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.483+0000 7fbbffe00640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc000b3150 0x7fbc000c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.483+0000 7fbbff400640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc0015e140 0x7fbc001609e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00e7e0 tx=0x7fbbec00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.484+0000 7fbbf7e00640 1 -- 172.21.15.153:0/2809788191 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec00f040 con 0x7fbc0015e140 2024-03-28T21:52:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.484+0000 7fbbf7e00640 1 -- 172.21.15.153:0/2809788191 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbec004030 con 0x7fbc0015e140 2024-03-28T21:52:50.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.484+0000 7fbc05a00640 1 -- 172.21.15.153:0/2809788191 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc000c57c0 con 0x7fbc0015e140 2024-03-28T21:52:50.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.484+0000 7fbbf7e00640 1 -- 172.21.15.153:0/2809788191 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec004400 con 0x7fbc0015e140 2024-03-28T21:52:50.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.484+0000 7fbc05a00640 1 -- 172.21.15.153:0/2809788191 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc000cd2f0 con 0x7fbc0015e140 2024-03-28T21:52:50.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.485+0000 7fbc05a00640 1 -- 172.21.15.153:0/2809788191 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc00068ff0 con 0x7fbc0015e140 2024-03-28T21:52:50.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.486+0000 7fbbf7e00640 1 -- 172.21.15.153:0/2809788191 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fbbec00c6d0 con 0x7fbc0015e140 2024-03-28T21:52:50.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.487+0000 7fbbf7e00640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbbe006b4d0 0x7fbbe006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:50.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.488+0000 7fbbf7e00640 1 -- 172.21.15.153:0/2809788191 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fbbec08a0f0 con 0x7fbc0015e140 2024-03-28T21:52:50.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.488+0000 7fbbffe00640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbbe006b4d0 0x7fbbe006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:50.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.488+0000 7fbbffe00640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbbe006b4d0 0x7fbbe006d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0000f60 tx=0x7fbbf0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:50.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.491+0000 7fbbf7e00640 1 -- 172.21.15.153:0/2809788191 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbbec017020 con 0x7fbc0015e140 2024-03-28T21:52:50.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.690+0000 7fbc05a00640 1 -- 172.21.15.153:0/2809788191 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbc000b2f30 con 0x7fbc0015e140 2024-03-28T21:52:50.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.691+0000 7fbbf7e00640 1 -- 172.21.15.153:0/2809788191 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fbbec058ee0 con 0x7fbc0015e140 2024-03-28T21:52:50.693 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-28T21:52:50.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.694+0000 7fbc05a00640 1 -- 172.21.15.153:0/2809788191 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbbe006b4d0 msgr2=0x7fbbe006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:50.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.694+0000 7fbc05a00640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbbe006b4d0 0x7fbbe006d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0000f60 tx=0x7fbbf0009040 comp rx=0 tx=0).stop 2024-03-28T21:52:50.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.694+0000 7fbc05a00640 1 -- 172.21.15.153:0/2809788191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc0015e140 msgr2=0x7fbc001609e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:50.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.694+0000 7fbc05a00640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc0015e140 0x7fbc001609e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00e7e0 tx=0x7fbbec00eca0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.694+0000 7fbc05a00640 1 -- 172.21.15.153:0/2809788191 shutdown_connections 2024-03-28T21:52:50.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.694+0000 7fbc05a00640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbbe006b4d0 0x7fbbe006d990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.694+0000 7fbc05a00640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc0015ea60 0x7fbc00160f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.694+0000 7fbc05a00640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc0015e140 0x7fbc001609e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.694+0000 7fbc05a00640 1 --2- 172.21.15.153:0/2809788191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc000b3150 0x7fbc000c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.694+0000 7fbc05a00640 1 -- 172.21.15.153:0/2809788191 >> 172.21.15.153:0/2809788191 conn(0x7fbc000b1820 msgr2=0x7fbc000b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:50.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.694+0000 7fbc05a00640 1 -- 172.21.15.153:0/2809788191 shutdown_connections 2024-03-28T21:52:50.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.695+0000 7fbc05a00640 1 -- 172.21.15.153:0/2809788191 wait complete. 2024-03-28T21:52:50.717 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T21:52:50.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.919+0000 7fc014e00640 1 Processor -- start 2024-03-28T21:52:50.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.919+0000 7fc014e00640 1 -- start start 2024-03-28T21:52:50.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.920+0000 7fc014e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc01015e560 0x7fc0100d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:50.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.920+0000 7fc014e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc0100d22f0 0x7fc01006fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:50.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.920+0000 7fc014e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0100d2850 con 0x7fc01015e180 2024-03-28T21:52:50.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.920+0000 7fc014e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc01006db90 con 0x7fc01015e560 2024-03-28T21:52:50.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.920+0000 7fc014e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc01006c6c0 con 0x7fc0100d22f0 2024-03-28T21:52:50.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.920+0000 7fc007e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc01015e560 0x7fc0100d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:50.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.921+0000 7fc007e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc01015e560 0x7fc0100d1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48194/0 (socket says 172.21.15.153:48194) 2024-03-28T21:52:50.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.921+0000 7fc007e00640 1 -- 172.21.15.153:0/2421791275 learned_addr learned my addr 172.21.15.153:0/2421791275 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:50.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.921+0000 7fc007e00640 1 -- 172.21.15.153:0/2421791275 >> v2:172.21.15.165:3300/0 conn(0x7fc0100d22f0 msgr2=0x7fc01006fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:50.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.921+0000 7fc007e00640 1 --2- 172.21.15.153:0/2421791275 >> v2:172.21.15.165:3300/0 conn(0x7fc0100d22f0 0x7fc01006fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.921+0000 7fc007e00640 1 -- 172.21.15.153:0/2421791275 >> v1:172.21.15.165:6789/0 conn(0x7fc01015e180 legacy=0x7fc01006d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:50.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.921+0000 7fc007e00640 1 -- 172.21.15.153:0/2421791275 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01006c9a0 con 0x7fc01015e560 2024-03-28T21:52:50.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.922+0000 7fc007e00640 1 --2- 172.21.15.153:0/2421791275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01015e560 0x7fc0100d1db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc0100b7fc0 tx=0x7fbff802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e7ef1d3068f62a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:50.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.923+0000 7fc00d400640 1 -- 172.21.15.153:0/2421791275 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8035020 con 0x7fc01015e560 2024-03-28T21:52:50.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.923+0000 7fc00d400640 1 -- 172.21.15.153:0/2421791275 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff8031870 con 0x7fc01015e560 2024-03-28T21:52:50.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.923+0000 7fc00d400640 1 -- 172.21.15.153:0/2421791275 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8031c40 con 0x7fc01015e560 2024-03-28T21:52:50.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.923+0000 7fc014e00640 1 -- 172.21.15.153:0/2421791275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01015e560 msgr2=0x7fc0100d1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:50.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.923+0000 7fc014e00640 1 --2- 172.21.15.153:0/2421791275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01015e560 0x7fc0100d1db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc0100b7fc0 tx=0x7fbff802b910 comp rx=0 tx=0).stop 2024-03-28T21:52:50.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.924+0000 7fc014e00640 1 -- 172.21.15.153:0/2421791275 shutdown_connections 2024-03-28T21:52:50.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.924+0000 7fc014e00640 1 --2- 172.21.15.153:0/2421791275 >> v2:172.21.15.165:3300/0 conn(0x7fc0100d22f0 0x7fc01006fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.924+0000 7fc014e00640 1 --2- 172.21.15.153:0/2421791275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01015e560 0x7fc0100d1db0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.924+0000 7fc014e00640 1 -- 172.21.15.153:0/2421791275 >> 172.21.15.153:0/2421791275 conn(0x7fc01009aa50 msgr2=0x7fc01009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:50.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.924+0000 7fc014e00640 1 -- 172.21.15.153:0/2421791275 shutdown_connections 2024-03-28T21:52:50.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.924+0000 7fc014e00640 1 -- 172.21.15.153:0/2421791275 wait complete. 2024-03-28T21:52:50.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.926+0000 7fc014e00640 1 Processor -- start 2024-03-28T21:52:50.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.927+0000 7fc014e00640 1 -- start start 2024-03-28T21:52:50.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.928+0000 7fc014e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0100d22f0 0x7fc010154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:50.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.928+0000 7fc014e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc01015e180 0x7fc0100b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:50.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.928+0000 7fc014e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc01015e560 0x7fc0100b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:50.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.928+0000 7fc014e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc01006ff40 con 0x7fc0100d22f0 2024-03-28T21:52:50.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.928+0000 7fc014e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc01006cf60 con 0x7fc01015e560 2024-03-28T21:52:50.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.928+0000 7fc014e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc0100700c0 con 0x7fc01015e180 2024-03-28T21:52:50.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.928+0000 7fc00de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0100d22f0 0x7fc010154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:50.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.929+0000 7fc00de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0100d22f0 0x7fc010154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48198/0 (socket says 172.21.15.153:48198) 2024-03-28T21:52:50.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.929+0000 7fc00de00640 1 -- 172.21.15.153:0/122451256 learned_addr learned my addr 172.21.15.153:0/122451256 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:50.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.929+0000 7fc00e800640 1 --2- 172.21.15.153:0/122451256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc01015e560 0x7fc0100b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:50.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.929+0000 7fc007e00640 1 --2- 172.21.15.153:0/122451256 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc01015e180 0x7fc0100b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:50.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.929+0000 7fc00de00640 1 -- 172.21.15.153:0/122451256 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc01015e180 msgr2=0x7fc0100b6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:50.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.929+0000 7fc00de00640 1 --2- 172.21.15.153:0/122451256 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc01015e180 0x7fc0100b6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.929+0000 7fc00de00640 1 -- 172.21.15.153:0/122451256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc01015e560 msgr2=0x7fc0100b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:50.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.929+0000 7fc00de00640 1 --2- 172.21.15.153:0/122451256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc01015e560 0x7fc0100b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:50.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.929+0000 7fc00de00640 1 -- 172.21.15.153:0/122451256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0100b7b70 con 0x7fc0100d22f0 2024-03-28T21:52:50.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.929+0000 7fc00de00640 1 --2- 172.21.15.153:0/122451256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0100d22f0 0x7fc010154ca0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc00000c430 tx=0x7fc00000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:50.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.930+0000 7fc006000640 1 -- 172.21.15.153:0/122451256 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000011790 con 0x7fc0100d22f0 2024-03-28T21:52:50.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.930+0000 7fc006000640 1 -- 172.21.15.153:0/122451256 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc000017070 con 0x7fc0100d22f0 2024-03-28T21:52:50.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.930+0000 7fc006000640 1 -- 172.21.15.153:0/122451256 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000011b70 con 0x7fc0100d22f0 2024-03-28T21:52:50.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.930+0000 7fc014e00640 1 -- 172.21.15.153:0/122451256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0100b75b0 con 0x7fc0100d22f0 2024-03-28T21:52:50.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.930+0000 7fc014e00640 1 -- 172.21.15.153:0/122451256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0100b57c0 con 0x7fc0100d22f0 2024-03-28T21:52:50.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.931+0000 7fc014e00640 1 -- 172.21.15.153:0/122451256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc010068ff0 con 0x7fc0100d22f0 2024-03-28T21:52:50.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.932+0000 7fc006000640 1 -- 172.21.15.153:0/122451256 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc000011d10 con 0x7fc0100d22f0 2024-03-28T21:52:50.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.933+0000 7fc006000640 1 --2- 172.21.15.153:0/122451256 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbfec06b4d0 0x7fbfec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:50.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.933+0000 7fc006000640 1 -- 172.21.15.153:0/122451256 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fc00008a190 con 0x7fc0100d22f0 2024-03-28T21:52:50.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.933+0000 7fc007e00640 1 --2- 172.21.15.153:0/122451256 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbfec06b4d0 0x7fbfec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:50.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.934+0000 7fc007e00640 1 --2- 172.21.15.153:0/122451256 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbfec06b4d0 0x7fbfec06d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbff8036000 tx=0x7fbff803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:50.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:50.937+0000 7fc006000640 1 -- 172.21.15.153:0/122451256 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc000058f00 con 0x7fc0100d22f0 2024-03-28T21:52:51.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.132+0000 7fc014e00640 1 -- 172.21.15.153:0/122451256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc01006ddb0 con 0x7fc0100d22f0 2024-03-28T21:52:51.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.133+0000 7fc006000640 1 -- 172.21.15.153:0/122451256 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fc000058800 con 0x7fc0100d22f0 2024-03-28T21:52:51.140 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-03-28T21:52:51.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.136+0000 7fc014e00640 1 -- 172.21.15.153:0/122451256 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbfec06b4d0 msgr2=0x7fbfec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:51.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.136+0000 7fc014e00640 1 --2- 172.21.15.153:0/122451256 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbfec06b4d0 0x7fbfec06d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbff8036000 tx=0x7fbff803c040 comp rx=0 tx=0).stop 2024-03-28T21:52:51.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.136+0000 7fc014e00640 1 -- 172.21.15.153:0/122451256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0100d22f0 msgr2=0x7fc010154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:51.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.136+0000 7fc014e00640 1 --2- 172.21.15.153:0/122451256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0100d22f0 0x7fc010154ca0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc00000c430 tx=0x7fc00000c8f0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.136+0000 7fc014e00640 1 -- 172.21.15.153:0/122451256 shutdown_connections 2024-03-28T21:52:51.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.136+0000 7fc014e00640 1 --2- 172.21.15.153:0/122451256 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbfec06b4d0 0x7fbfec06d990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.136+0000 7fc014e00640 1 --2- 172.21.15.153:0/122451256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc01015e560 0x7fc0100b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.136+0000 7fc014e00640 1 --2- 172.21.15.153:0/122451256 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc01015e180 0x7fc0100b6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.136+0000 7fc014e00640 1 --2- 172.21.15.153:0/122451256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0100d22f0 0x7fc010154ca0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.136+0000 7fc014e00640 1 -- 172.21.15.153:0/122451256 >> 172.21.15.153:0/122451256 conn(0x7fc01009aa50 msgr2=0x7fc01006d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:51.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.136+0000 7fc014e00640 1 -- 172.21.15.153:0/122451256 shutdown_connections 2024-03-28T21:52:51.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.136+0000 7fc014e00640 1 -- 172.21.15.153:0/122451256 wait complete. 2024-03-28T21:52:51.160 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T21:52:51.300 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:52:51.309 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:52:51.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.374+0000 7f0c3a800640 1 Processor -- start 2024-03-28T21:52:51.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.374+0000 7f0c3a800640 1 -- start start 2024-03-28T21:52:51.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.375+0000 7f0c3a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c34161990 0x7f0c340d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.375+0000 7f0c3a800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0c340d2ad0 0x7f0c340cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.375+0000 7f0c3a800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c340ceca0 con 0x7f0c340b3a60 2024-03-28T21:52:51.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.375+0000 7f0c3a800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0c340d1a20 con 0x7f0c340d2ad0 2024-03-28T21:52:51.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.375+0000 7f0c3a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c340d4810 con 0x7f0c34161990 2024-03-28T21:52:51.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.376+0000 7f0c2be00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0c340b3a60 0x7f0c340d23c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:57266/0 (socket says 172.21.15.153:57266) 2024-03-28T21:52:51.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.376+0000 7f0c2be00640 1 -- 172.21.15.153:0/2272919988 learned_addr learned my addr 172.21.15.153:0/2272919988 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:51.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.376+0000 7f0c33e00640 1 --2- 172.21.15.153:0/2272919988 >> v2:172.21.15.165:3300/0 conn(0x7f0c340d2ad0 0x7f0c340cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:51.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.376+0000 7f0c33400640 1 --2- 172.21.15.153:0/2272919988 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c34161990 0x7f0c340d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:51.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.376+0000 7f0c32a00640 1 -- 172.21.15.153:0/2272919988 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701796757 0 0) 0x7f0c1c001110 con 0x7f0c340b3a60 2024-03-28T21:52:51.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.376+0000 7f0c32a00640 1 -- 172.21.15.153:0/2272919988 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c18003520 con 0x7f0c340b3a60 2024-03-28T21:52:51.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.376+0000 7f0c32a00640 1 -- 172.21.15.153:0/2272919988 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1189396079 0 0) 0x7f0c18003520 con 0x7f0c340b3a60 2024-03-28T21:52:51.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c32a00640 1 -- 172.21.15.153:0/2272919988 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c34161990 msgr2=0x7f0c340d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:51.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c32a00640 1 --2- 172.21.15.153:0/2272919988 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c34161990 0x7f0c340d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c32a00640 1 -- 172.21.15.153:0/2272919988 >> v2:172.21.15.165:3300/0 conn(0x7f0c340d2ad0 msgr2=0x7f0c340cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:51.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c32a00640 1 --2- 172.21.15.153:0/2272919988 >> v2:172.21.15.165:3300/0 conn(0x7f0c340d2ad0 0x7f0c340cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c32a00640 1 -- 172.21.15.153:0/2272919988 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c340d4af0 con 0x7f0c340b3a60 2024-03-28T21:52:51.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c32a00640 1 -- 172.21.15.153:0/2272919988 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f0c1c001840 con 0x7f0c340b3a60 2024-03-28T21:52:51.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c32a00640 1 -- 172.21.15.153:0/2272919988 >> v1:172.21.15.153:6789/0 conn(0x7f0c340b3a60 legacy=0x7f0c340d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:51.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c32a00640 1 --2- 172.21.15.153:0/2272919988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c180039b0 0x7f0c18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c32a00640 1 --2- 172.21.15.153:0/2272919988 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c34161990 0x7f0c18004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c32a00640 1 --2- 172.21.15.153:0/2272919988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c18004d40 0x7f0c180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c32a00640 1 -- 172.21.15.153:0/2272919988 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c340d1a20 con 0x7f0c180039b0 2024-03-28T21:52:51.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c32a00640 1 -- 172.21.15.153:0/2272919988 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0c340d4810 con 0x7f0c18004d40 2024-03-28T21:52:51.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c32a00640 1 -- 172.21.15.153:0/2272919988 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c1800b9c0 con 0x7f0c34161990 2024-03-28T21:52:51.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c33400640 1 --2- 172.21.15.153:0/2272919988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c180039b0 0x7f0c18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:51.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c33e00640 1 --2- 172.21.15.153:0/2272919988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c18004d40 0x7f0c180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:51.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.377+0000 7f0c2be00640 1 --2- 172.21.15.153:0/2272919988 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c34161990 0x7f0c18004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:51.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.378+0000 7f0c33400640 1 -- 172.21.15.153:0/2272919988 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c34161990 msgr2=0x7f0c18004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:51.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.378+0000 7f0c33400640 1 --2- 172.21.15.153:0/2272919988 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c34161990 0x7f0c18004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.378+0000 7f0c33400640 1 -- 172.21.15.153:0/2272919988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c18004d40 msgr2=0x7f0c180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:51.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.378+0000 7f0c33400640 1 --2- 172.21.15.153:0/2272919988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c18004d40 0x7f0c180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.378+0000 7f0c33400640 1 -- 172.21.15.153:0/2272919988 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c18003520 con 0x7f0c180039b0 2024-03-28T21:52:51.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.378+0000 7f0c33e00640 1 --2- 172.21.15.153:0/2272919988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c18004d40 0x7f0c180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:51.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.379+0000 7f0c33400640 1 --2- 172.21.15.153:0/2272919988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c180039b0 0x7f0c18003dd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009ac0 tx=0x7f0c18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eea4e6815dbee23 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:51.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.379+0000 7f0c32a00640 1 -- 172.21.15.153:0/2272919988 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24039070 con 0x7f0c180039b0 2024-03-28T21:52:51.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.379+0000 7f0c32a00640 1 -- 172.21.15.153:0/2272919988 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2402c6b0 con 0x7f0c180039b0 2024-03-28T21:52:51.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.379+0000 7f0c32a00640 1 -- 172.21.15.153:0/2272919988 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24009690 con 0x7f0c180039b0 2024-03-28T21:52:51.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.380+0000 7f0c3a800640 1 -- 172.21.15.153:0/2272919988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c180039b0 msgr2=0x7f0c18003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:51.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.380+0000 7f0c3a800640 1 --2- 172.21.15.153:0/2272919988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c180039b0 0x7f0c18003dd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009ac0 tx=0x7f0c18005830 comp rx=0 tx=0).stop 2024-03-28T21:52:51.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.380+0000 7f0c33e00640 1 -- 172.21.15.153:0/2272919988 reap_dead start 2024-03-28T21:52:51.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.380+0000 7f0c3a800640 1 -- 172.21.15.153:0/2272919988 shutdown_connections 2024-03-28T21:52:51.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.380+0000 7f0c3a800640 1 -- 172.21.15.153:0/2272919988 >> 172.21.15.153:0/2272919988 conn(0x7f0c3409d430 msgr2=0x7f0c340d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:51.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.380+0000 7f0c3a800640 1 -- 172.21.15.153:0/2272919988 shutdown_connections 2024-03-28T21:52:51.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.380+0000 7f0c3a800640 1 -- 172.21.15.153:0/2272919988 wait complete. 2024-03-28T21:52:51.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.382+0000 7f0c3a800640 1 Processor -- start 2024-03-28T21:52:51.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.382+0000 7f0c3a800640 1 -- start start 2024-03-28T21:52:51.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.383+0000 7f0c3a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c180039b0 0x7f0c3415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.383+0000 7f0c3a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c340cbbe0 0x7f0c341540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.383+0000 7f0c3a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c34152130 0x7f0c341545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.383+0000 7f0c3a800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c340cf200 con 0x7f0c340cbbe0 2024-03-28T21:52:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.383+0000 7f0c3a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0c340cef20 con 0x7f0c34152130 2024-03-28T21:52:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.383+0000 7f0c3a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c340b3ec0 con 0x7f0c180039b0 2024-03-28T21:52:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.383+0000 7f0c2be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c340cbbe0 0x7f0c341540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.383+0000 7f0c2be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c340cbbe0 0x7f0c341540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48220/0 (socket says 172.21.15.153:48220) 2024-03-28T21:52:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.383+0000 7f0c2be00640 1 -- 172.21.15.153:0/817247586 learned_addr learned my addr 172.21.15.153:0/817247586 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.384+0000 7f0c33400640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c180039b0 0x7f0c3415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.384+0000 7f0c2be00640 1 -- 172.21.15.153:0/817247586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c180039b0 msgr2=0x7f0c3415b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.384+0000 7f0c2be00640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c180039b0 0x7f0c3415b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.384+0000 7f0c2be00640 1 -- 172.21.15.153:0/817247586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c34152130 msgr2=0x7f0c341545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.384+0000 7f0c33e00640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c34152130 0x7f0c341545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.384+0000 7f0c2be00640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c34152130 0x7f0c341545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.384+0000 7f0c2be00640 1 -- 172.21.15.153:0/817247586 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c340b9810 con 0x7f0c340cbbe0 2024-03-28T21:52:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.384+0000 7f0c33e00640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c34152130 0x7f0c341545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.384+0000 7f0c2be00640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c340cbbe0 0x7f0c341540a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00e850 tx=0x7f0c1c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.384+0000 7f0c2b400640 1 -- 172.21.15.153:0/817247586 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c00c870 con 0x7f0c340cbbe0 2024-03-28T21:52:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.385+0000 7f0c2b400640 1 -- 172.21.15.153:0/817247586 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c018070 con 0x7f0c340cbbe0 2024-03-28T21:52:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.385+0000 7f0c2b400640 1 -- 172.21.15.153:0/817247586 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c00cc70 con 0x7f0c340cbbe0 2024-03-28T21:52:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.385+0000 7f0c3a800640 1 -- 172.21.15.153:0/817247586 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c340cc380 con 0x7f0c340cbbe0 2024-03-28T21:52:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.385+0000 7f0c3a800640 1 -- 172.21.15.153:0/817247586 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c340cc0a0 con 0x7f0c340cbbe0 2024-03-28T21:52:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.386+0000 7f0c3a800640 1 -- 172.21.15.153:0/817247586 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c34068ff0 con 0x7f0c340cbbe0 2024-03-28T21:52:51.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.388+0000 7f0c2b400640 1 -- 172.21.15.153:0/817247586 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0c1c013420 con 0x7f0c340cbbe0 2024-03-28T21:52:51.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.389+0000 7f0c2b400640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c1006b500 0x7f0c1006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.389+0000 7f0c2b400640 1 -- 172.21.15.153:0/817247586 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f0c1c089f00 con 0x7f0c340cbbe0 2024-03-28T21:52:51.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.389+0000 7f0c33400640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c1006b500 0x7f0c1006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:51.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.390+0000 7f0c33400640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c1006b500 0x7f0c1006d9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0c24036000 tx=0x7f0c24030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:51.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.394+0000 7f0c2b400640 1 -- 172.21.15.153:0/817247586 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0c340cc380 con 0x7f0c340cbbe0 2024-03-28T21:52:51.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.592+0000 7f0c3a800640 1 -- 172.21.15.153:0/817247586 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0c340cb9c0 con 0x7f0c340cbbe0 2024-03-28T21:52:51.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.593+0000 7f0c2b400640 1 -- 172.21.15.153:0/817247586 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f0c340ceca0 con 0x7f0c340cbbe0 2024-03-28T21:52:51.596 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-03-28T21:52:51.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.596+0000 7f0c3a800640 1 -- 172.21.15.153:0/817247586 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c1006b500 msgr2=0x7f0c1006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.596+0000 7f0c3a800640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c1006b500 0x7f0c1006d9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0c24036000 tx=0x7f0c24030000 comp rx=0 tx=0).stop 2024-03-28T21:52:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.596+0000 7f0c3a800640 1 -- 172.21.15.153:0/817247586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c340cbbe0 msgr2=0x7f0c341540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.596+0000 7f0c3a800640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c340cbbe0 0x7f0c341540a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00e850 tx=0x7f0c1c00ed10 comp rx=0 tx=0).stop 2024-03-28T21:52:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.596+0000 7f0c3a800640 1 -- 172.21.15.153:0/817247586 shutdown_connections 2024-03-28T21:52:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.596+0000 7f0c3a800640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c1006b500 0x7f0c1006d9c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.596+0000 7f0c3a800640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c34152130 0x7f0c341545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.596+0000 7f0c3a800640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c340cbbe0 0x7f0c341540a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.596+0000 7f0c3a800640 1 --2- 172.21.15.153:0/817247586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c180039b0 0x7f0c3415b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.596+0000 7f0c3a800640 1 -- 172.21.15.153:0/817247586 >> 172.21.15.153:0/817247586 conn(0x7f0c3409d430 msgr2=0x7f0c3406bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.596+0000 7f0c3a800640 1 -- 172.21.15.153:0/817247586 shutdown_connections 2024-03-28T21:52:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.596+0000 7f0c3a800640 1 -- 172.21.15.153:0/817247586 wait complete. 2024-03-28T21:52:51.619 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-28T21:52:51.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.827+0000 7f485bc00640 1 Processor -- start 2024-03-28T21:52:51.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.827+0000 7f485bc00640 1 -- start start 2024-03-28T21:52:51.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.829+0000 7f485bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f485406ede0 0x7f4854071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.829+0000 7f485bc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f48540b3a70 0x7f48540b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.829+0000 7f485bc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f485406db60 con 0x7f4854070d70 2024-03-28T21:52:51.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.829+0000 7f485bc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f48540b35e0 con 0x7f48540b3a70 2024-03-28T21:52:51.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.829+0000 7f485bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f485406de40 con 0x7f485406ede0 2024-03-28T21:52:51.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.829+0000 7f4859200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4854070d70 0x7f4854071150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:57282/0 (socket says 172.21.15.153:57282) 2024-03-28T21:52:51.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.829+0000 7f4859200640 1 -- 172.21.15.153:0/2670916025 learned_addr learned my addr 172.21.15.153:0/2670916025 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:51.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.829+0000 7f4859c00640 1 --2- 172.21.15.153:0/2670916025 >> v2:172.21.15.153:3300/0 conn(0x7f48540b3a70 0x7f48540b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:51.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.830+0000 7f484be00640 1 --2- 172.21.15.153:0/2670916025 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f485406ede0 0x7f4854071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:51.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.830+0000 7f4859c00640 1 -- 172.21.15.153:0/2670916025 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f485406ede0 msgr2=0x7f4854071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:51.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.830+0000 7f4859c00640 1 --2- 172.21.15.153:0/2670916025 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f485406ede0 0x7f4854071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.830+0000 7f4859c00640 1 -- 172.21.15.153:0/2670916025 >> v1:172.21.15.153:6789/0 conn(0x7f4854070d70 legacy=0x7f4854071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:51.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.830+0000 7f4859c00640 1 -- 172.21.15.153:0/2670916025 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485406e120 con 0x7f48540b3a70 2024-03-28T21:52:51.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.830+0000 7f4853e00640 1 -- 172.21.15.153:0/2670916025 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208517821 0 0) 0x7f485406db60 con 0x7f4854070d70 2024-03-28T21:52:51.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.831+0000 7f4859c00640 1 --2- 172.21.15.153:0/2670916025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48540b3a70 0x7f48540b3f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f484c009d90 tx=0x7f484c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91deebdabd239f7a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:51.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.831+0000 7f4853e00640 1 -- 172.21.15.153:0/2670916025 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c039070 con 0x7f48540b3a70 2024-03-28T21:52:51.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.831+0000 7f4853e00640 1 -- 172.21.15.153:0/2670916025 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f484c02cc50 con 0x7f48540b3a70 2024-03-28T21:52:51.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.831+0000 7f4853e00640 1 -- 172.21.15.153:0/2670916025 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c034440 con 0x7f48540b3a70 2024-03-28T21:52:51.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.832+0000 7f485bc00640 1 -- 172.21.15.153:0/2670916025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48540b3a70 msgr2=0x7f48540b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:51.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.832+0000 7f485bc00640 1 --2- 172.21.15.153:0/2670916025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48540b3a70 0x7f48540b3f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f484c009d90 tx=0x7f484c02bea0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.832+0000 7f485bc00640 1 -- 172.21.15.153:0/2670916025 shutdown_connections 2024-03-28T21:52:51.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.832+0000 7f485bc00640 1 --2- 172.21.15.153:0/2670916025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48540b3a70 0x7f48540b3f20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.832+0000 7f485bc00640 1 --2- 172.21.15.153:0/2670916025 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f485406ede0 0x7f4854071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.832+0000 7f485bc00640 1 -- 172.21.15.153:0/2670916025 >> 172.21.15.153:0/2670916025 conn(0x7f48540cfc00 msgr2=0x7f48540cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:51.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.832+0000 7f485bc00640 1 -- 172.21.15.153:0/2670916025 shutdown_connections 2024-03-28T21:52:51.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.832+0000 7f485bc00640 1 -- 172.21.15.153:0/2670916025 wait complete. 2024-03-28T21:52:51.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.834+0000 7f485bc00640 1 Processor -- start 2024-03-28T21:52:51.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.834+0000 7f485bc00640 1 -- start start 2024-03-28T21:52:51.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.835+0000 7f485bc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f485406ede0 0x7f485415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.835+0000 7f485bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4854070d70 0x7f485414ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.835+0000 7f485bc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48540b3a70 0x7f48541496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.835+0000 7f485bc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f485415e5b0 con 0x7f485406ede0 2024-03-28T21:52:51.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.835+0000 7f485bc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f485415e430 con 0x7f48540b3a70 2024-03-28T21:52:51.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.835+0000 7f485bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f48540b4460 con 0x7f4854070d70 2024-03-28T21:52:51.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.835+0000 7f4859200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f485406ede0 0x7f485415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:51.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.835+0000 7f4859200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f485406ede0 0x7f485415a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48240/0 (socket says 172.21.15.153:48240) 2024-03-28T21:52:51.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.835+0000 7f4859200640 1 -- 172.21.15.153:0/2249549062 learned_addr learned my addr 172.21.15.153:0/2249549062 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:51.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.835+0000 7f4859200640 1 -- 172.21.15.153:0/2249549062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4854070d70 msgr2=0x7f485414ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:51.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.835+0000 7f4859200640 1 --2- 172.21.15.153:0/2249549062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4854070d70 0x7f485414ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.835+0000 7f4859200640 1 -- 172.21.15.153:0/2249549062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48540b3a70 msgr2=0x7f48541496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:51.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.835+0000 7f4859200640 1 --2- 172.21.15.153:0/2249549062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48540b3a70 0x7f48541496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:51.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.836+0000 7f4859200640 1 -- 172.21.15.153:0/2249549062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485414b160 con 0x7f485406ede0 2024-03-28T21:52:51.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.836+0000 7f4859200640 1 --2- 172.21.15.153:0/2249549062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f485406ede0 0x7f485415a770 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f484400c4d0 tx=0x7f484400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:51.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.836+0000 7f4851600640 1 -- 172.21.15.153:0/2249549062 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844018070 con 0x7f485406ede0 2024-03-28T21:52:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.836+0000 7f4851600640 1 -- 172.21.15.153:0/2249549062 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4844007500 con 0x7f485406ede0 2024-03-28T21:52:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.836+0000 7f485bc00640 1 -- 172.21.15.153:0/2249549062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f485414b3e0 con 0x7f485406ede0 2024-03-28T21:52:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.836+0000 7f4851600640 1 -- 172.21.15.153:0/2249549062 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844004a20 con 0x7f485406ede0 2024-03-28T21:52:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.836+0000 7f485bc00640 1 -- 172.21.15.153:0/2249549062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f485414b9a0 con 0x7f485406ede0 2024-03-28T21:52:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.838+0000 7f485bc00640 1 -- 172.21.15.153:0/2249549062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4854068ff0 con 0x7f485406ede0 2024-03-28T21:52:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.838+0000 7f4851600640 1 -- 172.21.15.153:0/2249549062 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f484401b070 con 0x7f485406ede0 2024-03-28T21:52:51.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.839+0000 7f4851600640 1 --2- 172.21.15.153:0/2249549062 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f483006b4d0 0x7f483006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:51.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.839+0000 7f4851600640 1 -- 172.21.15.153:0/2249549062 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f4844089620 con 0x7f485406ede0 2024-03-28T21:52:51.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.839+0000 7f484be00640 1 --2- 172.21.15.153:0/2249549062 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f483006b4d0 0x7f483006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:51.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.840+0000 7f484be00640 1 --2- 172.21.15.153:0/2249549062 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f483006b4d0 0x7f483006d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f485415acb0 tx=0x7f483c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:51.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:51.843+0000 7f4851600640 1 -- 172.21.15.153:0/2249549062 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f485414b160 con 0x7f485406ede0 2024-03-28T21:52:52.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.057+0000 7f485bc00640 1 -- 172.21.15.153:0/2249549062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f48540b2eb0 con 0x7f485406ede0 2024-03-28T21:52:52.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.057+0000 7f4851600640 1 -- 172.21.15.153:0/2249549062 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f4844058380 con 0x7f485406ede0 2024-03-28T21:52:52.060 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2024-03-28T21:52:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.060+0000 7f485bc00640 1 -- 172.21.15.153:0/2249549062 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f483006b4d0 msgr2=0x7f483006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.060+0000 7f485bc00640 1 --2- 172.21.15.153:0/2249549062 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f483006b4d0 0x7f483006d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f485415acb0 tx=0x7f483c008040 comp rx=0 tx=0).stop 2024-03-28T21:52:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.060+0000 7f485bc00640 1 -- 172.21.15.153:0/2249549062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f485406ede0 msgr2=0x7f485415a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.060+0000 7f485bc00640 1 --2- 172.21.15.153:0/2249549062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f485406ede0 0x7f485415a770 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f484400c4d0 tx=0x7f484400c990 comp rx=0 tx=0).stop 2024-03-28T21:52:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.060+0000 7f485bc00640 1 -- 172.21.15.153:0/2249549062 shutdown_connections 2024-03-28T21:52:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.060+0000 7f485bc00640 1 --2- 172.21.15.153:0/2249549062 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f483006b4d0 0x7f483006d990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.060+0000 7f485bc00640 1 --2- 172.21.15.153:0/2249549062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48540b3a70 0x7f48541496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.060+0000 7f485bc00640 1 --2- 172.21.15.153:0/2249549062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4854070d70 0x7f485414ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.060+0000 7f485bc00640 1 --2- 172.21.15.153:0/2249549062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f485406ede0 0x7f485415a770 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.060+0000 7f485bc00640 1 -- 172.21.15.153:0/2249549062 >> 172.21.15.153:0/2249549062 conn(0x7f48540cfc00 msgr2=0x7f48540cef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.060+0000 7f485bc00640 1 -- 172.21.15.153:0/2249549062 shutdown_connections 2024-03-28T21:52:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.060+0000 7f485bc00640 1 -- 172.21.15.153:0/2249549062 wait complete. 2024-03-28T21:52:52.080 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-03-28T21:52:52.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:52.080 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-03-28T21:52:52.184 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-03-28T21:52:52.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:52:52.185 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-28T21:52:52.235 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-28T21:52:52.236 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T21:52:52.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.447+0000 7fbdcec00640 1 Processor -- start 2024-03-28T21:52:52.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.447+0000 7fbdcec00640 1 -- start start 2024-03-28T21:52:52.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.448+0000 7fbdcec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdc8161d80 0x7fbdc80b5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:52.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.448+0000 7fbdcec00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbdc80d02c0 0x7fbdc80cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:52.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.448+0000 7fbdcec00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc8162b90 con 0x7fbdc80b3820 2024-03-28T21:52:52.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.448+0000 7fbdcec00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc80d2820 con 0x7fbdc80d02c0 2024-03-28T21:52:52.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.448+0000 7fbdcec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc80d2b00 con 0x7fbdc8161d80 2024-03-28T21:52:52.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.449+0000 7fbdce200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbdc80d02c0 0x7fbdc80cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:52.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.449+0000 7fbdce200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbdc80d02c0 0x7fbdc80cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48254/0 (socket says 172.21.15.153:48254) 2024-03-28T21:52:52.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.449+0000 7fbdcce00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbdc80b3820 0x7fbdc8162160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:57294/0 (socket says 172.21.15.153:57294) 2024-03-28T21:52:52.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.449+0000 7fbdce200640 1 -- 172.21.15.153:0/568696584 learned_addr learned my addr 172.21.15.153:0/568696584 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:52.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.449+0000 7fbdcd800640 1 --2- 172.21.15.153:0/568696584 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdc8161d80 0x7fbdc80b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:52.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.449+0000 7fbdce200640 1 -- 172.21.15.153:0/568696584 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdc8161d80 msgr2=0x7fbdc80b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:52.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.449+0000 7fbdce200640 1 --2- 172.21.15.153:0/568696584 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdc8161d80 0x7fbdc80b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.449+0000 7fbdce200640 1 -- 172.21.15.153:0/568696584 >> v1:172.21.15.153:6789/0 conn(0x7fbdc80b3820 legacy=0x7fbdc8162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:52.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.449+0000 7fbdce200640 1 -- 172.21.15.153:0/568696584 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc80d2de0 con 0x7fbdc80d02c0 2024-03-28T21:52:52.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.449+0000 7fbdcd800640 1 --2- 172.21.15.153:0/568696584 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdc8161d80 0x7fbdc80b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:52.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.450+0000 7fbdce200640 1 --2- 172.21.15.153:0/568696584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc80d02c0 0x7fbdc80cf0c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009e50 tx=0x7fbdc002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29a94719aa8b7e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:52.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.451+0000 7fbdc7e00640 1 -- 172.21.15.153:0/568696584 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc002ca80 con 0x7fbdc80d02c0 2024-03-28T21:52:52.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.451+0000 7fbdc7e00640 1 -- 172.21.15.153:0/568696584 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc002cc20 con 0x7fbdc80d02c0 2024-03-28T21:52:52.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.451+0000 7fbdc7e00640 1 -- 172.21.15.153:0/568696584 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc00343f0 con 0x7fbdc80d02c0 2024-03-28T21:52:52.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.451+0000 7fbdcec00640 1 -- 172.21.15.153:0/568696584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc80d02c0 msgr2=0x7fbdc80cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:52.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.451+0000 7fbdcec00640 1 --2- 172.21.15.153:0/568696584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc80d02c0 0x7fbdc80cf0c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009e50 tx=0x7fbdc002bee0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.452+0000 7fbdcec00640 1 -- 172.21.15.153:0/568696584 shutdown_connections 2024-03-28T21:52:52.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.452+0000 7fbdcec00640 1 --2- 172.21.15.153:0/568696584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc80d02c0 0x7fbdc80cf0c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.452+0000 7fbdcec00640 1 --2- 172.21.15.153:0/568696584 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdc8161d80 0x7fbdc80b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.452+0000 7fbdcec00640 1 -- 172.21.15.153:0/568696584 >> 172.21.15.153:0/568696584 conn(0x7fbdc80d3f10 msgr2=0x7fbdc80d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:52.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.452+0000 7fbdcec00640 1 -- 172.21.15.153:0/568696584 shutdown_connections 2024-03-28T21:52:52.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.452+0000 7fbdcec00640 1 -- 172.21.15.153:0/568696584 wait complete. 2024-03-28T21:52:52.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.453+0000 7fbdcec00640 1 Processor -- start 2024-03-28T21:52:52.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.453+0000 7fbdcec00640 1 -- start start 2024-03-28T21:52:52.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.454+0000 7fbdcec00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc80b3820 0x7fbdc8156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:52.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.454+0000 7fbdcec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdc80d02c0 0x7fbdc80b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:52.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.454+0000 7fbdcec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdc8161d80 0x7fbdc8160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:52.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.454+0000 7fbdcec00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc80ceae0 con 0x7fbdc80b3820 2024-03-28T21:52:52.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.454+0000 7fbdcec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc8161a60 con 0x7fbdc8161d80 2024-03-28T21:52:52.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.454+0000 7fbdcec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc80cec60 con 0x7fbdc80d02c0 2024-03-28T21:52:52.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.455+0000 7fbdcd800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc80b3820 0x7fbdc8156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:52.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.455+0000 7fbdcd800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc80b3820 0x7fbdc8156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48262/0 (socket says 172.21.15.153:48262) 2024-03-28T21:52:52.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.455+0000 7fbdcd800640 1 -- 172.21.15.153:0/3927596110 learned_addr learned my addr 172.21.15.153:0/3927596110 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:52.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.455+0000 7fbdcce00640 1 --2- 172.21.15.153:0/3927596110 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdc80d02c0 0x7fbdc80b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:52.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.455+0000 7fbdce200640 1 --2- 172.21.15.153:0/3927596110 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdc8161d80 0x7fbdc8160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:52.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.455+0000 7fbdcd800640 1 -- 172.21.15.153:0/3927596110 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdc80d02c0 msgr2=0x7fbdc80b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:52.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.455+0000 7fbdcd800640 1 --2- 172.21.15.153:0/3927596110 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdc80d02c0 0x7fbdc80b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.455+0000 7fbdcd800640 1 -- 172.21.15.153:0/3927596110 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdc8161d80 msgr2=0x7fbdc8160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:52.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.455+0000 7fbdcd800640 1 --2- 172.21.15.153:0/3927596110 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdc8161d80 0x7fbdc8160900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.455+0000 7fbdcd800640 1 -- 172.21.15.153:0/3927596110 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc806d790 con 0x7fbdc80b3820 2024-03-28T21:52:52.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.456+0000 7fbdcd800640 1 --2- 172.21.15.153:0/3927596110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc80b3820 0x7fbdc8156460 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00e7e0 tx=0x7fbdbc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:52.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.456+0000 7fbdc5600640 1 -- 172.21.15.153:0/3927596110 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00f040 con 0x7fbdc80b3820 2024-03-28T21:52:52.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.456+0000 7fbdc5600640 1 -- 172.21.15.153:0/3927596110 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdbc004030 con 0x7fbdc80b3820 2024-03-28T21:52:52.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.456+0000 7fbdcec00640 1 -- 172.21.15.153:0/3927596110 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc80b16d0 con 0x7fbdc80b3820 2024-03-28T21:52:52.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.456+0000 7fbdc5600640 1 -- 172.21.15.153:0/3927596110 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc004400 con 0x7fbdc80b3820 2024-03-28T21:52:52.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.456+0000 7fbdcec00640 1 -- 172.21.15.153:0/3927596110 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc815b0b0 con 0x7fbdc80b3820 2024-03-28T21:52:52.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.457+0000 7fbdcec00640 1 -- 172.21.15.153:0/3927596110 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc804f520 con 0x7fbdc80b3820 2024-03-28T21:52:52.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.458+0000 7fbdc5600640 1 -- 172.21.15.153:0/3927596110 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fbdbc00c6d0 con 0x7fbdc80b3820 2024-03-28T21:52:52.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.460+0000 7fbdc5600640 1 --2- 172.21.15.153:0/3927596110 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbda806b4d0 0x7fbda806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:52.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.460+0000 7fbdc5600640 1 -- 172.21.15.153:0/3927596110 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fbdbc08a100 con 0x7fbdc80b3820 2024-03-28T21:52:52.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.460+0000 7fbdcce00640 1 --2- 172.21.15.153:0/3927596110 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbda806b4d0 0x7fbda806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:52.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.461+0000 7fbdcce00640 1 --2- 172.21.15.153:0/3927596110 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbda806b4d0 0x7fbda806d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80ca590 tx=0x7fbdb4007ce0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:52.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.464+0000 7fbdc5600640 1 -- 172.21.15.153:0/3927596110 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbdbc017020 con 0x7fbdc80b3820 2024-03-28T21:52:52.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.699+0000 7fbdcec00640 1 -- 172.21.15.153:0/3927596110 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdc806b320 con 0x7fbdc80b3820 2024-03-28T21:52:52.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.699+0000 7fbdc5600640 1 -- 172.21.15.153:0/3927596110 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fbdbc058ee0 con 0x7fbdc80b3820 2024-03-28T21:52:52.702 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:52.702 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/207550071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":207550071},{"type":"v1","addr":"172.21.15.165:6835","nonce":207550071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/900073633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":900073633},{"type":"v1","addr":"172.21.15.153:6837","nonce":900073633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3915706377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3915706377},{"type":"v1","addr":"172.21.15.165:6833","nonce":3915706377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T21:51:56.169625+0000","modified":"2024-03-28T21:51:59.218861+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6836/3516257974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3516257974},{"type":"v1","addr":"172.21.15.153:6836","nonce":3516257974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-03-28T21:52:52.703 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2024-03-28T21:52:52.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.702+0000 7fbdcec00640 1 -- 172.21.15.153:0/3927596110 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbda806b4d0 msgr2=0x7fbda806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:52.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.702+0000 7fbdcec00640 1 --2- 172.21.15.153:0/3927596110 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbda806b4d0 0x7fbda806d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80ca590 tx=0x7fbdb4007ce0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.702+0000 7fbdcec00640 1 -- 172.21.15.153:0/3927596110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc80b3820 msgr2=0x7fbdc8156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:52.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.702+0000 7fbdcec00640 1 --2- 172.21.15.153:0/3927596110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc80b3820 0x7fbdc8156460 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00e7e0 tx=0x7fbdbc00eca0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.702+0000 7fbdcec00640 1 -- 172.21.15.153:0/3927596110 shutdown_connections 2024-03-28T21:52:52.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.702+0000 7fbdcec00640 1 --2- 172.21.15.153:0/3927596110 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fbda806b4d0 0x7fbda806d990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.702+0000 7fbdcec00640 1 --2- 172.21.15.153:0/3927596110 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdc8161d80 0x7fbdc8160900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.702+0000 7fbdcec00640 1 --2- 172.21.15.153:0/3927596110 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdc80d02c0 0x7fbdc80b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.702+0000 7fbdcec00640 1 --2- 172.21.15.153:0/3927596110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc80b3820 0x7fbdc8156460 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.702+0000 7fbdcec00640 1 -- 172.21.15.153:0/3927596110 >> 172.21.15.153:0/3927596110 conn(0x7fbdc80d3f10 msgr2=0x7fbdc80d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:52.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.702+0000 7fbdcec00640 1 -- 172.21.15.153:0/3927596110 shutdown_connections 2024-03-28T21:52:52.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.702+0000 7fbdcec00640 1 -- 172.21.15.153:0/3927596110 wait complete. 2024-03-28T21:52:52.723 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:52.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.926+0000 7f41de400640 1 Processor -- start 2024-03-28T21:52:52.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.926+0000 7f41de400640 1 -- start start 2024-03-28T21:52:52.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.928+0000 7f41de400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41d80ae8e0 0x7f41d80b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:52.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.928+0000 7f41de400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f41d80b4480 0x7f41d815ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:52.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.928+0000 7f41de400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d815ea70 con 0x7f41d815ade0 2024-03-28T21:52:52.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.928+0000 7f41de400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f41d80aee50 con 0x7f41d80b4480 2024-03-28T21:52:52.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.928+0000 7f41de400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f41d80af130 con 0x7f41d80ae8e0 2024-03-28T21:52:52.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.929+0000 7f41d6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41d80ae8e0 0x7f41d80b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:52.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.929+0000 7f41d6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41d80ae8e0 0x7f41d80b3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:41554/0 (socket says 172.21.15.153:41554) 2024-03-28T21:52:52.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.929+0000 7f41d6a00640 1 -- 172.21.15.153:0/1504756479 learned_addr learned my addr 172.21.15.153:0/1504756479 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:52.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.929+0000 7f41d7e00640 1 --2- 172.21.15.153:0/1504756479 >> v2:172.21.15.165:3300/0 conn(0x7f41d80b4480 0x7f41d815ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:52.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.929+0000 7f41d6a00640 1 -- 172.21.15.153:0/1504756479 >> v2:172.21.15.165:3300/0 conn(0x7f41d80b4480 msgr2=0x7f41d815ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:52.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.929+0000 7f41d6a00640 1 --2- 172.21.15.153:0/1504756479 >> v2:172.21.15.165:3300/0 conn(0x7f41d80b4480 0x7f41d815ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.929+0000 7f41d6a00640 1 -- 172.21.15.153:0/1504756479 >> v1:172.21.15.165:6789/0 conn(0x7f41d815ade0 legacy=0x7f41d80acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:52.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.929+0000 7f41d6a00640 1 -- 172.21.15.153:0/1504756479 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d80af410 con 0x7f41d80ae8e0 2024-03-28T21:52:52.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.931+0000 7f41d6a00640 1 --2- 172.21.15.153:0/1504756479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41d80ae8e0 0x7f41d80b3f40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009870 tx=0x7f41c402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9e7ce70bba90015 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:52.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.932+0000 7f41d6000640 1 -- 172.21.15.153:0/1504756479 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4034070 con 0x7f41d80ae8e0 2024-03-28T21:52:52.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.932+0000 7f41d6000640 1 -- 172.21.15.153:0/1504756479 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c4030840 con 0x7f41d80ae8e0 2024-03-28T21:52:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.932+0000 7f41d6000640 1 -- 172.21.15.153:0/1504756479 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4030c10 con 0x7f41d80ae8e0 2024-03-28T21:52:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.933+0000 7f41de400640 1 -- 172.21.15.153:0/1504756479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41d80ae8e0 msgr2=0x7f41d80b3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.933+0000 7f41de400640 1 --2- 172.21.15.153:0/1504756479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41d80ae8e0 0x7f41d80b3f40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009870 tx=0x7f41c402b980 comp rx=0 tx=0).stop 2024-03-28T21:52:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.933+0000 7f41de400640 1 -- 172.21.15.153:0/1504756479 shutdown_connections 2024-03-28T21:52:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.933+0000 7f41de400640 1 --2- 172.21.15.153:0/1504756479 >> v2:172.21.15.165:3300/0 conn(0x7f41d80b4480 0x7f41d815ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.933+0000 7f41de400640 1 --2- 172.21.15.153:0/1504756479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41d80ae8e0 0x7f41d80b3f40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.933+0000 7f41de400640 1 -- 172.21.15.153:0/1504756479 >> 172.21.15.153:0/1504756479 conn(0x7f41d80b1a30 msgr2=0x7f41d80b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.933+0000 7f41de400640 1 -- 172.21.15.153:0/1504756479 shutdown_connections 2024-03-28T21:52:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.933+0000 7f41de400640 1 -- 172.21.15.153:0/1504756479 wait complete. 2024-03-28T21:52:52.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.935+0000 7f41de400640 1 Processor -- start 2024-03-28T21:52:52.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.935+0000 7f41de400640 1 -- start start 2024-03-28T21:52:52.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.936+0000 7f41de400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d80ae8e0 0x7f41d8155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:52.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.936+0000 7f41de400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41d80b4480 0x7f41d8156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:52.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.936+0000 7f41de400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41d815ade0 0x7f41d8151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:52.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.936+0000 7f41de400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f41d815b1c0 con 0x7f41d80ae8e0 2024-03-28T21:52:52.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.937+0000 7f41de400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f41d815f460 con 0x7f41d80b4480 2024-03-28T21:52:52.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.937+0000 7f41de400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f41d81570c0 con 0x7f41d815ade0 2024-03-28T21:52:52.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.937+0000 7f41d7400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d80ae8e0 0x7f41d8155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:52.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.937+0000 7f41d7400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d80ae8e0 0x7f41d8155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48264/0 (socket says 172.21.15.153:48264) 2024-03-28T21:52:52.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.937+0000 7f41d7400640 1 -- 172.21.15.153:0/2972661614 learned_addr learned my addr 172.21.15.153:0/2972661614 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:52.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.937+0000 7f41d7e00640 1 --2- 172.21.15.153:0/2972661614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41d815ade0 0x7f41d8151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:52.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.937+0000 7f41d6a00640 1 --2- 172.21.15.153:0/2972661614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41d80b4480 0x7f41d8156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:52.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.937+0000 7f41d7400640 1 -- 172.21.15.153:0/2972661614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41d815ade0 msgr2=0x7f41d8151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:52.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.937+0000 7f41d7400640 1 --2- 172.21.15.153:0/2972661614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41d815ade0 0x7f41d8151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.937+0000 7f41d7400640 1 -- 172.21.15.153:0/2972661614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41d80b4480 msgr2=0x7f41d8156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.937+0000 7f41d7400640 1 --2- 172.21.15.153:0/2972661614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41d80b4480 0x7f41d8156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.937+0000 7f41d7400640 1 -- 172.21.15.153:0/2972661614 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d81560c0 con 0x7f41d80ae8e0 2024-03-28T21:52:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.938+0000 7f41d7400640 1 --2- 172.21.15.153:0/2972661614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d80ae8e0 0x7f41d8155ae0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f41c800c3c0 tx=0x7f41c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.938+0000 7f41cf400640 1 -- 172.21.15.153:0/2972661614 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c80052d0 con 0x7f41d80ae8e0 2024-03-28T21:52:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.938+0000 7f41cf400640 1 -- 172.21.15.153:0/2972661614 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c8005490 con 0x7f41d80ae8e0 2024-03-28T21:52:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.938+0000 7f41cf400640 1 -- 172.21.15.153:0/2972661614 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8007260 con 0x7f41d80ae8e0 2024-03-28T21:52:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.938+0000 7f41de400640 1 -- 172.21.15.153:0/2972661614 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d815b650 con 0x7f41d80ae8e0 2024-03-28T21:52:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.938+0000 7f41de400640 1 -- 172.21.15.153:0/2972661614 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d815bc10 con 0x7f41d80ae8e0 2024-03-28T21:52:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.940+0000 7f41de400640 1 -- 172.21.15.153:0/2972661614 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d8068ff0 con 0x7f41d80ae8e0 2024-03-28T21:52:52.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.941+0000 7f41cf400640 1 -- 172.21.15.153:0/2972661614 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f41c8007400 con 0x7f41d80ae8e0 2024-03-28T21:52:52.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.941+0000 7f41cf400640 1 --2- 172.21.15.153:0/2972661614 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f41b806b4d0 0x7f41b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:52.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.942+0000 7f41cf400640 1 -- 172.21.15.153:0/2972661614 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f41c80897b0 con 0x7f41d80ae8e0 2024-03-28T21:52:52.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.942+0000 7f41d6a00640 1 --2- 172.21.15.153:0/2972661614 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f41b806b4d0 0x7f41b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:52.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.943+0000 7f41d6a00640 1 --2- 172.21.15.153:0/2972661614 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f41b806b4d0 0x7f41b806d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f41c4036000 tx=0x7f41c403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:52.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:52.946+0000 7f41cf400640 1 -- 172.21.15.153:0/2972661614 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f41c8058520 con 0x7f41d80ae8e0 2024-03-28T21:52:53.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.144+0000 7f41de400640 1 -- 172.21.15.153:0/2972661614 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41d80742b0 con 0x7f41d80ae8e0 2024-03-28T21:52:53.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.145+0000 7f41cf400640 1 -- 172.21.15.153:0/2972661614 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16902 (secure 0 0 0) 0x7f41c8057e20 con 0x7f41d80ae8e0 2024-03-28T21:52:53.149 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:53.149 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":24,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:52:43.430328+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.148+0000 7f41de400640 1 -- 172.21.15.153:0/2972661614 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f41b806b4d0 msgr2=0x7f41b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.148+0000 7f41de400640 1 --2- 172.21.15.153:0/2972661614 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f41b806b4d0 0x7f41b806d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f41c4036000 tx=0x7f41c403b040 comp rx=0 tx=0).stop 2024-03-28T21:52:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.149+0000 7f41de400640 1 -- 172.21.15.153:0/2972661614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d80ae8e0 msgr2=0x7f41d8155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.149+0000 7f41de400640 1 --2- 172.21.15.153:0/2972661614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d80ae8e0 0x7f41d8155ae0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f41c800c3c0 tx=0x7f41c800c880 comp rx=0 tx=0).stop 2024-03-28T21:52:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.149+0000 7f41de400640 1 -- 172.21.15.153:0/2972661614 shutdown_connections 2024-03-28T21:52:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.149+0000 7f41de400640 1 --2- 172.21.15.153:0/2972661614 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f41b806b4d0 0x7f41b806d990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.149+0000 7f41de400640 1 --2- 172.21.15.153:0/2972661614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41d815ade0 0x7f41d8151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.149+0000 7f41de400640 1 --2- 172.21.15.153:0/2972661614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41d80b4480 0x7f41d8156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.149+0000 7f41de400640 1 --2- 172.21.15.153:0/2972661614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d80ae8e0 0x7f41d8155ae0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.149+0000 7f41de400640 1 -- 172.21.15.153:0/2972661614 >> 172.21.15.153:0/2972661614 conn(0x7f41d80b1a30 msgr2=0x7f41d8071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.149+0000 7f41de400640 1 -- 172.21.15.153:0/2972661614 shutdown_connections 2024-03-28T21:52:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.149+0000 7f41de400640 1 -- 172.21.15.153:0/2972661614 wait complete. 2024-03-28T21:52:53.173 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T21:51:53.863931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T21:51:55.188736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T21:52:53.174 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T21:52:53.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.400+0000 7f1216600640 1 Processor -- start 2024-03-28T21:52:53.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.400+0000 7f1216600640 1 -- start start 2024-03-28T21:52:53.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.402+0000 7f1216600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f121015e140 0x7f12100b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.402+0000 7f1216600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1210070d50 0x7f121015e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.402+0000 7f1216600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f121006cf10 con 0x7f1210071190 2024-03-28T21:52:53.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.402+0000 7f1216600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1210071fd0 con 0x7f1210070d50 2024-03-28T21:52:53.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.402+0000 7f1216600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1210071730 con 0x7f121015e140 2024-03-28T21:52:53.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.402+0000 7f1215c00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1210071190 0x7f121015ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45384/0 (socket says 172.21.15.153:45384) 2024-03-28T21:52:53.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.402+0000 7f1215c00640 1 -- 172.21.15.153:0/3874290540 learned_addr learned my addr 172.21.15.153:0/3874290540 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:53.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.402+0000 7f120fe00640 1 --2- 172.21.15.153:0/3874290540 >> v2:172.21.15.153:3300/0 conn(0x7f1210070d50 0x7f121015e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:53.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.403+0000 7f1215200640 1 --2- 172.21.15.153:0/3874290540 >> v2:172.21.15.165:3300/0 conn(0x7f121015e140 0x7f12100b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:53.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.403+0000 7f120f400640 1 -- 172.21.15.153:0/3874290540 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3519265781 0 0) 0x7f121006cf10 con 0x7f1210071190 2024-03-28T21:52:53.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.403+0000 7f120f400640 1 -- 172.21.15.153:0/3874290540 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11f4003520 con 0x7f1210071190 2024-03-28T21:52:53.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.403+0000 7f120fe00640 1 -- 172.21.15.153:0/3874290540 >> v2:172.21.15.165:3300/0 conn(0x7f121015e140 msgr2=0x7f12100b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:53.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.403+0000 7f120fe00640 1 --2- 172.21.15.153:0/3874290540 >> v2:172.21.15.165:3300/0 conn(0x7f121015e140 0x7f12100b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.403+0000 7f120fe00640 1 -- 172.21.15.153:0/3874290540 >> v1:172.21.15.153:6789/0 conn(0x7f1210071190 legacy=0x7f121015ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:53.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.403+0000 7f120fe00640 1 -- 172.21.15.153:0/3874290540 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1210071a10 con 0x7f1210070d50 2024-03-28T21:52:53.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.404+0000 7f120fe00640 1 --2- 172.21.15.153:0/3874290540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1210070d50 0x7f121015e520 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f12100d0cb0 tx=0x7f11f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c12fa6273c09a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:53.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.404+0000 7f120f400640 1 -- 172.21.15.153:0/3874290540 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8035020 con 0x7f1210070d50 2024-03-28T21:52:53.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.404+0000 7f120f400640 1 -- 172.21.15.153:0/3874290540 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f8031830 con 0x7f1210070d50 2024-03-28T21:52:53.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.404+0000 7f120f400640 1 -- 172.21.15.153:0/3874290540 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8031c00 con 0x7f1210070d50 2024-03-28T21:52:53.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.405+0000 7f1216600640 1 -- 172.21.15.153:0/3874290540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1210070d50 msgr2=0x7f121015e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:53.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.405+0000 7f1216600640 1 --2- 172.21.15.153:0/3874290540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1210070d50 0x7f121015e520 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f12100d0cb0 tx=0x7f11f802b8d0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.405+0000 7f1216600640 1 -- 172.21.15.153:0/3874290540 shutdown_connections 2024-03-28T21:52:53.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.405+0000 7f1216600640 1 --2- 172.21.15.153:0/3874290540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1210070d50 0x7f121015e520 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.405+0000 7f1216600640 1 --2- 172.21.15.153:0/3874290540 >> v2:172.21.15.165:3300/0 conn(0x7f121015e140 0x7f12100b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.405+0000 7f1216600640 1 -- 172.21.15.153:0/3874290540 >> 172.21.15.153:0/3874290540 conn(0x7f12100b1820 msgr2=0x7f12100b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:53.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.405+0000 7f1216600640 1 -- 172.21.15.153:0/3874290540 shutdown_connections 2024-03-28T21:52:53.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.405+0000 7f1216600640 1 -- 172.21.15.153:0/3874290540 wait complete. 2024-03-28T21:52:53.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.407+0000 7f1216600640 1 Processor -- start 2024-03-28T21:52:53.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.407+0000 7f1216600640 1 -- start start 2024-03-28T21:52:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.408+0000 7f1216600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1210070d50 0x7f121015a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.408+0000 7f1216600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1210071190 0x7f121015ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.408+0000 7f1216600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121015e140 0x7f12101f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.408+0000 7f1216600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f12100b4c30 con 0x7f1210070d50 2024-03-28T21:52:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.408+0000 7f1216600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f121006d1b0 con 0x7f1210071190 2024-03-28T21:52:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.408+0000 7f1216600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f12100b4db0 con 0x7f121015e140 2024-03-28T21:52:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.408+0000 7f1215200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1210070d50 0x7f121015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.408+0000 7f1215200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1210070d50 0x7f121015a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36908/0 (socket says 172.21.15.153:36908) 2024-03-28T21:52:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.408+0000 7f1215200640 1 -- 172.21.15.153:0/3048974595 learned_addr learned my addr 172.21.15.153:0/3048974595 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.408+0000 7f1215200640 1 -- 172.21.15.153:0/3048974595 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121015e140 msgr2=0x7f12101f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.408+0000 7f1215200640 1 --2- 172.21.15.153:0/3048974595 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121015e140 0x7f12101f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.408+0000 7f1215200640 1 -- 172.21.15.153:0/3048974595 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1210071190 msgr2=0x7f121015ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.408+0000 7f1215200640 1 --2- 172.21.15.153:0/3048974595 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1210071190 0x7f121015ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.408+0000 7f1215200640 1 -- 172.21.15.153:0/3048974595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12100cdab0 con 0x7f1210070d50 2024-03-28T21:52:53.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.409+0000 7f1215200640 1 --2- 172.21.15.153:0/3048974595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1210070d50 0x7f121015a820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f120000d620 tx=0x7f120000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:53.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.409+0000 7f120cc00640 1 -- 172.21.15.153:0/3048974595 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120000b620 con 0x7f1210070d50 2024-03-28T21:52:53.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.409+0000 7f120cc00640 1 -- 172.21.15.153:0/3048974595 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1200019070 con 0x7f1210070d50 2024-03-28T21:52:53.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.409+0000 7f120cc00640 1 -- 172.21.15.153:0/3048974595 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120000b9e0 con 0x7f1210070d50 2024-03-28T21:52:53.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.409+0000 7f1216600640 1 -- 172.21.15.153:0/3048974595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12100cdd90 con 0x7f1210070d50 2024-03-28T21:52:53.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.409+0000 7f1216600640 1 -- 172.21.15.153:0/3048974595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12100ce350 con 0x7f1210070d50 2024-03-28T21:52:53.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.410+0000 7f1216600640 1 -- 172.21.15.153:0/3048974595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1210068ff0 con 0x7f1210070d50 2024-03-28T21:52:53.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.411+0000 7f120cc00640 1 -- 172.21.15.153:0/3048974595 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f120000bb80 con 0x7f1210070d50 2024-03-28T21:52:53.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.412+0000 7f120cc00640 1 --2- 172.21.15.153:0/3048974595 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f11ec06b500 0x7f11ec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.412+0000 7f120cc00640 1 -- 172.21.15.153:0/3048974595 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f120008a680 con 0x7f1210070d50 2024-03-28T21:52:53.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.412+0000 7f120fe00640 1 --2- 172.21.15.153:0/3048974595 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f11ec06b500 0x7f11ec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:53.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.413+0000 7f120fe00640 1 --2- 172.21.15.153:0/3048974595 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f11ec06b500 0x7f11ec06d9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f11f8036000 tx=0x7f11f8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:53.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.421+0000 7f120cc00640 1 -- 172.21.15.153:0/3048974595 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1200059470 con 0x7f1210070d50 2024-03-28T21:52:53.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.751+0000 7f1216600640 1 -- 172.21.15.153:0/3048974595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f12100b2f30 con 0x7f1210070d50 2024-03-28T21:52:53.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.752+0000 7f120cc00640 1 -- 172.21.15.153:0/3048974595 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f1200058d70 con 0x7f1210070d50 2024-03-28T21:52:53.754 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-28T21:52:53.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.755+0000 7f1216600640 1 -- 172.21.15.153:0/3048974595 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f11ec06b500 msgr2=0x7f11ec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:53.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.755+0000 7f1216600640 1 --2- 172.21.15.153:0/3048974595 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f11ec06b500 0x7f11ec06d9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f11f8036000 tx=0x7f11f8030000 comp rx=0 tx=0).stop 2024-03-28T21:52:53.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.755+0000 7f1216600640 1 -- 172.21.15.153:0/3048974595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1210070d50 msgr2=0x7f121015a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:53.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.755+0000 7f1216600640 1 --2- 172.21.15.153:0/3048974595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1210070d50 0x7f121015a820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f120000d620 tx=0x7f120000dae0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.755+0000 7f1216600640 1 -- 172.21.15.153:0/3048974595 shutdown_connections 2024-03-28T21:52:53.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.755+0000 7f1216600640 1 --2- 172.21.15.153:0/3048974595 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f11ec06b500 0x7f11ec06d9c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.755+0000 7f1216600640 1 --2- 172.21.15.153:0/3048974595 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121015e140 0x7f12101f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.755+0000 7f1216600640 1 --2- 172.21.15.153:0/3048974595 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1210071190 0x7f121015ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.755+0000 7f1216600640 1 --2- 172.21.15.153:0/3048974595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1210070d50 0x7f121015a820 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.755+0000 7f1216600640 1 -- 172.21.15.153:0/3048974595 >> 172.21.15.153:0/3048974595 conn(0x7f12100b1820 msgr2=0x7f121015e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:53.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.755+0000 7f1216600640 1 -- 172.21.15.153:0/3048974595 shutdown_connections 2024-03-28T21:52:53.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.756+0000 7f1216600640 1 -- 172.21.15.153:0/3048974595 wait complete. 2024-03-28T21:52:53.778 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T21:52:53.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.975+0000 7fc61a200640 1 Processor -- start 2024-03-28T21:52:53.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.975+0000 7fc61a200640 1 -- start start 2024-03-28T21:52:53.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.976+0000 7fc61a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc61413ef10 0x7fc6141416a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.976+0000 7fc61a200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc6140ce9b0 0x7fc6140712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.976+0000 7fc61a200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc614070df0 con 0x7fc614141be0 2024-03-28T21:52:53.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.976+0000 7fc61a200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc6140cee40 con 0x7fc6140ce9b0 2024-03-28T21:52:53.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.976+0000 7fc61a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc614142040 con 0x7fc61413ef10 2024-03-28T21:52:53.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.977+0000 7fc60be00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc614141be0 0x7fc6140ce2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45390/0 (socket says 172.21.15.153:45390) 2024-03-28T21:52:53.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.977+0000 7fc60be00640 1 -- 172.21.15.153:0/722770590 learned_addr learned my addr 172.21.15.153:0/722770590 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:53.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.977+0000 7fc618e00640 1 --2- 172.21.15.153:0/722770590 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc61413ef10 0x7fc6141416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:53.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.977+0000 7fc619800640 1 --2- 172.21.15.153:0/722770590 >> v2:172.21.15.165:3300/0 conn(0x7fc6140ce9b0 0x7fc6140712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.977+0000 7fc613e00640 1 -- 172.21.15.153:0/722770590 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1135192764 0 0) 0x7fc614070df0 con 0x7fc614141be0 2024-03-28T21:52:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.977+0000 7fc613e00640 1 -- 172.21.15.153:0/722770590 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5f8003520 con 0x7fc614141be0 2024-03-28T21:52:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.977+0000 7fc613e00640 1 -- 172.21.15.153:0/722770590 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2471998364 0 0) 0x7fc5f8003520 con 0x7fc614141be0 2024-03-28T21:52:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc613e00640 1 -- 172.21.15.153:0/722770590 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc61413ef10 msgr2=0x7fc6141416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc613e00640 1 --2- 172.21.15.153:0/722770590 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc61413ef10 0x7fc6141416a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc613e00640 1 -- 172.21.15.153:0/722770590 >> v2:172.21.15.165:3300/0 conn(0x7fc6140ce9b0 msgr2=0x7fc6140712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc613e00640 1 --2- 172.21.15.153:0/722770590 >> v2:172.21.15.165:3300/0 conn(0x7fc6140ce9b0 0x7fc6140712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc613e00640 1 -- 172.21.15.153:0/722770590 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61413f2f0 con 0x7fc614141be0 2024-03-28T21:52:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc613e00640 1 -- 172.21.15.153:0/722770590 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fc5fc001670 con 0x7fc614141be0 2024-03-28T21:52:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc613e00640 1 -- 172.21.15.153:0/722770590 >> v1:172.21.15.153:6789/0 conn(0x7fc614141be0 legacy=0x7fc6140ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc613e00640 1 --2- 172.21.15.153:0/722770590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5f80039b0 0x7fc5f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc613e00640 1 --2- 172.21.15.153:0/722770590 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc61413ef10 0x7fc5f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc613e00640 1 --2- 172.21.15.153:0/722770590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5f8004d40 0x7fc5f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc613e00640 1 -- 172.21.15.153:0/722770590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140cee40 con 0x7fc5f80039b0 2024-03-28T21:52:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc613e00640 1 -- 172.21.15.153:0/722770590 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f800b9c0 con 0x7fc5f8004d40 2024-03-28T21:52:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc613e00640 1 -- 172.21.15.153:0/722770590 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f800bb40 con 0x7fc61413ef10 2024-03-28T21:52:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc619800640 1 --2- 172.21.15.153:0/722770590 >> v2:172.21.15.165:3300/0 conn(0x7fc6140ce9b0 0x7fc6140712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc618e00640 1 --2- 172.21.15.153:0/722770590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5f80039b0 0x7fc5f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc618e00640 1 -- 172.21.15.153:0/722770590 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc61413ef10 msgr2=0x7fc5f8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.978+0000 7fc60be00640 1 --2- 172.21.15.153:0/722770590 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc61413ef10 0x7fc5f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.979+0000 7fc619800640 1 --2- 172.21.15.153:0/722770590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5f8004d40 0x7fc5f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.979+0000 7fc618e00640 1 --2- 172.21.15.153:0/722770590 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc61413ef10 0x7fc5f8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.979+0000 7fc618e00640 1 -- 172.21.15.153:0/722770590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5f8004d40 msgr2=0x7fc5f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.979+0000 7fc618e00640 1 --2- 172.21.15.153:0/722770590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5f8004d40 0x7fc5f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.979+0000 7fc618e00640 1 -- 172.21.15.153:0/722770590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f8003520 con 0x7fc5f80039b0 2024-03-28T21:52:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.979+0000 7fc619800640 1 --2- 172.21.15.153:0/722770590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5f8004d40 0x7fc5f80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.979+0000 7fc60be00640 1 --2- 172.21.15.153:0/722770590 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc61413ef10 0x7fc5f8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.980+0000 7fc618e00640 1 --2- 172.21.15.153:0/722770590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5f80039b0 0x7fc5f8003dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc604009af0 tx=0x7fc5f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11087099be0fada4 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.980+0000 7fc613e00640 1 -- 172.21.15.153:0/722770590 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604039070 con 0x7fc5f80039b0 2024-03-28T21:52:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.980+0000 7fc613e00640 1 -- 172.21.15.153:0/722770590 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60402c6b0 con 0x7fc5f80039b0 2024-03-28T21:52:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.980+0000 7fc613e00640 1 -- 172.21.15.153:0/722770590 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604009690 con 0x7fc5f80039b0 2024-03-28T21:52:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.981+0000 7fc61a200640 1 -- 172.21.15.153:0/722770590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5f80039b0 msgr2=0x7fc5f8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.981+0000 7fc61a200640 1 --2- 172.21.15.153:0/722770590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5f80039b0 0x7fc5f8003dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc604009af0 tx=0x7fc5f8005830 comp rx=0 tx=0).stop 2024-03-28T21:52:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.981+0000 7fc619800640 1 -- 172.21.15.153:0/722770590 reap_dead start 2024-03-28T21:52:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.981+0000 7fc61a200640 1 -- 172.21.15.153:0/722770590 shutdown_connections 2024-03-28T21:52:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.981+0000 7fc61a200640 1 -- 172.21.15.153:0/722770590 >> 172.21.15.153:0/722770590 conn(0x7fc6140b1820 msgr2=0x7fc6140b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.981+0000 7fc61a200640 1 -- 172.21.15.153:0/722770590 shutdown_connections 2024-03-28T21:52:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.981+0000 7fc61a200640 1 -- 172.21.15.153:0/722770590 wait complete. 2024-03-28T21:52:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.983+0000 7fc61a200640 1 Processor -- start 2024-03-28T21:52:53.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.983+0000 7fc61a200640 1 -- start start 2024-03-28T21:52:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc61a200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5f80039b0 0x7fc6140b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc61a200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6140aec80 0x7fc6140ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc61a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6140af100 0x7fc6140ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc61a200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140cf620 con 0x7fc6140aec80 2024-03-28T21:52:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc61a200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140cf340 con 0x7fc5f80039b0 2024-03-28T21:52:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc61a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc6140cf900 con 0x7fc6140af100 2024-03-28T21:52:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc60be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6140aec80 0x7fc6140ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc60be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6140aec80 0x7fc6140ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36920/0 (socket says 172.21.15.153:36920) 2024-03-28T21:52:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc60be00640 1 -- 172.21.15.153:0/2568314057 learned_addr learned my addr 172.21.15.153:0/2568314057 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc618e00640 1 --2- 172.21.15.153:0/2568314057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5f80039b0 0x7fc6140b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc60be00640 1 -- 172.21.15.153:0/2568314057 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6140af100 msgr2=0x7fc6140ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc60be00640 1 --2- 172.21.15.153:0/2568314057 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6140af100 0x7fc6140ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc60be00640 1 -- 172.21.15.153:0/2568314057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5f80039b0 msgr2=0x7fc6140b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc60be00640 1 --2- 172.21.15.153:0/2568314057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5f80039b0 0x7fc6140b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc60be00640 1 -- 172.21.15.153:0/2568314057 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6141f7080 con 0x7fc6140aec80 2024-03-28T21:52:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.984+0000 7fc618e00640 1 --2- 172.21.15.153:0/2568314057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5f80039b0 0x7fc6140b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.985+0000 7fc60be00640 1 --2- 172.21.15.153:0/2568314057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6140aec80 0x7fc6140ad8c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00db40 tx=0x7fc5fc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.985+0000 7fc611600640 1 -- 172.21.15.153:0/2568314057 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc019070 con 0x7fc6140aec80 2024-03-28T21:52:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.985+0000 7fc611600640 1 -- 172.21.15.153:0/2568314057 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5fc0074e0 con 0x7fc6140aec80 2024-03-28T21:52:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.985+0000 7fc611600640 1 -- 172.21.15.153:0/2568314057 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0047e0 con 0x7fc6140aec80 2024-03-28T21:52:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.985+0000 7fc61a200640 1 -- 172.21.15.153:0/2568314057 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6141f7320 con 0x7fc6140aec80 2024-03-28T21:52:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.985+0000 7fc61a200640 1 -- 172.21.15.153:0/2568314057 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6141f78e0 con 0x7fc6140aec80 2024-03-28T21:52:53.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.986+0000 7fc61a200640 1 -- 172.21.15.153:0/2568314057 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc614068ff0 con 0x7fc6140aec80 2024-03-28T21:52:53.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.987+0000 7fc611600640 1 -- 172.21.15.153:0/2568314057 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc5fc004980 con 0x7fc6140aec80 2024-03-28T21:52:53.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.988+0000 7fc611600640 1 --2- 172.21.15.153:0/2568314057 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc5f006b500 0x7fc5f006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:53.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.988+0000 7fc611600640 1 -- 172.21.15.153:0/2568314057 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fc5fc089f90 con 0x7fc6140aec80 2024-03-28T21:52:53.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.988+0000 7fc618e00640 1 --2- 172.21.15.153:0/2568314057 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc5f006b500 0x7fc5f006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:53.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.989+0000 7fc618e00640 1 --2- 172.21.15.153:0/2568314057 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc5f006b500 0x7fc5f006d9c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc604036000 tx=0x7fc604030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:53.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:53.992+0000 7fc611600640 1 -- 172.21.15.153:0/2568314057 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc5fc058e20 con 0x7fc6140aec80 2024-03-28T21:52:54.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.180+0000 7fc61a200640 1 -- 172.21.15.153:0/2568314057 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc614072c10 con 0x7fc6140aec80 2024-03-28T21:52:54.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.181+0000 7fc611600640 1 -- 172.21.15.153:0/2568314057 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fc5fc058720 con 0x7fc6140aec80 2024-03-28T21:52:54.183 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-03-28T21:52:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.183+0000 7fc61a200640 1 -- 172.21.15.153:0/2568314057 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc5f006b500 msgr2=0x7fc5f006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.183+0000 7fc61a200640 1 --2- 172.21.15.153:0/2568314057 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc5f006b500 0x7fc5f006d9c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc604036000 tx=0x7fc604030000 comp rx=0 tx=0).stop 2024-03-28T21:52:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.183+0000 7fc61a200640 1 -- 172.21.15.153:0/2568314057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6140aec80 msgr2=0x7fc6140ad8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.183+0000 7fc61a200640 1 --2- 172.21.15.153:0/2568314057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6140aec80 0x7fc6140ad8c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00db40 tx=0x7fc5fc007e10 comp rx=0 tx=0).stop 2024-03-28T21:52:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.183+0000 7fc61a200640 1 -- 172.21.15.153:0/2568314057 shutdown_connections 2024-03-28T21:52:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.183+0000 7fc61a200640 1 --2- 172.21.15.153:0/2568314057 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc5f006b500 0x7fc5f006d9c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.183+0000 7fc61a200640 1 --2- 172.21.15.153:0/2568314057 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6140af100 0x7fc6140ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.183+0000 7fc61a200640 1 --2- 172.21.15.153:0/2568314057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6140aec80 0x7fc6140ad8c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.183+0000 7fc61a200640 1 --2- 172.21.15.153:0/2568314057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5f80039b0 0x7fc6140b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.183+0000 7fc61a200640 1 -- 172.21.15.153:0/2568314057 >> 172.21.15.153:0/2568314057 conn(0x7fc6140b1820 msgr2=0x7fc61415dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:54.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.183+0000 7fc61a200640 1 -- 172.21.15.153:0/2568314057 shutdown_connections 2024-03-28T21:52:54.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.183+0000 7fc61a200640 1 -- 172.21.15.153:0/2568314057 wait complete. 2024-03-28T21:52:54.203 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T21:52:54.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.405+0000 7fd385600640 1 Processor -- start 2024-03-28T21:52:54.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.405+0000 7fd385600640 1 -- start start 2024-03-28T21:52:54.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.406+0000 7fd385600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd3800d2ad0 0x7fd3800cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.407+0000 7fd385600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3800ceca0 con 0x7fd3800b3a60 2024-03-28T21:52:54.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.407+0000 7fd385600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3800d4810 con 0x7fd380161990 2024-03-28T21:52:54.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.407+0000 7fd385600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd3800d4af0 con 0x7fd3800d2ad0 2024-03-28T21:52:54.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.407+0000 7fd37e000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd3800b3a60 0x7fd3800d23c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45400/0 (socket says 172.21.15.153:45400) 2024-03-28T21:52:54.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.407+0000 7fd37e000640 1 -- 172.21.15.153:0/3465950417 learned_addr learned my addr 172.21.15.153:0/3465950417 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:54.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.407+0000 7fd37f400640 1 --2- 172.21.15.153:0/3465950417 >> v2:172.21.15.165:3300/0 conn(0x7fd3800d2ad0 0x7fd3800cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.407+0000 7fd37d600640 1 -- 172.21.15.153:0/3465950417 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235810075 0 0) 0x7fd36c001110 con 0x7fd3800b3a60 2024-03-28T21:52:54.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.407+0000 7fd37d600640 1 -- 172.21.15.153:0/3465950417 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd364003520 con 0x7fd3800b3a60 2024-03-28T21:52:54.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37d600640 1 -- 172.21.15.153:0/3465950417 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 949817148 0 0) 0x7fd364003520 con 0x7fd3800b3a60 2024-03-28T21:52:54.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37d600640 1 -- 172.21.15.153:0/3465950417 >> v2:172.21.15.165:3300/0 conn(0x7fd3800d2ad0 msgr2=0x7fd3800cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:54.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37d600640 1 --2- 172.21.15.153:0/3465950417 >> v2:172.21.15.165:3300/0 conn(0x7fd3800d2ad0 0x7fd3800cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37d600640 1 -- 172.21.15.153:0/3465950417 >> v1:172.21.15.165:6789/0 conn(0x7fd380161990 legacy=0x7fd3800d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:54.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37d600640 1 -- 172.21.15.153:0/3465950417 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3800d4dd0 con 0x7fd3800b3a60 2024-03-28T21:52:54.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37d600640 1 -- 172.21.15.153:0/3465950417 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fd36c001840 con 0x7fd3800b3a60 2024-03-28T21:52:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37d600640 1 -- 172.21.15.153:0/3465950417 >> v1:172.21.15.153:6789/0 conn(0x7fd3800b3a60 legacy=0x7fd3800d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37d600640 1 --2- 172.21.15.153:0/3465950417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3640039b0 0x7fd364003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37d600640 1 --2- 172.21.15.153:0/3465950417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd364004800 0x7fd364004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37d600640 1 --2- 172.21.15.153:0/3465950417 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3640051c0 0x7fd36400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37d600640 1 -- 172.21.15.153:0/3465950417 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd3800d4af0 con 0x7fd364004800 2024-03-28T21:52:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37d600640 1 -- 172.21.15.153:0/3465950417 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd36400c060 con 0x7fd3640039b0 2024-03-28T21:52:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37d600640 1 -- 172.21.15.153:0/3465950417 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd36400c260 con 0x7fd3640051c0 2024-03-28T21:52:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37e000640 1 --2- 172.21.15.153:0/3465950417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd364004800 0x7fd364004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.408+0000 7fd37ea00640 1 --2- 172.21.15.153:0/3465950417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3640039b0 0x7fd364003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.409+0000 7fd37f400640 1 --2- 172.21.15.153:0/3465950417 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3640051c0 0x7fd36400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.409+0000 7fd37e000640 1 -- 172.21.15.153:0/3465950417 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3640051c0 msgr2=0x7fd36400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.409+0000 7fd37e000640 1 --2- 172.21.15.153:0/3465950417 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3640051c0 0x7fd36400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.409+0000 7fd37e000640 1 -- 172.21.15.153:0/3465950417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3640039b0 msgr2=0x7fd364003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:54.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.409+0000 7fd37e000640 1 --2- 172.21.15.153:0/3465950417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3640039b0 0x7fd364003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.409+0000 7fd37e000640 1 -- 172.21.15.153:0/3465950417 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd364003520 con 0x7fd364004800 2024-03-28T21:52:54.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.409+0000 7fd37f400640 1 -- 172.21.15.153:0/3465950417 reap_dead start 2024-03-28T21:52:54.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.410+0000 7fd37e000640 1 --2- 172.21.15.153:0/3465950417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd364004800 0x7fd364004c80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c490 tx=0x7fd364005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a70ce5dde6e88a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:54.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.410+0000 7fd37d600640 1 -- 172.21.15.153:0/3465950417 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00c0e0 con 0x7fd364004800 2024-03-28T21:52:54.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.410+0000 7fd37d600640 1 -- 172.21.15.153:0/3465950417 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36c030070 con 0x7fd364004800 2024-03-28T21:52:54.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.410+0000 7fd37d600640 1 -- 172.21.15.153:0/3465950417 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c02ce50 con 0x7fd364004800 2024-03-28T21:52:54.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.411+0000 7fd385600640 1 -- 172.21.15.153:0/3465950417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd364004800 msgr2=0x7fd364004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:54.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.411+0000 7fd385600640 1 --2- 172.21.15.153:0/3465950417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd364004800 0x7fd364004c80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c490 tx=0x7fd364005830 comp rx=0 tx=0).stop 2024-03-28T21:52:54.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.411+0000 7fd385600640 1 -- 172.21.15.153:0/3465950417 shutdown_connections 2024-03-28T21:52:54.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.411+0000 7fd385600640 1 --2- 172.21.15.153:0/3465950417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd364004800 0x7fd364004c80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.411+0000 7fd385600640 1 -- 172.21.15.153:0/3465950417 >> 172.21.15.153:0/3465950417 conn(0x7fd38009d430 msgr2=0x7fd3800d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:54.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.411+0000 7fd385600640 1 -- 172.21.15.153:0/3465950417 shutdown_connections 2024-03-28T21:52:54.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.411+0000 7fd385600640 1 -- 172.21.15.153:0/3465950417 wait complete. 2024-03-28T21:52:54.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.413+0000 7fd385600640 1 Processor -- start 2024-03-28T21:52:54.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.413+0000 7fd385600640 1 -- start start 2024-03-28T21:52:54.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd385600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd364004800 0x7fd3800c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd385600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3800b9460 0x7fd3800b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd385600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3800b7200 0x7fd3800b7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd385600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd3800b3ec0 con 0x7fd3800b7200 2024-03-28T21:52:54.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd385600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd3800cf200 con 0x7fd364004800 2024-03-28T21:52:54.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd385600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd3800b4040 con 0x7fd3800b9460 2024-03-28T21:52:54.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd37f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3800b7200 0x7fd3800b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd37f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3800b7200 0x7fd3800b7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36938/0 (socket says 172.21.15.153:36938) 2024-03-28T21:52:54.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd37f400640 1 -- 172.21.15.153:0/3182637138 learned_addr learned my addr 172.21.15.153:0/3182637138 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:54.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd37ea00640 1 --2- 172.21.15.153:0/3182637138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd364004800 0x7fd3800c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd37f400640 1 -- 172.21.15.153:0/3182637138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3800b9460 msgr2=0x7fd3800b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:54.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd37f400640 1 --2- 172.21.15.153:0/3182637138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3800b9460 0x7fd3800b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd37f400640 1 -- 172.21.15.153:0/3182637138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd364004800 msgr2=0x7fd3800c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:54.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd37f400640 1 --2- 172.21.15.153:0/3182637138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd364004800 0x7fd3800c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.414+0000 7fd37f400640 1 -- 172.21.15.153:0/3182637138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3800c9a40 con 0x7fd3800b7200 2024-03-28T21:52:54.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.415+0000 7fd37f400640 1 --2- 172.21.15.153:0/3182637138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3800b7200 0x7fd3800b7680 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd3800cea90 tx=0x7fd37800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:54.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.415+0000 7fd376a00640 1 -- 172.21.15.153:0/3182637138 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37800fe80 con 0x7fd3800b7200 2024-03-28T21:52:54.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.415+0000 7fd376a00640 1 -- 172.21.15.153:0/3182637138 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd378003990 con 0x7fd3800b7200 2024-03-28T21:52:54.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.415+0000 7fd385600640 1 -- 172.21.15.153:0/3182637138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3800c9d20 con 0x7fd3800b7200 2024-03-28T21:52:54.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.415+0000 7fd376a00640 1 -- 172.21.15.153:0/3182637138 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd378003d60 con 0x7fd3800b7200 2024-03-28T21:52:54.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.415+0000 7fd385600640 1 -- 172.21.15.153:0/3182637138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3800b7e80 con 0x7fd3800b7200 2024-03-28T21:52:54.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.416+0000 7fd385600640 1 -- 172.21.15.153:0/3182637138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3800b11d0 con 0x7fd3800b7200 2024-03-28T21:52:54.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.417+0000 7fd376a00640 1 -- 172.21.15.153:0/3182637138 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fd378005d10 con 0x7fd3800b7200 2024-03-28T21:52:54.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.418+0000 7fd376a00640 1 --2- 172.21.15.153:0/3182637138 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd36006b4d0 0x7fd36006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.418+0000 7fd376a00640 1 -- 172.21.15.153:0/3182637138 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fd37808aad0 con 0x7fd3800b7200 2024-03-28T21:52:54.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.418+0000 7fd37ea00640 1 --2- 172.21.15.153:0/3182637138 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd36006b4d0 0x7fd36006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.419+0000 7fd37ea00640 1 --2- 172.21.15.153:0/3182637138 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd36006b4d0 0x7fd36006d990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd370007fd0 tx=0x7fd370009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:54.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.422+0000 7fd376a00640 1 -- 172.21.15.153:0/3182637138 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd378024020 con 0x7fd3800b7200 2024-03-28T21:52:54.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.630+0000 7fd385600640 1 -- 172.21.15.153:0/3182637138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd380068ff0 con 0x7fd3800b7200 2024-03-28T21:52:54.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.630+0000 7fd376a00640 1 -- 172.21.15.153:0/3182637138 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fd378059830 con 0x7fd3800b7200 2024-03-28T21:52:54.633 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-03-28T21:52:54.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.633+0000 7fd385600640 1 -- 172.21.15.153:0/3182637138 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd36006b4d0 msgr2=0x7fd36006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:54.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.633+0000 7fd385600640 1 --2- 172.21.15.153:0/3182637138 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd36006b4d0 0x7fd36006d990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd370007fd0 tx=0x7fd370009040 comp rx=0 tx=0).stop 2024-03-28T21:52:54.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.633+0000 7fd385600640 1 -- 172.21.15.153:0/3182637138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3800b7200 msgr2=0x7fd3800b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:54.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.633+0000 7fd385600640 1 --2- 172.21.15.153:0/3182637138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3800b7200 0x7fd3800b7680 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd3800cea90 tx=0x7fd37800f520 comp rx=0 tx=0).stop 2024-03-28T21:52:54.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.633+0000 7fd385600640 1 -- 172.21.15.153:0/3182637138 shutdown_connections 2024-03-28T21:52:54.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.633+0000 7fd385600640 1 --2- 172.21.15.153:0/3182637138 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd36006b4d0 0x7fd36006d990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.633+0000 7fd385600640 1 --2- 172.21.15.153:0/3182637138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3800b7200 0x7fd3800b7680 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.633+0000 7fd385600640 1 --2- 172.21.15.153:0/3182637138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3800b9460 0x7fd3800b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.633+0000 7fd385600640 1 --2- 172.21.15.153:0/3182637138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd364004800 0x7fd3800c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.633+0000 7fd385600640 1 -- 172.21.15.153:0/3182637138 >> 172.21.15.153:0/3182637138 conn(0x7fd38009d430 msgr2=0x7fd3800b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:54.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.634+0000 7fd385600640 1 -- 172.21.15.153:0/3182637138 shutdown_connections 2024-03-28T21:52:54.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.634+0000 7fd385600640 1 -- 172.21.15.153:0/3182637138 wait complete. 2024-03-28T21:52:54.655 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T21:52:54.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.859+0000 7f69b8c00640 1 Processor -- start 2024-03-28T21:52:54.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.859+0000 7f69b8c00640 1 -- start start 2024-03-28T21:52:54.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.861+0000 7f69b8c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f69b406de90 0x7f69b406e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.861+0000 7f69b8c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69b40cf090 con 0x7f69b40d0130 2024-03-28T21:52:54.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.861+0000 7f69b8c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69b40cf370 con 0x7f69b406f970 2024-03-28T21:52:54.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.861+0000 7f69b8c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f69b40cf650 con 0x7f69b406de90 2024-03-28T21:52:54.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.861+0000 7f69abe00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f69b40d0130 0x7f69b406b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45414/0 (socket says 172.21.15.153:45414) 2024-03-28T21:52:54.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.861+0000 7f69abe00640 1 -- 172.21.15.153:0/3640047549 learned_addr learned my addr 172.21.15.153:0/3640047549 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:54.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.862+0000 7f69b1400640 1 -- 172.21.15.153:0/3640047549 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3720773628 0 0) 0x7f69b40cf090 con 0x7f69b40d0130 2024-03-28T21:52:54.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.862+0000 7f69b1e00640 1 --2- 172.21.15.153:0/3640047549 >> v2:172.21.15.165:3300/0 conn(0x7f69b406de90 0x7f69b406e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.862+0000 7f69b1400640 1 -- 172.21.15.153:0/3640047549 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6998003520 con 0x7f69b40d0130 2024-03-28T21:52:54.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.862+0000 7f69b1400640 1 -- 172.21.15.153:0/3640047549 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 815249082 0 0) 0x7f6998003520 con 0x7f69b40d0130 2024-03-28T21:52:54.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.862+0000 7f69b1400640 1 -- 172.21.15.153:0/3640047549 >> v2:172.21.15.165:3300/0 conn(0x7f69b406de90 msgr2=0x7f69b406e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:54.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.862+0000 7f69b1400640 1 --2- 172.21.15.153:0/3640047549 >> v2:172.21.15.165:3300/0 conn(0x7f69b406de90 0x7f69b406e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.862+0000 7f69b1400640 1 -- 172.21.15.153:0/3640047549 >> v1:172.21.15.165:6789/0 conn(0x7f69b406f970 legacy=0x7f69b406b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:54.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.862+0000 7f69b1400640 1 -- 172.21.15.153:0/3640047549 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b40cf930 con 0x7f69b40d0130 2024-03-28T21:52:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.862+0000 7f69b1400640 1 -- 172.21.15.153:0/3640047549 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f699c001670 con 0x7f69b40d0130 2024-03-28T21:52:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.862+0000 7f69b1400640 1 -- 172.21.15.153:0/3640047549 >> v1:172.21.15.153:6789/0 conn(0x7f69b40d0130 legacy=0x7f69b406b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.862+0000 7f69b1400640 1 --2- 172.21.15.153:0/3640047549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69980039b0 0x7f6998003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.862+0000 7f69b1400640 1 --2- 172.21.15.153:0/3640047549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6998004800 0x7f6998004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.862+0000 7f69b1400640 1 --2- 172.21.15.153:0/3640047549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69980051c0 0x7f699800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.862+0000 7f69b1400640 1 -- 172.21.15.153:0/3640047549 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69b40cf650 con 0x7f6998004800 2024-03-28T21:52:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.863+0000 7f69b1400640 1 -- 172.21.15.153:0/3640047549 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f699800c060 con 0x7f69980039b0 2024-03-28T21:52:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.863+0000 7f69b1400640 1 -- 172.21.15.153:0/3640047549 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f699800c260 con 0x7f69980051c0 2024-03-28T21:52:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.863+0000 7f69abe00640 1 --2- 172.21.15.153:0/3640047549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6998004800 0x7f6998004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.863+0000 7f69b1e00640 1 --2- 172.21.15.153:0/3640047549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69980039b0 0x7f6998003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.863+0000 7f69b2800640 1 --2- 172.21.15.153:0/3640047549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69980051c0 0x7f699800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.863+0000 7f69abe00640 1 -- 172.21.15.153:0/3640047549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69980051c0 msgr2=0x7f699800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.863+0000 7f69abe00640 1 --2- 172.21.15.153:0/3640047549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69980051c0 0x7f699800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.863+0000 7f69abe00640 1 -- 172.21.15.153:0/3640047549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69980039b0 msgr2=0x7f6998003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:54.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.863+0000 7f69abe00640 1 --2- 172.21.15.153:0/3640047549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69980039b0 0x7f6998003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.863+0000 7f69abe00640 1 -- 172.21.15.153:0/3640047549 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6998003520 con 0x7f6998004800 2024-03-28T21:52:54.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.863+0000 7f69b2800640 1 --2- 172.21.15.153:0/3640047549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69980051c0 0x7f699800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:54.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.863+0000 7f69b2800640 1 -- 172.21.15.153:0/3640047549 reap_dead start 2024-03-28T21:52:54.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.865+0000 7f69abe00640 1 --2- 172.21.15.153:0/3640047549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6998004800 0x7f6998004c80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f699c00c240 tx=0x7f6998005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fee79abe333eac7 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:54.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.865+0000 7f69b1400640 1 -- 172.21.15.153:0/3640047549 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c007cf0 con 0x7f6998004800 2024-03-28T21:52:54.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.865+0000 7f69b1400640 1 -- 172.21.15.153:0/3640047549 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699c030070 con 0x7f6998004800 2024-03-28T21:52:54.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.865+0000 7f69b1400640 1 -- 172.21.15.153:0/3640047549 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c005d30 con 0x7f6998004800 2024-03-28T21:52:54.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.865+0000 7f69b8c00640 1 -- 172.21.15.153:0/3640047549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6998004800 msgr2=0x7f6998004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:54.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.865+0000 7f69b8c00640 1 --2- 172.21.15.153:0/3640047549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6998004800 0x7f6998004c80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f699c00c240 tx=0x7f6998005830 comp rx=0 tx=0).stop 2024-03-28T21:52:54.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.866+0000 7f69b8c00640 1 -- 172.21.15.153:0/3640047549 shutdown_connections 2024-03-28T21:52:54.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.866+0000 7f69b8c00640 1 --2- 172.21.15.153:0/3640047549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6998004800 0x7f6998004c80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.866+0000 7f69b8c00640 1 -- 172.21.15.153:0/3640047549 >> 172.21.15.153:0/3640047549 conn(0x7f69b40d0540 msgr2=0x7f69b40d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:54.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.866+0000 7f69b8c00640 1 -- 172.21.15.153:0/3640047549 shutdown_connections 2024-03-28T21:52:54.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.866+0000 7f69b8c00640 1 -- 172.21.15.153:0/3640047549 wait complete. 2024-03-28T21:52:54.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.868+0000 7f69b8c00640 1 Processor -- start 2024-03-28T21:52:54.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.868+0000 7f69b8c00640 1 -- start start 2024-03-28T21:52:54.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.869+0000 7f69b8c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6998004800 0x7f69b4155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.869+0000 7f69b8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69b4152440 0x7f69b41528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.869+0000 7f69b8c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b4153c40 0x7f69b4154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.869+0000 7f69b8c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69b40ced40 con 0x7f69b4153c40 2024-03-28T21:52:54.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.869+0000 7f69b8c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f69b4070060 con 0x7f6998004800 2024-03-28T21:52:54.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.869+0000 7f69b8c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f69b40cc7e0 con 0x7f69b4152440 2024-03-28T21:52:54.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.869+0000 7f69b2800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b4153c40 0x7f69b4154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.869+0000 7f69b2800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b4153c40 0x7f69b4154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36960/0 (socket says 172.21.15.153:36960) 2024-03-28T21:52:54.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.869+0000 7f69b2800640 1 -- 172.21.15.153:0/1719211066 learned_addr learned my addr 172.21.15.153:0/1719211066 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:54.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.870+0000 7f69b1e00640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6998004800 0x7f69b4155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.870+0000 7f69abe00640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69b4152440 0x7f69b41528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.870+0000 7f69b2800640 1 -- 172.21.15.153:0/1719211066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69b4152440 msgr2=0x7f69b41528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:54.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.870+0000 7f69b2800640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69b4152440 0x7f69b41528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.870+0000 7f69b2800640 1 -- 172.21.15.153:0/1719211066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6998004800 msgr2=0x7f69b4155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:54.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.870+0000 7f69b2800640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6998004800 0x7f69b4155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:54.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.870+0000 7f69b2800640 1 -- 172.21.15.153:0/1719211066 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b4154930 con 0x7f69b4153c40 2024-03-28T21:52:54.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.870+0000 7f69b1e00640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6998004800 0x7f69b4155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:54.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.870+0000 7f69b2800640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b4153c40 0x7f69b4154080 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f69b40b32a0 tx=0x7f69ac00d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:54.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.870+0000 7f69aa000640 1 -- 172.21.15.153:0/1719211066 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac018070 con 0x7f69b4153c40 2024-03-28T21:52:54.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.870+0000 7f69aa000640 1 -- 172.21.15.153:0/1719211066 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ac003da0 con 0x7f69b4153c40 2024-03-28T21:52:54.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.870+0000 7f69b8c00640 1 -- 172.21.15.153:0/1719211066 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b4154c10 con 0x7f69b4153c40 2024-03-28T21:52:54.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.870+0000 7f69aa000640 1 -- 172.21.15.153:0/1719211066 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac0052b0 con 0x7f69b4153c40 2024-03-28T21:52:54.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.871+0000 7f69b8c00640 1 -- 172.21.15.153:0/1719211066 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b40adad0 con 0x7f69b4153c40 2024-03-28T21:52:54.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.872+0000 7f69b8c00640 1 -- 172.21.15.153:0/1719211066 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b40ad8c0 con 0x7f69b4153c40 2024-03-28T21:52:54.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.873+0000 7f69aa000640 1 -- 172.21.15.153:0/1719211066 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f69ac01b070 con 0x7f69b4153c40 2024-03-28T21:52:54.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.873+0000 7f69aa000640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f699006b4d0 0x7f699006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:54.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.874+0000 7f69aa000640 1 -- 172.21.15.153:0/1719211066 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f69ac0897e0 con 0x7f69b4153c40 2024-03-28T21:52:54.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.874+0000 7f69b1e00640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f699006b4d0 0x7f699006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:54.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.874+0000 7f69b1e00640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f699006b4d0 0x7f699006d990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f69a4009b30 tx=0x7f69a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:54.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:54.882+0000 7f69aa000640 1 -- 172.21.15.153:0/1719211066 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f69ac0585d0 con 0x7f69b4153c40 2024-03-28T21:52:55.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.116+0000 7f69b8c00640 1 -- 172.21.15.153:0/1719211066 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69b40681c0 con 0x7f69b4153c40 2024-03-28T21:52:55.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.117+0000 7f69aa000640 1 -- 172.21.15.153:0/1719211066 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f69ac057ed0 con 0x7f69b4153c40 2024-03-28T21:52:55.120 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:55.120 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/207550071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":207550071},{"type":"v1","addr":"172.21.15.165:6835","nonce":207550071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/900073633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":900073633},{"type":"v1","addr":"172.21.15.153:6837","nonce":900073633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3915706377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3915706377},{"type":"v1","addr":"172.21.15.165:6833","nonce":3915706377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T21:51:56.169625+0000","modified":"2024-03-28T21:51:59.218861+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6836/3516257974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3516257974},{"type":"v1","addr":"172.21.15.153:6836","nonce":3516257974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-03-28T21:52:55.120 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2024-03-28T21:52:55.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.120+0000 7f69b8c00640 1 -- 172.21.15.153:0/1719211066 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f699006b4d0 msgr2=0x7f699006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:55.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.120+0000 7f69b8c00640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f699006b4d0 0x7f699006d990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f69a4009b30 tx=0x7f69a4008040 comp rx=0 tx=0).stop 2024-03-28T21:52:55.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.120+0000 7f69b8c00640 1 -- 172.21.15.153:0/1719211066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b4153c40 msgr2=0x7f69b4154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:55.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.120+0000 7f69b8c00640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b4153c40 0x7f69b4154080 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f69b40b32a0 tx=0x7f69ac00d9d0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.120+0000 7f69b8c00640 1 -- 172.21.15.153:0/1719211066 shutdown_connections 2024-03-28T21:52:55.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.120+0000 7f69b8c00640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f699006b4d0 0x7f699006d990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.120+0000 7f69b8c00640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b4153c40 0x7f69b4154080 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.120+0000 7f69b8c00640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69b4152440 0x7f69b41528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.120+0000 7f69b8c00640 1 --2- 172.21.15.153:0/1719211066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6998004800 0x7f69b4155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.120+0000 7f69b8c00640 1 -- 172.21.15.153:0/1719211066 >> 172.21.15.153:0/1719211066 conn(0x7f69b40d0540 msgr2=0x7f69b415b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:55.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.120+0000 7f69b8c00640 1 -- 172.21.15.153:0/1719211066 shutdown_connections 2024-03-28T21:52:55.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.120+0000 7f69b8c00640 1 -- 172.21.15.153:0/1719211066 wait complete. 2024-03-28T21:52:55.140 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:55.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.340+0000 7f98a1800640 1 Processor -- start 2024-03-28T21:52:55.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.340+0000 7f98a1800640 1 -- start start 2024-03-28T21:52:55.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.342+0000 7f98a1800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f989c146c30 0x7f989c0add90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:55.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.342+0000 7f98a1800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f989c06b880 0x7f989c0b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:55.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.342+0000 7f98a1800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989c0b0270 con 0x7f989c0ae2d0 2024-03-28T21:52:55.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.342+0000 7f98a1800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f989c161d30 con 0x7f989c146c30 2024-03-28T21:52:55.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.342+0000 7f98a1800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f989c161fd0 con 0x7f989c06b880 2024-03-28T21:52:55.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.342+0000 7f989be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f989c146c30 0x7f989c0add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:55.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.342+0000 7f989be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f989c146c30 0x7f989c0add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36964/0 (socket says 172.21.15.153:36964) 2024-03-28T21:52:55.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.342+0000 7f989be00640 1 -- 172.21.15.153:0/251187777 learned_addr learned my addr 172.21.15.153:0/251187777 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:55.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.343+0000 7f98a0e00640 1 --2- 172.21.15.153:0/251187777 >> v2:172.21.15.165:3300/0 conn(0x7f989c06b880 0x7f989c0b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:55.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.343+0000 7f989be00640 1 -- 172.21.15.153:0/251187777 >> v2:172.21.15.165:3300/0 conn(0x7f989c06b880 msgr2=0x7f989c0b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:55.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.343+0000 7f989be00640 1 --2- 172.21.15.153:0/251187777 >> v2:172.21.15.165:3300/0 conn(0x7f989c06b880 0x7f989c0b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.343+0000 7f989be00640 1 -- 172.21.15.153:0/251187777 >> v1:172.21.15.153:6789/0 conn(0x7f989c0ae2d0 legacy=0x7f989c06b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:55.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.343+0000 7f989be00640 1 -- 172.21.15.153:0/251187777 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c1622b0 con 0x7f989c146c30 2024-03-28T21:52:55.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.343+0000 7f98a0e00640 1 --2- 172.21.15.153:0/251187777 >> v2:172.21.15.165:3300/0 conn(0x7f989c06b880 0x7f989c0b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:55.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.343+0000 7f989aa00640 1 -- 172.21.15.153:0/251187777 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1208045279 0 0) 0x7f989c0b0270 con 0x7f989c0ae2d0 2024-03-28T21:52:55.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.344+0000 7f989be00640 1 --2- 172.21.15.153:0/251187777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f989c146c30 0x7f989c0add90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f989c0b0760 tx=0x7f988c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6803c6a47fbf4bfd server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.344+0000 7f989aa00640 1 -- 172.21.15.153:0/251187777 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c035020 con 0x7f989c146c30 2024-03-28T21:52:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.344+0000 7f989aa00640 1 -- 172.21.15.153:0/251187777 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f988c031870 con 0x7f989c146c30 2024-03-28T21:52:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.344+0000 7f989aa00640 1 -- 172.21.15.153:0/251187777 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c031c40 con 0x7f989c146c30 2024-03-28T21:52:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.345+0000 7f98a1800640 1 -- 172.21.15.153:0/251187777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f989c146c30 msgr2=0x7f989c0add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.345+0000 7f98a1800640 1 --2- 172.21.15.153:0/251187777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f989c146c30 0x7f989c0add90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f989c0b0760 tx=0x7f988c02b910 comp rx=0 tx=0).stop 2024-03-28T21:52:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.345+0000 7f98a1800640 1 -- 172.21.15.153:0/251187777 shutdown_connections 2024-03-28T21:52:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.345+0000 7f98a1800640 1 --2- 172.21.15.153:0/251187777 >> v2:172.21.15.165:3300/0 conn(0x7f989c06b880 0x7f989c0b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.345+0000 7f98a1800640 1 --2- 172.21.15.153:0/251187777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f989c146c30 0x7f989c0add90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.345+0000 7f98a1800640 1 -- 172.21.15.153:0/251187777 >> 172.21.15.153:0/251187777 conn(0x7f989c06c9f0 msgr2=0x7f989c0b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.345+0000 7f98a1800640 1 -- 172.21.15.153:0/251187777 shutdown_connections 2024-03-28T21:52:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.345+0000 7f98a1800640 1 -- 172.21.15.153:0/251187777 wait complete. 2024-03-28T21:52:55.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.347+0000 7f98a1800640 1 Processor -- start 2024-03-28T21:52:55.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.347+0000 7f98a1800640 1 -- start start 2024-03-28T21:52:55.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.348+0000 7f98a1800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f989c06b880 0x7f989c13b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:55.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.348+0000 7f98a1800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f989c0ae2d0 0x7f989c15cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:55.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.348+0000 7f98a1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f989c146c30 0x7f989c0b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:55.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.348+0000 7f98a1800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f989c162ab0 con 0x7f989c06b880 2024-03-28T21:52:55.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.348+0000 7f98a1800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f989c0ae950 con 0x7f989c0ae2d0 2024-03-28T21:52:55.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.348+0000 7f98a1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f989c147010 con 0x7f989c146c30 2024-03-28T21:52:55.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.348+0000 7f989be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f989c06b880 0x7f989c13b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:55.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.348+0000 7f989be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f989c06b880 0x7f989c13b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36966/0 (socket says 172.21.15.153:36966) 2024-03-28T21:52:55.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.348+0000 7f989be00640 1 -- 172.21.15.153:0/4205759853 learned_addr learned my addr 172.21.15.153:0/4205759853 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:55.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.349+0000 7f989be00640 1 -- 172.21.15.153:0/4205759853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f989c146c30 msgr2=0x7f989c0b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:55.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.349+0000 7f989be00640 1 --2- 172.21.15.153:0/4205759853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f989c146c30 0x7f989c0b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.349+0000 7f989be00640 1 -- 172.21.15.153:0/4205759853 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f989c0ae2d0 msgr2=0x7f989c15cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:55.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.349+0000 7f989be00640 1 --2- 172.21.15.153:0/4205759853 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f989c0ae2d0 0x7f989c15cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.349+0000 7f989be00640 1 -- 172.21.15.153:0/4205759853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c15d060 con 0x7f989c06b880 2024-03-28T21:52:55.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.349+0000 7f989be00640 1 --2- 172.21.15.153:0/4205759853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f989c06b880 0x7f989c13b0f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f988c02b950 tx=0x7f988c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:55.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.349+0000 7f9893e00640 1 -- 172.21.15.153:0/4205759853 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c040070 con 0x7f989c06b880 2024-03-28T21:52:55.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.349+0000 7f9893e00640 1 -- 172.21.15.153:0/4205759853 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f988c03a420 con 0x7f989c06b880 2024-03-28T21:52:55.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.349+0000 7f98a1800640 1 -- 172.21.15.153:0/4205759853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989c13b760 con 0x7f989c06b880 2024-03-28T21:52:55.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.349+0000 7f9893e00640 1 -- 172.21.15.153:0/4205759853 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c035040 con 0x7f989c06b880 2024-03-28T21:52:55.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.349+0000 7f98a1800640 1 -- 172.21.15.153:0/4205759853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f989c1391e0 con 0x7f989c06b880 2024-03-28T21:52:55.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.351+0000 7f98a1800640 1 -- 172.21.15.153:0/4205759853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f989c04f520 con 0x7f989c06b880 2024-03-28T21:52:55.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.351+0000 7f9893e00640 1 -- 172.21.15.153:0/4205759853 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f988c038020 con 0x7f989c06b880 2024-03-28T21:52:55.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.352+0000 7f9893e00640 1 --2- 172.21.15.153:0/4205759853 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f987c06b4d0 0x7f987c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:55.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.352+0000 7f9893e00640 1 -- 172.21.15.153:0/4205759853 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f988c0ac200 con 0x7f989c06b880 2024-03-28T21:52:55.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.353+0000 7f989b400640 1 --2- 172.21.15.153:0/4205759853 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f987c06b4d0 0x7f987c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:55.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.353+0000 7f989b400640 1 --2- 172.21.15.153:0/4205759853 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f987c06b4d0 0x7f987c06d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f989c13aec0 tx=0x7f9888007910 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:55.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.357+0000 7f9893e00640 1 -- 172.21.15.153:0/4205759853 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f989c15d060 con 0x7f989c06b880 2024-03-28T21:52:55.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.557+0000 7f98a1800640 1 -- 172.21.15.153:0/4205759853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f989c0b37a0 con 0x7f989c06b880 2024-03-28T21:52:55.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.558+0000 7f9893e00640 1 -- 172.21.15.153:0/4205759853 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16902 (secure 0 0 0) 0x7f988c07b090 con 0x7f989c06b880 2024-03-28T21:52:55.561 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:55.562 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":24,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:52:43.430328+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:55.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.562+0000 7f98a1800640 1 -- 172.21.15.153:0/4205759853 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f987c06b4d0 msgr2=0x7f987c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.562+0000 7f98a1800640 1 --2- 172.21.15.153:0/4205759853 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f987c06b4d0 0x7f987c06d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f989c13aec0 tx=0x7f9888007910 comp rx=0 tx=0).stop 2024-03-28T21:52:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.562+0000 7f98a1800640 1 -- 172.21.15.153:0/4205759853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f989c06b880 msgr2=0x7f989c13b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.562+0000 7f98a1800640 1 --2- 172.21.15.153:0/4205759853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f989c06b880 0x7f989c13b0f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f988c02b950 tx=0x7f988c0046c0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.562+0000 7f98a1800640 1 -- 172.21.15.153:0/4205759853 shutdown_connections 2024-03-28T21:52:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.562+0000 7f98a1800640 1 --2- 172.21.15.153:0/4205759853 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f987c06b4d0 0x7f987c06d990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.562+0000 7f98a1800640 1 --2- 172.21.15.153:0/4205759853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f989c146c30 0x7f989c0b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.562+0000 7f98a1800640 1 --2- 172.21.15.153:0/4205759853 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f989c0ae2d0 0x7f989c15cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.562+0000 7f98a1800640 1 --2- 172.21.15.153:0/4205759853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f989c06b880 0x7f989c13b0f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.562+0000 7f98a1800640 1 -- 172.21.15.153:0/4205759853 >> 172.21.15.153:0/4205759853 conn(0x7f989c06c9f0 msgr2=0x7f989c06dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.562+0000 7f98a1800640 1 -- 172.21.15.153:0/4205759853 shutdown_connections 2024-03-28T21:52:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.562+0000 7f98a1800640 1 -- 172.21.15.153:0/4205759853 wait complete. 2024-03-28T21:52:55.590 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-28T21:52:55.590 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T21:52:55.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.791+0000 7f0569c00640 1 Processor -- start 2024-03-28T21:52:55.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.791+0000 7f0569c00640 1 -- start start 2024-03-28T21:52:55.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.793+0000 7f0569c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0564159a10 0x7f056415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:55.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.793+0000 7f0569c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f056406e440 0x7f05640b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:55.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.793+0000 7f0569c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05640b2e60 con 0x7f05640ad830 2024-03-28T21:52:55.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.793+0000 7f0569c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f05640adc70 con 0x7f0564159a10 2024-03-28T21:52:55.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.793+0000 7f0569c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0564159df0 con 0x7f056406e440 2024-03-28T21:52:55.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.793+0000 7f0562a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0564159a10 0x7f056415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:55.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.793+0000 7f055a000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f05640ad830 0x7f056406dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45440/0 (socket says 172.21.15.153:45440) 2024-03-28T21:52:55.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.793+0000 7f055a000640 1 -- 172.21.15.153:0/2379490446 learned_addr learned my addr 172.21.15.153:0/2379490446 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:55.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.794+0000 7f0563400640 1 --2- 172.21.15.153:0/2379490446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f056406e440 0x7f05640b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:55.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.794+0000 7f0562000640 1 -- 172.21.15.153:0/2379490446 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 633743721 0 0) 0x7f05640b2e60 con 0x7f05640ad830 2024-03-28T21:52:55.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.794+0000 7f0562a00640 1 -- 172.21.15.153:0/2379490446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f056406e440 msgr2=0x7f05640b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:55.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.794+0000 7f0562a00640 1 --2- 172.21.15.153:0/2379490446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f056406e440 0x7f05640b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.794+0000 7f0562a00640 1 -- 172.21.15.153:0/2379490446 >> v1:172.21.15.153:6789/0 conn(0x7f05640ad830 legacy=0x7f056406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:55.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.794+0000 7f0562a00640 1 -- 172.21.15.153:0/2379490446 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05640adf10 con 0x7f0564159a10 2024-03-28T21:52:55.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.794+0000 7f0563400640 1 --2- 172.21.15.153:0/2379490446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f056406e440 0x7f05640b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:55.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.795+0000 7f0562a00640 1 --2- 172.21.15.153:0/2379490446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0564159a10 0x7f056415cf00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0554009d90 tx=0x7f055402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe6f90f8a39ae9a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:55.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.795+0000 7f0562000640 1 -- 172.21.15.153:0/2379490446 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554039070 con 0x7f0564159a10 2024-03-28T21:52:55.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.795+0000 7f0562000640 1 -- 172.21.15.153:0/2379490446 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f055402cbd0 con 0x7f0564159a10 2024-03-28T21:52:55.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.795+0000 7f0562000640 1 -- 172.21.15.153:0/2379490446 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554034440 con 0x7f0564159a10 2024-03-28T21:52:55.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.796+0000 7f0569c00640 1 -- 172.21.15.153:0/2379490446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0564159a10 msgr2=0x7f056415cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:55.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.796+0000 7f0569c00640 1 --2- 172.21.15.153:0/2379490446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0564159a10 0x7f056415cf00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0554009d90 tx=0x7f055402be20 comp rx=0 tx=0).stop 2024-03-28T21:52:55.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.796+0000 7f0569c00640 1 -- 172.21.15.153:0/2379490446 shutdown_connections 2024-03-28T21:52:55.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.796+0000 7f0569c00640 1 --2- 172.21.15.153:0/2379490446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f056406e440 0x7f05640b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.796+0000 7f0569c00640 1 --2- 172.21.15.153:0/2379490446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0564159a10 0x7f056415cf00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.796+0000 7f0569c00640 1 -- 172.21.15.153:0/2379490446 >> 172.21.15.153:0/2379490446 conn(0x7f05640b1a30 msgr2=0x7f05640b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:55.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.796+0000 7f0569c00640 1 -- 172.21.15.153:0/2379490446 shutdown_connections 2024-03-28T21:52:55.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.796+0000 7f0569c00640 1 -- 172.21.15.153:0/2379490446 wait complete. 2024-03-28T21:52:55.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.798+0000 7f0569c00640 1 Processor -- start 2024-03-28T21:52:55.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.798+0000 7f0569c00640 1 -- start start 2024-03-28T21:52:55.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.799+0000 7f0569c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f056406e440 0x7f05641f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:55.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.799+0000 7f0569c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05640ad830 0x7f05641f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:55.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.799+0000 7f0569c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0564159a10 0x7f0564154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:55.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.799+0000 7f0569c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f05640ae4d0 con 0x7f0564159a10 2024-03-28T21:52:55.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.799+0000 7f0569c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f05640b3100 con 0x7f056406e440 2024-03-28T21:52:55.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.799+0000 7f0569c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f05640b3b60 con 0x7f05640ad830 2024-03-28T21:52:55.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.799+0000 7f0563400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0564159a10 0x7f0564154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.799+0000 7f0563400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0564159a10 0x7f0564154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36984/0 (socket says 172.21.15.153:36984) 2024-03-28T21:52:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.799+0000 7f0563400640 1 -- 172.21.15.153:0/3336717347 learned_addr learned my addr 172.21.15.153:0/3336717347 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.799+0000 7f0562a00640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f056406e440 0x7f05641f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.799+0000 7f0563400640 1 -- 172.21.15.153:0/3336717347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05640ad830 msgr2=0x7f05641f53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.799+0000 7f055a000640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05640ad830 0x7f05641f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.800+0000 7f0563400640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05640ad830 0x7f05641f53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.800+0000 7f0563400640 1 -- 172.21.15.153:0/3336717347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f056406e440 msgr2=0x7f05641f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.800+0000 7f0563400640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f056406e440 0x7f05641f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.800+0000 7f0563400640 1 -- 172.21.15.153:0/3336717347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056414e760 con 0x7f0564159a10 2024-03-28T21:52:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.800+0000 7f0562a00640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f056406e440 0x7f05641f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.800+0000 7f0563400640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0564159a10 0x7f0564154010 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f055c00c7f0 tx=0x7f055c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:55.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.800+0000 7f055b400640 1 -- 172.21.15.153:0/3336717347 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c015070 con 0x7f0564159a10 2024-03-28T21:52:55.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.800+0000 7f055b400640 1 -- 172.21.15.153:0/3336717347 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f055c007820 con 0x7f0564159a10 2024-03-28T21:52:55.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.800+0000 7f055b400640 1 -- 172.21.15.153:0/3336717347 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c007c50 con 0x7f0564159a10 2024-03-28T21:52:55.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.800+0000 7f0569c00640 1 -- 172.21.15.153:0/3336717347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056414ea20 con 0x7f0564159a10 2024-03-28T21:52:55.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.800+0000 7f0569c00640 1 -- 172.21.15.153:0/3336717347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f056414efe0 con 0x7f0564159a10 2024-03-28T21:52:55.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.801+0000 7f0569c00640 1 -- 172.21.15.153:0/3336717347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05640689c0 con 0x7f0564159a10 2024-03-28T21:52:55.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.803+0000 7f055b400640 1 -- 172.21.15.153:0/3336717347 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f055c018070 con 0x7f0564159a10 2024-03-28T21:52:55.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.804+0000 7f055b400640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f054006b500 0x7f054006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:55.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.804+0000 7f055b400640 1 -- 172.21.15.153:0/3336717347 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f055c08a340 con 0x7f0564159a10 2024-03-28T21:52:55.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.804+0000 7f0562a00640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f054006b500 0x7f054006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:55.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.805+0000 7f0562a00640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f054006b500 0x7f054006d9c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0554036000 tx=0x7f0554030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:55.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:55.808+0000 7f055b400640 1 -- 172.21.15.153:0/3336717347 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f05640689c0 con 0x7f0564159a10 2024-03-28T21:52:56.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.043+0000 7f0569c00640 1 -- 172.21.15.153:0/3336717347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f056406dd20 con 0x7f0564159a10 2024-03-28T21:52:56.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.044+0000 7f055b400640 1 -- 172.21.15.153:0/3336717347 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f055c059130 con 0x7f0564159a10 2024-03-28T21:52:56.047 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:56.047 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/207550071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":207550071},{"type":"v1","addr":"172.21.15.165:6835","nonce":207550071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/900073633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":900073633},{"type":"v1","addr":"172.21.15.153:6837","nonce":900073633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3915706377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3915706377},{"type":"v1","addr":"172.21.15.165:6833","nonce":3915706377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T21:51:56.169625+0000","modified":"2024-03-28T21:51:59.218861+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6836/3516257974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3516257974},{"type":"v1","addr":"172.21.15.153:6836","nonce":3516257974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-03-28T21:52:56.047 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2024-03-28T21:52:56.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.047+0000 7f0569c00640 1 -- 172.21.15.153:0/3336717347 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f054006b500 msgr2=0x7f054006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:56.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.047+0000 7f0569c00640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f054006b500 0x7f054006d9c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0554036000 tx=0x7f0554030000 comp rx=0 tx=0).stop 2024-03-28T21:52:56.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.047+0000 7f0569c00640 1 -- 172.21.15.153:0/3336717347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0564159a10 msgr2=0x7f0564154010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:56.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.047+0000 7f0569c00640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0564159a10 0x7f0564154010 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f055c00c7f0 tx=0x7f055c00ccb0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.047+0000 7f0569c00640 1 -- 172.21.15.153:0/3336717347 shutdown_connections 2024-03-28T21:52:56.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.047+0000 7f0569c00640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f054006b500 0x7f054006d9c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.047+0000 7f0569c00640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0564159a10 0x7f0564154010 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.047+0000 7f0569c00640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05640ad830 0x7f05641f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.047+0000 7f0569c00640 1 --2- 172.21.15.153:0/3336717347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f056406e440 0x7f05641f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.048+0000 7f0569c00640 1 -- 172.21.15.153:0/3336717347 >> 172.21.15.153:0/3336717347 conn(0x7f05640b1a30 msgr2=0x7f05640b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:56.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.048+0000 7f0569c00640 1 -- 172.21.15.153:0/3336717347 shutdown_connections 2024-03-28T21:52:56.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.048+0000 7f0569c00640 1 -- 172.21.15.153:0/3336717347 wait complete. 2024-03-28T21:52:56.068 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T21:52:56.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.264+0000 7fc1d2c00640 1 Processor -- start 2024-03-28T21:52:56.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.264+0000 7fc1d2c00640 1 -- start start 2024-03-28T21:52:56.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.266+0000 7fc1d2c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc1cc0b5c00 0x7fc1cc06b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:56.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.266+0000 7fc1d2c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc1cc06b6b0 0x7fc1cc0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:56.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.266+0000 7fc1d2c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1cc147e30 con 0x7fc1cc147a50 2024-03-28T21:52:56.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.266+0000 7fc1d2c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc1cc06bae0 con 0x7fc1cc0b5c00 2024-03-28T21:52:56.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.266+0000 7fc1d2c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc1cc0b05f0 con 0x7fc1cc06b6b0 2024-03-28T21:52:56.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.266+0000 7fc1cb400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc1cc0b5c00 0x7fc1cc06b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:56.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.266+0000 7fc1cb400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc1cc0b5c00 0x7fc1cc06b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36994/0 (socket says 172.21.15.153:36994) 2024-03-28T21:52:56.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.266+0000 7fc1cb400640 1 -- 172.21.15.153:0/1021088752 learned_addr learned my addr 172.21.15.153:0/1021088752 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:56.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.267+0000 7fc1d0c00640 1 --2- 172.21.15.153:0/1021088752 >> v2:172.21.15.165:3300/0 conn(0x7fc1cc06b6b0 0x7fc1cc0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:56.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.267+0000 7fc1cb400640 1 -- 172.21.15.153:0/1021088752 >> v2:172.21.15.165:3300/0 conn(0x7fc1cc06b6b0 msgr2=0x7fc1cc0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:56.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.267+0000 7fc1cb400640 1 --2- 172.21.15.153:0/1021088752 >> v2:172.21.15.165:3300/0 conn(0x7fc1cc06b6b0 0x7fc1cc0cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.267+0000 7fc1cb400640 1 -- 172.21.15.153:0/1021088752 >> v1:172.21.15.165:6789/0 conn(0x7fc1cc147a50 legacy=0x7fc1cc161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:56.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.267+0000 7fc1cb400640 1 -- 172.21.15.153:0/1021088752 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1cc162950 con 0x7fc1cc0b5c00 2024-03-28T21:52:56.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.267+0000 7fc1d0c00640 1 --2- 172.21.15.153:0/1021088752 >> v2:172.21.15.165:3300/0 conn(0x7fc1cc06b6b0 0x7fc1cc0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:56.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.268+0000 7fc1cb400640 1 --2- 172.21.15.153:0/1021088752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1cc0b5c00 0x7fc1cc06b170 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0d19c0 tx=0x7fc1b802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564977408946ab7 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:56.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.269+0000 7fc1caa00640 1 -- 172.21.15.153:0/1021088752 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8035020 con 0x7fc1cc0b5c00 2024-03-28T21:52:56.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.269+0000 7fc1caa00640 1 -- 172.21.15.153:0/1021088752 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1b8031870 con 0x7fc1cc0b5c00 2024-03-28T21:52:56.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.269+0000 7fc1caa00640 1 -- 172.21.15.153:0/1021088752 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8031c40 con 0x7fc1cc0b5c00 2024-03-28T21:52:56.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.269+0000 7fc1d2c00640 1 -- 172.21.15.153:0/1021088752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1cc0b5c00 msgr2=0x7fc1cc06b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:56.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.269+0000 7fc1d2c00640 1 --2- 172.21.15.153:0/1021088752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1cc0b5c00 0x7fc1cc06b170 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0d19c0 tx=0x7fc1b802b910 comp rx=0 tx=0).stop 2024-03-28T21:52:56.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.269+0000 7fc1d2c00640 1 -- 172.21.15.153:0/1021088752 shutdown_connections 2024-03-28T21:52:56.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.269+0000 7fc1d2c00640 1 --2- 172.21.15.153:0/1021088752 >> v2:172.21.15.165:3300/0 conn(0x7fc1cc06b6b0 0x7fc1cc0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.269+0000 7fc1d2c00640 1 --2- 172.21.15.153:0/1021088752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1cc0b5c00 0x7fc1cc06b170 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.269+0000 7fc1d2c00640 1 -- 172.21.15.153:0/1021088752 >> 172.21.15.153:0/1021088752 conn(0x7fc1cc0d0d20 msgr2=0x7fc1cc0d1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:56.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.269+0000 7fc1d2c00640 1 -- 172.21.15.153:0/1021088752 shutdown_connections 2024-03-28T21:52:56.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.269+0000 7fc1d2c00640 1 -- 172.21.15.153:0/1021088752 wait complete. 2024-03-28T21:52:56.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.271+0000 7fc1d2c00640 1 Processor -- start 2024-03-28T21:52:56.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.271+0000 7fc1d2c00640 1 -- start start 2024-03-28T21:52:56.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.272+0000 7fc1d2c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1cc06b6b0 0x7fc1cc157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:56.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.272+0000 7fc1d2c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1cc0b5c00 0x7fc1cc1612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:56.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.272+0000 7fc1d2c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1cc147a50 0x7fc1cc0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:56.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.272+0000 7fc1d2c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc0b5400 con 0x7fc1cc147a50 2024-03-28T21:52:56.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.272+0000 7fc1d2c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc0b5120 con 0x7fc1cc0b5c00 2024-03-28T21:52:56.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.272+0000 7fc1d2c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc1cc0b56e0 con 0x7fc1cc06b6b0 2024-03-28T21:52:56.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.272+0000 7fc1d0c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1cc147a50 0x7fc1cc0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:56.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.272+0000 7fc1d0c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1cc147a50 0x7fc1cc0aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37010/0 (socket says 172.21.15.153:37010) 2024-03-28T21:52:56.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.273+0000 7fc1d0c00640 1 -- 172.21.15.153:0/2529453164 learned_addr learned my addr 172.21.15.153:0/2529453164 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:56.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.273+0000 7fc1cb400640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1cc0b5c00 0x7fc1cc1612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:56.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.273+0000 7fc1cbe00640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1cc06b6b0 0x7fc1cc157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:56.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.273+0000 7fc1d0c00640 1 -- 172.21.15.153:0/2529453164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1cc06b6b0 msgr2=0x7fc1cc157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:56.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.273+0000 7fc1d0c00640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1cc06b6b0 0x7fc1cc157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.273+0000 7fc1d0c00640 1 -- 172.21.15.153:0/2529453164 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1cc0b5c00 msgr2=0x7fc1cc1612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:56.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.273+0000 7fc1d0c00640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1cc0b5c00 0x7fc1cc1612d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.273+0000 7fc1d0c00640 1 -- 172.21.15.153:0/2529453164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1cc15f920 con 0x7fc1cc147a50 2024-03-28T21:52:56.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.273+0000 7fc1cb400640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1cc0b5c00 0x7fc1cc1612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:56.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.273+0000 7fc1d0c00640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1cc147a50 0x7fc1cc0aede0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400cef0 tx=0x7fc1c400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:56.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.273+0000 7fc1c3e00640 1 -- 172.21.15.153:0/2529453164 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c401a070 con 0x7fc1cc147a50 2024-03-28T21:52:56.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.274+0000 7fc1c3e00640 1 -- 172.21.15.153:0/2529453164 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c400d860 con 0x7fc1cc147a50 2024-03-28T21:52:56.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.274+0000 7fc1c3e00640 1 -- 172.21.15.153:0/2529453164 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c400dc50 con 0x7fc1cc147a50 2024-03-28T21:52:56.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.274+0000 7fc1d2c00640 1 -- 172.21.15.153:0/2529453164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1cc15fc00 con 0x7fc1cc147a50 2024-03-28T21:52:56.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.274+0000 7fc1d2c00640 1 -- 172.21.15.153:0/2529453164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1cc1601c0 con 0x7fc1cc147a50 2024-03-28T21:52:56.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.275+0000 7fc1d2c00640 1 -- 172.21.15.153:0/2529453164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1cc068ff0 con 0x7fc1cc147a50 2024-03-28T21:52:56.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.276+0000 7fc1c3e00640 1 -- 172.21.15.153:0/2529453164 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc1c401d070 con 0x7fc1cc147a50 2024-03-28T21:52:56.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.277+0000 7fc1c3e00640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc1ac06b500 0x7fc1ac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:56.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.277+0000 7fc1c3e00640 1 -- 172.21.15.153:0/2529453164 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fc1c408ab40 con 0x7fc1cc147a50 2024-03-28T21:52:56.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.277+0000 7fc1cbe00640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc1ac06b500 0x7fc1ac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:56.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.278+0000 7fc1cbe00640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc1ac06b500 0x7fc1ac06d9c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc006fd0 tx=0x7fc1bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:56.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.286+0000 7fc1c3e00640 1 -- 172.21.15.153:0/2529453164 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc1c4059960 con 0x7fc1cc147a50 2024-03-28T21:52:56.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.519+0000 7fc1d2c00640 1 -- 172.21.15.153:0/2529453164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1cc162690 con 0x7fc1cc147a50 2024-03-28T21:52:56.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.520+0000 7fc1c3e00640 1 -- 172.21.15.153:0/2529453164 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fc1c4059260 con 0x7fc1cc147a50 2024-03-28T21:52:56.522 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:56.523 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/207550071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":207550071},{"type":"v1","addr":"172.21.15.165:6835","nonce":207550071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/900073633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":900073633},{"type":"v1","addr":"172.21.15.153:6837","nonce":900073633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3915706377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3915706377},{"type":"v1","addr":"172.21.15.165:6833","nonce":3915706377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T21:51:56.169625+0000","modified":"2024-03-28T21:51:59.218861+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6836/3516257974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3516257974},{"type":"v1","addr":"172.21.15.153:6836","nonce":3516257974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-03-28T21:52:56.523 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 8 2024-03-28T21:52:56.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.522+0000 7fc1d2c00640 1 -- 172.21.15.153:0/2529453164 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc1ac06b500 msgr2=0x7fc1ac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:56.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.522+0000 7fc1d2c00640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc1ac06b500 0x7fc1ac06d9c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc006fd0 tx=0x7fc1bc008040 comp rx=0 tx=0).stop 2024-03-28T21:52:56.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.522+0000 7fc1d2c00640 1 -- 172.21.15.153:0/2529453164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1cc147a50 msgr2=0x7fc1cc0aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:56.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.522+0000 7fc1d2c00640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1cc147a50 0x7fc1cc0aede0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400cef0 tx=0x7fc1c400a710 comp rx=0 tx=0).stop 2024-03-28T21:52:56.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.522+0000 7fc1d2c00640 1 -- 172.21.15.153:0/2529453164 shutdown_connections 2024-03-28T21:52:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.522+0000 7fc1d2c00640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc1ac06b500 0x7fc1ac06d9c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.523+0000 7fc1d2c00640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1cc147a50 0x7fc1cc0aede0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.523+0000 7fc1d2c00640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1cc0b5c00 0x7fc1cc1612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.523+0000 7fc1d2c00640 1 --2- 172.21.15.153:0/2529453164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1cc06b6b0 0x7fc1cc157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.523+0000 7fc1d2c00640 1 -- 172.21.15.153:0/2529453164 >> 172.21.15.153:0/2529453164 conn(0x7fc1cc0d0d20 msgr2=0x7fc1cc0cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.523+0000 7fc1d2c00640 1 -- 172.21.15.153:0/2529453164 shutdown_connections 2024-03-28T21:52:56.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.523+0000 7fc1d2c00640 1 -- 172.21.15.153:0/2529453164 wait complete. 2024-03-28T21:52:56.541 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:52:56.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.780+0000 7f6b01200640 1 Processor -- start 2024-03-28T21:52:56.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.780+0000 7f6b01200640 1 -- start start 2024-03-28T21:52:56.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.781+0000 7f6b01200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6afc15cf00 0x7f6afc0ad830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:56.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.781+0000 7f6b01200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6afc15d340 con 0x7f6afc06e440 2024-03-28T21:52:56.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.782+0000 7f6b01200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6afc0b2e60 con 0x7f6afc159a10 2024-03-28T21:52:56.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.782+0000 7f6b01200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6afc159df0 con 0x7f6afc15cf00 2024-03-28T21:52:56.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.782+0000 7f6af9400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6afc06e440 0x7f6afc0b3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45456/0 (socket says 172.21.15.153:45456) 2024-03-28T21:52:56.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.782+0000 7f6af9400640 1 -- 172.21.15.153:0/1029217849 learned_addr learned my addr 172.21.15.153:0/1029217849 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:56.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.782+0000 7f6af8a00640 1 -- 172.21.15.153:0/1029217849 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3944706807 0 0) 0x7f6afc15d340 con 0x7f6afc06e440 2024-03-28T21:52:56.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.782+0000 7f6af8a00640 1 -- 172.21.15.153:0/1029217849 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ae0003520 con 0x7f6afc06e440 2024-03-28T21:52:56.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.782+0000 7f6afa800640 1 --2- 172.21.15.153:0/1029217849 >> v2:172.21.15.165:3300/0 conn(0x7f6afc15cf00 0x7f6afc0ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:56.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.783+0000 7f6af8a00640 1 -- 172.21.15.153:0/1029217849 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 404423991 0 0) 0x7f6ae0003520 con 0x7f6afc06e440 2024-03-28T21:52:56.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.783+0000 7f6af8a00640 1 -- 172.21.15.153:0/1029217849 >> v2:172.21.15.165:3300/0 conn(0x7f6afc15cf00 msgr2=0x7f6afc0ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:56.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.783+0000 7f6af8a00640 1 --2- 172.21.15.153:0/1029217849 >> v2:172.21.15.165:3300/0 conn(0x7f6afc15cf00 0x7f6afc0ad830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.783+0000 7f6af8a00640 1 -- 172.21.15.153:0/1029217849 >> v1:172.21.15.165:6789/0 conn(0x7f6afc159a10 legacy=0x7f6afc06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:56.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.783+0000 7f6af8a00640 1 -- 172.21.15.153:0/1029217849 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6afc0adf10 con 0x7f6afc06e440 2024-03-28T21:52:56.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.783+0000 7f6af8a00640 1 -- 172.21.15.153:0/1029217849 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f6ae8001670 con 0x7f6afc06e440 2024-03-28T21:52:56.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.783+0000 7f6af8a00640 1 -- 172.21.15.153:0/1029217849 >> v1:172.21.15.153:6789/0 conn(0x7f6afc06e440 legacy=0x7f6afc0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:56.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.783+0000 7f6af8a00640 1 --2- 172.21.15.153:0/1029217849 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae0003a00 0x7f6ae0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:56.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.783+0000 7f6af8a00640 1 --2- 172.21.15.153:0/1029217849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ae0004800 0x7f6ae0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:56.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.783+0000 7f6af8a00640 1 --2- 172.21.15.153:0/1029217849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ae00052e0 0x7f6ae000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:56.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.783+0000 7f6af8a00640 1 -- 172.21.15.153:0/1029217849 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc159df0 con 0x7f6ae00052e0 2024-03-28T21:52:56.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.783+0000 7f6af8a00640 1 -- 172.21.15.153:0/1029217849 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae000c200 con 0x7f6ae0004800 2024-03-28T21:52:56.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.783+0000 7f6af8a00640 1 -- 172.21.15.153:0/1029217849 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae000c400 con 0x7f6ae0003a00 2024-03-28T21:52:56.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.783+0000 7f6afa800640 1 --2- 172.21.15.153:0/1029217849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ae00052e0 0x7f6ae000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:56.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.784+0000 7f6af9400640 1 --2- 172.21.15.153:0/1029217849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ae0004800 0x7f6ae0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:56.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.784+0000 7f6af9e00640 1 --2- 172.21.15.153:0/1029217849 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae0003a00 0x7f6ae0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:56.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.784+0000 7f6afa800640 1 -- 172.21.15.153:0/1029217849 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae0003a00 msgr2=0x7f6ae0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:56.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.784+0000 7f6afa800640 1 --2- 172.21.15.153:0/1029217849 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae0003a00 0x7f6ae0003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.784+0000 7f6afa800640 1 -- 172.21.15.153:0/1029217849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ae0004800 msgr2=0x7f6ae0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:56.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.784+0000 7f6afa800640 1 --2- 172.21.15.153:0/1029217849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ae0004800 0x7f6ae0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.784+0000 7f6afa800640 1 -- 172.21.15.153:0/1029217849 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae0003520 con 0x7f6ae00052e0 2024-03-28T21:52:56.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.784+0000 7f6af9400640 1 --2- 172.21.15.153:0/1029217849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ae0004800 0x7f6ae0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:56.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.785+0000 7f6afa800640 1 -- 172.21.15.153:0/1029217849 reap_dead start 2024-03-28T21:52:56.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.785+0000 7f6afa800640 1 --2- 172.21.15.153:0/1029217849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ae00052e0 0x7f6ae000b9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6af4007360 tx=0x7f6ae0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4894a1c909f5bd3 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:56.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.785+0000 7f6af8a00640 1 -- 172.21.15.153:0/1029217849 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4009be0 con 0x7f6ae00052e0 2024-03-28T21:52:56.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.785+0000 7f6af8a00640 1 -- 172.21.15.153:0/1029217849 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af402ccf0 con 0x7f6ae00052e0 2024-03-28T21:52:56.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.785+0000 7f6af8a00640 1 -- 172.21.15.153:0/1029217849 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4003bd0 con 0x7f6ae00052e0 2024-03-28T21:52:56.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.786+0000 7f6b01200640 1 -- 172.21.15.153:0/1029217849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ae00052e0 msgr2=0x7f6ae000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:56.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.786+0000 7f6b01200640 1 --2- 172.21.15.153:0/1029217849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ae00052e0 0x7f6ae000b9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6af4007360 tx=0x7f6ae0005830 comp rx=0 tx=0).stop 2024-03-28T21:52:56.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.786+0000 7f6b01200640 1 -- 172.21.15.153:0/1029217849 shutdown_connections 2024-03-28T21:52:56.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.786+0000 7f6b01200640 1 --2- 172.21.15.153:0/1029217849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ae00052e0 0x7f6ae000b9c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.786+0000 7f6b01200640 1 -- 172.21.15.153:0/1029217849 >> 172.21.15.153:0/1029217849 conn(0x7f6afc0b1a30 msgr2=0x7f6afc0b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:56.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.786+0000 7f6b01200640 1 -- 172.21.15.153:0/1029217849 shutdown_connections 2024-03-28T21:52:56.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.786+0000 7f6b01200640 1 -- 172.21.15.153:0/1029217849 wait complete. 2024-03-28T21:52:56.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.787+0000 7f6b01200640 1 Processor -- start 2024-03-28T21:52:56.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.788+0000 7f6b01200640 1 -- start start 2024-03-28T21:52:56.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6b01200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae00052e0 0x7f6afc14d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:56.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6b01200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6afc15b5a0 0x7f6afc15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:56.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6b01200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6afc0cabb0 0x7f6afc0cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:56.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6b01200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc0ae4d0 con 0x7f6afc15b5a0 2024-03-28T21:52:56.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6b01200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc0b3100 con 0x7f6afc0cabb0 2024-03-28T21:52:56.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6b01200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6afc0ad830 con 0x7f6ae00052e0 2024-03-28T21:52:56.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6af9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6afc15b5a0 0x7f6afc15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:56.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6af9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6afc15b5a0 0x7f6afc15ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37038/0 (socket says 172.21.15.153:37038) 2024-03-28T21:52:56.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6af9400640 1 -- 172.21.15.153:0/3440432363 learned_addr learned my addr 172.21.15.153:0/3440432363 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:56.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6af9400640 1 -- 172.21.15.153:0/3440432363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae00052e0 msgr2=0x7f6afc14d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:56.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6af9400640 1 --2- 172.21.15.153:0/3440432363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae00052e0 0x7f6afc14d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6af9400640 1 -- 172.21.15.153:0/3440432363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6afc0cabb0 msgr2=0x7f6afc0cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:56.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6af9400640 1 --2- 172.21.15.153:0/3440432363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6afc0cabb0 0x7f6afc0cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:56.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6af9400640 1 -- 172.21.15.153:0/3440432363 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6afc14dc00 con 0x7f6afc15b5a0 2024-03-28T21:52:56.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.789+0000 7f6af9400640 1 --2- 172.21.15.153:0/3440432363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6afc15b5a0 0x7f6afc15ba20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800d7a0 tx=0x7f6ae800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:56.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.790+0000 7f6af2000640 1 -- 172.21.15.153:0/3440432363 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8019070 con 0x7f6afc15b5a0 2024-03-28T21:52:56.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.790+0000 7f6b01200640 1 -- 172.21.15.153:0/3440432363 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6afc0c90b0 con 0x7f6afc15b5a0 2024-03-28T21:52:56.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.790+0000 7f6b01200640 1 -- 172.21.15.153:0/3440432363 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6afc0c9670 con 0x7f6afc15b5a0 2024-03-28T21:52:56.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.790+0000 7f6af2000640 1 -- 172.21.15.153:0/3440432363 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae80072d0 con 0x7f6afc15b5a0 2024-03-28T21:52:56.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.790+0000 7f6af2000640 1 -- 172.21.15.153:0/3440432363 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8023060 con 0x7f6afc15b5a0 2024-03-28T21:52:56.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.791+0000 7f6b01200640 1 -- 172.21.15.153:0/3440432363 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad4005290 con 0x7f6afc15b5a0 2024-03-28T21:52:56.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.792+0000 7f6af2000640 1 -- 172.21.15.153:0/3440432363 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f6ae801c070 con 0x7f6afc15b5a0 2024-03-28T21:52:56.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.793+0000 7f6af2000640 1 --2- 172.21.15.153:0/3440432363 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6adc06b500 0x7f6adc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:56.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.793+0000 7f6af2000640 1 -- 172.21.15.153:0/3440432363 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f6ae8089b70 con 0x7f6afc15b5a0 2024-03-28T21:52:56.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.793+0000 7f6af9e00640 1 --2- 172.21.15.153:0/3440432363 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6adc06b500 0x7f6adc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:56.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.794+0000 7f6af9e00640 1 --2- 172.21.15.153:0/3440432363 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6adc06b500 0x7f6adc06d9c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0015d0 tx=0x7f6aec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:56.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.797+0000 7f6af2000640 1 -- 172.21.15.153:0/3440432363 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6afc14dc00 con 0x7f6afc15b5a0 2024-03-28T21:52:56.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.993+0000 7f6b01200640 1 -- 172.21.15.153:0/3440432363 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ad4005580 con 0x7f6afc15b5a0 2024-03-28T21:52:56.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.994+0000 7f6af2000640 1 -- 172.21.15.153:0/3440432363 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16902 (secure 0 0 0) 0x7f6ae8058310 con 0x7f6afc15b5a0 2024-03-28T21:52:56.997 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:52:56.997 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":24,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:52:43.430328+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:51:53.863931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T21:51:55.188736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:52:57.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.997+0000 7f6b01200640 1 -- 172.21.15.153:0/3440432363 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6adc06b500 msgr2=0x7f6adc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:57.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.997+0000 7f6b01200640 1 --2- 172.21.15.153:0/3440432363 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6adc06b500 0x7f6adc06d9c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0015d0 tx=0x7f6aec009040 comp rx=0 tx=0).stop 2024-03-28T21:52:57.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.997+0000 7f6b01200640 1 -- 172.21.15.153:0/3440432363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6afc15b5a0 msgr2=0x7f6afc15ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:57.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.997+0000 7f6b01200640 1 --2- 172.21.15.153:0/3440432363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6afc15b5a0 0x7f6afc15ba20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800d7a0 tx=0x7f6ae800dc60 comp rx=0 tx=0).stop 2024-03-28T21:52:57.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.997+0000 7f6b01200640 1 -- 172.21.15.153:0/3440432363 shutdown_connections 2024-03-28T21:52:57.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.997+0000 7f6b01200640 1 --2- 172.21.15.153:0/3440432363 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6adc06b500 0x7f6adc06d9c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.997+0000 7f6b01200640 1 --2- 172.21.15.153:0/3440432363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6afc0cabb0 0x7f6afc0cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.997+0000 7f6b01200640 1 --2- 172.21.15.153:0/3440432363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6afc15b5a0 0x7f6afc15ba20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.997+0000 7f6b01200640 1 --2- 172.21.15.153:0/3440432363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae00052e0 0x7f6afc14d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.997+0000 7f6b01200640 1 -- 172.21.15.153:0/3440432363 >> 172.21.15.153:0/3440432363 conn(0x7f6afc0b1a30 msgr2=0x7f6afc06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:57.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.998+0000 7f6b01200640 1 -- 172.21.15.153:0/3440432363 shutdown_connections 2024-03-28T21:52:57.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:56.998+0000 7f6b01200640 1 -- 172.21.15.153:0/3440432363 wait complete. 2024-03-28T21:52:57.024 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-28T21:52:57.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.229+0000 7f0ae1600640 1 Processor -- start 2024-03-28T21:52:57.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.229+0000 7f0ae1600640 1 -- start start 2024-03-28T21:52:57.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.230+0000 7f0ae1600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0adc0cb360 0x7f0adc06b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:57.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.230+0000 7f0ae1600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0adc06b6b0 0x7f0adc157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:57.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.230+0000 7f0ae1600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0adc06bac0 con 0x7f0adc0cd0b0 2024-03-28T21:52:57.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.230+0000 7f0ae1600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0adc15eab0 con 0x7f0adc0cb360 2024-03-28T21:52:57.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.230+0000 7f0ae1600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0adc15ed90 con 0x7f0adc06b6b0 2024-03-28T21:52:57.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.231+0000 7f0adaa00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0adc0cd0b0 0x7f0adc0c72e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45470/0 (socket says 172.21.15.153:45470) 2024-03-28T21:52:57.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.231+0000 7f0adaa00640 1 -- 172.21.15.153:0/3690057404 learned_addr learned my addr 172.21.15.153:0/3690057404 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:57.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.231+0000 7f0ad2000640 1 --2- 172.21.15.153:0/3690057404 >> v2:172.21.15.153:3300/0 conn(0x7f0adc0cb360 0x7f0adc06b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:57.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.231+0000 7f0adb400640 1 --2- 172.21.15.153:0/3690057404 >> v2:172.21.15.165:3300/0 conn(0x7f0adc06b6b0 0x7f0adc157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:57.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.231+0000 7f0ada000640 1 -- 172.21.15.153:0/3690057404 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3586039805 0 0) 0x7f0acc001110 con 0x7f0adc0cd0b0 2024-03-28T21:52:57.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.231+0000 7f0ada000640 1 -- 172.21.15.153:0/3690057404 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ac0003520 con 0x7f0adc0cd0b0 2024-03-28T21:52:57.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.231+0000 7f0ad2000640 1 -- 172.21.15.153:0/3690057404 >> v2:172.21.15.165:3300/0 conn(0x7f0adc06b6b0 msgr2=0x7f0adc157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:57.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.231+0000 7f0ad2000640 1 --2- 172.21.15.153:0/3690057404 >> v2:172.21.15.165:3300/0 conn(0x7f0adc06b6b0 0x7f0adc157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.231+0000 7f0ad2000640 1 -- 172.21.15.153:0/3690057404 >> v1:172.21.15.153:6789/0 conn(0x7f0adc0cd0b0 legacy=0x7f0adc0c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:57.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.232+0000 7f0ad2000640 1 -- 172.21.15.153:0/3690057404 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0adc15f070 con 0x7f0adc0cb360 2024-03-28T21:52:57.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.233+0000 7f0ad2000640 1 --2- 172.21.15.153:0/3690057404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0adc0cb360 0x7f0adc06b170 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0ce650 tx=0x7f0ac402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ede23cb98881e49 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:57.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.233+0000 7f0ada000640 1 -- 172.21.15.153:0/3690057404 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac4035020 con 0x7f0adc0cb360 2024-03-28T21:52:57.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.233+0000 7f0ada000640 1 -- 172.21.15.153:0/3690057404 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ac4031830 con 0x7f0adc0cb360 2024-03-28T21:52:57.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.233+0000 7f0ada000640 1 -- 172.21.15.153:0/3690057404 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac4031c00 con 0x7f0adc0cb360 2024-03-28T21:52:57.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.234+0000 7f0ae1600640 1 -- 172.21.15.153:0/3690057404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0adc0cb360 msgr2=0x7f0adc06b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:57.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.234+0000 7f0ae1600640 1 --2- 172.21.15.153:0/3690057404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0adc0cb360 0x7f0adc06b170 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0ce650 tx=0x7f0ac402b8d0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.234+0000 7f0ae1600640 1 -- 172.21.15.153:0/3690057404 shutdown_connections 2024-03-28T21:52:57.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.234+0000 7f0ae1600640 1 --2- 172.21.15.153:0/3690057404 >> v2:172.21.15.165:3300/0 conn(0x7f0adc06b6b0 0x7f0adc157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.234+0000 7f0ae1600640 1 --2- 172.21.15.153:0/3690057404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0adc0cb360 0x7f0adc06b170 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.234+0000 7f0ae1600640 1 -- 172.21.15.153:0/3690057404 >> 172.21.15.153:0/3690057404 conn(0x7f0adc0cd790 msgr2=0x7f0adc0cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:57.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.234+0000 7f0ae1600640 1 -- 172.21.15.153:0/3690057404 shutdown_connections 2024-03-28T21:52:57.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.234+0000 7f0ae1600640 1 -- 172.21.15.153:0/3690057404 wait complete. 2024-03-28T21:52:57.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.236+0000 7f0ae1600640 1 Processor -- start 2024-03-28T21:52:57.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.236+0000 7f0ae1600640 1 -- start start 2024-03-28T21:52:57.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0ae1600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0adc06b6b0 0x7f0adc0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:57.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0ae1600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0adc0cb360 0x7f0adc0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:57.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0ae1600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0adc0cd0b0 0x7f0adc06f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:57.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0ae1600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0adc0c79f0 con 0x7f0adc0cb360 2024-03-28T21:52:57.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0ae1600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0adc15e7a0 con 0x7f0adc06b6b0 2024-03-28T21:52:57.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0ae1600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0adc0c7b70 con 0x7f0adc0cd0b0 2024-03-28T21:52:57.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0ad2000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0adc0cb360 0x7f0adc0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:57.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0ad2000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0adc0cb360 0x7f0adc0b3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37066/0 (socket says 172.21.15.153:37066) 2024-03-28T21:52:57.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0ad2000640 1 -- 172.21.15.153:0/2959985459 learned_addr learned my addr 172.21.15.153:0/2959985459 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:57.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0adaa00640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0adc06b6b0 0x7f0adc0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:57.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0adb400640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0adc0cd0b0 0x7f0adc06f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:57.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0ad2000640 1 -- 172.21.15.153:0/2959985459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0adc0cd0b0 msgr2=0x7f0adc06f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:57.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0ad2000640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0adc0cd0b0 0x7f0adc06f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0ad2000640 1 -- 172.21.15.153:0/2959985459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0adc06b6b0 msgr2=0x7f0adc0af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:57.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0ad2000640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0adc06b6b0 0x7f0adc0af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0ad2000640 1 -- 172.21.15.153:0/2959985459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0adc0ae220 con 0x7f0adc0cb360 2024-03-28T21:52:57.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.237+0000 7f0adaa00640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0adc06b6b0 0x7f0adc0af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:57.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.238+0000 7f0ad2000640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0adc0cb360 0x7f0adc0b3c40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4009890 tx=0x7f0ac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:57.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.238+0000 7f0ad3400640 1 -- 172.21.15.153:0/2959985459 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac4041070 con 0x7f0adc0cb360 2024-03-28T21:52:57.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.238+0000 7f0ad3400640 1 -- 172.21.15.153:0/2959985459 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ac403b920 con 0x7f0adc0cb360 2024-03-28T21:52:57.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.238+0000 7f0ae1600640 1 -- 172.21.15.153:0/2959985459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0adc0ae500 con 0x7f0adc0cb360 2024-03-28T21:52:57.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.238+0000 7f0ad3400640 1 -- 172.21.15.153:0/2959985459 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac4035040 con 0x7f0adc0cb360 2024-03-28T21:52:57.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.238+0000 7f0ae1600640 1 -- 172.21.15.153:0/2959985459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0adc0aeda0 con 0x7f0adc0cb360 2024-03-28T21:52:57.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.239+0000 7f0ae1600640 1 -- 172.21.15.153:0/2959985459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0adc0ae6d0 con 0x7f0adc0cb360 2024-03-28T21:52:57.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.240+0000 7f0ad3400640 1 -- 172.21.15.153:0/2959985459 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0ac4038020 con 0x7f0adc0cb360 2024-03-28T21:52:57.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.241+0000 7f0ad3400640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0ab806b4d0 0x7f0ab806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:57.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.241+0000 7f0ad3400640 1 -- 172.21.15.153:0/2959985459 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f0ac40abce0 con 0x7f0adc0cb360 2024-03-28T21:52:57.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.241+0000 7f0adaa00640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0ab806b4d0 0x7f0ab806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:57.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.242+0000 7f0adaa00640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0ab806b4d0 0x7f0ab806d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0012b0 tx=0x7f0acc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:57.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.246+0000 7f0ad3400640 1 -- 172.21.15.153:0/2959985459 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0ac4031800 con 0x7f0adc0cb360 2024-03-28T21:52:57.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.480+0000 7f0ae1600640 1 -- 172.21.15.153:0/2959985459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0adc068ff0 con 0x7f0adc0cb360 2024-03-28T21:52:57.483 INFO:tasks.ceph.mon.a.smithi153.stderr:2024-03-28T21:52:57.481+0000 7f3dbd600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-28T21:52:57.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.485+0000 7f0ad3400640 1 -- 172.21.15.153:0/2959985459 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f0ac407aa40 con 0x7f0adc0cb360 2024-03-28T21:52:57.488 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-28T21:52:57.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.489+0000 7f0ae1600640 1 -- 172.21.15.153:0/2959985459 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0ab806b4d0 msgr2=0x7f0ab806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:57.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.489+0000 7f0ae1600640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0ab806b4d0 0x7f0ab806d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0012b0 tx=0x7f0acc009040 comp rx=0 tx=0).stop 2024-03-28T21:52:57.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.489+0000 7f0ae1600640 1 -- 172.21.15.153:0/2959985459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0adc0cb360 msgr2=0x7f0adc0b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:57.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.489+0000 7f0ae1600640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0adc0cb360 0x7f0adc0b3c40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4009890 tx=0x7f0ac40046c0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.489+0000 7f0ae1600640 1 -- 172.21.15.153:0/2959985459 shutdown_connections 2024-03-28T21:52:57.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.489+0000 7f0ae1600640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0ab806b4d0 0x7f0ab806d990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.489+0000 7f0ae1600640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0adc0cd0b0 0x7f0adc06f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.489+0000 7f0ae1600640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0adc0cb360 0x7f0adc0b3c40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.489+0000 7f0ae1600640 1 --2- 172.21.15.153:0/2959985459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0adc06b6b0 0x7f0adc0af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.489+0000 7f0ae1600640 1 -- 172.21.15.153:0/2959985459 >> 172.21.15.153:0/2959985459 conn(0x7f0adc0cd790 msgr2=0x7f0adc0b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:57.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.490+0000 7f0ae1600640 1 -- 172.21.15.153:0/2959985459 shutdown_connections 2024-03-28T21:52:57.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.490+0000 7f0ae1600640 1 -- 172.21.15.153:0/2959985459 wait complete. 2024-03-28T21:52:57.510 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-28T21:52:57.510 INFO:tasks.ceph.mds.c.smithi153.stderr: -8593> 2024-03-28T21:51:58.786+0000 7fcc00600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-28T21:52:57.579 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2024-03-28T21:52:57.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.696+0000 7fae89e00640 1 Processor -- start 2024-03-28T21:52:57.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.696+0000 7fae89e00640 1 -- start start 2024-03-28T21:52:57.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.697+0000 7fae89e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fae84145580 0x7fae840cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:57.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.697+0000 7fae89e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fae840ceb30 0x7fae8406b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:57.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.697+0000 7fae89e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae8406bad0 0x7fae84147e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:57.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.697+0000 7fae89e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fae8406bf40 con 0x7fae84145580 2024-03-28T21:52:57.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.697+0000 7fae89e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fae84166f00 con 0x7fae840ceb30 2024-03-28T21:52:57.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.697+0000 7fae89e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fae841662f0 con 0x7fae8406bad0 2024-03-28T21:52:57.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.698+0000 7fae82a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fae84145580 0x7fae840cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:57.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.698+0000 7fae82a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fae84145580 0x7fae840cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37090/0 (socket says 172.21.15.153:37090) 2024-03-28T21:52:57.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.698+0000 7fae82a00640 1 -- 172.21.15.153:0/386533479 learned_addr learned my addr 172.21.15.153:0/386533479 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:57.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.698+0000 7fae83400640 1 --2- 172.21.15.153:0/386533479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae8406bad0 0x7fae84147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:57.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.698+0000 7fae82000640 1 --2- 172.21.15.153:0/386533479 >> v2:172.21.15.165:3300/0 conn(0x7fae840ceb30 0x7fae8406b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:57.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.698+0000 7fae82a00640 1 -- 172.21.15.153:0/386533479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae8406bad0 msgr2=0x7fae84147e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:57.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.698+0000 7fae82a00640 1 --2- 172.21.15.153:0/386533479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae8406bad0 0x7fae84147e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.698+0000 7fae82a00640 1 -- 172.21.15.153:0/386533479 >> v2:172.21.15.165:3300/0 conn(0x7fae840ceb30 msgr2=0x7fae8406b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:57.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.698+0000 7fae82a00640 1 --2- 172.21.15.153:0/386533479 >> v2:172.21.15.165:3300/0 conn(0x7fae840ceb30 0x7fae8406b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.698+0000 7fae82a00640 1 -- 172.21.15.153:0/386533479 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae841665d0 con 0x7fae84145580 2024-03-28T21:52:57.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.699+0000 7fae82000640 1 --2- 172.21.15.153:0/386533479 >> v2:172.21.15.165:3300/0 conn(0x7fae840ceb30 0x7fae8406b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:52:57.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.700+0000 7fae82a00640 1 --2- 172.21.15.153:0/386533479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae84145580 0x7fae840cf2f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fae8406c130 tx=0x7fae7402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925c774d9fc98693 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:57.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.700+0000 7fae81600640 1 -- 172.21.15.153:0/386533479 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74035020 con 0x7fae84145580 2024-03-28T21:52:57.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.700+0000 7fae81600640 1 -- 172.21.15.153:0/386533479 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae74031870 con 0x7fae84145580 2024-03-28T21:52:57.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.700+0000 7fae81600640 1 -- 172.21.15.153:0/386533479 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74031c40 con 0x7fae84145580 2024-03-28T21:52:57.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.701+0000 7fae89e00640 1 -- 172.21.15.153:0/386533479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae84145580 msgr2=0x7fae840cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:57.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.701+0000 7fae89e00640 1 --2- 172.21.15.153:0/386533479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae84145580 0x7fae840cf2f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fae8406c130 tx=0x7fae7402b910 comp rx=0 tx=0).stop 2024-03-28T21:52:57.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.701+0000 7fae89e00640 1 -- 172.21.15.153:0/386533479 shutdown_connections 2024-03-28T21:52:57.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.701+0000 7fae89e00640 1 --2- 172.21.15.153:0/386533479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae8406bad0 0x7fae84147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.701+0000 7fae89e00640 1 --2- 172.21.15.153:0/386533479 >> v2:172.21.15.165:3300/0 conn(0x7fae840ceb30 0x7fae8406b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.701+0000 7fae89e00640 1 --2- 172.21.15.153:0/386533479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae84145580 0x7fae840cf2f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.701+0000 7fae89e00640 1 -- 172.21.15.153:0/386533479 >> 172.21.15.153:0/386533479 conn(0x7fae840b1cb0 msgr2=0x7fae840b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:57.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.701+0000 7fae89e00640 1 -- 172.21.15.153:0/386533479 shutdown_connections 2024-03-28T21:52:57.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.701+0000 7fae89e00640 1 -- 172.21.15.153:0/386533479 wait complete. 2024-03-28T21:52:57.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.703+0000 7fae89e00640 1 Processor -- start 2024-03-28T21:52:57.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.703+0000 7fae89e00640 1 -- start start 2024-03-28T21:52:57.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.704+0000 7fae89e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae8406bad0 0x7fae8415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:57.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.704+0000 7fae89e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae840ceb30 0x7fae84144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:57.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.704+0000 7fae89e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae84145580 0x7fae841619d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:57.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.704+0000 7fae89e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae84145960 con 0x7fae840ceb30 2024-03-28T21:52:57.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.704+0000 7fae89e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fae84166b90 con 0x7fae84145580 2024-03-28T21:52:57.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.704+0000 7fae89e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fae84145ae0 con 0x7fae8406bad0 2024-03-28T21:52:57.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.704+0000 7fae82000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae840ceb30 0x7fae84144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:57.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.704+0000 7fae82000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae840ceb30 0x7fae84144740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37106/0 (socket says 172.21.15.153:37106) 2024-03-28T21:52:57.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.704+0000 7fae82000640 1 -- 172.21.15.153:0/345606361 learned_addr learned my addr 172.21.15.153:0/345606361 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:57.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae83400640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae84145580 0x7fae841619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:57.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae82000640 1 -- 172.21.15.153:0/345606361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae8406bad0 msgr2=0x7fae8415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:57.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae82a00640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae8406bad0 0x7fae8415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:57.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae82000640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae8406bad0 0x7fae8415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae82000640 1 -- 172.21.15.153:0/345606361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae84145580 msgr2=0x7fae841619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:57.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae82000640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae84145580 0x7fae841619d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:57.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae82000640 1 -- 172.21.15.153:0/345606361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8415da60 con 0x7fae840ceb30 2024-03-28T21:52:57.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae83400640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae84145580 0x7fae841619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:57.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae82a00640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae8406bad0 0x7fae8415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:57.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae82000640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae840ceb30 0x7fae84144740 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae7000e730 tx=0x7fae7000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:57.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae7b400640 1 -- 172.21.15.153:0/345606361 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7000f040 con 0x7fae840ceb30 2024-03-28T21:52:57.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae7b400640 1 -- 172.21.15.153:0/345606361 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae70004230 con 0x7fae840ceb30 2024-03-28T21:52:57.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae7b400640 1 -- 172.21.15.153:0/345606361 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7000ee40 con 0x7fae840ceb30 2024-03-28T21:52:57.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae89e00640 1 -- 172.21.15.153:0/345606361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae8415dd00 con 0x7fae840ceb30 2024-03-28T21:52:57.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.705+0000 7fae89e00640 1 -- 172.21.15.153:0/345606361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae8415e2c0 con 0x7fae840ceb30 2024-03-28T21:52:57.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.707+0000 7fae89e00640 1 -- 172.21.15.153:0/345606361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae8406d3c0 con 0x7fae840ceb30 2024-03-28T21:52:57.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.707+0000 7fae7b400640 1 -- 172.21.15.153:0/345606361 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fae7000c6d0 con 0x7fae840ceb30 2024-03-28T21:52:57.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.708+0000 7fae7b400640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fae6406b4d0 0x7fae6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:57.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.708+0000 7fae7b400640 1 -- 172.21.15.153:0/345606361 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5911+0+0 (secure 0 0 0) 0x7fae70089f70 con 0x7fae840ceb30 2024-03-28T21:52:57.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.709+0000 7fae82a00640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fae6406b4d0 0x7fae6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:57.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.709+0000 7fae82a00640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fae6406b4d0 0x7fae6406d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae74036000 tx=0x7fae74008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:57.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.712+0000 7fae7b400640 1 -- 172.21.15.153:0/345606361 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fae8406d3c0 con 0x7fae840ceb30 2024-03-28T21:52:57.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:57.945+0000 7fae89e00640 1 -- 172.21.15.153:0/345606361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fae84068ff0 con 0x7fae840ceb30 2024-03-28T21:52:58.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.488+0000 7fae7b400640 1 -- 172.21.15.153:0/345606361 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fae70017020 con 0x7fae840ceb30 2024-03-28T21:52:58.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.492+0000 7fae89e00640 1 -- 172.21.15.153:0/345606361 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fae6406b4d0 msgr2=0x7fae6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.492+0000 7fae89e00640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fae6406b4d0 0x7fae6406d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae74036000 tx=0x7fae74008030 comp rx=0 tx=0).stop 2024-03-28T21:52:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.492+0000 7fae89e00640 1 -- 172.21.15.153:0/345606361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae840ceb30 msgr2=0x7fae84144740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.492+0000 7fae89e00640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae840ceb30 0x7fae84144740 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae7000e730 tx=0x7fae7000ebf0 comp rx=0 tx=0).stop 2024-03-28T21:52:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.492+0000 7fae89e00640 1 -- 172.21.15.153:0/345606361 shutdown_connections 2024-03-28T21:52:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.492+0000 7fae89e00640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fae6406b4d0 0x7fae6406d990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.492+0000 7fae89e00640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae84145580 0x7fae841619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.492+0000 7fae89e00640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae840ceb30 0x7fae84144740 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.492+0000 7fae89e00640 1 --2- 172.21.15.153:0/345606361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae8406bad0 0x7fae8415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.492+0000 7fae89e00640 1 -- 172.21.15.153:0/345606361 >> 172.21.15.153:0/345606361 conn(0x7fae840b1cb0 msgr2=0x7fae841643a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.492+0000 7fae89e00640 1 -- 172.21.15.153:0/345606361 shutdown_connections 2024-03-28T21:52:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.492+0000 7fae89e00640 1 -- 172.21.15.153:0/345606361 wait complete. 2024-03-28T21:52:58.518 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-28T21:52:58.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.728+0000 7fd1de800640 1 Processor -- start 2024-03-28T21:52:58.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.729+0000 7fd1de800640 1 -- start start 2024-03-28T21:52:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.730+0000 7fd1de800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1d8071fc0 0x7fd1d8072420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.730+0000 7fd1de800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd1d806d440 0x7fd1d806d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.730+0000 7fd1de800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1d8163000 con 0x7fd1d80cc270 2024-03-28T21:52:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.730+0000 7fd1de800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd1d8072960 con 0x7fd1d806d440 2024-03-28T21:52:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.730+0000 7fd1de800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d8163b80 con 0x7fd1d8071fc0 2024-03-28T21:52:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.730+0000 7fd1d7400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd1d80cc270 0x7fd1d8166bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45480/0 (socket says 172.21.15.153:45480) 2024-03-28T21:52:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.731+0000 7fd1d7400640 1 -- 172.21.15.153:0/884746079 learned_addr learned my addr 172.21.15.153:0/884746079 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:52:58.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.731+0000 7fd1d7e00640 1 --2- 172.21.15.153:0/884746079 >> v2:172.21.15.165:3300/0 conn(0x7fd1d806d440 0x7fd1d806d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:58.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.731+0000 7fd1d6a00640 1 --2- 172.21.15.153:0/884746079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1d8071fc0 0x7fd1d8072420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:58.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.731+0000 7fd1d6000640 1 -- 172.21.15.153:0/884746079 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016681504 0 0) 0x7fd1d8163000 con 0x7fd1d80cc270 2024-03-28T21:52:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.731+0000 7fd1d6000640 1 -- 172.21.15.153:0/884746079 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1b8003520 con 0x7fd1d80cc270 2024-03-28T21:52:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6000640 1 -- 172.21.15.153:0/884746079 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2695642347 0 0) 0x7fd1b8003520 con 0x7fd1d80cc270 2024-03-28T21:52:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6000640 1 -- 172.21.15.153:0/884746079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1d8071fc0 msgr2=0x7fd1d8072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6000640 1 --2- 172.21.15.153:0/884746079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1d8071fc0 0x7fd1d8072420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6000640 1 -- 172.21.15.153:0/884746079 >> v2:172.21.15.165:3300/0 conn(0x7fd1d806d440 msgr2=0x7fd1d806d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6000640 1 --2- 172.21.15.153:0/884746079 >> v2:172.21.15.165:3300/0 conn(0x7fd1d806d440 0x7fd1d806d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6000640 1 -- 172.21.15.153:0/884746079 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d81632e0 con 0x7fd1d80cc270 2024-03-28T21:52:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6000640 1 -- 172.21.15.153:0/884746079 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fd1c8001670 con 0x7fd1d80cc270 2024-03-28T21:52:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6000640 1 -- 172.21.15.153:0/884746079 >> v1:172.21.15.153:6789/0 conn(0x7fd1d80cc270 legacy=0x7fd1d8166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6000640 1 --2- 172.21.15.153:0/884746079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80039b0 0x7fd1b8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6000640 1 --2- 172.21.15.153:0/884746079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1d8071fc0 0x7fd1b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6000640 1 --2- 172.21.15.153:0/884746079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1b8004d40 0x7fd1b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:58.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6000640 1 -- 172.21.15.153:0/884746079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d8163b80 con 0x7fd1b80039b0 2024-03-28T21:52:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6000640 1 -- 172.21.15.153:0/884746079 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b800b9c0 con 0x7fd1b8004d40 2024-03-28T21:52:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6000640 1 -- 172.21.15.153:0/884746079 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b800bb70 con 0x7fd1d8071fc0 2024-03-28T21:52:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d7400640 1 --2- 172.21.15.153:0/884746079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80039b0 0x7fd1b8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d7e00640 1 --2- 172.21.15.153:0/884746079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1b8004d40 0x7fd1b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d6a00640 1 --2- 172.21.15.153:0/884746079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1d8071fc0 0x7fd1b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d7400640 1 -- 172.21.15.153:0/884746079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1d8071fc0 msgr2=0x7fd1b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d7400640 1 --2- 172.21.15.153:0/884746079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1d8071fc0 0x7fd1b8004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d7400640 1 -- 172.21.15.153:0/884746079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1b8004d40 msgr2=0x7fd1b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d7400640 1 --2- 172.21.15.153:0/884746079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1b8004d40 0x7fd1b80051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:58.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.732+0000 7fd1d7400640 1 -- 172.21.15.153:0/884746079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b8003520 con 0x7fd1b80039b0 2024-03-28T21:52:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.734+0000 7fd1d7400640 1 --2- 172.21.15.153:0/884746079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80039b0 0x7fd1b8003df0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8007fd0 tx=0x7fd1b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c72a8b625a746c server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.734+0000 7fd1d6000640 1 -- 172.21.15.153:0/884746079 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8007d50 con 0x7fd1b80039b0 2024-03-28T21:52:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.734+0000 7fd1d6000640 1 -- 172.21.15.153:0/884746079 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c8030070 con 0x7fd1b80039b0 2024-03-28T21:52:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.734+0000 7fd1d6000640 1 -- 172.21.15.153:0/884746079 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c802cd40 con 0x7fd1b80039b0 2024-03-28T21:52:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.734+0000 7fd1de800640 1 -- 172.21.15.153:0/884746079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80039b0 msgr2=0x7fd1b8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.734+0000 7fd1de800640 1 --2- 172.21.15.153:0/884746079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b80039b0 0x7fd1b8003df0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8007fd0 tx=0x7fd1b8005830 comp rx=0 tx=0).stop 2024-03-28T21:52:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.734+0000 7fd1d7e00640 1 -- 172.21.15.153:0/884746079 reap_dead start 2024-03-28T21:52:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.734+0000 7fd1de800640 1 -- 172.21.15.153:0/884746079 shutdown_connections 2024-03-28T21:52:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.734+0000 7fd1de800640 1 -- 172.21.15.153:0/884746079 >> 172.21.15.153:0/884746079 conn(0x7fd1d806b170 msgr2=0x7fd1d806b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.735+0000 7fd1de800640 1 -- 172.21.15.153:0/884746079 shutdown_connections 2024-03-28T21:52:58.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.735+0000 7fd1de800640 1 -- 172.21.15.153:0/884746079 wait complete. 2024-03-28T21:52:58.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.736+0000 7fd1de800640 1 Processor -- start 2024-03-28T21:52:58.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.736+0000 7fd1de800640 1 -- start start 2024-03-28T21:52:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.737+0000 7fd1de800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1b80039b0 0x7fd1d81ec310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.737+0000 7fd1de800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1d80b22e0 0x7fd1d81ed360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.737+0000 7fd1de800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1d81588a0 0x7fd1d80ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.737+0000 7fd1de800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d80b4190 con 0x7fd1d80b22e0 2024-03-28T21:52:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.737+0000 7fd1de800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d81638a0 con 0x7fd1b80039b0 2024-03-28T21:52:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.737+0000 7fd1de800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d8162bf0 con 0x7fd1d81588a0 2024-03-28T21:52:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.737+0000 7fd1d6a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1d80b22e0 0x7fd1d81ed360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.737+0000 7fd1d6a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1d80b22e0 0x7fd1d81ed360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37112/0 (socket says 172.21.15.153:37112) 2024-03-28T21:52:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.738+0000 7fd1d6a00640 1 -- 172.21.15.153:0/2707371588 learned_addr learned my addr 172.21.15.153:0/2707371588 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.738+0000 7fd1d7400640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1b80039b0 0x7fd1d81ec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:58.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.738+0000 7fd1d7e00640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1d81588a0 0x7fd1d80ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.738+0000 7fd1d6a00640 1 -- 172.21.15.153:0/2707371588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1d81588a0 msgr2=0x7fd1d80ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.738+0000 7fd1d6a00640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1d81588a0 0x7fd1d80ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.738+0000 7fd1d6a00640 1 -- 172.21.15.153:0/2707371588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1b80039b0 msgr2=0x7fd1d81ec310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.738+0000 7fd1d6a00640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1b80039b0 0x7fd1d81ec310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.738+0000 7fd1d6a00640 1 -- 172.21.15.153:0/2707371588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d81ec9f0 con 0x7fd1d80b22e0 2024-03-28T21:52:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.738+0000 7fd1d7e00640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1d81588a0 0x7fd1d80ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:52:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.738+0000 7fd1d6a00640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1d80b22e0 0x7fd1d81ed360 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000f350 tx=0x7fd1c000f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.739+0000 7fd1cf400640 1 -- 172.21.15.153:0/2707371588 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c001c070 con 0x7fd1d80b22e0 2024-03-28T21:52:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.739+0000 7fd1cf400640 1 -- 172.21.15.153:0/2707371588 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c0017620 con 0x7fd1d80b22e0 2024-03-28T21:52:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.739+0000 7fd1de800640 1 -- 172.21.15.153:0/2707371588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d80b1520 con 0x7fd1d80b22e0 2024-03-28T21:52:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.739+0000 7fd1cf400640 1 -- 172.21.15.153:0/2707371588 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0017a10 con 0x7fd1d80b22e0 2024-03-28T21:52:58.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.739+0000 7fd1de800640 1 -- 172.21.15.153:0/2707371588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d80b1ae0 con 0x7fd1d80b22e0 2024-03-28T21:52:58.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.740+0000 7fd1de800640 1 -- 172.21.15.153:0/2707371588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d80690d0 con 0x7fd1d80b22e0 2024-03-28T21:52:58.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.741+0000 7fd1cf400640 1 -- 172.21.15.153:0/2707371588 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fd1c001f070 con 0x7fd1d80b22e0 2024-03-28T21:52:58.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.742+0000 7fd1cf400640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd1b406b500 0x7fd1b406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:58.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.742+0000 7fd1cf400640 1 -- 172.21.15.153:0/2707371588 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5911+0+0 (secure 0 0 0) 0x7fd1c008a5f0 con 0x7fd1d80b22e0 2024-03-28T21:52:58.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.742+0000 7fd1d7400640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd1b406b500 0x7fd1b406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:58.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.743+0000 7fd1d7400640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd1b406b500 0x7fd1b406d9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8034000 tx=0x7fd1c8007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:58.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.746+0000 7fd1cf400640 1 -- 172.21.15.153:0/2707371588 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd1c0012070 con 0x7fd1d80b22e0 2024-03-28T21:52:58.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:58.927+0000 7fd1de800640 1 -- 172.21.15.153:0/2707371588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd1d81ed8a0 con 0x7fd1d80b22e0 2024-03-28T21:52:59.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.492+0000 7fd1cf400640 1 -- 172.21.15.153:0/2707371588 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) ==== 181+0+0 (secure 0 0 0) 0x7fd1c0058d70 con 0x7fd1d80b22e0 2024-03-28T21:52:59.495 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2024-03-28T21:52:59.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.495+0000 7fd1de800640 1 -- 172.21.15.153:0/2707371588 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd1b406b500 msgr2=0x7fd1b406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:59.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.495+0000 7fd1de800640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd1b406b500 0x7fd1b406d9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8034000 tx=0x7fd1c8007000 comp rx=0 tx=0).stop 2024-03-28T21:52:59.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.495+0000 7fd1de800640 1 -- 172.21.15.153:0/2707371588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1d80b22e0 msgr2=0x7fd1d81ed360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:59.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.495+0000 7fd1de800640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1d80b22e0 0x7fd1d81ed360 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000f350 tx=0x7fd1c000f810 comp rx=0 tx=0).stop 2024-03-28T21:52:59.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.496+0000 7fd1de800640 1 -- 172.21.15.153:0/2707371588 shutdown_connections 2024-03-28T21:52:59.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.496+0000 7fd1de800640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd1b406b500 0x7fd1b406d9c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:59.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.497+0000 7fd1de800640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1d81588a0 0x7fd1d80ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:59.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.497+0000 7fd1de800640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1d80b22e0 0x7fd1d81ed360 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:59.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.497+0000 7fd1de800640 1 --2- 172.21.15.153:0/2707371588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1b80039b0 0x7fd1d81ec310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:59.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.497+0000 7fd1de800640 1 -- 172.21.15.153:0/2707371588 >> 172.21.15.153:0/2707371588 conn(0x7fd1d806b170 msgr2=0x7fd1d8161fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:59.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.498+0000 7fd1de800640 1 -- 172.21.15.153:0/2707371588 shutdown_connections 2024-03-28T21:52:59.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.498+0000 7fd1de800640 1 -- 172.21.15.153:0/2707371588 wait complete. 2024-03-28T21:52:59.524 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-28T21:52:59.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.736+0000 7f6950400640 1 Processor -- start 2024-03-28T21:52:59.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.736+0000 7f6950400640 1 -- start start 2024-03-28T21:52:59.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.738+0000 7f6950400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f694815e640 0x7f69480d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:59.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.738+0000 7f6950400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f69480cedc0 0x7f69480cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:59.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.738+0000 7f6950400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69480cf7e0 con 0x7f69480d2950 2024-03-28T21:52:59.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.738+0000 7f6950400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f694806c280 con 0x7f694815e640 2024-03-28T21:52:59.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.738+0000 7f6950400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f69480ccc70 con 0x7f69480cedc0 2024-03-28T21:52:59.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.738+0000 7f694da00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f694815e640 0x7f69480d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:59.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.738+0000 7f694da00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f694815e640 0x7f69480d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37114/0 (socket says 172.21.15.153:37114) 2024-03-28T21:52:59.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.738+0000 7f694da00640 1 -- 172.21.15.153:0/1404302186 learned_addr learned my addr 172.21.15.153:0/1404302186 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:59.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.738+0000 7f694da00640 1 -- 172.21.15.153:0/1404302186 >> v2:172.21.15.165:3300/0 conn(0x7f69480cedc0 msgr2=0x7f69480cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:59.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.739+0000 7f694da00640 1 --2- 172.21.15.153:0/1404302186 >> v2:172.21.15.165:3300/0 conn(0x7f69480cedc0 0x7f69480cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:59.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.739+0000 7f694da00640 1 -- 172.21.15.153:0/1404302186 >> v1:172.21.15.165:6789/0 conn(0x7f69480d2950 legacy=0x7f69480ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:52:59.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.739+0000 7f694da00640 1 -- 172.21.15.153:0/1404302186 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69480d12a0 con 0x7f694815e640 2024-03-28T21:52:59.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.740+0000 7f694da00640 1 --2- 172.21.15.153:0/1404302186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f694815e640 0x7f69480d0c10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f69480cc410 tx=0x7f693c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27dda40a710376ba server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:59.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.740+0000 7f6947e00640 1 -- 172.21.15.153:0/1404302186 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c034070 con 0x7f694815e640 2024-03-28T21:52:59.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.740+0000 7f6947e00640 1 -- 172.21.15.153:0/1404302186 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693c030860 con 0x7f694815e640 2024-03-28T21:52:59.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.740+0000 7f6947e00640 1 -- 172.21.15.153:0/1404302186 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c030c30 con 0x7f694815e640 2024-03-28T21:52:59.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.741+0000 7f6950400640 1 -- 172.21.15.153:0/1404302186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f694815e640 msgr2=0x7f69480d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:59.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.741+0000 7f6950400640 1 --2- 172.21.15.153:0/1404302186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f694815e640 0x7f69480d0c10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f69480cc410 tx=0x7f693c02b9a0 comp rx=0 tx=0).stop 2024-03-28T21:52:59.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.741+0000 7f6950400640 1 -- 172.21.15.153:0/1404302186 shutdown_connections 2024-03-28T21:52:59.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.741+0000 7f6950400640 1 --2- 172.21.15.153:0/1404302186 >> v2:172.21.15.165:3300/0 conn(0x7f69480cedc0 0x7f69480cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:59.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.741+0000 7f6950400640 1 --2- 172.21.15.153:0/1404302186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f694815e640 0x7f69480d0c10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:59.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.741+0000 7f6950400640 1 -- 172.21.15.153:0/1404302186 >> 172.21.15.153:0/1404302186 conn(0x7f69480d1e30 msgr2=0x7f69480d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:52:59.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.741+0000 7f6950400640 1 -- 172.21.15.153:0/1404302186 shutdown_connections 2024-03-28T21:52:59.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.741+0000 7f6950400640 1 -- 172.21.15.153:0/1404302186 wait complete. 2024-03-28T21:52:59.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.743+0000 7f6950400640 1 Processor -- start 2024-03-28T21:52:59.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.743+0000 7f6950400640 1 -- start start 2024-03-28T21:52:59.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.744+0000 7f6950400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69480cedc0 0x7f69481f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:59.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.744+0000 7f6950400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69480d2950 0x7f694815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:59.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.744+0000 7f6950400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f694815e640 0x7f69480c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:59.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.744+0000 7f6950400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69480cd640 con 0x7f694815e640 2024-03-28T21:52:59.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.744+0000 7f6950400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f69480cc900 con 0x7f69480d2950 2024-03-28T21:52:59.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.744+0000 7f6950400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f69480cd7c0 con 0x7f69480cedc0 2024-03-28T21:52:59.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.744+0000 7f694e400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f694815e640 0x7f69480c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:59.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.744+0000 7f694e400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f694815e640 0x7f69480c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37118/0 (socket says 172.21.15.153:37118) 2024-03-28T21:52:59.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.744+0000 7f694e400640 1 -- 172.21.15.153:0/334290755 learned_addr learned my addr 172.21.15.153:0/334290755 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:52:59.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.744+0000 7f694da00640 1 --2- 172.21.15.153:0/334290755 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69480cedc0 0x7f69481f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:59.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.744+0000 7f694d000640 1 --2- 172.21.15.153:0/334290755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69480d2950 0x7f694815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:59.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.745+0000 7f694e400640 1 -- 172.21.15.153:0/334290755 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69480cedc0 msgr2=0x7f69481f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:59.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.745+0000 7f694e400640 1 --2- 172.21.15.153:0/334290755 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69480cedc0 0x7f69481f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:59.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.745+0000 7f694e400640 1 -- 172.21.15.153:0/334290755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69480d2950 msgr2=0x7f694815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:52:59.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.745+0000 7f694e400640 1 --2- 172.21.15.153:0/334290755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69480d2950 0x7f694815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:52:59.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.745+0000 7f694e400640 1 -- 172.21.15.153:0/334290755 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69481f5050 con 0x7f694815e640 2024-03-28T21:52:59.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.745+0000 7f694e400640 1 --2- 172.21.15.153:0/334290755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f694815e640 0x7f69480c8f00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f694000ba10 tx=0x7f694000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:59.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.745+0000 7f6945600640 1 -- 172.21.15.153:0/334290755 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940019070 con 0x7f694815e640 2024-03-28T21:52:59.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.745+0000 7f6945600640 1 -- 172.21.15.153:0/334290755 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694000cb60 con 0x7f694815e640 2024-03-28T21:52:59.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.745+0000 7f6950400640 1 -- 172.21.15.153:0/334290755 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69480cac10 con 0x7f694815e640 2024-03-28T21:52:59.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.745+0000 7f6945600640 1 -- 172.21.15.153:0/334290755 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940014440 con 0x7f694815e640 2024-03-28T21:52:59.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.745+0000 7f6950400640 1 -- 172.21.15.153:0/334290755 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69480cb1d0 con 0x7f694815e640 2024-03-28T21:52:59.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.747+0000 7f6950400640 1 -- 172.21.15.153:0/334290755 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69480690d0 con 0x7f694815e640 2024-03-28T21:52:59.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.747+0000 7f6945600640 1 -- 172.21.15.153:0/334290755 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f694001c070 con 0x7f694815e640 2024-03-28T21:52:59.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.748+0000 7f6945600640 1 --2- 172.21.15.153:0/334290755 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f692806b4d0 0x7f692806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:52:59.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.748+0000 7f6945600640 1 -- 172.21.15.153:0/334290755 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5473+0+0 (secure 0 0 0) 0x7f6940089df0 con 0x7f694815e640 2024-03-28T21:52:59.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.748+0000 7f694da00640 1 --2- 172.21.15.153:0/334290755 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f692806b4d0 0x7f692806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:52:59.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.749+0000 7f694da00640 1 --2- 172.21.15.153:0/334290755 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f692806b4d0 0x7f692806d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f693c036000 tx=0x7f693c03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:52:59.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.753+0000 7f6945600640 1 -- 172.21.15.153:0/334290755 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f69481f5050 con 0x7f694815e640 2024-03-28T21:52:59.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:52:59.950+0000 7f6950400640 1 -- 172.21.15.153:0/334290755 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f69480ce720 con 0x7f694815e640 2024-03-28T21:53:00.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.503+0000 7f6945600640 1 -- 172.21.15.153:0/334290755 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) ==== 169+0+0 (secure 0 0 0) 0x7f6940058d40 con 0x7f694815e640 2024-03-28T21:53:00.506 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2024-03-28T21:53:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.507+0000 7f6950400640 1 -- 172.21.15.153:0/334290755 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f692806b4d0 msgr2=0x7f692806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.507+0000 7f6950400640 1 --2- 172.21.15.153:0/334290755 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f692806b4d0 0x7f692806d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f693c036000 tx=0x7f693c03b040 comp rx=0 tx=0).stop 2024-03-28T21:53:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.507+0000 7f6950400640 1 -- 172.21.15.153:0/334290755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f694815e640 msgr2=0x7f69480c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.507+0000 7f6950400640 1 --2- 172.21.15.153:0/334290755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f694815e640 0x7f69480c8f00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f694000ba10 tx=0x7f694000bed0 comp rx=0 tx=0).stop 2024-03-28T21:53:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.510+0000 7f6950400640 1 -- 172.21.15.153:0/334290755 shutdown_connections 2024-03-28T21:53:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.510+0000 7f6950400640 1 --2- 172.21.15.153:0/334290755 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f692806b4d0 0x7f692806d990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.510+0000 7f6950400640 1 --2- 172.21.15.153:0/334290755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f694815e640 0x7f69480c8f00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.510+0000 7f6950400640 1 --2- 172.21.15.153:0/334290755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69480d2950 0x7f694815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.510+0000 7f6950400640 1 --2- 172.21.15.153:0/334290755 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69480cedc0 0x7f69481f4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.510+0000 7f6950400640 1 -- 172.21.15.153:0/334290755 >> 172.21.15.153:0/334290755 conn(0x7f69480d1e30 msgr2=0x7f69480cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.510+0000 7f6950400640 1 -- 172.21.15.153:0/334290755 shutdown_connections 2024-03-28T21:53:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.511+0000 7f6950400640 1 -- 172.21.15.153:0/334290755 wait complete. 2024-03-28T21:53:00.536 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-28T21:53:00.536 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-28T21:53:00.536 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-28T21:53:00.536 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T21:53:00.536 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-28T21:53:00.537 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-28T21:53:00.537 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-28T21:53:00.537 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T21:53:00.537 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-28T21:53:00.537 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-28T21:53:00.537 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-28T21:53:00.537 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T21:53:00.538 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-28T21:53:00.538 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-28T21:53:00.538 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-28T21:53:00.538 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T21:53:00.555 INFO:tasks.ceph.mds.c:Stopped 2024-03-28T21:53:00.555 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-28T21:53:00.556 INFO:tasks.ceph.mds.a:Stopped 2024-03-28T21:53:00.556 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-28T21:53:00.559 INFO:tasks.ceph.mds.b:Stopped 2024-03-28T21:53:00.559 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-28T21:53:00.560 INFO:tasks.ceph.mds.d:Stopped 2024-03-28T21:53:00.560 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-28T21:53:00.603 INFO:tasks.ceph.mds.c:Started 2024-03-28T21:53:00.603 DEBUG:teuthology.parallel:result is None 2024-03-28T21:53:00.606 INFO:tasks.ceph.mds.b:Started 2024-03-28T21:53:00.606 DEBUG:teuthology.parallel:result is None 2024-03-28T21:53:00.608 INFO:tasks.ceph.mds.a:Started 2024-03-28T21:53:00.608 DEBUG:teuthology.parallel:result is None 2024-03-28T21:53:00.611 INFO:tasks.ceph.mds.d:Started 2024-03-28T21:53:00.611 DEBUG:teuthology.parallel:result is None 2024-03-28T21:53:00.611 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-28T21:53:00.758 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2024-03-28T21:53:00.760 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2024-03-28T21:53:00.760 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-03-28T21:53:00.780 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-03-28T21:53:00.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.799+0000 7f4350a00640 1 Processor -- start 2024-03-28T21:53:00.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.799+0000 7f4350a00640 1 -- start start 2024-03-28T21:53:00.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.800+0000 7f4350a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f434c0d2c00 0x7f434c162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:00.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.800+0000 7f4350a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f434c0cf940 con 0x7f434c15e0e0 2024-03-28T21:53:00.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.800+0000 7f4350a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f434c0cfc20 con 0x7f434c161d40 2024-03-28T21:53:00.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.800+0000 7f4350a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f434c0d1aa0 con 0x7f434c0d2c00 2024-03-28T21:53:00.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.800+0000 7f434a800640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f434c15e0e0 0x7f434c0b37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45492/0 (socket says 172.21.15.153:45492) 2024-03-28T21:53:00.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.800+0000 7f434a800640 1 -- 172.21.15.153:0/2157361635 learned_addr learned my addr 172.21.15.153:0/2157361635 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:00.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.800+0000 7f434b200640 1 --2- 172.21.15.153:0/2157361635 >> v2:172.21.15.153:3300/0 conn(0x7f434c0d2c00 0x7f434c162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:00.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.801+0000 7f434b200640 1 -- 172.21.15.153:0/2157361635 >> v1:172.21.15.165:6789/0 conn(0x7f434c161d40 legacy=0x7f434c0d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:00.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.801+0000 7f434b200640 1 -- 172.21.15.153:0/2157361635 >> v1:172.21.15.153:6789/0 conn(0x7f434c15e0e0 legacy=0x7f434c0b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:00.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.801+0000 7f434b200640 1 -- 172.21.15.153:0/2157361635 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434c0d1cf0 con 0x7f434c0d2c00 2024-03-28T21:53:00.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.802+0000 7f434b200640 1 --2- 172.21.15.153:0/2157361635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f434c0d2c00 0x7f434c162180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4344009dc0 tx=0x7f434402be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafb66abf23922d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:00.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.802+0000 7f4349400640 1 -- 172.21.15.153:0/2157361635 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4344039070 con 0x7f434c0d2c00 2024-03-28T21:53:00.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.802+0000 7f4349400640 1 -- 172.21.15.153:0/2157361635 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f434402cc40 con 0x7f434c0d2c00 2024-03-28T21:53:00.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.802+0000 7f4349400640 1 -- 172.21.15.153:0/2157361635 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4344034440 con 0x7f434c0d2c00 2024-03-28T21:53:00.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.803+0000 7f4350a00640 1 -- 172.21.15.153:0/2157361635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f434c0d2c00 msgr2=0x7f434c162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:00.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.803+0000 7f4350a00640 1 --2- 172.21.15.153:0/2157361635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f434c0d2c00 0x7f434c162180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4344009dc0 tx=0x7f434402be90 comp rx=0 tx=0).stop 2024-03-28T21:53:00.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.803+0000 7f4350a00640 1 -- 172.21.15.153:0/2157361635 shutdown_connections 2024-03-28T21:53:00.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.803+0000 7f4350a00640 1 --2- 172.21.15.153:0/2157361635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f434c0d2c00 0x7f434c162180 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:00.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.803+0000 7f4350a00640 1 -- 172.21.15.153:0/2157361635 >> 172.21.15.153:0/2157361635 conn(0x7f434c09d1a0 msgr2=0x7f434c0d3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:00.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.803+0000 7f4350a00640 1 -- 172.21.15.153:0/2157361635 shutdown_connections 2024-03-28T21:53:00.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.803+0000 7f4350a00640 1 -- 172.21.15.153:0/2157361635 wait complete. 2024-03-28T21:53:00.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.805+0000 7f4350a00640 1 Processor -- start 2024-03-28T21:53:00.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.805+0000 7f4350a00640 1 -- start start 2024-03-28T21:53:00.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f4350a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f434c0d2c00 0x7f434c0cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:00.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f4350a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f434c15e0e0 0x7f434c14b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:00.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f4350a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f434c161d40 0x7f434c0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:00.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f4350a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f434c15e4c0 con 0x7f434c0d2c00 2024-03-28T21:53:00.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f4350a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f434c1626c0 con 0x7f434c161d40 2024-03-28T21:53:00.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f4350a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f434c15e640 con 0x7f434c15e0e0 2024-03-28T21:53:00.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f434a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f434c0d2c00 0x7f434c0cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:00.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f434a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f434c0d2c00 0x7f434c0cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37156/0 (socket says 172.21.15.153:37156) 2024-03-28T21:53:00.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f434a800640 1 -- 172.21.15.153:0/2230296429 learned_addr learned my addr 172.21.15.153:0/2230296429 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:00.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f434b200640 1 --2- 172.21.15.153:0/2230296429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f434c161d40 0x7f434c0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:00.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f4349e00640 1 --2- 172.21.15.153:0/2230296429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f434c15e0e0 0x7f434c14b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:00.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f434a800640 1 -- 172.21.15.153:0/2230296429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f434c15e0e0 msgr2=0x7f434c14b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:00.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f434a800640 1 --2- 172.21.15.153:0/2230296429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f434c15e0e0 0x7f434c14b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:00.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f434a800640 1 -- 172.21.15.153:0/2230296429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f434c161d40 msgr2=0x7f434c0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:00.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f434a800640 1 --2- 172.21.15.153:0/2230296429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f434c161d40 0x7f434c0cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:00.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.806+0000 7f434a800640 1 -- 172.21.15.153:0/2230296429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434c0ccd20 con 0x7f434c0d2c00 2024-03-28T21:53:00.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.807+0000 7f434a800640 1 --2- 172.21.15.153:0/2230296429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f434c0d2c00 0x7f434c0cbcd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f433c00c4d0 tx=0x7f433c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:00.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.807+0000 7f4342a00640 1 -- 172.21.15.153:0/2230296429 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c017070 con 0x7f434c0d2c00 2024-03-28T21:53:00.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.807+0000 7f4342a00640 1 -- 172.21.15.153:0/2230296429 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f433c005ce0 con 0x7f434c0d2c00 2024-03-28T21:53:00.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.807+0000 7f4342a00640 1 -- 172.21.15.153:0/2230296429 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c007270 con 0x7f434c0d2c00 2024-03-28T21:53:00.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.807+0000 7f4350a00640 1 -- 172.21.15.153:0/2230296429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434c0cb1f0 con 0x7f434c0d2c00 2024-03-28T21:53:00.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.807+0000 7f4350a00640 1 -- 172.21.15.153:0/2230296429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f434c156300 con 0x7f434c0d2c00 2024-03-28T21:53:00.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.809+0000 7f4350a00640 1 -- 172.21.15.153:0/2230296429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f434c04f4b0 con 0x7f434c0d2c00 2024-03-28T21:53:00.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.810+0000 7f4342a00640 1 -- 172.21.15.153:0/2230296429 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f433c01a070 con 0x7f434c0d2c00 2024-03-28T21:53:00.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.810+0000 7f4342a00640 1 --2- 172.21.15.153:0/2230296429 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f432c06b4d0 0x7f432c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:00.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.811+0000 7f4342a00640 1 -- 172.21.15.153:0/2230296429 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4943+0+0 (secure 0 0 0) 0x7f433c0891a0 con 0x7f434c0d2c00 2024-03-28T21:53:00.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.811+0000 7f4349e00640 1 --2- 172.21.15.153:0/2230296429 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f432c06b4d0 0x7f432c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:00.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.811+0000 7f4349e00640 1 --2- 172.21.15.153:0/2230296429 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f432c06b4d0 0x7f432c06d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f434c06dc10 tx=0x7f4338009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:00.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:00.815+0000 7f4342a00640 1 -- 172.21.15.153:0/2230296429 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f433c057c30 con 0x7f434c0d2c00 2024-03-28T21:53:01.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.028+0000 7f4350a00640 1 -- 172.21.15.153:0/2230296429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f434c08df90 con 0x7f434c0d2c00 2024-03-28T21:53:01.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.528+0000 7f4342a00640 1 -- 172.21.15.153:0/2230296429 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) ==== 97+0+0 (secure 0 0 0) 0x7f433c05bcd0 con 0x7f434c0d2c00 2024-03-28T21:53:01.531 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2024-03-28T21:53:01.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.532+0000 7f4350a00640 1 -- 172.21.15.153:0/2230296429 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f432c06b4d0 msgr2=0x7f432c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:01.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.532+0000 7f4350a00640 1 --2- 172.21.15.153:0/2230296429 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f432c06b4d0 0x7f432c06d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f434c06dc10 tx=0x7f4338009040 comp rx=0 tx=0).stop 2024-03-28T21:53:01.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.532+0000 7f4350a00640 1 -- 172.21.15.153:0/2230296429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f434c0d2c00 msgr2=0x7f434c0cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:01.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.532+0000 7f4350a00640 1 --2- 172.21.15.153:0/2230296429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f434c0d2c00 0x7f434c0cbcd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f433c00c4d0 tx=0x7f433c00c990 comp rx=0 tx=0).stop 2024-03-28T21:53:01.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.532+0000 7f4350a00640 1 -- 172.21.15.153:0/2230296429 shutdown_connections 2024-03-28T21:53:01.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.532+0000 7f4350a00640 1 --2- 172.21.15.153:0/2230296429 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f432c06b4d0 0x7f432c06d990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:01.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.532+0000 7f4350a00640 1 --2- 172.21.15.153:0/2230296429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f434c161d40 0x7f434c0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:01.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.532+0000 7f4350a00640 1 --2- 172.21.15.153:0/2230296429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f434c15e0e0 0x7f434c14b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:01.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.532+0000 7f4350a00640 1 --2- 172.21.15.153:0/2230296429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f434c0d2c00 0x7f434c0cbcd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:01.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.532+0000 7f4350a00640 1 -- 172.21.15.153:0/2230296429 >> 172.21.15.153:0/2230296429 conn(0x7f434c09d1a0 msgr2=0x7f434c15cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:01.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.532+0000 7f4350a00640 1 -- 172.21.15.153:0/2230296429 shutdown_connections 2024-03-28T21:53:01.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.532+0000 7f4350a00640 1 -- 172.21.15.153:0/2230296429 wait complete. 2024-03-28T21:53:01.555 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-28T21:53:01.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.756+0000 7f9104600640 1 Processor -- start 2024-03-28T21:53:01.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.756+0000 7f9104600640 1 -- start start 2024-03-28T21:53:01.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.758+0000 7f9104600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f90fc159a10 0x7f90fc15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:01.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.758+0000 7f9104600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90fc0b2e60 con 0x7f90fc0ad830 2024-03-28T21:53:01.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.758+0000 7f9104600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90fc0adc70 con 0x7f90fc06e440 2024-03-28T21:53:01.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.758+0000 7f9104600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f90fc159df0 con 0x7f90fc159a10 2024-03-28T21:53:01.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.758+0000 7f9101200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f90fc0ad830 0x7f90fc06dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45494/0 (socket says 172.21.15.153:45494) 2024-03-28T21:53:01.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.758+0000 7f9101200640 1 -- 172.21.15.153:0/2537943984 learned_addr learned my addr 172.21.15.153:0/2537943984 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.758+0000 7f9101c00640 1 --2- 172.21.15.153:0/2537943984 >> v2:172.21.15.165:3300/0 conn(0x7f90fc159a10 0x7f90fc15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 -- 172.21.15.153:0/2537943984 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3302204948 0 0) 0x7f90fc0b2e60 con 0x7f90fc0ad830 2024-03-28T21:53:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 -- 172.21.15.153:0/2537943984 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90e4003520 con 0x7f90fc0ad830 2024-03-28T21:53:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 -- 172.21.15.153:0/2537943984 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2136056438 0 0) 0x7f90e4003520 con 0x7f90fc0ad830 2024-03-28T21:53:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 -- 172.21.15.153:0/2537943984 >> v2:172.21.15.165:3300/0 conn(0x7f90fc159a10 msgr2=0x7f90fc15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 --2- 172.21.15.153:0/2537943984 >> v2:172.21.15.165:3300/0 conn(0x7f90fc159a10 0x7f90fc15cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 -- 172.21.15.153:0/2537943984 >> v1:172.21.15.165:6789/0 conn(0x7f90fc06e440 legacy=0x7f90fc0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 -- 172.21.15.153:0/2537943984 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90fc0adf10 con 0x7f90fc0ad830 2024-03-28T21:53:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 -- 172.21.15.153:0/2537943984 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f90e8001690 con 0x7f90fc0ad830 2024-03-28T21:53:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 -- 172.21.15.153:0/2537943984 >> v1:172.21.15.153:6789/0 conn(0x7f90fc0ad830 legacy=0x7f90fc06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:01.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 --2- 172.21.15.153:0/2537943984 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90e40039b0 0x7f90e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:01.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 --2- 172.21.15.153:0/2537943984 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90e4004800 0x7f90e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:01.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 --2- 172.21.15.153:0/2537943984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90e40051c0 0x7f90e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:01.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 -- 172.21.15.153:0/2537943984 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc159df0 con 0x7f90e40051c0 2024-03-28T21:53:01.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 -- 172.21.15.153:0/2537943984 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f90e400c160 con 0x7f90e4004800 2024-03-28T21:53:01.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.759+0000 7f90fbe00640 1 -- 172.21.15.153:0/2537943984 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f90e400c360 con 0x7f90e40039b0 2024-03-28T21:53:01.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.760+0000 7f9102600640 1 --2- 172.21.15.153:0/2537943984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90e40051c0 0x7f90e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:01.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.760+0000 7f9101200640 1 --2- 172.21.15.153:0/2537943984 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90e4004800 0x7f90e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:01.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.760+0000 7f9101c00640 1 --2- 172.21.15.153:0/2537943984 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90e40039b0 0x7f90e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:01.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.760+0000 7f9102600640 1 -- 172.21.15.153:0/2537943984 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90e40039b0 msgr2=0x7f90e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:01.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.760+0000 7f9102600640 1 --2- 172.21.15.153:0/2537943984 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90e40039b0 0x7f90e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:01.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.760+0000 7f9102600640 1 -- 172.21.15.153:0/2537943984 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90e4004800 msgr2=0x7f90e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:01.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.760+0000 7f9102600640 1 --2- 172.21.15.153:0/2537943984 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90e4004800 0x7f90e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:01.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.760+0000 7f9102600640 1 -- 172.21.15.153:0/2537943984 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e4003520 con 0x7f90e40051c0 2024-03-28T21:53:01.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.760+0000 7f9101200640 1 --2- 172.21.15.153:0/2537943984 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90e4004800 0x7f90e4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:53:01.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.761+0000 7f9102600640 1 -- 172.21.15.153:0/2537943984 reap_dead start 2024-03-28T21:53:01.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.761+0000 7f9102600640 1 --2- 172.21.15.153:0/2537943984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90e40051c0 0x7f90e400b9c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f90f4001e50 tx=0x7f90e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5ad8e1e34010c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:01.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.761+0000 7f90fbe00640 1 -- 172.21.15.153:0/2537943984 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4001a70 con 0x7f90e40051c0 2024-03-28T21:53:01.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.761+0000 7f90fbe00640 1 -- 172.21.15.153:0/2537943984 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f4003bb0 con 0x7f90e40051c0 2024-03-28T21:53:01.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.761+0000 7f90fbe00640 1 -- 172.21.15.153:0/2537943984 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f40050d0 con 0x7f90e40051c0 2024-03-28T21:53:01.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.762+0000 7f9104600640 1 -- 172.21.15.153:0/2537943984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90e40051c0 msgr2=0x7f90e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:01.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.762+0000 7f9104600640 1 --2- 172.21.15.153:0/2537943984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90e40051c0 0x7f90e400b9c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f90f4001e50 tx=0x7f90e4005830 comp rx=0 tx=0).stop 2024-03-28T21:53:01.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.762+0000 7f9104600640 1 -- 172.21.15.153:0/2537943984 shutdown_connections 2024-03-28T21:53:01.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.762+0000 7f9104600640 1 --2- 172.21.15.153:0/2537943984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90e40051c0 0x7f90e400b9c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:01.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.762+0000 7f9104600640 1 -- 172.21.15.153:0/2537943984 >> 172.21.15.153:0/2537943984 conn(0x7f90fc0b1a30 msgr2=0x7f90fc0b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:01.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.762+0000 7f9104600640 1 -- 172.21.15.153:0/2537943984 shutdown_connections 2024-03-28T21:53:01.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.762+0000 7f9104600640 1 -- 172.21.15.153:0/2537943984 wait complete. 2024-03-28T21:53:01.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.764+0000 7f9104600640 1 Processor -- start 2024-03-28T21:53:01.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.764+0000 7f9104600640 1 -- start start 2024-03-28T21:53:01.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.765+0000 7f9104600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90e40051c0 0x7f90fc144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:01.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.765+0000 7f9104600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90fc158990 0x7f90fc158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:01.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.765+0000 7f9104600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90fc09c550 0x7f90fc09ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:01.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.765+0000 7f9104600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc0ae4d0 con 0x7f90e40051c0 2024-03-28T21:53:01.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.765+0000 7f9104600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc0b3100 con 0x7f90fc09c550 2024-03-28T21:53:01.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.765+0000 7f9104600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f90fc15cf00 con 0x7f90fc158990 2024-03-28T21:53:01.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.765+0000 7f9101c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90e40051c0 0x7f90fc144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:01.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.765+0000 7f9101c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90e40051c0 0x7f90fc144530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37166/0 (socket says 172.21.15.153:37166) 2024-03-28T21:53:01.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.765+0000 7f9101c00640 1 -- 172.21.15.153:0/3074354161 learned_addr learned my addr 172.21.15.153:0/3074354161 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:01.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.766+0000 7f9102600640 1 --2- 172.21.15.153:0/3074354161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90fc09c550 0x7f90fc09ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:01.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.766+0000 7f9101c00640 1 -- 172.21.15.153:0/3074354161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90fc158990 msgr2=0x7f90fc158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:01.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.766+0000 7f9101c00640 1 --2- 172.21.15.153:0/3074354161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90fc158990 0x7f90fc158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:01.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.766+0000 7f9101c00640 1 -- 172.21.15.153:0/3074354161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90fc09c550 msgr2=0x7f90fc09ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:01.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.766+0000 7f9101c00640 1 --2- 172.21.15.153:0/3074354161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90fc09c550 0x7f90fc09ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:01.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.766+0000 7f9101c00640 1 -- 172.21.15.153:0/3074354161 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90fc1f1d10 con 0x7f90e40051c0 2024-03-28T21:53:01.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.766+0000 7f9101c00640 1 --2- 172.21.15.153:0/3074354161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90e40051c0 0x7f90fc144530 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f90f00115a0 tx=0x7f90f0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:01.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.766+0000 7f90f9600640 1 -- 172.21.15.153:0/3074354161 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0015930 con 0x7f90e40051c0 2024-03-28T21:53:01.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.766+0000 7f90f9600640 1 -- 172.21.15.153:0/3074354161 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f0015ad0 con 0x7f90e40051c0 2024-03-28T21:53:01.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.766+0000 7f90f9600640 1 -- 172.21.15.153:0/3074354161 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f000f480 con 0x7f90e40051c0 2024-03-28T21:53:01.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.766+0000 7f9104600640 1 -- 172.21.15.153:0/3074354161 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90fc1f1ff0 con 0x7f90e40051c0 2024-03-28T21:53:01.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.766+0000 7f9104600640 1 -- 172.21.15.153:0/3074354161 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90fc1f25b0 con 0x7f90e40051c0 2024-03-28T21:53:01.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.768+0000 7f9104600640 1 -- 172.21.15.153:0/3074354161 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90fc068ff0 con 0x7f90e40051c0 2024-03-28T21:53:01.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.769+0000 7f90f9600640 1 -- 172.21.15.153:0/3074354161 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f90f000f620 con 0x7f90e40051c0 2024-03-28T21:53:01.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.769+0000 7f90f9600640 1 --2- 172.21.15.153:0/3074354161 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f90dc06b4d0 0x7f90dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:01.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.770+0000 7f90f9600640 1 -- 172.21.15.153:0/3074354161 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f90f008a4e0 con 0x7f90e40051c0 2024-03-28T21:53:01.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.770+0000 7f9101200640 1 --2- 172.21.15.153:0/3074354161 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f90dc06b4d0 0x7f90dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:01.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.770+0000 7f9101200640 1 --2- 172.21.15.153:0/3074354161 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f90dc06b4d0 0x7f90dc06d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f90e8001ba0 tx=0x7f90e8001150 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:01.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:01.774+0000 7f90f9600640 1 -- 172.21.15.153:0/3074354161 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f90f0019030 con 0x7f90e40051c0 2024-03-28T21:53:02.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.037+0000 7f9104600640 1 -- 172.21.15.153:0/3074354161 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f90fc0b4880 con 0x7f90e40051c0 2024-03-28T21:53:02.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.038+0000 7f90f9600640 1 -- 172.21.15.153:0/3074354161 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7f90f0059610 con 0x7f90e40051c0 2024-03-28T21:53:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:02.041 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-28T21:53:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2024-03-28T21:53:02.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2024-03-28T21:53:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQA+5gVmZ/I2OxAAgJssqqSY/xt2MLUxfNeJbg==", 2024-03-28T21:53:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-03-28T21:53:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-03-28T21:53:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-03-28T21:53:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2024-03-28T21:53:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQA/5gVmwdZ9IBAAal5ua9YPJk0URlidxPk4BQ==", 2024-03-28T21:53:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.042 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-03-28T21:53:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-03-28T21:53:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-03-28T21:53:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2024-03-28T21:53:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQA/5gVmbUkCERAAjDwHvMAXCTzX92+JX+d+uQ==", 2024-03-28T21:53:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-03-28T21:53:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-03-28T21:53:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-03-28T21:53:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.043 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2024-03-28T21:53:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQA/5gVmBByYLxAAENbTxlJ8HWfBx0AAVALKLQ==", 2024-03-28T21:53:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-03-28T21:53:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-03-28T21:53:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-03-28T21:53:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2024-03-28T21:53:02.044 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBE5gVmh4gIIhAAiPprW1aqSCIFWEt4H+nOKA==", 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBI5gVmfYhhABAAMdXy0w1kDNmj8ZVzREwmDg==", 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2024-03-28T21:53:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBL5gVm1xIMChAA0t3uAjMLMnbY7eWe4ifFpw==", 2024-03-28T21:53:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-03-28T21:53:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-03-28T21:53:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2024-03-28T21:53:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBO5gVmr1JlExAASsUfv6m0M7j/Jiwx9N8nWQ==", 2024-03-28T21:53:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-03-28T21:53:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-03-28T21:53:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2024-03-28T21:53:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBV5gVmlpXCDhAALhHCR8t4lqD8BBLLdP/W5w==", 2024-03-28T21:53:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-03-28T21:53:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-03-28T21:53:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBY5gVmwO2UGRAAKwfM2Y56FRD1BSqOQTORGw==", 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBb5gVm27DnMRAAP30Jep4QPVrg8ar+pw+xIw==", 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-03-28T21:53:02.048 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-03-28T21:53:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2024-03-28T21:53:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBf5gVmX8VMDRAA/OIBRaqTPKcwCUoTlQiCyQ==", 2024-03-28T21:53:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-03-28T21:53:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-03-28T21:53:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.049 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2024-03-28T21:53:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBA5gVmoG2wARAAshqkf7uwt2GxtPnRirjPtA==", 2024-03-28T21:53:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-03-28T21:53:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-03-28T21:53:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-03-28T21:53:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-03-28T21:53:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2024-03-28T21:53:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBA5gVmWoLgFxAA2L2+rMbLC6dq9H8yn99iWw==", 2024-03-28T21:53:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-03-28T21:53:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-03-28T21:53:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-03-28T21:53:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-03-28T21:53:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2024-03-28T21:53:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBA5gVmLROwDBAAtk2obNFzs1H4b13HTnAuPg==", 2024-03-28T21:53:02.051 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBA5gVmtXSwIhAAQ4YtDhgFApQrtcdzdShKrg==", 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-03-28T21:53:02.052 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2024-03-28T21:53:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg==", 2024-03-28T21:53:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2024-03-28T21:53:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-03-28T21:53:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-03-28T21:53:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-mds", 2024-03-28T21:53:02.053 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBo5gVmCW1KFhAAv5MiSXShLSPIsL++5s5NWg==", 2024-03-28T21:53:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-mds" 2024-03-28T21:53:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-mgr", 2024-03-28T21:53:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBo5gVmPn1KFhAAgdxeCJc84pD8Rz3MINQt1A==", 2024-03-28T21:53:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-28T21:53:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-osd", 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBo5gVmm4lKFhAALzeVoGLpECpWw+NfCpz0Sw==", 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-osd" 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rbd", 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBo5gVmdZVKFhAAMDh99jd8N/g9X/OljBXABQ==", 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-28T21:53:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBo5gVme6FKFhAA7trfdNZ3UY8f5hjogpKqDQ==", 2024-03-28T21:53:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-28T21:53:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rgw", 2024-03-28T21:53:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBo5gVm6q1KFhAA1PUdVVsF9jKvFyRnpZCgkQ==", 2024-03-28T21:53:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-28T21:53:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQA+5gVmEskWLxAAJmE18GXPQENiw9BuGNFkSQ==", 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQA+5gVmXf4EJRAAs1jwJgrAUJxEKBFDyxXxsg==", 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2024-03-28T21:53:02.057 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2024-03-28T21:53:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-03-28T21:53:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:02.058 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-03-28T21:53:02.058 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-28T21:53:02.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.041+0000 7f9104600640 1 -- 172.21.15.153:0/3074354161 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f90dc06b4d0 msgr2=0x7f90dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:02.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.041+0000 7f9104600640 1 --2- 172.21.15.153:0/3074354161 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f90dc06b4d0 0x7f90dc06d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f90e8001ba0 tx=0x7f90e8001150 comp rx=0 tx=0).stop 2024-03-28T21:53:02.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.041+0000 7f9104600640 1 -- 172.21.15.153:0/3074354161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90e40051c0 msgr2=0x7f90fc144530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:02.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.041+0000 7f9104600640 1 --2- 172.21.15.153:0/3074354161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90e40051c0 0x7f90fc144530 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f90f00115a0 tx=0x7f90f0011a60 comp rx=0 tx=0).stop 2024-03-28T21:53:02.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.041+0000 7f9104600640 1 -- 172.21.15.153:0/3074354161 shutdown_connections 2024-03-28T21:53:02.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.041+0000 7f9104600640 1 --2- 172.21.15.153:0/3074354161 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f90dc06b4d0 0x7f90dc06d990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.041+0000 7f9104600640 1 --2- 172.21.15.153:0/3074354161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90fc09c550 0x7f90fc09ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.041+0000 7f9104600640 1 --2- 172.21.15.153:0/3074354161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90fc158990 0x7f90fc158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.041+0000 7f9104600640 1 --2- 172.21.15.153:0/3074354161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90e40051c0 0x7f90fc144530 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.041+0000 7f9104600640 1 -- 172.21.15.153:0/3074354161 >> 172.21.15.153:0/3074354161 conn(0x7f90fc0b1a30 msgr2=0x7f90fc15a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:02.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.041+0000 7f9104600640 1 -- 172.21.15.153:0/3074354161 shutdown_connections 2024-03-28T21:53:02.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.041+0000 7f9104600640 1 -- 172.21.15.153:0/3074354161 wait complete. 2024-03-28T21:53:02.064 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-28T21:53:02.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.272+0000 7f91af200640 1 Processor -- start 2024-03-28T21:53:02.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.273+0000 7f91af200640 1 -- start start 2024-03-28T21:53:02.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.274+0000 7f91af200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f91b015e570 0x7f91b015ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.274+0000 7f91af200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f91b015ef60 0x7f91b00b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.274+0000 7f91af200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b006ffa0 con 0x7f91b0158810 2024-03-28T21:53:02.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.274+0000 7f91af200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f91b00b36b0 con 0x7f91b015ef60 2024-03-28T21:53:02.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.274+0000 7f91af200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f91b015f3d0 con 0x7f91b015e570 2024-03-28T21:53:02.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.274+0000 7f91ae800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f91b015ef60 0x7f91b00b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.274+0000 7f91ae800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f91b015ef60 0x7f91b00b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37180/0 (socket says 172.21.15.153:37180) 2024-03-28T21:53:02.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.274+0000 7f91ae800640 1 -- 172.21.15.153:0/481054266 learned_addr learned my addr 172.21.15.153:0/481054266 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:02.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.275+0000 7f91ad400640 1 --2- 172.21.15.153:0/481054266 >> v2:172.21.15.165:3300/0 conn(0x7f91b015e570 0x7f91b015ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.275+0000 7f91ae800640 1 -- 172.21.15.153:0/481054266 >> v2:172.21.15.165:3300/0 conn(0x7f91b015e570 msgr2=0x7f91b015ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:02.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.275+0000 7f91ae800640 1 --2- 172.21.15.153:0/481054266 >> v2:172.21.15.165:3300/0 conn(0x7f91b015e570 0x7f91b015ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.275+0000 7f91ae800640 1 -- 172.21.15.153:0/481054266 >> v1:172.21.15.165:6789/0 conn(0x7f91b0158810 legacy=0x7f91b006eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:02.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.275+0000 7f91ae800640 1 -- 172.21.15.153:0/481054266 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b006f700 con 0x7f91b015ef60 2024-03-28T21:53:02.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.276+0000 7f91ae800640 1 --2- 172.21.15.153:0/481054266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015ef60 0x7f91b00b3b40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f91b006cb30 tx=0x7f91a802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198df5b507c5012f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:02.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.276+0000 7f91aca00640 1 -- 172.21.15.153:0/481054266 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a802e070 con 0x7f91b015ef60 2024-03-28T21:53:02.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.276+0000 7f91aca00640 1 -- 172.21.15.153:0/481054266 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a8037070 con 0x7f91b015ef60 2024-03-28T21:53:02.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.276+0000 7f91aca00640 1 -- 172.21.15.153:0/481054266 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8031a00 con 0x7f91b015ef60 2024-03-28T21:53:02.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.277+0000 7f91af200640 1 -- 172.21.15.153:0/481054266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015ef60 msgr2=0x7f91b00b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:02.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.277+0000 7f91af200640 1 --2- 172.21.15.153:0/481054266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015ef60 0x7f91b00b3b40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f91b006cb30 tx=0x7f91a802b880 comp rx=0 tx=0).stop 2024-03-28T21:53:02.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.277+0000 7f91af200640 1 -- 172.21.15.153:0/481054266 shutdown_connections 2024-03-28T21:53:02.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.277+0000 7f91af200640 1 --2- 172.21.15.153:0/481054266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015ef60 0x7f91b00b3b40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.277+0000 7f91af200640 1 --2- 172.21.15.153:0/481054266 >> v2:172.21.15.165:3300/0 conn(0x7f91b015e570 0x7f91b015ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.277+0000 7f91af200640 1 -- 172.21.15.153:0/481054266 >> 172.21.15.153:0/481054266 conn(0x7f91b00724e0 msgr2=0x7f91b006b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:02.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.277+0000 7f91af200640 1 -- 172.21.15.153:0/481054266 shutdown_connections 2024-03-28T21:53:02.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.277+0000 7f91af200640 1 -- 172.21.15.153:0/481054266 wait complete. 2024-03-28T21:53:02.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.279+0000 7f91af200640 1 Processor -- start 2024-03-28T21:53:02.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.279+0000 7f91af200640 1 -- start start 2024-03-28T21:53:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.280+0000 7f91af200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91b0158810 0x7f91b01f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.280+0000 7f91af200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91b015e570 0x7f91b015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.280+0000 7f91af200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015ef60 0x7f91b015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.280+0000 7f91af200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91b00b4080 con 0x7f91b015ef60 2024-03-28T21:53:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.280+0000 7f91af200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f91b006fcc0 con 0x7f91b0158810 2024-03-28T21:53:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.280+0000 7f91af200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f91b00b4200 con 0x7f91b015e570 2024-03-28T21:53:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.280+0000 7f91ae800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015ef60 0x7f91b015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.280+0000 7f91ae800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015ef60 0x7f91b015b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37192/0 (socket says 172.21.15.153:37192) 2024-03-28T21:53:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.280+0000 7f91ae800640 1 -- 172.21.15.153:0/2310157067 learned_addr learned my addr 172.21.15.153:0/2310157067 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.280+0000 7f91ade00640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91b0158810 0x7f91b01f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.280+0000 7f91ad400640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91b015e570 0x7f91b015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.281+0000 7f91ae800640 1 -- 172.21.15.153:0/2310157067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91b015e570 msgr2=0x7f91b015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.281+0000 7f91ae800640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91b015e570 0x7f91b015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.281+0000 7f91ae800640 1 -- 172.21.15.153:0/2310157067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91b0158810 msgr2=0x7f91b01f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.281+0000 7f91ae800640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91b0158810 0x7f91b01f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.281+0000 7f91ae800640 1 -- 172.21.15.153:0/2310157067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b01615a0 con 0x7f91b015ef60 2024-03-28T21:53:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.281+0000 7f91ade00640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91b0158810 0x7f91b01f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.281+0000 7f91ad400640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91b015e570 0x7f91b015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:02.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.281+0000 7f91ae800640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015ef60 0x7f91b015b3b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f91a80090b0 tx=0x7f91a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.281+0000 7f91a6000640 1 -- 172.21.15.153:0/2310157067 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8032670 con 0x7f91b015ef60 2024-03-28T21:53:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.281+0000 7f91a6000640 1 -- 172.21.15.153:0/2310157067 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a8032810 con 0x7f91b015ef60 2024-03-28T21:53:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.281+0000 7f91af200640 1 -- 172.21.15.153:0/2310157067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b0161880 con 0x7f91b015ef60 2024-03-28T21:53:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.281+0000 7f91a6000640 1 -- 172.21.15.153:0/2310157067 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8032c00 con 0x7f91b015ef60 2024-03-28T21:53:02.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.281+0000 7f91af200640 1 -- 172.21.15.153:0/2310157067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b0161e40 con 0x7f91b015ef60 2024-03-28T21:53:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.282+0000 7f91af200640 1 -- 172.21.15.153:0/2310157067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b004f4b0 con 0x7f91b015ef60 2024-03-28T21:53:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.283+0000 7f91a6000640 1 -- 172.21.15.153:0/2310157067 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f91a804c060 con 0x7f91b015ef60 2024-03-28T21:53:02.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.284+0000 7f91a6000640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f918c06b4d0 0x7f918c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.284+0000 7f91a6000640 1 -- 172.21.15.153:0/2310157067 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f91a80ab9d0 con 0x7f91b015ef60 2024-03-28T21:53:02.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.284+0000 7f91ade00640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f918c06b4d0 0x7f918c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.285+0000 7f91ade00640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f918c06b4d0 0x7f918c06d990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f91b015bbc0 tx=0x7f9198009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:02.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.289+0000 7f91a6000640 1 -- 172.21.15.153:0/2310157067 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f91a8040070 con 0x7f91b015ef60 2024-03-28T21:53:02.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.552+0000 7f91af200640 1 -- 172.21.15.153:0/2310157067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f91b00b5270 con 0x7f91b015ef60 2024-03-28T21:53:02.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.556+0000 7f91a6000640 1 -- 172.21.15.153:0/2310157067 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f91b006ffa0 con 0x7f91b015ef60 2024-03-28T21:53:02.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.559+0000 7f91af200640 1 -- 172.21.15.153:0/2310157067 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f918c06b4d0 msgr2=0x7f918c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:02.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.559+0000 7f91af200640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f918c06b4d0 0x7f918c06d990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f91b015bbc0 tx=0x7f9198009040 comp rx=0 tx=0).stop 2024-03-28T21:53:02.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.559+0000 7f91af200640 1 -- 172.21.15.153:0/2310157067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015ef60 msgr2=0x7f91b015b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:02.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.559+0000 7f91af200640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015ef60 0x7f91b015b3b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f91a80090b0 tx=0x7f91a80046c0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.559+0000 7f91af200640 1 -- 172.21.15.153:0/2310157067 shutdown_connections 2024-03-28T21:53:02.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.559+0000 7f91af200640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f918c06b4d0 0x7f918c06d990 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.559+0000 7f91af200640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91b015ef60 0x7f91b015b3b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.559+0000 7f91af200640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91b015e570 0x7f91b015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.559+0000 7f91af200640 1 --2- 172.21.15.153:0/2310157067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91b0158810 0x7f91b01f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.559+0000 7f91af200640 1 -- 172.21.15.153:0/2310157067 >> 172.21.15.153:0/2310157067 conn(0x7f91b00724e0 msgr2=0x7f91b0156a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:02.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.559+0000 7f91af200640 1 -- 172.21.15.153:0/2310157067 shutdown_connections 2024-03-28T21:53:02.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.559+0000 7f91af200640 1 -- 172.21.15.153:0/2310157067 wait complete. 2024-03-28T21:53:02.578 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-28T21:53:02.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.765+0000 7f30b0600640 1 Processor -- start 2024-03-28T21:53:02.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.765+0000 7f30b0600640 1 -- start start 2024-03-28T21:53:02.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.767+0000 7f30b0600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f30a8145a10 0x7f30a806e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.767+0000 7f30b0600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a8160260 0x7f30a8070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.767+0000 7f30b0600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a80cec20 con 0x7f30a80ce360 2024-03-28T21:53:02.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.767+0000 7f30b0600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f30a80cf830 con 0x7f30a8145a10 2024-03-28T21:53:02.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.767+0000 7f30b0600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f30a80cef00 con 0x7f30a8160260 2024-03-28T21:53:02.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.767+0000 7f30ad200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f30a80ce360 0x7f30a815fb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45498/0 (socket says 172.21.15.153:45498) 2024-03-28T21:53:02.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.767+0000 7f30ad200640 1 -- 172.21.15.153:0/1449270420 learned_addr learned my addr 172.21.15.153:0/1449270420 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:02.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.767+0000 7f30a7e00640 1 -- 172.21.15.153:0/1449270420 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315818146 0 0) 0x7f30a80cec20 con 0x7f30a80ce360 2024-03-28T21:53:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.767+0000 7f30a7e00640 1 -- 172.21.15.153:0/1449270420 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3090003520 con 0x7f30a80ce360 2024-03-28T21:53:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.767+0000 7f30adc00640 1 --2- 172.21.15.153:0/1449270420 >> v2:172.21.15.165:3300/0 conn(0x7f30a8145a10 0x7f30a806e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.767+0000 7f30ae600640 1 --2- 172.21.15.153:0/1449270420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a8160260 0x7f30a8070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30a7e00640 1 -- 172.21.15.153:0/1449270420 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2084686141 0 0) 0x7f3090003520 con 0x7f30a80ce360 2024-03-28T21:53:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30a7e00640 1 -- 172.21.15.153:0/1449270420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a8160260 msgr2=0x7f30a8070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30a7e00640 1 --2- 172.21.15.153:0/1449270420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a8160260 0x7f30a8070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30a7e00640 1 -- 172.21.15.153:0/1449270420 >> v2:172.21.15.165:3300/0 conn(0x7f30a8145a10 msgr2=0x7f30a806e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30a7e00640 1 --2- 172.21.15.153:0/1449270420 >> v2:172.21.15.165:3300/0 conn(0x7f30a8145a10 0x7f30a806e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30a7e00640 1 -- 172.21.15.153:0/1449270420 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a80cf1e0 con 0x7f30a80ce360 2024-03-28T21:53:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30a7e00640 1 -- 172.21.15.153:0/1449270420 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f3094001670 con 0x7f30a80ce360 2024-03-28T21:53:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30a7e00640 1 -- 172.21.15.153:0/1449270420 >> v1:172.21.15.153:6789/0 conn(0x7f30a80ce360 legacy=0x7f30a815fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30a7e00640 1 --2- 172.21.15.153:0/1449270420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30900039b0 0x7f3090003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30a7e00640 1 --2- 172.21.15.153:0/1449270420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a8160260 0x7f3090004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30a7e00640 1 --2- 172.21.15.153:0/1449270420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3090004d40 0x7f30900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30a7e00640 1 -- 172.21.15.153:0/1449270420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30a80cf830 con 0x7f3090004d40 2024-03-28T21:53:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30a7e00640 1 -- 172.21.15.153:0/1449270420 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f30a80cef00 con 0x7f30900039b0 2024-03-28T21:53:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30a7e00640 1 -- 172.21.15.153:0/1449270420 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f309000bb20 con 0x7f30a8160260 2024-03-28T21:53:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.768+0000 7f30ae600640 1 --2- 172.21.15.153:0/1449270420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3090004d40 0x7f30900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.769+0000 7f30adc00640 1 --2- 172.21.15.153:0/1449270420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30900039b0 0x7f3090003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.769+0000 7f30ad200640 1 --2- 172.21.15.153:0/1449270420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a8160260 0x7f3090004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.769+0000 7f30ae600640 1 -- 172.21.15.153:0/1449270420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a8160260 msgr2=0x7f3090004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.769+0000 7f30ae600640 1 --2- 172.21.15.153:0/1449270420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a8160260 0x7f3090004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.769+0000 7f30ae600640 1 -- 172.21.15.153:0/1449270420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30900039b0 msgr2=0x7f3090003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.769+0000 7f30ae600640 1 --2- 172.21.15.153:0/1449270420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30900039b0 0x7f3090003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.769+0000 7f30ae600640 1 -- 172.21.15.153:0/1449270420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3090003520 con 0x7f3090004d40 2024-03-28T21:53:02.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.770+0000 7f30ae600640 1 --2- 172.21.15.153:0/1449270420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3090004d40 0x7f30900051c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f30a80b27f0 tx=0x7f3090005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ace224d1b24a496 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:02.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.770+0000 7f30a7e00640 1 -- 172.21.15.153:0/1449270420 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0039070 con 0x7f3090004d40 2024-03-28T21:53:02.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.770+0000 7f30a7e00640 1 -- 172.21.15.153:0/1449270420 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a002cc70 con 0x7f3090004d40 2024-03-28T21:53:02.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.770+0000 7f30a7e00640 1 -- 172.21.15.153:0/1449270420 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0009be0 con 0x7f3090004d40 2024-03-28T21:53:02.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.771+0000 7f30b0600640 1 -- 172.21.15.153:0/1449270420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3090004d40 msgr2=0x7f30900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:02.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.771+0000 7f30b0600640 1 --2- 172.21.15.153:0/1449270420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3090004d40 0x7f30900051c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f30a80b27f0 tx=0x7f3090005830 comp rx=0 tx=0).stop 2024-03-28T21:53:02.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.771+0000 7f30ae600640 1 -- 172.21.15.153:0/1449270420 reap_dead start 2024-03-28T21:53:02.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.771+0000 7f30b0600640 1 -- 172.21.15.153:0/1449270420 shutdown_connections 2024-03-28T21:53:02.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.771+0000 7f30b0600640 1 -- 172.21.15.153:0/1449270420 >> 172.21.15.153:0/1449270420 conn(0x7f30a80cfc00 msgr2=0x7f30a80cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:02.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.771+0000 7f30b0600640 1 -- 172.21.15.153:0/1449270420 shutdown_connections 2024-03-28T21:53:02.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.771+0000 7f30b0600640 1 -- 172.21.15.153:0/1449270420 wait complete. 2024-03-28T21:53:02.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.773+0000 7f30b0600640 1 Processor -- start 2024-03-28T21:53:02.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.773+0000 7f30b0600640 1 -- start start 2024-03-28T21:53:02.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30b0600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3090004d40 0x7f30a8144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30b0600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a813c9e0 0x7f30a813ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30b0600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a813a8b0 0x7f30a813acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30b0600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30a80ce970 con 0x7f30a813a8b0 2024-03-28T21:53:02.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30b0600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f30a80ce7f0 con 0x7f3090004d40 2024-03-28T21:53:02.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30b0600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f30a8070e70 con 0x7f30a813c9e0 2024-03-28T21:53:02.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30ae600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a813a8b0 0x7f30a813acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30ae600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a813a8b0 0x7f30a813acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37216/0 (socket says 172.21.15.153:37216) 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30ae600640 1 -- 172.21.15.153:0/2353165134 learned_addr learned my addr 172.21.15.153:0/2353165134 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30adc00640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3090004d40 0x7f30a8144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30ad200640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a813c9e0 0x7f30a813ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30ae600640 1 -- 172.21.15.153:0/2353165134 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a813c9e0 msgr2=0x7f30a813ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30ae600640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a813c9e0 0x7f30a813ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30ae600640 1 -- 172.21.15.153:0/2353165134 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3090004d40 msgr2=0x7f30a8144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30ae600640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3090004d40 0x7f30a8144460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30ae600640 1 -- 172.21.15.153:0/2353165134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a813b620 con 0x7f30a813a8b0 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.774+0000 7f30adc00640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3090004d40 0x7f30a8144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.775+0000 7f30ae600640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a813a8b0 0x7f30a813acf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f30a0007420 tx=0x7f30a0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.775+0000 7f30a5600640 1 -- 172.21.15.153:0/2353165134 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0039070 con 0x7f30a813a8b0 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.775+0000 7f30a5600640 1 -- 172.21.15.153:0/2353165134 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a0044070 con 0x7f30a813a8b0 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.775+0000 7f30a5600640 1 -- 172.21.15.153:0/2353165134 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0009be0 con 0x7f30a813a8b0 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.775+0000 7f30b0600640 1 -- 172.21.15.153:0/2353165134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a813b900 con 0x7f30a813a8b0 2024-03-28T21:53:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.775+0000 7f30b0600640 1 -- 172.21.15.153:0/2353165134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a813bec0 con 0x7f30a813a8b0 2024-03-28T21:53:02.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.776+0000 7f30b0600640 1 -- 172.21.15.153:0/2353165134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a8068ff0 con 0x7f30a813a8b0 2024-03-28T21:53:02.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.777+0000 7f30a5600640 1 -- 172.21.15.153:0/2353165134 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f30a003e830 con 0x7f30a813a8b0 2024-03-28T21:53:02.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.778+0000 7f30a5600640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f308806b4d0 0x7f308806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:02.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.779+0000 7f30a5600640 1 -- 172.21.15.153:0/2353165134 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f30a00abcf0 con 0x7f30a813a8b0 2024-03-28T21:53:02.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.779+0000 7f30adc00640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f308806b4d0 0x7f308806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:02.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.779+0000 7f30adc00640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f308806b4d0 0x7f308806d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f309c006fd0 tx=0x7f309c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:02.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:02.783+0000 7f30a5600640 1 -- 172.21.15.153:0/2353165134 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f30a004d020 con 0x7f30a813a8b0 2024-03-28T21:53:03.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.055+0000 7f30b0600640 1 -- 172.21.15.153:0/2353165134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f30a8072c60 con 0x7f30a813a8b0 2024-03-28T21:53:03.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.060+0000 7f30a5600640 1 -- 172.21.15.153:0/2353165134 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f30a002ce20 con 0x7f30a813a8b0 2024-03-28T21:53:03.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.063+0000 7f30b0600640 1 -- 172.21.15.153:0/2353165134 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f308806b4d0 msgr2=0x7f308806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:03.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.063+0000 7f30b0600640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f308806b4d0 0x7f308806d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f309c006fd0 tx=0x7f309c008040 comp rx=0 tx=0).stop 2024-03-28T21:53:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.063+0000 7f30b0600640 1 -- 172.21.15.153:0/2353165134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a813a8b0 msgr2=0x7f30a813acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.063+0000 7f30b0600640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a813a8b0 0x7f30a813acf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f30a0007420 tx=0x7f30a0004ab0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.063+0000 7f30b0600640 1 -- 172.21.15.153:0/2353165134 shutdown_connections 2024-03-28T21:53:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.063+0000 7f30b0600640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f308806b4d0 0x7f308806d990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.063+0000 7f30b0600640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a813a8b0 0x7f30a813acf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.063+0000 7f30b0600640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a813c9e0 0x7f30a813ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.063+0000 7f30b0600640 1 --2- 172.21.15.153:0/2353165134 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3090004d40 0x7f30a8144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.063+0000 7f30b0600640 1 -- 172.21.15.153:0/2353165134 >> 172.21.15.153:0/2353165134 conn(0x7f30a80cfc00 msgr2=0x7f30a815ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.063+0000 7f30b0600640 1 -- 172.21.15.153:0/2353165134 shutdown_connections 2024-03-28T21:53:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.063+0000 7f30b0600640 1 -- 172.21.15.153:0/2353165134 wait complete. 2024-03-28T21:53:03.083 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-28T21:53:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.288+0000 7f681fc00640 1 Processor -- start 2024-03-28T21:53:03.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.288+0000 7f681fc00640 1 -- start start 2024-03-28T21:53:03.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.290+0000 7f681fc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6818145a10 0x7f681806e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:03.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.290+0000 7f681fc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f68180ce360 0x7f681815fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:03.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.290+0000 7f681fc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68180cec20 con 0x7f6818160090 2024-03-28T21:53:03.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.290+0000 7f681fc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f68181604e0 con 0x7f6818145a10 2024-03-28T21:53:03.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.290+0000 7f681fc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f68180cf830 con 0x7f68180ce360 2024-03-28T21:53:03.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.290+0000 7f681d200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6818145a10 0x7f681806e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:03.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.290+0000 7f681d200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6818145a10 0x7f681806e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46628/0 (socket says 172.21.15.153:46628) 2024-03-28T21:53:03.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.290+0000 7f681d200640 1 -- 172.21.15.153:0/3079695830 learned_addr learned my addr 172.21.15.153:0/3079695830 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:03.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.290+0000 7f681dc00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6818160090 0x7f681806d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40292/0 (socket says 172.21.15.153:40292) 2024-03-28T21:53:03.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.290+0000 7f6817e00640 1 --2- 172.21.15.153:0/3079695830 >> v2:172.21.15.165:3300/0 conn(0x7f68180ce360 0x7f681815fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:03.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.290+0000 7f681d200640 1 -- 172.21.15.153:0/3079695830 >> v2:172.21.15.165:3300/0 conn(0x7f68180ce360 msgr2=0x7f681815fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:03.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.291+0000 7f681d200640 1 --2- 172.21.15.153:0/3079695830 >> v2:172.21.15.165:3300/0 conn(0x7f68180ce360 0x7f681815fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.291+0000 7f6817400640 1 -- 172.21.15.153:0/3079695830 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 891482701 0 0) 0x7f68180cec20 con 0x7f6818160090 2024-03-28T21:53:03.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.291+0000 7f681d200640 1 -- 172.21.15.153:0/3079695830 >> v1:172.21.15.153:6789/0 conn(0x7f6818160090 legacy=0x7f681806d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:03.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.291+0000 7f681d200640 1 -- 172.21.15.153:0/3079695830 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68180cef00 con 0x7f6818145a10 2024-03-28T21:53:03.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.291+0000 7f6817e00640 1 --2- 172.21.15.153:0/3079695830 >> v2:172.21.15.165:3300/0 conn(0x7f68180ce360 0x7f681815fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:03.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.292+0000 7f681d200640 1 --2- 172.21.15.153:0/3079695830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6818145a10 0x7f681806e2c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f681806ca20 tx=0x7f680c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5dd057bebe10df server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.292+0000 7f6817400640 1 -- 172.21.15.153:0/3079695830 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c034070 con 0x7f6818145a10 2024-03-28T21:53:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.292+0000 7f6817400640 1 -- 172.21.15.153:0/3079695830 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f680c030860 con 0x7f6818145a10 2024-03-28T21:53:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.292+0000 7f6817400640 1 -- 172.21.15.153:0/3079695830 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c030c30 con 0x7f6818145a10 2024-03-28T21:53:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.293+0000 7f681fc00640 1 -- 172.21.15.153:0/3079695830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6818145a10 msgr2=0x7f681806e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.293+0000 7f681fc00640 1 --2- 172.21.15.153:0/3079695830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6818145a10 0x7f681806e2c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f681806ca20 tx=0x7f680c02b9a0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.293+0000 7f681fc00640 1 -- 172.21.15.153:0/3079695830 shutdown_connections 2024-03-28T21:53:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.293+0000 7f681fc00640 1 --2- 172.21.15.153:0/3079695830 >> v2:172.21.15.165:3300/0 conn(0x7f68180ce360 0x7f681815fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.293+0000 7f681fc00640 1 --2- 172.21.15.153:0/3079695830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6818145a10 0x7f681806e2c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.293+0000 7f681fc00640 1 -- 172.21.15.153:0/3079695830 >> 172.21.15.153:0/3079695830 conn(0x7f68180cfc00 msgr2=0x7f68180cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.293+0000 7f681fc00640 1 -- 172.21.15.153:0/3079695830 shutdown_connections 2024-03-28T21:53:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.293+0000 7f681fc00640 1 -- 172.21.15.153:0/3079695830 wait complete. 2024-03-28T21:53:03.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.295+0000 7f681fc00640 1 Processor -- start 2024-03-28T21:53:03.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.295+0000 7f681fc00640 1 -- start start 2024-03-28T21:53:03.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.296+0000 7f681fc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68180ce360 0x7f681815b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:03.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.296+0000 7f681fc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6818145a10 0x7f681813d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:03.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.296+0000 7f681fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6818160090 0x7f681813ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:03.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.296+0000 7f681fc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68180ce7f0 con 0x7f68180ce360 2024-03-28T21:53:03.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.296+0000 7f681fc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f68180cf4c0 con 0x7f6818145a10 2024-03-28T21:53:03.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.296+0000 7f681fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f68180ce970 con 0x7f6818160090 2024-03-28T21:53:03.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.296+0000 7f681d200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68180ce360 0x7f681815b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:03.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.296+0000 7f681d200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68180ce360 0x7f681815b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46632/0 (socket says 172.21.15.153:46632) 2024-03-28T21:53:03.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.296+0000 7f681d200640 1 -- 172.21.15.153:0/3340991600 learned_addr learned my addr 172.21.15.153:0/3340991600 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:03.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.297+0000 7f6817e00640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6818145a10 0x7f681813d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:03.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.297+0000 7f681dc00640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6818160090 0x7f681813ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:03.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.297+0000 7f681d200640 1 -- 172.21.15.153:0/3340991600 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6818160090 msgr2=0x7f681813ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:03.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.297+0000 7f681d200640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6818160090 0x7f681813ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.297+0000 7f681d200640 1 -- 172.21.15.153:0/3340991600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6818145a10 msgr2=0x7f681813d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:03.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.297+0000 7f681d200640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6818145a10 0x7f681813d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.297+0000 7f681d200640 1 -- 172.21.15.153:0/3340991600 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681815b6f0 con 0x7f68180ce360 2024-03-28T21:53:03.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.297+0000 7f6817e00640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6818145a10 0x7f681813d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:03.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.297+0000 7f681d200640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68180ce360 0x7f681815b1b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f680c000c00 tx=0x7f680c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:03.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.297+0000 7f6814c00640 1 -- 172.21.15.153:0/3340991600 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c034040 con 0x7f68180ce360 2024-03-28T21:53:03.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.297+0000 7f6814c00640 1 -- 172.21.15.153:0/3340991600 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f680c039b00 con 0x7f68180ce360 2024-03-28T21:53:03.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.297+0000 7f6814c00640 1 -- 172.21.15.153:0/3340991600 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c004030 con 0x7f68180ce360 2024-03-28T21:53:03.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.297+0000 7f681fc00640 1 -- 172.21.15.153:0/3340991600 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f681813d960 con 0x7f68180ce360 2024-03-28T21:53:03.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.298+0000 7f681fc00640 1 -- 172.21.15.153:0/3340991600 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6818143450 con 0x7f68180ce360 2024-03-28T21:53:03.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.299+0000 7f681fc00640 1 -- 172.21.15.153:0/3340991600 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6818068ff0 con 0x7f68180ce360 2024-03-28T21:53:03.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.299+0000 7f6814c00640 1 -- 172.21.15.153:0/3340991600 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f680c04b060 con 0x7f68180ce360 2024-03-28T21:53:03.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.300+0000 7f6814c00640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f67f806b4d0 0x7f67f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:03.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.300+0000 7f6814c00640 1 -- 172.21.15.153:0/3340991600 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f680c0abe60 con 0x7f68180ce360 2024-03-28T21:53:03.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.301+0000 7f6817e00640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f67f806b4d0 0x7f67f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:03.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.301+0000 7f6817e00640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f67f806b4d0 0x7f67f806d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6804006fd0 tx=0x7f6804008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:03.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.305+0000 7f6814c00640 1 -- 172.21.15.153:0/3340991600 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f680c038e90 con 0x7f68180ce360 2024-03-28T21:53:03.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.557+0000 7f681fc00640 1 -- 172.21.15.153:0/3340991600 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f6818072c60 con 0x7f68180ce360 2024-03-28T21:53:03.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.561+0000 7f6814c00640 1 -- 172.21.15.153:0/3340991600 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f680c07b010 con 0x7f68180ce360 2024-03-28T21:53:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.564+0000 7f681fc00640 1 -- 172.21.15.153:0/3340991600 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f67f806b4d0 msgr2=0x7f67f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.564+0000 7f681fc00640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f67f806b4d0 0x7f67f806d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6804006fd0 tx=0x7f6804008040 comp rx=0 tx=0).stop 2024-03-28T21:53:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.564+0000 7f681fc00640 1 -- 172.21.15.153:0/3340991600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68180ce360 msgr2=0x7f681815b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.564+0000 7f681fc00640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68180ce360 0x7f681815b1b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f680c000c00 tx=0x7f680c0046c0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.564+0000 7f681fc00640 1 -- 172.21.15.153:0/3340991600 shutdown_connections 2024-03-28T21:53:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.564+0000 7f681fc00640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f67f806b4d0 0x7f67f806d990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.564+0000 7f681fc00640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6818160090 0x7f681813ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.564+0000 7f681fc00640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6818145a10 0x7f681813d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.564+0000 7f681fc00640 1 --2- 172.21.15.153:0/3340991600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68180ce360 0x7f681815b1b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.564+0000 7f681fc00640 1 -- 172.21.15.153:0/3340991600 >> 172.21.15.153:0/3340991600 conn(0x7f68180cfc00 msgr2=0x7f681806e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.564+0000 7f681fc00640 1 -- 172.21.15.153:0/3340991600 shutdown_connections 2024-03-28T21:53:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.564+0000 7f681fc00640 1 -- 172.21.15.153:0/3340991600 wait complete. 2024-03-28T21:53:03.585 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-28T21:53:03.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.789+0000 7f3629c00640 1 Processor -- start 2024-03-28T21:53:03.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.789+0000 7f3629c00640 1 -- start start 2024-03-28T21:53:03.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.791+0000 7f3629c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3624158a60 0x7f36240b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:03.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.791+0000 7f3629c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f362415c110 0x7f362406e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:03.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.791+0000 7f3629c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f362406ec50 0x7f362415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:03.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.791+0000 7f3629c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f362406f0a0 con 0x7f362406ec50 2024-03-28T21:53:03.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.791+0000 7f3629c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f36240b3f40 con 0x7f362415c110 2024-03-28T21:53:03.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.791+0000 7f3629c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3624158e40 con 0x7f3624158a60 2024-03-28T21:53:03.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.791+0000 7f3623400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f362406ec50 0x7f362415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:03.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.791+0000 7f3623400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f362406ec50 0x7f362415eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46634/0 (socket says 172.21.15.153:46634) 2024-03-28T21:53:03.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.791+0000 7f3623400640 1 -- 172.21.15.153:0/3838277662 learned_addr learned my addr 172.21.15.153:0/3838277662 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:03.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.791+0000 7f361be00640 1 --2- 172.21.15.153:0/3838277662 >> v2:172.21.15.165:3300/0 conn(0x7f362415c110 0x7f362406e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:03.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.792+0000 7f3622a00640 1 --2- 172.21.15.153:0/3838277662 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3624158a60 0x7f36240b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:03.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.792+0000 7f3623400640 1 -- 172.21.15.153:0/3838277662 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3624158a60 msgr2=0x7f36240b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:03.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.792+0000 7f3623400640 1 --2- 172.21.15.153:0/3838277662 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3624158a60 0x7f36240b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.792+0000 7f3623400640 1 -- 172.21.15.153:0/3838277662 >> v2:172.21.15.165:3300/0 conn(0x7f362415c110 msgr2=0x7f362406e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:03.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.792+0000 7f3623400640 1 --2- 172.21.15.153:0/3838277662 >> v2:172.21.15.165:3300/0 conn(0x7f362415c110 0x7f362406e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.792+0000 7f3623400640 1 -- 172.21.15.153:0/3838277662 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36240b33c0 con 0x7f362406ec50 2024-03-28T21:53:03.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.792+0000 7f3622a00640 1 --2- 172.21.15.153:0/3838277662 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3624158a60 0x7f36240b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:03.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.793+0000 7f3623400640 1 --2- 172.21.15.153:0/3838277662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f362406ec50 0x7f362415eac0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3624073540 tx=0x7f361c02e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2cf036f7ec6529 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:03.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.793+0000 7f3622000640 1 -- 172.21.15.153:0/3838277662 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c02ea00 con 0x7f362406ec50 2024-03-28T21:53:03.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.793+0000 7f3622000640 1 -- 172.21.15.153:0/3838277662 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361c02eba0 con 0x7f362406ec50 2024-03-28T21:53:03.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.793+0000 7f3622000640 1 -- 172.21.15.153:0/3838277662 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c009600 con 0x7f362406ec50 2024-03-28T21:53:03.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.794+0000 7f3629c00640 1 -- 172.21.15.153:0/3838277662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f362406ec50 msgr2=0x7f362415eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:03.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.794+0000 7f3629c00640 1 --2- 172.21.15.153:0/3838277662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f362406ec50 0x7f362415eac0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3624073540 tx=0x7f361c02e060 comp rx=0 tx=0).stop 2024-03-28T21:53:03.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.794+0000 7f3629c00640 1 -- 172.21.15.153:0/3838277662 shutdown_connections 2024-03-28T21:53:03.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.794+0000 7f3629c00640 1 --2- 172.21.15.153:0/3838277662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f362406ec50 0x7f362415eac0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.794+0000 7f3629c00640 1 --2- 172.21.15.153:0/3838277662 >> v2:172.21.15.165:3300/0 conn(0x7f362415c110 0x7f362406e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.794+0000 7f3629c00640 1 --2- 172.21.15.153:0/3838277662 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3624158a60 0x7f36240b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.794+0000 7f3629c00640 1 -- 172.21.15.153:0/3838277662 >> 172.21.15.153:0/3838277662 conn(0x7f36240cfc00 msgr2=0x7f36240cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:03.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.794+0000 7f3629c00640 1 -- 172.21.15.153:0/3838277662 shutdown_connections 2024-03-28T21:53:03.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.794+0000 7f3629c00640 1 -- 172.21.15.153:0/3838277662 wait complete. 2024-03-28T21:53:03.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.795+0000 7f3629c00640 1 Processor -- start 2024-03-28T21:53:03.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.796+0000 7f3629c00640 1 -- start start 2024-03-28T21:53:03.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3629c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f362406ec50 0x7f362414b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:03.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3629c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3624158a60 0x7f362415a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:03.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3629c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f362415c110 0x7f362415ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:03.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3629c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f36240b3c60 con 0x7f362415c110 2024-03-28T21:53:03.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3629c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f36240b3980 con 0x7f3624158a60 2024-03-28T21:53:03.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3629c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f36240b30d0 con 0x7f362406ec50 2024-03-28T21:53:03.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3623400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f362415c110 0x7f362415ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:03.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3623400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f362415c110 0x7f362415ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46642/0 (socket says 172.21.15.153:46642) 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3623400640 1 -- 172.21.15.153:0/3925075820 learned_addr learned my addr 172.21.15.153:0/3925075820 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3622a00640 1 --2- 172.21.15.153:0/3925075820 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f362406ec50 0x7f362414b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f361be00640 1 --2- 172.21.15.153:0/3925075820 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3624158a60 0x7f362415a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3623400640 1 -- 172.21.15.153:0/3925075820 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f362406ec50 msgr2=0x7f362414b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3623400640 1 --2- 172.21.15.153:0/3925075820 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f362406ec50 0x7f362414b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3623400640 1 -- 172.21.15.153:0/3925075820 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3624158a60 msgr2=0x7f362415a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3623400640 1 --2- 172.21.15.153:0/3925075820 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3624158a60 0x7f362415a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.797+0000 7f3623400640 1 -- 172.21.15.153:0/3925075820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3624159190 con 0x7f362415c110 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.798+0000 7f3623400640 1 --2- 172.21.15.153:0/3925075820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f362415c110 0x7f362415ac60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f361c038040 tx=0x7f361c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.798+0000 7f361aa00640 1 -- 172.21.15.153:0/3925075820 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c00b720 con 0x7f362415c110 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.798+0000 7f361aa00640 1 -- 172.21.15.153:0/3925075820 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361c045070 con 0x7f362415c110 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.798+0000 7f361aa00640 1 -- 172.21.15.153:0/3925075820 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c02ea00 con 0x7f362415c110 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.798+0000 7f3629c00640 1 -- 172.21.15.153:0/3925075820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3624159470 con 0x7f362415c110 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.798+0000 7f3629c00640 1 -- 172.21.15.153:0/3925075820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3624159a30 con 0x7f362415c110 2024-03-28T21:53:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.799+0000 7f3629c00640 1 -- 172.21.15.153:0/3925075820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3624068ff0 con 0x7f362415c110 2024-03-28T21:53:03.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.800+0000 7f361aa00640 1 -- 172.21.15.153:0/3925075820 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f361c036a40 con 0x7f362415c110 2024-03-28T21:53:03.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.801+0000 7f361aa00640 1 --2- 172.21.15.153:0/3925075820 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f360006b4d0 0x7f360006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:03.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.801+0000 7f361aa00640 1 -- 172.21.15.153:0/3925075820 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f361c0ad050 con 0x7f362415c110 2024-03-28T21:53:03.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.801+0000 7f3622a00640 1 --2- 172.21.15.153:0/3925075820 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f360006b4d0 0x7f360006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:03.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.802+0000 7f3622a00640 1 --2- 172.21.15.153:0/3925075820 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f360006b4d0 0x7f360006d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f361400a990 tx=0x7f3614008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:03.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:03.805+0000 7f361aa00640 1 -- 172.21.15.153:0/3925075820 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f361c07c330 con 0x7f362415c110 2024-03-28T21:53:04.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.075+0000 7f3629c00640 1 -- 172.21.15.153:0/3925075820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f36240721f0 con 0x7f362415c110 2024-03-28T21:53:04.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.079+0000 7f361aa00640 1 -- 172.21.15.153:0/3925075820 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f361c07bc30 con 0x7f362415c110 2024-03-28T21:53:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.082+0000 7f3629c00640 1 -- 172.21.15.153:0/3925075820 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f360006b4d0 msgr2=0x7f360006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.082+0000 7f3629c00640 1 --2- 172.21.15.153:0/3925075820 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f360006b4d0 0x7f360006d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f361400a990 tx=0x7f3614008040 comp rx=0 tx=0).stop 2024-03-28T21:53:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.082+0000 7f3629c00640 1 -- 172.21.15.153:0/3925075820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f362415c110 msgr2=0x7f362415ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.082+0000 7f3629c00640 1 --2- 172.21.15.153:0/3925075820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f362415c110 0x7f362415ac60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f361c038040 tx=0x7f361c004a40 comp rx=0 tx=0).stop 2024-03-28T21:53:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.082+0000 7f3629c00640 1 -- 172.21.15.153:0/3925075820 shutdown_connections 2024-03-28T21:53:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.082+0000 7f3629c00640 1 --2- 172.21.15.153:0/3925075820 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f360006b4d0 0x7f360006d990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.082+0000 7f3629c00640 1 --2- 172.21.15.153:0/3925075820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f362415c110 0x7f362415ac60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.082+0000 7f3629c00640 1 --2- 172.21.15.153:0/3925075820 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3624158a60 0x7f362415a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.082+0000 7f3629c00640 1 --2- 172.21.15.153:0/3925075820 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f362406ec50 0x7f362414b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.082+0000 7f3629c00640 1 -- 172.21.15.153:0/3925075820 >> 172.21.15.153:0/3925075820 conn(0x7f36240cfc00 msgr2=0x7f362415ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.082+0000 7f3629c00640 1 -- 172.21.15.153:0/3925075820 shutdown_connections 2024-03-28T21:53:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.082+0000 7f3629c00640 1 -- 172.21.15.153:0/3925075820 wait complete. 2024-03-28T21:53:04.104 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-28T21:53:04.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.299+0000 7f9ab6200640 1 Processor -- start 2024-03-28T21:53:04.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.299+0000 7f9ab6200640 1 -- start start 2024-03-28T21:53:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.301+0000 7f9ab6200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ab0158a60 0x7f9ab00b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.301+0000 7f9ab6200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab015c110 0x7f9ab006e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.301+0000 7f9ab6200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9ab006ec50 0x7f9ab015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.301+0000 7f9ab6200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab006f0a0 con 0x7f9ab0158a60 2024-03-28T21:53:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.301+0000 7f9ab6200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab00b3f40 con 0x7f9ab006ec50 2024-03-28T21:53:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.301+0000 7f9ab6200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab0158e40 con 0x7f9ab015c110 2024-03-28T21:53:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.301+0000 7f9aaf400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ab0158a60 0x7f9ab00b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.301+0000 7f9aaf400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ab0158a60 0x7f9ab00b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46658/0 (socket says 172.21.15.153:46658) 2024-03-28T21:53:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.301+0000 7f9aaf400640 1 -- 172.21.15.153:0/2878904659 learned_addr learned my addr 172.21.15.153:0/2878904659 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.301+0000 7f9aaf400640 1 -- 172.21.15.153:0/2878904659 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab015c110 msgr2=0x7f9ab006e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:04.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.301+0000 7f9aaf400640 1 --2- 172.21.15.153:0/2878904659 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab015c110 0x7f9ab006e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.301+0000 7f9aaf400640 1 -- 172.21.15.153:0/2878904659 >> v2:172.21.15.165:3300/0 conn(0x7f9ab006ec50 msgr2=0x7f9ab015eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:04.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.301+0000 7f9aaf400640 1 --2- 172.21.15.153:0/2878904659 >> v2:172.21.15.165:3300/0 conn(0x7f9ab006ec50 0x7f9ab015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.301+0000 7f9aaf400640 1 -- 172.21.15.153:0/2878904659 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab00b33c0 con 0x7f9ab0158a60 2024-03-28T21:53:04.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.304+0000 7f9aaf400640 1 --2- 172.21.15.153:0/2878904659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab0158a60 0x7f9ab00b2b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9ab006ce00 tx=0x7f9aa002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77e14686ee825f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:04.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.304+0000 7f9aae000640 1 -- 172.21.15.153:0/2878904659 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa002e070 con 0x7f9ab0158a60 2024-03-28T21:53:04.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.304+0000 7f9aae000640 1 -- 172.21.15.153:0/2878904659 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa0037070 con 0x7f9ab0158a60 2024-03-28T21:53:04.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.304+0000 7f9aae000640 1 -- 172.21.15.153:0/2878904659 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0031a00 con 0x7f9ab0158a60 2024-03-28T21:53:04.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.304+0000 7f9ab6200640 1 -- 172.21.15.153:0/2878904659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab0158a60 msgr2=0x7f9ab00b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:04.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.304+0000 7f9ab6200640 1 --2- 172.21.15.153:0/2878904659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab0158a60 0x7f9ab00b2b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9ab006ce00 tx=0x7f9aa002b880 comp rx=0 tx=0).stop 2024-03-28T21:53:04.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.304+0000 7f9ab6200640 1 -- 172.21.15.153:0/2878904659 shutdown_connections 2024-03-28T21:53:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.304+0000 7f9ab6200640 1 --2- 172.21.15.153:0/2878904659 >> v2:172.21.15.165:3300/0 conn(0x7f9ab006ec50 0x7f9ab015eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.304+0000 7f9ab6200640 1 --2- 172.21.15.153:0/2878904659 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab015c110 0x7f9ab006e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.304+0000 7f9ab6200640 1 --2- 172.21.15.153:0/2878904659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab0158a60 0x7f9ab00b2b90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.304+0000 7f9ab6200640 1 -- 172.21.15.153:0/2878904659 >> 172.21.15.153:0/2878904659 conn(0x7f9ab00cfc00 msgr2=0x7f9ab00cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.304+0000 7f9ab6200640 1 -- 172.21.15.153:0/2878904659 shutdown_connections 2024-03-28T21:53:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.304+0000 7f9ab6200640 1 -- 172.21.15.153:0/2878904659 wait complete. 2024-03-28T21:53:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.305+0000 7f9ab6200640 1 Processor -- start 2024-03-28T21:53:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.306+0000 7f9ab6200640 1 -- start start 2024-03-28T21:53:04.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.306+0000 7f9ab6200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ab006ec50 0x7f9ab0150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:04.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9ab6200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab0158a60 0x7f9ab014be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:04.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9ab6200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab015c110 0x7f9ab014dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:04.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9ab6200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab00b3c60 con 0x7f9ab015c110 2024-03-28T21:53:04.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9ab6200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab00b3980 con 0x7f9ab006ec50 2024-03-28T21:53:04.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9ab6200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab00b30d0 con 0x7f9ab0158a60 2024-03-28T21:53:04.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9aafe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab015c110 0x7f9ab014dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:04.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9aafe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab015c110 0x7f9ab014dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46668/0 (socket says 172.21.15.153:46668) 2024-03-28T21:53:04.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9aafe00640 1 -- 172.21.15.153:0/2406939875 learned_addr learned my addr 172.21.15.153:0/2406939875 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:04.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9aaea00640 1 --2- 172.21.15.153:0/2406939875 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab0158a60 0x7f9ab014be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:04.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9aaf400640 1 --2- 172.21.15.153:0/2406939875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ab006ec50 0x7f9ab0150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:04.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9aafe00640 1 -- 172.21.15.153:0/2406939875 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab0158a60 msgr2=0x7f9ab014be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:04.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9aafe00640 1 --2- 172.21.15.153:0/2406939875 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab0158a60 0x7f9ab014be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9aafe00640 1 -- 172.21.15.153:0/2406939875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ab006ec50 msgr2=0x7f9ab0150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:04.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9aafe00640 1 --2- 172.21.15.153:0/2406939875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ab006ec50 0x7f9ab0150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.307+0000 7f9aafe00640 1 -- 172.21.15.153:0/2406939875 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab00ce6f0 con 0x7f9ab015c110 2024-03-28T21:53:04.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.308+0000 7f9aafe00640 1 --2- 172.21.15.153:0/2406939875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab015c110 0x7f9ab014dd50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800b970 tx=0x7f9aa800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:04.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.308+0000 7f9aa7400640 1 -- 172.21.15.153:0/2406939875 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8019070 con 0x7f9ab015c110 2024-03-28T21:53:04.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.308+0000 7f9aa7400640 1 -- 172.21.15.153:0/2406939875 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa800cb60 con 0x7f9ab015c110 2024-03-28T21:53:04.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.308+0000 7f9aa7400640 1 -- 172.21.15.153:0/2406939875 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8014440 con 0x7f9ab015c110 2024-03-28T21:53:04.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.308+0000 7f9ab6200640 1 -- 172.21.15.153:0/2406939875 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab00ce9d0 con 0x7f9ab015c110 2024-03-28T21:53:04.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.308+0000 7f9ab6200640 1 -- 172.21.15.153:0/2406939875 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab014c710 con 0x7f9ab015c110 2024-03-28T21:53:04.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.309+0000 7f9ab6200640 1 -- 172.21.15.153:0/2406939875 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab0072e20 con 0x7f9ab015c110 2024-03-28T21:53:04.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.310+0000 7f9aa7400640 1 -- 172.21.15.153:0/2406939875 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f9aa801c070 con 0x7f9ab015c110 2024-03-28T21:53:04.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.311+0000 7f9aa7400640 1 --2- 172.21.15.153:0/2406939875 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9a9006b4d0 0x7f9a9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:04.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.311+0000 7f9aa7400640 1 -- 172.21.15.153:0/2406939875 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f9aa8089c00 con 0x7f9ab015c110 2024-03-28T21:53:04.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.312+0000 7f9aaf400640 1 --2- 172.21.15.153:0/2406939875 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9a9006b4d0 0x7f9a9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:04.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.312+0000 7f9aaf400640 1 --2- 172.21.15.153:0/2406939875 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9a9006b4d0 0x7f9a9006d990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0036000 tx=0x7f9aa003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:04.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.315+0000 7f9aa7400640 1 -- 172.21.15.153:0/2406939875 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9ab0072e20 con 0x7f9ab015c110 2024-03-28T21:53:04.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.576+0000 7f9ab6200640 1 -- 172.21.15.153:0/2406939875 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f9ab0068ff0 con 0x7f9ab015c110 2024-03-28T21:53:04.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.579+0000 7f9aa7400640 1 -- 172.21.15.153:0/2406939875 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7f9aa8058dc0 con 0x7f9ab015c110 2024-03-28T21:53:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.582+0000 7f9ab6200640 1 -- 172.21.15.153:0/2406939875 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9a9006b4d0 msgr2=0x7f9a9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.582+0000 7f9ab6200640 1 --2- 172.21.15.153:0/2406939875 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9a9006b4d0 0x7f9a9006d990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0036000 tx=0x7f9aa003d040 comp rx=0 tx=0).stop 2024-03-28T21:53:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.582+0000 7f9ab6200640 1 -- 172.21.15.153:0/2406939875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab015c110 msgr2=0x7f9ab014dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.582+0000 7f9ab6200640 1 --2- 172.21.15.153:0/2406939875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab015c110 0x7f9ab014dd50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800b970 tx=0x7f9aa800be30 comp rx=0 tx=0).stop 2024-03-28T21:53:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.582+0000 7f9ab6200640 1 -- 172.21.15.153:0/2406939875 shutdown_connections 2024-03-28T21:53:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.582+0000 7f9ab6200640 1 --2- 172.21.15.153:0/2406939875 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9a9006b4d0 0x7f9a9006d990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.582+0000 7f9ab6200640 1 --2- 172.21.15.153:0/2406939875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab015c110 0x7f9ab014dd50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.582+0000 7f9ab6200640 1 --2- 172.21.15.153:0/2406939875 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab0158a60 0x7f9ab014be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.582+0000 7f9ab6200640 1 --2- 172.21.15.153:0/2406939875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ab006ec50 0x7f9ab0150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.582+0000 7f9ab6200640 1 -- 172.21.15.153:0/2406939875 >> 172.21.15.153:0/2406939875 conn(0x7f9ab00cfc00 msgr2=0x7f9ab015dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.582+0000 7f9ab6200640 1 -- 172.21.15.153:0/2406939875 shutdown_connections 2024-03-28T21:53:04.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.582+0000 7f9ab6200640 1 -- 172.21.15.153:0/2406939875 wait complete. 2024-03-28T21:53:04.601 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-28T21:53:04.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.802+0000 7fe817800640 1 Processor -- start 2024-03-28T21:53:04.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.802+0000 7fe817800640 1 -- start start 2024-03-28T21:53:04.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.803+0000 7fe817800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe810160090 0x7fe810071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:04.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.803+0000 7fe817800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe810071650 0x7fe81006cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:04.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.803+0000 7fe817800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81006d2b0 0x7fe8101660c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:04.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.803+0000 7fe817800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe81006d700 con 0x7fe810160090 2024-03-28T21:53:04.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.803+0000 7fe817800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe810160470 con 0x7fe810071650 2024-03-28T21:53:04.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.803+0000 7fe817800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe810071bf0 con 0x7fe81006d2b0 2024-03-28T21:53:04.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.803+0000 7fe814e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe810160090 0x7fe810071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:04.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.803+0000 7fe814e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe810160090 0x7fe810071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46670/0 (socket says 172.21.15.153:46670) 2024-03-28T21:53:04.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.803+0000 7fe814e00640 1 -- 172.21.15.153:0/985707100 learned_addr learned my addr 172.21.15.153:0/985707100 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:04.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.804+0000 7fe814e00640 1 -- 172.21.15.153:0/985707100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81006d2b0 msgr2=0x7fe8101660c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:04.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.804+0000 7fe814e00640 1 --2- 172.21.15.153:0/985707100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81006d2b0 0x7fe8101660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.804+0000 7fe814e00640 1 -- 172.21.15.153:0/985707100 >> v2:172.21.15.165:3300/0 conn(0x7fe810071650 msgr2=0x7fe81006cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:04.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.804+0000 7fe814e00640 1 --2- 172.21.15.153:0/985707100 >> v2:172.21.15.165:3300/0 conn(0x7fe810071650 0x7fe81006cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.804+0000 7fe814e00640 1 -- 172.21.15.153:0/985707100 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe810071ed0 con 0x7fe810160090 2024-03-28T21:53:04.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.805+0000 7fe814e00640 1 --2- 172.21.15.153:0/985707100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810160090 0x7fe810071110 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe810070e20 tx=0x7fe80002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8eb0842395431 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:04.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.805+0000 7fe80fe00640 1 -- 172.21.15.153:0/985707100 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800035020 con 0x7fe810160090 2024-03-28T21:53:04.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.805+0000 7fe80fe00640 1 -- 172.21.15.153:0/985707100 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80002d040 con 0x7fe810160090 2024-03-28T21:53:04.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.805+0000 7fe80fe00640 1 -- 172.21.15.153:0/985707100 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800031a80 con 0x7fe810160090 2024-03-28T21:53:04.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.806+0000 7fe817800640 1 -- 172.21.15.153:0/985707100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810160090 msgr2=0x7fe810071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:04.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.806+0000 7fe817800640 1 --2- 172.21.15.153:0/985707100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810160090 0x7fe810071110 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe810070e20 tx=0x7fe80002b900 comp rx=0 tx=0).stop 2024-03-28T21:53:04.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.806+0000 7fe817800640 1 -- 172.21.15.153:0/985707100 shutdown_connections 2024-03-28T21:53:04.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.806+0000 7fe817800640 1 --2- 172.21.15.153:0/985707100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81006d2b0 0x7fe8101660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.806+0000 7fe817800640 1 --2- 172.21.15.153:0/985707100 >> v2:172.21.15.165:3300/0 conn(0x7fe810071650 0x7fe81006cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.806+0000 7fe817800640 1 --2- 172.21.15.153:0/985707100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810160090 0x7fe810071110 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.806+0000 7fe817800640 1 -- 172.21.15.153:0/985707100 >> 172.21.15.153:0/985707100 conn(0x7fe8100cfc00 msgr2=0x7fe8100cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:04.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.806+0000 7fe817800640 1 -- 172.21.15.153:0/985707100 shutdown_connections 2024-03-28T21:53:04.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.806+0000 7fe817800640 1 -- 172.21.15.153:0/985707100 wait complete. 2024-03-28T21:53:04.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.808+0000 7fe817800640 1 Processor -- start 2024-03-28T21:53:04.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.808+0000 7fe817800640 1 -- start start 2024-03-28T21:53:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe817800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe81006d2b0 0x7fe810165780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe817800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810071650 0x7fe81015db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe817800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe810160090 0x7fe8101fb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe817800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe810162db0 con 0x7fe810071650 2024-03-28T21:53:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe817800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe810072490 con 0x7fe81006d2b0 2024-03-28T21:53:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe817800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe810166600 con 0x7fe810160090 2024-03-28T21:53:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe807e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810071650 0x7fe81015db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe807e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810071650 0x7fe81015db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46678/0 (socket says 172.21.15.153:46678) 2024-03-28T21:53:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe807e00640 1 -- 172.21.15.153:0/2374729310 learned_addr learned my addr 172.21.15.153:0/2374729310 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe814e00640 1 --2- 172.21.15.153:0/2374729310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe81006d2b0 0x7fe810165780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:04.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe807e00640 1 -- 172.21.15.153:0/2374729310 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe810160090 msgr2=0x7fe8101fb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:04.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe807e00640 1 --2- 172.21.15.153:0/2374729310 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe810160090 0x7fe8101fb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe807e00640 1 -- 172.21.15.153:0/2374729310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe81006d2b0 msgr2=0x7fe810165780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:04.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe807e00640 1 --2- 172.21.15.153:0/2374729310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe81006d2b0 0x7fe810165780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:04.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.809+0000 7fe807e00640 1 -- 172.21.15.153:0/2374729310 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81015e290 con 0x7fe810071650 2024-03-28T21:53:04.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.810+0000 7fe807e00640 1 --2- 172.21.15.153:0/2374729310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810071650 0x7fe81015db20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800b4d0 tx=0x7fe7f800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:04.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.810+0000 7fe80d600640 1 -- 172.21.15.153:0/2374729310 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8014070 con 0x7fe810071650 2024-03-28T21:53:04.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.810+0000 7fe80d600640 1 -- 172.21.15.153:0/2374729310 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f8010870 con 0x7fe810071650 2024-03-28T21:53:04.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.810+0000 7fe80d600640 1 -- 172.21.15.153:0/2374729310 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8010c60 con 0x7fe810071650 2024-03-28T21:53:04.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.810+0000 7fe817800640 1 -- 172.21.15.153:0/2374729310 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe81015e570 con 0x7fe810071650 2024-03-28T21:53:04.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.810+0000 7fe817800640 1 -- 172.21.15.153:0/2374729310 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe81015eb30 con 0x7fe810071650 2024-03-28T21:53:04.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.811+0000 7fe817800640 1 -- 172.21.15.153:0/2374729310 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe810068ff0 con 0x7fe810071650 2024-03-28T21:53:04.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.812+0000 7fe80d600640 1 -- 172.21.15.153:0/2374729310 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe7f8017070 con 0x7fe810071650 2024-03-28T21:53:04.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.813+0000 7fe80d600640 1 --2- 172.21.15.153:0/2374729310 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe7ec06b4d0 0x7fe7ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:04.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.813+0000 7fe80d600640 1 -- 172.21.15.153:0/2374729310 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fe7f8089cc0 con 0x7fe810071650 2024-03-28T21:53:04.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.814+0000 7fe814e00640 1 --2- 172.21.15.153:0/2374729310 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe7ec06b4d0 0x7fe7ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:04.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.814+0000 7fe814e00640 1 --2- 172.21.15.153:0/2374729310 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe7ec06b4d0 0x7fe7ec06d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe800036000 tx=0x7fe80003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:04.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:04.818+0000 7fe80d600640 1 -- 172.21.15.153:0/2374729310 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe7f8058e90 con 0x7fe810071650 2024-03-28T21:53:05.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.083+0000 7fe817800640 1 -- 172.21.15.153:0/2374729310 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fe8100b4d50 con 0x7fe810071650 2024-03-28T21:53:05.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.087+0000 7fe80d600640 1 -- 172.21.15.153:0/2374729310 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7fe7f8058790 con 0x7fe810071650 2024-03-28T21:53:05.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.090+0000 7fe817800640 1 -- 172.21.15.153:0/2374729310 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe7ec06b4d0 msgr2=0x7fe7ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:05.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.091+0000 7fe817800640 1 --2- 172.21.15.153:0/2374729310 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe7ec06b4d0 0x7fe7ec06d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe800036000 tx=0x7fe80003c040 comp rx=0 tx=0).stop 2024-03-28T21:53:05.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.091+0000 7fe817800640 1 -- 172.21.15.153:0/2374729310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810071650 msgr2=0x7fe81015db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:05.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.091+0000 7fe817800640 1 --2- 172.21.15.153:0/2374729310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810071650 0x7fe81015db20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800b4d0 tx=0x7fe7f800b990 comp rx=0 tx=0).stop 2024-03-28T21:53:05.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.091+0000 7fe817800640 1 -- 172.21.15.153:0/2374729310 shutdown_connections 2024-03-28T21:53:05.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.091+0000 7fe817800640 1 --2- 172.21.15.153:0/2374729310 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe7ec06b4d0 0x7fe7ec06d990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.091+0000 7fe817800640 1 --2- 172.21.15.153:0/2374729310 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe810160090 0x7fe8101fb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.091+0000 7fe817800640 1 --2- 172.21.15.153:0/2374729310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe810071650 0x7fe81015db20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.091+0000 7fe817800640 1 --2- 172.21.15.153:0/2374729310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe81006d2b0 0x7fe810165780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.091+0000 7fe817800640 1 -- 172.21.15.153:0/2374729310 >> 172.21.15.153:0/2374729310 conn(0x7fe8100cfc00 msgr2=0x7fe810160790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:05.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.091+0000 7fe817800640 1 -- 172.21.15.153:0/2374729310 shutdown_connections 2024-03-28T21:53:05.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.091+0000 7fe817800640 1 -- 172.21.15.153:0/2374729310 wait complete. 2024-03-28T21:53:05.113 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:53:05.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.318+0000 7fddaa200640 1 Processor -- start 2024-03-28T21:53:05.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.318+0000 7fddaa200640 1 -- start start 2024-03-28T21:53:05.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.318+0000 7fddaa200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdda40ae8e0 0x7fdda40b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.318+0000 7fddaa200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdda40b4480 0x7fdda415ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.320+0000 7fddaa200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda415ea70 con 0x7fdda415ade0 2024-03-28T21:53:05.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.320+0000 7fddaa200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdda40aee50 con 0x7fdda40b4480 2024-03-28T21:53:05.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.320+0000 7fddaa200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdda40af130 con 0x7fdda40ae8e0 2024-03-28T21:53:05.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.320+0000 7fdda3400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fdda415ade0 0x7fdda40acd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40304/0 (socket says 172.21.15.153:40304) 2024-03-28T21:53:05.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.320+0000 7fdda3400640 1 -- 172.21.15.153:0/3555800044 learned_addr learned my addr 172.21.15.153:0/3555800044 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:05.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.320+0000 7fdda3e00640 1 --2- 172.21.15.153:0/3555800044 >> v2:172.21.15.165:3300/0 conn(0x7fdda40b4480 0x7fdda415ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:05.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.320+0000 7fdda2a00640 1 -- 172.21.15.153:0/3555800044 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766294754 0 0) 0x7fdda415ea70 con 0x7fdda415ade0 2024-03-28T21:53:05.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.320+0000 7fdd9be00640 1 --2- 172.21.15.153:0/3555800044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdda40ae8e0 0x7fdda40b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:05.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.320+0000 7fdda2a00640 1 -- 172.21.15.153:0/3555800044 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd88005730 con 0x7fdda415ade0 2024-03-28T21:53:05.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda2a00640 1 -- 172.21.15.153:0/3555800044 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 233466589 0 0) 0x7fdd88005730 con 0x7fdda415ade0 2024-03-28T21:53:05.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda2a00640 1 -- 172.21.15.153:0/3555800044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdda40ae8e0 msgr2=0x7fdda40b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:05.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda2a00640 1 --2- 172.21.15.153:0/3555800044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdda40ae8e0 0x7fdda40b3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda2a00640 1 -- 172.21.15.153:0/3555800044 >> v2:172.21.15.165:3300/0 conn(0x7fdda40b4480 msgr2=0x7fdda415ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:05.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda2a00640 1 --2- 172.21.15.153:0/3555800044 >> v2:172.21.15.165:3300/0 conn(0x7fdda40b4480 0x7fdda415ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda2a00640 1 -- 172.21.15.153:0/3555800044 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda40af410 con 0x7fdda415ade0 2024-03-28T21:53:05.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda2a00640 1 -- 172.21.15.153:0/3555800044 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fdd94001670 con 0x7fdda415ade0 2024-03-28T21:53:05.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda2a00640 1 -- 172.21.15.153:0/3555800044 >> v1:172.21.15.153:6789/0 conn(0x7fdda415ade0 legacy=0x7fdda40acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:05.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda2a00640 1 --2- 172.21.15.153:0/3555800044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd88005bc0 0x7fdd88005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda2a00640 1 --2- 172.21.15.153:0/3555800044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd88006a10 0x7fdd88006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda2a00640 1 --2- 172.21.15.153:0/3555800044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdda40ae8e0 0x7fdd880073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda2a00640 1 -- 172.21.15.153:0/3555800044 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdda40aee50 con 0x7fdd88005bc0 2024-03-28T21:53:05.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda2a00640 1 -- 172.21.15.153:0/3555800044 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdda40af130 con 0x7fdd88006a10 2024-03-28T21:53:05.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda2a00640 1 -- 172.21.15.153:0/3555800044 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdd8800dbd0 con 0x7fdda40ae8e0 2024-03-28T21:53:05.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda3400640 1 --2- 172.21.15.153:0/3555800044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd88005bc0 0x7fdd88005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:05.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda3400640 1 -- 172.21.15.153:0/3555800044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdda40ae8e0 msgr2=0x7fdd880073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:05.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda3400640 1 --2- 172.21.15.153:0/3555800044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdda40ae8e0 0x7fdd880073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda3400640 1 -- 172.21.15.153:0/3555800044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd88006a10 msgr2=0x7fdd88006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:05.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda3400640 1 --2- 172.21.15.153:0/3555800044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd88006a10 0x7fdd88006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.321+0000 7fdda3400640 1 -- 172.21.15.153:0/3555800044 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd88005730 con 0x7fdd88005bc0 2024-03-28T21:53:05.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.322+0000 7fdda3400640 1 --2- 172.21.15.153:0/3555800044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd88005bc0 0x7fdd88005fe0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400c290 tx=0x7fdd88007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eafb9830abbb4b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:05.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.322+0000 7fdda2a00640 1 -- 172.21.15.153:0/3555800044 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd94007d50 con 0x7fdd88005bc0 2024-03-28T21:53:05.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.322+0000 7fdda2a00640 1 -- 172.21.15.153:0/3555800044 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd94030070 con 0x7fdd88005bc0 2024-03-28T21:53:05.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.322+0000 7fdda2a00640 1 -- 172.21.15.153:0/3555800044 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9402cd80 con 0x7fdd88005bc0 2024-03-28T21:53:05.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.322+0000 7fddaa200640 1 -- 172.21.15.153:0/3555800044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd88005bc0 msgr2=0x7fdd88005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:05.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.322+0000 7fddaa200640 1 --2- 172.21.15.153:0/3555800044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd88005bc0 0x7fdd88005fe0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400c290 tx=0x7fdd88007a40 comp rx=0 tx=0).stop 2024-03-28T21:53:05.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.322+0000 7fdda3e00640 1 -- 172.21.15.153:0/3555800044 reap_dead start 2024-03-28T21:53:05.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.323+0000 7fddaa200640 1 -- 172.21.15.153:0/3555800044 shutdown_connections 2024-03-28T21:53:05.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.323+0000 7fddaa200640 1 -- 172.21.15.153:0/3555800044 >> 172.21.15.153:0/3555800044 conn(0x7fdda40b1a30 msgr2=0x7fdda40b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:05.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.323+0000 7fddaa200640 1 -- 172.21.15.153:0/3555800044 shutdown_connections 2024-03-28T21:53:05.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.323+0000 7fddaa200640 1 -- 172.21.15.153:0/3555800044 wait complete. 2024-03-28T21:53:05.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.324+0000 7fddaa200640 1 Processor -- start 2024-03-28T21:53:05.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.324+0000 7fddaa200640 1 -- start start 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.326+0000 7fddaa200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd88005bc0 0x7fdda4147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.326+0000 7fddaa200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdda415cde0 0x7fdda415d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.326+0000 7fddaa200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdda406db20 0x7fdda406dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.326+0000 7fddaa200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdda415b1c0 con 0x7fdd88005bc0 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.326+0000 7fddaa200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdda415f460 con 0x7fdda406db20 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.326+0000 7fddaa200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdda415d950 con 0x7fdda415cde0 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.327+0000 7fdda3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd88005bc0 0x7fdda4147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.327+0000 7fdda3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd88005bc0 0x7fdda4147540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46706/0 (socket says 172.21.15.153:46706) 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.327+0000 7fdda3400640 1 -- 172.21.15.153:0/1801186693 learned_addr learned my addr 172.21.15.153:0/1801186693 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.327+0000 7fdda3400640 1 -- 172.21.15.153:0/1801186693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdda415cde0 msgr2=0x7fdda415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.327+0000 7fdda3400640 1 --2- 172.21.15.153:0/1801186693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdda415cde0 0x7fdda415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.327+0000 7fdda3400640 1 -- 172.21.15.153:0/1801186693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdda406db20 msgr2=0x7fdda406dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.327+0000 7fdda3400640 1 --2- 172.21.15.153:0/1801186693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdda406db20 0x7fdda406dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.327+0000 7fdda3400640 1 -- 172.21.15.153:0/1801186693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda415dc30 con 0x7fdd88005bc0 2024-03-28T21:53:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.327+0000 7fdda3400640 1 --2- 172.21.15.153:0/1801186693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd88005bc0 0x7fdda4147540 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400c3b0 tx=0x7fdda40aed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:05.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.327+0000 7fdd9b400640 1 -- 172.21.15.153:0/1801186693 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd94045070 con 0x7fdd88005bc0 2024-03-28T21:53:05.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.328+0000 7fdd9b400640 1 -- 172.21.15.153:0/1801186693 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd94004bf0 con 0x7fdd88005bc0 2024-03-28T21:53:05.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.328+0000 7fdd9b400640 1 -- 172.21.15.153:0/1801186693 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd94007d50 con 0x7fdd88005bc0 2024-03-28T21:53:05.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.328+0000 7fddaa200640 1 -- 172.21.15.153:0/1801186693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda415df10 con 0x7fdd88005bc0 2024-03-28T21:53:05.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.328+0000 7fddaa200640 1 -- 172.21.15.153:0/1801186693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda4151bc0 con 0x7fdd88005bc0 2024-03-28T21:53:05.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.329+0000 7fddaa200640 1 -- 172.21.15.153:0/1801186693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda406e4e0 con 0x7fdd88005bc0 2024-03-28T21:53:05.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.330+0000 7fdd9b400640 1 -- 172.21.15.153:0/1801186693 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fdd94048070 con 0x7fdd88005bc0 2024-03-28T21:53:05.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.330+0000 7fdd9b400640 1 --2- 172.21.15.153:0/1801186693 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdd8006b500 0x7fdd8006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.331+0000 7fdd9b400640 1 -- 172.21.15.153:0/1801186693 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fdd940aafc0 con 0x7fdd88005bc0 2024-03-28T21:53:05.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.331+0000 7fdd9be00640 1 --2- 172.21.15.153:0/1801186693 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdd8006b500 0x7fdd8006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:05.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.331+0000 7fdd9be00640 1 --2- 172.21.15.153:0/1801186693 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdd8006b500 0x7fdd8006d9c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c006a90 tx=0x7fdd8c006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:05.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.335+0000 7fdd9b400640 1 -- 172.21.15.153:0/1801186693 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdd94079b30 con 0x7fdd88005bc0 2024-03-28T21:53:05.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.534+0000 7fddaa200640 1 -- 172.21.15.153:0/1801186693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdda4068ff0 con 0x7fdd88005bc0 2024-03-28T21:53:05.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.536+0000 7fdd9b400640 1 -- 172.21.15.153:0/1801186693 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+12939 (secure 0 0 0) 0x7fdd9407dbd0 con 0x7fdd88005bc0 2024-03-28T21:53:05.538 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:05.538 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":31,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:53:01.544994+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:53:05.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.539+0000 7fddaa200640 1 -- 172.21.15.153:0/1801186693 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdd8006b500 msgr2=0x7fdd8006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:05.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.539+0000 7fddaa200640 1 --2- 172.21.15.153:0/1801186693 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdd8006b500 0x7fdd8006d9c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c006a90 tx=0x7fdd8c006a20 comp rx=0 tx=0).stop 2024-03-28T21:53:05.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.539+0000 7fddaa200640 1 -- 172.21.15.153:0/1801186693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd88005bc0 msgr2=0x7fdda4147540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:05.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.539+0000 7fddaa200640 1 --2- 172.21.15.153:0/1801186693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd88005bc0 0x7fdda4147540 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400c3b0 tx=0x7fdda40aed40 comp rx=0 tx=0).stop 2024-03-28T21:53:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.540+0000 7fddaa200640 1 -- 172.21.15.153:0/1801186693 shutdown_connections 2024-03-28T21:53:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.540+0000 7fddaa200640 1 --2- 172.21.15.153:0/1801186693 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdd8006b500 0x7fdd8006d9c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.540+0000 7fddaa200640 1 --2- 172.21.15.153:0/1801186693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdda406db20 0x7fdda406dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.540+0000 7fddaa200640 1 --2- 172.21.15.153:0/1801186693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdda415cde0 0x7fdda415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.540+0000 7fddaa200640 1 --2- 172.21.15.153:0/1801186693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd88005bc0 0x7fdda4147540 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.540+0000 7fddaa200640 1 -- 172.21.15.153:0/1801186693 >> 172.21.15.153:0/1801186693 conn(0x7fdda40b1a30 msgr2=0x7fdda4153dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.540+0000 7fddaa200640 1 -- 172.21.15.153:0/1801186693 shutdown_connections 2024-03-28T21:53:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.540+0000 7fddaa200640 1 -- 172.21.15.153:0/1801186693 wait complete. 2024-03-28T21:53:05.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T21:53:05.562 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T21:53:05.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.778+0000 7fd621600640 1 Processor -- start 2024-03-28T21:53:05.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.778+0000 7fd621600640 1 -- start start 2024-03-28T21:53:05.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.780+0000 7fd621600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd61c0acd80 0x7fd61c071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.780+0000 7fd621600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd61c0728c0 0x7fd61c06cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.780+0000 7fd621600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd61c070f20 con 0x7fd61c0cef30 2024-03-28T21:53:05.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.780+0000 7fd621600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fd61c071200 con 0x7fd61c0acd80 2024-03-28T21:53:05.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.780+0000 7fd621600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd61c0714e0 con 0x7fd61c0728c0 2024-03-28T21:53:05.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.780+0000 7fd61aa00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd61c0cef30 0x7fd61c0cf310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40308/0 (socket says 172.21.15.153:40308) 2024-03-28T21:53:05.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.780+0000 7fd61aa00640 1 -- 172.21.15.153:0/2708843691 learned_addr learned my addr 172.21.15.153:0/2708843691 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:05.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.780+0000 7fd61a000640 1 --2- 172.21.15.153:0/2708843691 >> v2:172.21.15.153:3300/0 conn(0x7fd61c0acd80 0x7fd61c071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:05.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.781+0000 7fd61b400640 1 --2- 172.21.15.153:0/2708843691 >> v2:172.21.15.165:3300/0 conn(0x7fd61c0728c0 0x7fd61c06cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:05.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.781+0000 7fd61a000640 1 -- 172.21.15.153:0/2708843691 >> v2:172.21.15.165:3300/0 conn(0x7fd61c0728c0 msgr2=0x7fd61c06cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:05.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.781+0000 7fd61a000640 1 --2- 172.21.15.153:0/2708843691 >> v2:172.21.15.165:3300/0 conn(0x7fd61c0728c0 0x7fd61c06cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.781+0000 7fd61a000640 1 -- 172.21.15.153:0/2708843691 >> v1:172.21.15.153:6789/0 conn(0x7fd61c0cef30 legacy=0x7fd61c0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:05.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.781+0000 7fd61a000640 1 -- 172.21.15.153:0/2708843691 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61c0717c0 con 0x7fd61c0acd80 2024-03-28T21:53:05.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.781+0000 7fd619600640 1 -- 172.21.15.153:0/2708843691 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2442762977 0 0) 0x7fd61c070f20 con 0x7fd61c0cef30 2024-03-28T21:53:05.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.782+0000 7fd61a000640 1 --2- 172.21.15.153:0/2708843691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd61c0acd80 0x7fd61c071ce0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd61c070d10 tx=0x7fd60802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ae676d315857ec server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:05.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.782+0000 7fd619600640 1 -- 172.21.15.153:0/2708843691 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608035020 con 0x7fd61c0acd80 2024-03-28T21:53:05.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.782+0000 7fd619600640 1 -- 172.21.15.153:0/2708843691 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd608031830 con 0x7fd61c0acd80 2024-03-28T21:53:05.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.782+0000 7fd619600640 1 -- 172.21.15.153:0/2708843691 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608031c00 con 0x7fd61c0acd80 2024-03-28T21:53:05.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.783+0000 7fd621600640 1 -- 172.21.15.153:0/2708843691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd61c0acd80 msgr2=0x7fd61c071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:05.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.783+0000 7fd621600640 1 --2- 172.21.15.153:0/2708843691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd61c0acd80 0x7fd61c071ce0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd61c070d10 tx=0x7fd60802b8d0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.783+0000 7fd621600640 1 -- 172.21.15.153:0/2708843691 shutdown_connections 2024-03-28T21:53:05.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.783+0000 7fd621600640 1 --2- 172.21.15.153:0/2708843691 >> v2:172.21.15.165:3300/0 conn(0x7fd61c0728c0 0x7fd61c06cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.783+0000 7fd621600640 1 --2- 172.21.15.153:0/2708843691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd61c0acd80 0x7fd61c071ce0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.783+0000 7fd621600640 1 -- 172.21.15.153:0/2708843691 >> 172.21.15.153:0/2708843691 conn(0x7fd61c0b19a0 msgr2=0x7fd61c0b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:05.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.783+0000 7fd621600640 1 -- 172.21.15.153:0/2708843691 shutdown_connections 2024-03-28T21:53:05.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.783+0000 7fd621600640 1 -- 172.21.15.153:0/2708843691 wait complete. 2024-03-28T21:53:05.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.784+0000 7fd621600640 1 Processor -- start 2024-03-28T21:53:05.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.785+0000 7fd621600640 1 -- start start 2024-03-28T21:53:05.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.785+0000 7fd621600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd61c0728c0 0x7fd61c09b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.785+0000 7fd621600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd61c0acd80 0x7fd61c154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.785+0000 7fd621600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd61c0cef30 0x7fd61c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.785+0000 7fd621600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c15c370 con 0x7fd61c0728c0 2024-03-28T21:53:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.785+0000 7fd621600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c15c1f0 con 0x7fd61c0cef30 2024-03-28T21:53:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.786+0000 7fd621600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd61c06d040 con 0x7fd61c0acd80 2024-03-28T21:53:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.786+0000 7fd61aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd61c0728c0 0x7fd61c09b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.786+0000 7fd61aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd61c0728c0 0x7fd61c09b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46716/0 (socket says 172.21.15.153:46716) 2024-03-28T21:53:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.786+0000 7fd61aa00640 1 -- 172.21.15.153:0/1389898806 learned_addr learned my addr 172.21.15.153:0/1389898806 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.786+0000 7fd61a000640 1 --2- 172.21.15.153:0/1389898806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd61c0acd80 0x7fd61c154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.786+0000 7fd61aa00640 1 -- 172.21.15.153:0/1389898806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd61c0acd80 msgr2=0x7fd61c154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.786+0000 7fd61aa00640 1 --2- 172.21.15.153:0/1389898806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd61c0acd80 0x7fd61c154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.786+0000 7fd61aa00640 1 -- 172.21.15.153:0/1389898806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd61c0cef30 msgr2=0x7fd61c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.786+0000 7fd61aa00640 1 --2- 172.21.15.153:0/1389898806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd61c0cef30 0x7fd61c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.786+0000 7fd61aa00640 1 -- 172.21.15.153:0/1389898806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61c15d140 con 0x7fd61c0728c0 2024-03-28T21:53:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.786+0000 7fd61aa00640 1 --2- 172.21.15.153:0/1389898806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd61c0728c0 0x7fd61c09b650 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00c460 tx=0x7fd60c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:05.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.787+0000 7fd612a00640 1 -- 172.21.15.153:0/1389898806 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c018070 con 0x7fd61c0728c0 2024-03-28T21:53:05.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.787+0000 7fd612a00640 1 -- 172.21.15.153:0/1389898806 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60c007500 con 0x7fd61c0728c0 2024-03-28T21:53:05.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.787+0000 7fd621600640 1 -- 172.21.15.153:0/1389898806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61c15d3e0 con 0x7fd61c0728c0 2024-03-28T21:53:05.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.787+0000 7fd612a00640 1 -- 172.21.15.153:0/1389898806 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c004a20 con 0x7fd61c0728c0 2024-03-28T21:53:05.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.787+0000 7fd621600640 1 -- 172.21.15.153:0/1389898806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd61c15d9a0 con 0x7fd61c0728c0 2024-03-28T21:53:05.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.788+0000 7fd621600640 1 -- 172.21.15.153:0/1389898806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd61c068ff0 con 0x7fd61c0728c0 2024-03-28T21:53:05.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.789+0000 7fd612a00640 1 -- 172.21.15.153:0/1389898806 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fd60c01b070 con 0x7fd61c0728c0 2024-03-28T21:53:05.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.790+0000 7fd612a00640 1 --2- 172.21.15.153:0/1389898806 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd5fc06b4d0 0x7fd5fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:05.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.790+0000 7fd612a00640 1 -- 172.21.15.153:0/1389898806 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fd60c089220 con 0x7fd61c0728c0 2024-03-28T21:53:05.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.790+0000 7fd61a000640 1 --2- 172.21.15.153:0/1389898806 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd5fc06b4d0 0x7fd5fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:05.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.791+0000 7fd61a000640 1 --2- 172.21.15.153:0/1389898806 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd5fc06b4d0 0x7fd5fc06d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd608036000 tx=0x7fd608008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:05.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.794+0000 7fd612a00640 1 -- 172.21.15.153:0/1389898806 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd60c058350 con 0x7fd61c0728c0 2024-03-28T21:53:05.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.989+0000 7fd621600640 1 -- 172.21.15.153:0/1389898806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd61c15bbd0 con 0x7fd61c0728c0 2024-03-28T21:53:05.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.990+0000 7fd612a00640 1 -- 172.21.15.153:0/1389898806 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) ==== 93+0+10 (secure 0 0 0) 0x7fd60c087e20 con 0x7fd61c0728c0 2024-03-28T21:53:05.992 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-28T21:53:05.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.993+0000 7fd621600640 1 -- 172.21.15.153:0/1389898806 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd5fc06b4d0 msgr2=0x7fd5fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:05.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.993+0000 7fd621600640 1 --2- 172.21.15.153:0/1389898806 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd5fc06b4d0 0x7fd5fc06d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd608036000 tx=0x7fd608008030 comp rx=0 tx=0).stop 2024-03-28T21:53:05.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.993+0000 7fd621600640 1 -- 172.21.15.153:0/1389898806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd61c0728c0 msgr2=0x7fd61c09b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:05.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.993+0000 7fd621600640 1 --2- 172.21.15.153:0/1389898806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd61c0728c0 0x7fd61c09b650 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00c460 tx=0x7fd60c00c920 comp rx=0 tx=0).stop 2024-03-28T21:53:05.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.993+0000 7fd621600640 1 -- 172.21.15.153:0/1389898806 shutdown_connections 2024-03-28T21:53:05.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.993+0000 7fd621600640 1 --2- 172.21.15.153:0/1389898806 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fd5fc06b4d0 0x7fd5fc06d990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.993+0000 7fd621600640 1 --2- 172.21.15.153:0/1389898806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd61c0cef30 0x7fd61c09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.993+0000 7fd621600640 1 --2- 172.21.15.153:0/1389898806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd61c0acd80 0x7fd61c154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.993+0000 7fd621600640 1 --2- 172.21.15.153:0/1389898806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd61c0728c0 0x7fd61c09b650 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:05.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.993+0000 7fd621600640 1 -- 172.21.15.153:0/1389898806 >> 172.21.15.153:0/1389898806 conn(0x7fd61c0b19a0 msgr2=0x7fd61c0af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:05.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.993+0000 7fd621600640 1 -- 172.21.15.153:0/1389898806 shutdown_connections 2024-03-28T21:53:05.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:05.993+0000 7fd621600640 1 -- 172.21.15.153:0/1389898806 wait complete. 2024-03-28T21:53:06.014 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-28T21:53:06.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.224+0000 7f383fa00640 1 Processor -- start 2024-03-28T21:53:06.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.224+0000 7f383fa00640 1 -- start start 2024-03-28T21:53:06.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.225+0000 7f383fa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f38380ae8e0 0x7f38380b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.225+0000 7f383fa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38380b4480 0x7f383815ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.225+0000 7f383fa00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f383815ea70 con 0x7f383815ade0 2024-03-28T21:53:06.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.226+0000 7f383fa00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f38380aee50 con 0x7f38380ae8e0 2024-03-28T21:53:06.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.226+0000 7f383fa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f38380af130 con 0x7f38380b4480 2024-03-28T21:53:06.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.226+0000 7f382fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f38380ae8e0 0x7f38380b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:06.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.226+0000 7f383da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38380b4480 0x7f383815ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:06.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.226+0000 7f382fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f38380ae8e0 0x7f38380b3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:36462/0 (socket says 172.21.15.153:36462) 2024-03-28T21:53:06.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.226+0000 7f383d000640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f383815ade0 0x7f38380acd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:33046/0 (socket says 172.21.15.153:33046) 2024-03-28T21:53:06.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.226+0000 7f382fe00640 1 -- 172.21.15.153:0/4234094395 learned_addr learned my addr 172.21.15.153:0/4234094395 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:06.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.227+0000 7f382fe00640 1 -- 172.21.15.153:0/4234094395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38380b4480 msgr2=0x7f383815ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.227+0000 7f382fe00640 1 --2- 172.21.15.153:0/4234094395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38380b4480 0x7f383815ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.227+0000 7f382fe00640 1 -- 172.21.15.153:0/4234094395 >> v1:172.21.15.165:6789/0 conn(0x7f383815ade0 legacy=0x7f38380acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.227+0000 7f382fe00640 1 -- 172.21.15.153:0/4234094395 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38380af410 con 0x7f38380ae8e0 2024-03-28T21:53:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.228+0000 7f382fe00640 1 --2- 172.21.15.153:0/4234094395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38380ae8e0 0x7f38380b3f40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3820009870 tx=0x7f382002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d30c0f51ad568b07 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:06.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.229+0000 7f3837e00640 1 -- 172.21.15.153:0/4234094395 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820034070 con 0x7f38380ae8e0 2024-03-28T21:53:06.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.229+0000 7f3837e00640 1 -- 172.21.15.153:0/4234094395 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3820030840 con 0x7f38380ae8e0 2024-03-28T21:53:06.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.229+0000 7f3837e00640 1 -- 172.21.15.153:0/4234094395 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820030c10 con 0x7f38380ae8e0 2024-03-28T21:53:06.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.229+0000 7f383fa00640 1 -- 172.21.15.153:0/4234094395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38380ae8e0 msgr2=0x7f38380b3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:06.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.229+0000 7f383fa00640 1 --2- 172.21.15.153:0/4234094395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38380ae8e0 0x7f38380b3f40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3820009870 tx=0x7f382002b980 comp rx=0 tx=0).stop 2024-03-28T21:53:06.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.230+0000 7f383fa00640 1 -- 172.21.15.153:0/4234094395 shutdown_connections 2024-03-28T21:53:06.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.230+0000 7f383fa00640 1 --2- 172.21.15.153:0/4234094395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38380b4480 0x7f383815ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.230+0000 7f383fa00640 1 --2- 172.21.15.153:0/4234094395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38380ae8e0 0x7f38380b3f40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.230+0000 7f383fa00640 1 -- 172.21.15.153:0/4234094395 >> 172.21.15.153:0/4234094395 conn(0x7f38380b1a30 msgr2=0x7f38380b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:06.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.230+0000 7f383fa00640 1 -- 172.21.15.153:0/4234094395 shutdown_connections 2024-03-28T21:53:06.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.230+0000 7f383fa00640 1 -- 172.21.15.153:0/4234094395 wait complete. 2024-03-28T21:53:06.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.232+0000 7f383fa00640 1 Processor -- start 2024-03-28T21:53:06.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.232+0000 7f383fa00640 1 -- start start 2024-03-28T21:53:06.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.233+0000 7f383fa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38380ae8e0 0x7f3838144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.233+0000 7f383fa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38380b4480 0x7f383809c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.233+0000 7f383fa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f383815ade0 0x7f38381e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.233+0000 7f383fa00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f383815b1c0 con 0x7f38380b4480 2024-03-28T21:53:06.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.233+0000 7f383fa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f383815f460 con 0x7f38380ae8e0 2024-03-28T21:53:06.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.233+0000 7f383fa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f383809dd80 con 0x7f383815ade0 2024-03-28T21:53:06.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.233+0000 7f382fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38380b4480 0x7f383809c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:06.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.233+0000 7f382fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38380b4480 0x7f383809c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46724/0 (socket says 172.21.15.153:46724) 2024-03-28T21:53:06.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.233+0000 7f382fe00640 1 -- 172.21.15.153:0/2682039644 learned_addr learned my addr 172.21.15.153:0/2682039644 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:06.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.234+0000 7f383d000640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38380ae8e0 0x7f3838144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.234+0000 7f383da00640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f383815ade0 0x7f38381e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.234+0000 7f382fe00640 1 -- 172.21.15.153:0/2682039644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f383815ade0 msgr2=0x7f38381e4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.234+0000 7f382fe00640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f383815ade0 0x7f38381e4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.234+0000 7f382fe00640 1 -- 172.21.15.153:0/2682039644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38380ae8e0 msgr2=0x7f3838144af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.234+0000 7f382fe00640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38380ae8e0 0x7f3838144af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.234+0000 7f382fe00640 1 -- 172.21.15.153:0/2682039644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383809cce0 con 0x7f38380b4480 2024-03-28T21:53:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.234+0000 7f383d000640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38380ae8e0 0x7f3838144af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.234+0000 7f382fe00640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38380b4480 0x7f383809c260 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3820000c00 tx=0x7f3820004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.234+0000 7f3835600640 1 -- 172.21.15.153:0/2682039644 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820048070 con 0x7f38380b4480 2024-03-28T21:53:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.235+0000 7f3835600640 1 -- 172.21.15.153:0/2682039644 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3820030640 con 0x7f38380b4480 2024-03-28T21:53:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.235+0000 7f383fa00640 1 -- 172.21.15.153:0/2682039644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f383809cfc0 con 0x7f38380b4480 2024-03-28T21:53:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.235+0000 7f3835600640 1 -- 172.21.15.153:0/2682039644 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820034040 con 0x7f38380b4480 2024-03-28T21:53:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.235+0000 7f383fa00640 1 -- 172.21.15.153:0/2682039644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f383809d580 con 0x7f38380b4480 2024-03-28T21:53:06.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.236+0000 7f383fa00640 1 -- 172.21.15.153:0/2682039644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3838143140 con 0x7f38380b4480 2024-03-28T21:53:06.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.237+0000 7f3835600640 1 -- 172.21.15.153:0/2682039644 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f382004b070 con 0x7f38380b4480 2024-03-28T21:53:06.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.238+0000 7f3835600640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f381406b4d0 0x7f381406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.238+0000 7f3835600640 1 -- 172.21.15.153:0/2682039644 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f38200abe00 con 0x7f38380b4480 2024-03-28T21:53:06.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.238+0000 7f383d000640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f381406b4d0 0x7f381406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:06.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.239+0000 7f383d000640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f381406b4d0 0x7f381406d990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3828000f60 tx=0x7f3828009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:06.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.243+0000 7f3835600640 1 -- 172.21.15.153:0/2682039644 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f382007b050 con 0x7f38380b4480 2024-03-28T21:53:06.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.440+0000 7f383fa00640 1 -- 172.21.15.153:0/2682039644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3838068ff0 con 0x7f38380b4480 2024-03-28T21:53:06.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.441+0000 7f3835600640 1 -- 172.21.15.153:0/2682039644 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) ==== 84+0+65 (secure 0 0 0) 0x7f3820030810 con 0x7f38380b4480 2024-03-28T21:53:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:06.443 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2024-03-28T21:53:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-03-28T21:53:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2024-03-28T21:53:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": ".mgr" 2024-03-28T21:53:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-28T21:53:06.443 INFO:teuthology.orchestra.run.smithi153.stdout:] 2024-03-28T21:53:06.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.444+0000 7f383fa00640 1 -- 172.21.15.153:0/2682039644 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f381406b4d0 msgr2=0x7f381406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.444+0000 7f383fa00640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f381406b4d0 0x7f381406d990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3828000f60 tx=0x7f3828009040 comp rx=0 tx=0).stop 2024-03-28T21:53:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.444+0000 7f383fa00640 1 -- 172.21.15.153:0/2682039644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38380b4480 msgr2=0x7f383809c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.444+0000 7f383fa00640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38380b4480 0x7f383809c260 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3820000c00 tx=0x7f3820004730 comp rx=0 tx=0).stop 2024-03-28T21:53:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.444+0000 7f383fa00640 1 -- 172.21.15.153:0/2682039644 shutdown_connections 2024-03-28T21:53:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.444+0000 7f383fa00640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f381406b4d0 0x7f381406d990 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.444+0000 7f383fa00640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f383815ade0 0x7f38381e4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.444+0000 7f383fa00640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38380b4480 0x7f383809c260 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.444+0000 7f383fa00640 1 --2- 172.21.15.153:0/2682039644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38380ae8e0 0x7f3838144af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.444+0000 7f383fa00640 1 -- 172.21.15.153:0/2682039644 >> 172.21.15.153:0/2682039644 conn(0x7f38380b1a30 msgr2=0x7f38380b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.444+0000 7f383fa00640 1 -- 172.21.15.153:0/2682039644 shutdown_connections 2024-03-28T21:53:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.444+0000 7f383fa00640 1 -- 172.21.15.153:0/2682039644 wait complete. 2024-03-28T21:53:06.466 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-28T21:53:06.466 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-28T21:53:06.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.682+0000 7f8e79a00640 1 Processor -- start 2024-03-28T21:53:06.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.682+0000 7f8e79a00640 1 -- start start 2024-03-28T21:53:06.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.683+0000 7f8e79a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8e7415e380 0x7f8e740d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.683+0000 7f8e79a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e740d2980 0x7f8e740d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.683+0000 7f8e79a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e740cf090 con 0x7f8e740b3a60 2024-03-28T21:53:06.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.683+0000 7f8e79a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8e740cfca0 con 0x7f8e7415e380 2024-03-28T21:53:06.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.683+0000 7f8e79a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8e740cf370 con 0x7f8e740d2980 2024-03-28T21:53:06.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.684+0000 7f8e73400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8e740b3a60 0x7f8e740b3ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40310/0 (socket says 172.21.15.153:40310) 2024-03-28T21:53:06.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.684+0000 7f8e73400640 1 -- 172.21.15.153:0/2517657637 learned_addr learned my addr 172.21.15.153:0/2517657637 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:06.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.684+0000 7f8e72000640 1 --2- 172.21.15.153:0/2517657637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e740d2980 0x7f8e740d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:06.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.684+0000 7f8e72a00640 1 --2- 172.21.15.153:0/2517657637 >> v2:172.21.15.165:3300/0 conn(0x7f8e7415e380 0x7f8e740d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:06.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.684+0000 7f8e71600640 1 -- 172.21.15.153:0/2517657637 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3938315815 0 0) 0x7f8e740cf090 con 0x7f8e740b3a60 2024-03-28T21:53:06.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.684+0000 7f8e71600640 1 -- 172.21.15.153:0/2517657637 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e58003520 con 0x7f8e740b3a60 2024-03-28T21:53:06.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.684+0000 7f8e71600640 1 -- 172.21.15.153:0/2517657637 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 832049099 0 0) 0x7f8e58003520 con 0x7f8e740b3a60 2024-03-28T21:53:06.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.684+0000 7f8e71600640 1 -- 172.21.15.153:0/2517657637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e740d2980 msgr2=0x7f8e740d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:06.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.684+0000 7f8e71600640 1 --2- 172.21.15.153:0/2517657637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e740d2980 0x7f8e740d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e71600640 1 -- 172.21.15.153:0/2517657637 >> v2:172.21.15.165:3300/0 conn(0x7f8e7415e380 msgr2=0x7f8e740d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e71600640 1 --2- 172.21.15.153:0/2517657637 >> v2:172.21.15.165:3300/0 conn(0x7f8e7415e380 0x7f8e740d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e71600640 1 -- 172.21.15.153:0/2517657637 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e740cf650 con 0x7f8e740b3a60 2024-03-28T21:53:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e71600640 1 -- 172.21.15.153:0/2517657637 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f8e6c0019f0 con 0x7f8e740b3a60 2024-03-28T21:53:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e71600640 1 -- 172.21.15.153:0/2517657637 >> v1:172.21.15.153:6789/0 conn(0x7f8e740b3a60 legacy=0x7f8e740b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e71600640 1 --2- 172.21.15.153:0/2517657637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e580039b0 0x7f8e58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e71600640 1 --2- 172.21.15.153:0/2517657637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e58004800 0x7f8e58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e71600640 1 --2- 172.21.15.153:0/2517657637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e740d2980 0x7f8e580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e71600640 1 -- 172.21.15.153:0/2517657637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e740cfca0 con 0x7f8e580039b0 2024-03-28T21:53:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e71600640 1 -- 172.21.15.153:0/2517657637 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8e740cf370 con 0x7f8e58004800 2024-03-28T21:53:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e71600640 1 -- 172.21.15.153:0/2517657637 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5800b9c0 con 0x7f8e740d2980 2024-03-28T21:53:06.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e72a00640 1 --2- 172.21.15.153:0/2517657637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e580039b0 0x7f8e58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:06.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e73400640 1 --2- 172.21.15.153:0/2517657637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e740d2980 0x7f8e580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:06.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e72a00640 1 -- 172.21.15.153:0/2517657637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e740d2980 msgr2=0x7f8e580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:06.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e72a00640 1 --2- 172.21.15.153:0/2517657637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e740d2980 0x7f8e580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e72a00640 1 -- 172.21.15.153:0/2517657637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e58004800 msgr2=0x7f8e58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:06.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e72a00640 1 --2- 172.21.15.153:0/2517657637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e58004800 0x7f8e58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.685+0000 7f8e72a00640 1 -- 172.21.15.153:0/2517657637 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e58003520 con 0x7f8e580039b0 2024-03-28T21:53:06.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.687+0000 7f8e72a00640 1 --2- 172.21.15.153:0/2517657637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e580039b0 0x7f8e58003dd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009ac0 tx=0x7f8e58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc32d9feec44558a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:06.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.687+0000 7f8e71600640 1 -- 172.21.15.153:0/2517657637 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64039070 con 0x7f8e580039b0 2024-03-28T21:53:06.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.687+0000 7f8e71600640 1 -- 172.21.15.153:0/2517657637 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e6402c710 con 0x7f8e580039b0 2024-03-28T21:53:06.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.687+0000 7f8e71600640 1 -- 172.21.15.153:0/2517657637 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64009690 con 0x7f8e580039b0 2024-03-28T21:53:06.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.688+0000 7f8e79a00640 1 -- 172.21.15.153:0/2517657637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e580039b0 msgr2=0x7f8e58003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:06.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.688+0000 7f8e79a00640 1 --2- 172.21.15.153:0/2517657637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e580039b0 0x7f8e58003dd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009ac0 tx=0x7f8e58005830 comp rx=0 tx=0).stop 2024-03-28T21:53:06.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.688+0000 7f8e73400640 1 -- 172.21.15.153:0/2517657637 reap_dead start 2024-03-28T21:53:06.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.688+0000 7f8e79a00640 1 -- 172.21.15.153:0/2517657637 shutdown_connections 2024-03-28T21:53:06.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.688+0000 7f8e79a00640 1 -- 172.21.15.153:0/2517657637 >> 172.21.15.153:0/2517657637 conn(0x7f8e7408bfe0 msgr2=0x7f8e7409d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:06.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.688+0000 7f8e79a00640 1 -- 172.21.15.153:0/2517657637 shutdown_connections 2024-03-28T21:53:06.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.688+0000 7f8e79a00640 1 -- 172.21.15.153:0/2517657637 wait complete. 2024-03-28T21:53:06.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.690+0000 7f8e79a00640 1 Processor -- start 2024-03-28T21:53:06.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.690+0000 7f8e79a00640 1 -- start start 2024-03-28T21:53:06.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.691+0000 7f8e79a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e580039b0 0x7f8e741f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.691+0000 7f8e79a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e740cc7d0 0x7f8e740cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.691+0000 7f8e79a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e7415b330 0x7f8e7415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.691+0000 7f8e79a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7415e760 con 0x7f8e740cc7d0 2024-03-28T21:53:06.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.691+0000 7f8e79a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8e740cecd0 con 0x7f8e580039b0 2024-03-28T21:53:06.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.691+0000 7f8e79a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8e741549b0 con 0x7f8e7415b330 2024-03-28T21:53:06.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.691+0000 7f8e72000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e740cc7d0 0x7f8e740cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:06.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.691+0000 7f8e72000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e740cc7d0 0x7f8e740cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46736/0 (socket says 172.21.15.153:46736) 2024-03-28T21:53:06.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.691+0000 7f8e72000640 1 -- 172.21.15.153:0/1439914561 learned_addr learned my addr 172.21.15.153:0/1439914561 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:06.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.691+0000 7f8e72000640 1 -- 172.21.15.153:0/1439914561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e7415b330 msgr2=0x7f8e7415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:06.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.691+0000 7f8e72000640 1 --2- 172.21.15.153:0/1439914561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e7415b330 0x7f8e7415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.691+0000 7f8e72000640 1 -- 172.21.15.153:0/1439914561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e580039b0 msgr2=0x7f8e741f70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:06.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.691+0000 7f8e72000640 1 --2- 172.21.15.153:0/1439914561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e580039b0 0x7f8e741f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:06.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.691+0000 7f8e72000640 1 -- 172.21.15.153:0/1439914561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e741551c0 con 0x7f8e740cc7d0 2024-03-28T21:53:06.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.692+0000 7f8e72000640 1 --2- 172.21.15.153:0/1439914561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e740cc7d0 0x7f8e740cd780 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000e7a0 tx=0x7f8e6000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:06.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.692+0000 7f8e6aa00640 1 -- 172.21.15.153:0/1439914561 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60017070 con 0x7f8e740cc7d0 2024-03-28T21:53:06.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.692+0000 7f8e6aa00640 1 -- 172.21.15.153:0/1439914561 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e6000c940 con 0x7f8e740cc7d0 2024-03-28T21:53:06.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.692+0000 7f8e79a00640 1 -- 172.21.15.153:0/1439914561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e741f7600 con 0x7f8e740cc7d0 2024-03-28T21:53:06.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.692+0000 7f8e6aa00640 1 -- 172.21.15.153:0/1439914561 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000cd10 con 0x7f8e740cc7d0 2024-03-28T21:53:06.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.692+0000 7f8e79a00640 1 -- 172.21.15.153:0/1439914561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e74154c00 con 0x7f8e740cc7d0 2024-03-28T21:53:06.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.693+0000 7f8e79a00640 1 -- 172.21.15.153:0/1439914561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e740690d0 con 0x7f8e740cc7d0 2024-03-28T21:53:06.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.694+0000 7f8e6aa00640 1 -- 172.21.15.153:0/1439914561 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f8e6001a070 con 0x7f8e740cc7d0 2024-03-28T21:53:06.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.695+0000 7f8e6aa00640 1 --2- 172.21.15.153:0/1439914561 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8e5406b4d0 0x7f8e5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:06.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.695+0000 7f8e6aa00640 1 -- 172.21.15.153:0/1439914561 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f8e60089de0 con 0x7f8e740cc7d0 2024-03-28T21:53:06.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.696+0000 7f8e72a00640 1 --2- 172.21.15.153:0/1439914561 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8e5406b4d0 0x7f8e5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:06.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.696+0000 7f8e72a00640 1 --2- 172.21.15.153:0/1439914561 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8e5406b4d0 0x7f8e5406d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8e64036000 tx=0x7f8e6402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:06.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.700+0000 7f8e6aa00640 1 -- 172.21.15.153:0/1439914561 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8e60058fa0 con 0x7f8e740cc7d0 2024-03-28T21:53:06.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:06.895+0000 7f8e79a00640 1 -- 172.21.15.153:0/1439914561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8e740d4fb0 con 0x7f8e740cc7d0 2024-03-28T21:53:07.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.558+0000 7f8e6aa00640 1 -- 172.21.15.153:0/1439914561 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) ==== 138+0+0 (secure 0 0 0) 0x7f8e600588a0 con 0x7f8e740cc7d0 2024-03-28T21:53:07.560 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2024-03-28T21:53:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.562+0000 7f8e79a00640 1 -- 172.21.15.153:0/1439914561 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8e5406b4d0 msgr2=0x7f8e5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.562+0000 7f8e79a00640 1 --2- 172.21.15.153:0/1439914561 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8e5406b4d0 0x7f8e5406d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8e64036000 tx=0x7f8e6402e000 comp rx=0 tx=0).stop 2024-03-28T21:53:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.562+0000 7f8e79a00640 1 -- 172.21.15.153:0/1439914561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e740cc7d0 msgr2=0x7f8e740cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.562+0000 7f8e79a00640 1 --2- 172.21.15.153:0/1439914561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e740cc7d0 0x7f8e740cd780 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000e7a0 tx=0x7f8e6000ec60 comp rx=0 tx=0).stop 2024-03-28T21:53:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.562+0000 7f8e79a00640 1 -- 172.21.15.153:0/1439914561 shutdown_connections 2024-03-28T21:53:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.562+0000 7f8e79a00640 1 --2- 172.21.15.153:0/1439914561 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8e5406b4d0 0x7f8e5406d990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.562+0000 7f8e79a00640 1 --2- 172.21.15.153:0/1439914561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e7415b330 0x7f8e7415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.562+0000 7f8e79a00640 1 --2- 172.21.15.153:0/1439914561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e740cc7d0 0x7f8e740cd780 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.562+0000 7f8e79a00640 1 --2- 172.21.15.153:0/1439914561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e580039b0 0x7f8e741f70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:07.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.562+0000 7f8e79a00640 1 -- 172.21.15.153:0/1439914561 >> 172.21.15.153:0/1439914561 conn(0x7f8e7408bfe0 msgr2=0x7f8e7406bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:07.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.563+0000 7f8e79a00640 1 -- 172.21.15.153:0/1439914561 shutdown_connections 2024-03-28T21:53:07.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.563+0000 7f8e79a00640 1 -- 172.21.15.153:0/1439914561 wait complete. 2024-03-28T21:53:07.590 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-28T21:53:07.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.787+0000 7f6f5bc00640 1 Processor -- start 2024-03-28T21:53:07.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.787+0000 7f6f5bc00640 1 -- start start 2024-03-28T21:53:07.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.789+0000 7f6f5bc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6f540cef30 0x7f6f54071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:07.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.789+0000 7f6f5bc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6f540acd80 0x7f6f540cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:07.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.789+0000 7f6f5bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f540728c0 0x7f6f5406cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:07.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.789+0000 7f6f5bc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6f540cf850 con 0x7f6f540cef30 2024-03-28T21:53:07.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.789+0000 7f6f5bc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6f54070f20 con 0x7f6f540acd80 2024-03-28T21:53:07.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.789+0000 7f6f5bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6f54071200 con 0x7f6f540728c0 2024-03-28T21:53:07.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.789+0000 7f6f59200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6f540cef30 0x7f6f54071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:07.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.789+0000 7f6f59200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6f540cef30 0x7f6f54071ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46742/0 (socket says 172.21.15.153:46742) 2024-03-28T21:53:07.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.789+0000 7f6f59200640 1 -- 172.21.15.153:0/123578013 learned_addr learned my addr 172.21.15.153:0/123578013 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:07.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.790+0000 7f6f53e00640 1 --2- 172.21.15.153:0/123578013 >> v2:172.21.15.165:3300/0 conn(0x7f6f540acd80 0x7f6f540cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:07.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.790+0000 7f6f59c00640 1 --2- 172.21.15.153:0/123578013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f540728c0 0x7f6f5406cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:07.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.790+0000 7f6f59200640 1 -- 172.21.15.153:0/123578013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f540728c0 msgr2=0x7f6f5406cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:07.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.790+0000 7f6f59200640 1 --2- 172.21.15.153:0/123578013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f540728c0 0x7f6f5406cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:07.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.790+0000 7f6f59200640 1 -- 172.21.15.153:0/123578013 >> v2:172.21.15.165:3300/0 conn(0x7f6f540acd80 msgr2=0x7f6f540cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:07.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.790+0000 7f6f59200640 1 --2- 172.21.15.153:0/123578013 >> v2:172.21.15.165:3300/0 conn(0x7f6f540acd80 0x7f6f540cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:07.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.790+0000 7f6f59200640 1 -- 172.21.15.153:0/123578013 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f540714e0 con 0x7f6f540cef30 2024-03-28T21:53:07.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.790+0000 7f6f59c00640 1 --2- 172.21.15.153:0/123578013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f540728c0 0x7f6f5406cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:07.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.791+0000 7f6f59200640 1 --2- 172.21.15.153:0/123578013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f540cef30 0x7f6f54071ce0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6f5406f820 tx=0x7f6f4402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92224cffcb53a371 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:07.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.791+0000 7f6f53400640 1 -- 172.21.15.153:0/123578013 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44035020 con 0x7f6f540cef30 2024-03-28T21:53:07.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.791+0000 7f6f53400640 1 -- 172.21.15.153:0/123578013 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f44031870 con 0x7f6f540cef30 2024-03-28T21:53:07.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.791+0000 7f6f53400640 1 -- 172.21.15.153:0/123578013 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44031c40 con 0x7f6f540cef30 2024-03-28T21:53:07.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.792+0000 7f6f5bc00640 1 -- 172.21.15.153:0/123578013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f540cef30 msgr2=0x7f6f54071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:07.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.792+0000 7f6f5bc00640 1 --2- 172.21.15.153:0/123578013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f540cef30 0x7f6f54071ce0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6f5406f820 tx=0x7f6f4402b910 comp rx=0 tx=0).stop 2024-03-28T21:53:07.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.792+0000 7f6f5bc00640 1 -- 172.21.15.153:0/123578013 shutdown_connections 2024-03-28T21:53:07.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.792+0000 7f6f5bc00640 1 --2- 172.21.15.153:0/123578013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f540728c0 0x7f6f5406cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:07.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.792+0000 7f6f5bc00640 1 --2- 172.21.15.153:0/123578013 >> v2:172.21.15.165:3300/0 conn(0x7f6f540acd80 0x7f6f540cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:07.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.792+0000 7f6f5bc00640 1 --2- 172.21.15.153:0/123578013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f540cef30 0x7f6f54071ce0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:07.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.792+0000 7f6f5bc00640 1 -- 172.21.15.153:0/123578013 >> 172.21.15.153:0/123578013 conn(0x7f6f540b19a0 msgr2=0x7f6f540b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:07.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.792+0000 7f6f5bc00640 1 -- 172.21.15.153:0/123578013 shutdown_connections 2024-03-28T21:53:07.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.792+0000 7f6f5bc00640 1 -- 172.21.15.153:0/123578013 wait complete. 2024-03-28T21:53:07.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.794+0000 7f6f5bc00640 1 Processor -- start 2024-03-28T21:53:07.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.794+0000 7f6f5bc00640 1 -- start start 2024-03-28T21:53:07.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.795+0000 7f6f5bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f540728c0 0x7f6f540ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:07.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.795+0000 7f6f5bc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f540acd80 0x7f6f540cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:07.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.795+0000 7f6f5bc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f540cef30 0x7f6f540cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:07.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.795+0000 7f6f5bc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6f54072ed0 con 0x7f6f540acd80 2024-03-28T21:53:07.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.795+0000 7f6f5bc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6f54072d50 con 0x7f6f540cef30 2024-03-28T21:53:07.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.795+0000 7f6f5bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5415c1f0 con 0x7f6f540728c0 2024-03-28T21:53:07.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.795+0000 7f6f53e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f540acd80 0x7f6f540cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:07.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.795+0000 7f6f53e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f540acd80 0x7f6f540cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46750/0 (socket says 172.21.15.153:46750) 2024-03-28T21:53:07.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.795+0000 7f6f53e00640 1 -- 172.21.15.153:0/3282727490 learned_addr learned my addr 172.21.15.153:0/3282727490 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:07.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.796+0000 7f6f59200640 1 --2- 172.21.15.153:0/3282727490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f540728c0 0x7f6f540ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:07.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.796+0000 7f6f53e00640 1 -- 172.21.15.153:0/3282727490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f540728c0 msgr2=0x7f6f540ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:07.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.796+0000 7f6f53e00640 1 --2- 172.21.15.153:0/3282727490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f540728c0 0x7f6f540ce170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:07.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.796+0000 7f6f53e00640 1 -- 172.21.15.153:0/3282727490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f540cef30 msgr2=0x7f6f540cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:07.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.796+0000 7f6f53e00640 1 --2- 172.21.15.153:0/3282727490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f540cef30 0x7f6f540cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:07.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.796+0000 7f6f53e00640 1 -- 172.21.15.153:0/3282727490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f541f4a40 con 0x7f6f540acd80 2024-03-28T21:53:07.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.796+0000 7f6f53e00640 1 --2- 172.21.15.153:0/3282727490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f540acd80 0x7f6f540cb900 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00d800 tx=0x7f6f3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:07.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.796+0000 7f6f50c00640 1 -- 172.21.15.153:0/3282727490 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c00b6c0 con 0x7f6f540acd80 2024-03-28T21:53:07.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.796+0000 7f6f50c00640 1 -- 172.21.15.153:0/3282727490 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3c019070 con 0x7f6f540acd80 2024-03-28T21:53:07.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.796+0000 7f6f5bc00640 1 -- 172.21.15.153:0/3282727490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f5414f3a0 con 0x7f6f540acd80 2024-03-28T21:53:07.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.796+0000 7f6f50c00640 1 -- 172.21.15.153:0/3282727490 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c00ba80 con 0x7f6f540acd80 2024-03-28T21:53:07.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.796+0000 7f6f5bc00640 1 -- 172.21.15.153:0/3282727490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f5414f960 con 0x7f6f540acd80 2024-03-28T21:53:07.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.797+0000 7f6f5bc00640 1 -- 172.21.15.153:0/3282727490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f54068ff0 con 0x7f6f540acd80 2024-03-28T21:53:07.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.798+0000 7f6f50c00640 1 -- 172.21.15.153:0/3282727490 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f6f3c00bc20 con 0x7f6f540acd80 2024-03-28T21:53:07.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.799+0000 7f6f50c00640 1 --2- 172.21.15.153:0/3282727490 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6f3006b4d0 0x7f6f3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:07.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.799+0000 7f6f50c00640 1 -- 172.21.15.153:0/3282727490 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5227+0+0 (secure 0 0 0) 0x7f6f3c08a450 con 0x7f6f540acd80 2024-03-28T21:53:07.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.800+0000 7f6f59200640 1 --2- 172.21.15.153:0/3282727490 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6f3006b4d0 0x7f6f3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:07.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.800+0000 7f6f59200640 1 --2- 172.21.15.153:0/3282727490 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6f3006b4d0 0x7f6f3006d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6f44036000 tx=0x7f6f44008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:07.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:07.805+0000 7f6f50c00640 1 -- 172.21.15.153:0/3282727490 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6f3c0594a0 con 0x7f6f540acd80 2024-03-28T21:53:08.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.000+0000 7f6f5bc00640 1 -- 172.21.15.153:0/3282727490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6f540b04a0 con 0x7f6f540acd80 2024-03-28T21:53:08.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.565+0000 7f6f50c00640 1 -- 172.21.15.153:0/3282727490 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) ==== 170+0+0 (secure 0 0 0) 0x7f6f3c058da0 con 0x7f6f540acd80 2024-03-28T21:53:08.567 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2024-03-28T21:53:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.569+0000 7f6f5bc00640 1 -- 172.21.15.153:0/3282727490 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6f3006b4d0 msgr2=0x7f6f3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.569+0000 7f6f5bc00640 1 --2- 172.21.15.153:0/3282727490 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6f3006b4d0 0x7f6f3006d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6f44036000 tx=0x7f6f44008030 comp rx=0 tx=0).stop 2024-03-28T21:53:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.569+0000 7f6f5bc00640 1 -- 172.21.15.153:0/3282727490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f540acd80 msgr2=0x7f6f540cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.569+0000 7f6f5bc00640 1 --2- 172.21.15.153:0/3282727490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f540acd80 0x7f6f540cb900 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00d800 tx=0x7f6f3c00dcc0 comp rx=0 tx=0).stop 2024-03-28T21:53:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.569+0000 7f6f5bc00640 1 -- 172.21.15.153:0/3282727490 shutdown_connections 2024-03-28T21:53:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.569+0000 7f6f5bc00640 1 --2- 172.21.15.153:0/3282727490 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6f3006b4d0 0x7f6f3006d990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.569+0000 7f6f5bc00640 1 --2- 172.21.15.153:0/3282727490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f540cef30 0x7f6f540cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.569+0000 7f6f5bc00640 1 --2- 172.21.15.153:0/3282727490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f540acd80 0x7f6f540cb900 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.569+0000 7f6f5bc00640 1 --2- 172.21.15.153:0/3282727490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f540728c0 0x7f6f540ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:08.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.569+0000 7f6f5bc00640 1 -- 172.21.15.153:0/3282727490 >> 172.21.15.153:0/3282727490 conn(0x7f6f540b19a0 msgr2=0x7f6f540b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:08.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.569+0000 7f6f5bc00640 1 -- 172.21.15.153:0/3282727490 shutdown_connections 2024-03-28T21:53:08.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.569+0000 7f6f5bc00640 1 -- 172.21.15.153:0/3282727490 wait complete. 2024-03-28T21:53:08.608 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-28T21:53:08.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.788+0000 7f4e63000640 1 Processor -- start 2024-03-28T21:53:08.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.789+0000 7f4e63000640 1 -- start start 2024-03-28T21:53:08.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.790+0000 7f4e63000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4e5c141db0 0x7f4e5c0ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:08.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.790+0000 7f4e63000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e5c0ce7e0 0x7f4e5c0712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:08.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.790+0000 7f4e63000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e5c070df0 con 0x7f4e5c13ef10 2024-03-28T21:53:08.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.790+0000 7f4e63000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4e5c13f2f0 con 0x7f4e5c141db0 2024-03-28T21:53:08.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.790+0000 7f4e63000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4e5c0cf060 con 0x7f4e5c0ce7e0 2024-03-28T21:53:08.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.790+0000 7f4e61c00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4e5c13ef10 0x7f4e5c1416a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40316/0 (socket says 172.21.15.153:40316) 2024-03-28T21:53:08.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.790+0000 7f4e61c00640 1 -- 172.21.15.153:0/3311082514 learned_addr learned my addr 172.21.15.153:0/3311082514 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:08.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.790+0000 7f4e61200640 1 --2- 172.21.15.153:0/3311082514 >> v2:172.21.15.153:3300/0 conn(0x7f4e5c141db0 0x7f4e5c0ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:08.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.791+0000 7f4e62600640 1 --2- 172.21.15.153:0/3311082514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e5c0ce7e0 0x7f4e5c0712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:08.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.791+0000 7f4e61200640 1 -- 172.21.15.153:0/3311082514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e5c0ce7e0 msgr2=0x7f4e5c0712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:08.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.791+0000 7f4e5be00640 1 -- 172.21.15.153:0/3311082514 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 128697628 0 0) 0x7f4e5c070df0 con 0x7f4e5c13ef10 2024-03-28T21:53:08.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.791+0000 7f4e61200640 1 --2- 172.21.15.153:0/3311082514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e5c0ce7e0 0x7f4e5c0712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:08.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.791+0000 7f4e61200640 1 -- 172.21.15.153:0/3311082514 >> v1:172.21.15.153:6789/0 conn(0x7f4e5c13ef10 legacy=0x7f4e5c1416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:08.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.791+0000 7f4e61200640 1 -- 172.21.15.153:0/3311082514 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5c0cf340 con 0x7f4e5c141db0 2024-03-28T21:53:08.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.792+0000 7f4e61200640 1 --2- 172.21.15.153:0/3311082514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5c141db0 0x7f4e5c0ce2a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4e480097a0 tx=0x7f4e4802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c2a6f385b5941b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:08.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.792+0000 7f4e5be00640 1 -- 172.21.15.153:0/3311082514 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48035020 con 0x7f4e5c141db0 2024-03-28T21:53:08.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.792+0000 7f4e5be00640 1 -- 172.21.15.153:0/3311082514 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e48031810 con 0x7f4e5c141db0 2024-03-28T21:53:08.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.792+0000 7f4e5be00640 1 -- 172.21.15.153:0/3311082514 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48031be0 con 0x7f4e5c141db0 2024-03-28T21:53:08.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.793+0000 7f4e63000640 1 -- 172.21.15.153:0/3311082514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5c141db0 msgr2=0x7f4e5c0ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:08.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.793+0000 7f4e63000640 1 --2- 172.21.15.153:0/3311082514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5c141db0 0x7f4e5c0ce2a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4e480097a0 tx=0x7f4e4802b8b0 comp rx=0 tx=0).stop 2024-03-28T21:53:08.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.793+0000 7f4e63000640 1 -- 172.21.15.153:0/3311082514 shutdown_connections 2024-03-28T21:53:08.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.793+0000 7f4e63000640 1 --2- 172.21.15.153:0/3311082514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e5c0ce7e0 0x7f4e5c0712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:08.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.793+0000 7f4e63000640 1 --2- 172.21.15.153:0/3311082514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5c141db0 0x7f4e5c0ce2a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:08.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.793+0000 7f4e63000640 1 -- 172.21.15.153:0/3311082514 >> 172.21.15.153:0/3311082514 conn(0x7f4e5c0b1820 msgr2=0x7f4e5c0b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:08.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.793+0000 7f4e63000640 1 -- 172.21.15.153:0/3311082514 shutdown_connections 2024-03-28T21:53:08.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.793+0000 7f4e63000640 1 -- 172.21.15.153:0/3311082514 wait complete. 2024-03-28T21:53:08.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.795+0000 7f4e63000640 1 Processor -- start 2024-03-28T21:53:08.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.795+0000 7f4e63000640 1 -- start start 2024-03-28T21:53:08.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.796+0000 7f4e63000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e5c0ce7e0 0x7f4e5c136790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:08.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.796+0000 7f4e63000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5c13ef10 0x7f4e5c137fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:08.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.796+0000 7f4e63000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e5c141db0 0x7f4e5c071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:08.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.796+0000 7f4e63000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5c0cebf0 con 0x7f4e5c13ef10 2024-03-28T21:53:08.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.796+0000 7f4e63000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5c0cf900 con 0x7f4e5c0ce7e0 2024-03-28T21:53:08.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.796+0000 7f4e63000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4e5c0ced70 con 0x7f4e5c141db0 2024-03-28T21:53:08.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.796+0000 7f4e61200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5c13ef10 0x7f4e5c137fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:08.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.796+0000 7f4e61200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5c13ef10 0x7f4e5c137fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46774/0 (socket says 172.21.15.153:46774) 2024-03-28T21:53:08.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.796+0000 7f4e61200640 1 -- 172.21.15.153:0/2358258011 learned_addr learned my addr 172.21.15.153:0/2358258011 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:08.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.796+0000 7f4e61c00640 1 --2- 172.21.15.153:0/2358258011 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e5c0ce7e0 0x7f4e5c136790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:08.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.797+0000 7f4e62600640 1 --2- 172.21.15.153:0/2358258011 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e5c141db0 0x7f4e5c071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.797+0000 7f4e61200640 1 -- 172.21.15.153:0/2358258011 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e5c141db0 msgr2=0x7f4e5c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.797+0000 7f4e61200640 1 --2- 172.21.15.153:0/2358258011 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e5c141db0 0x7f4e5c071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.797+0000 7f4e61200640 1 -- 172.21.15.153:0/2358258011 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e5c0ce7e0 msgr2=0x7f4e5c136790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.797+0000 7f4e61200640 1 --2- 172.21.15.153:0/2358258011 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e5c0ce7e0 0x7f4e5c136790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.797+0000 7f4e61200640 1 -- 172.21.15.153:0/2358258011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5c140470 con 0x7f4e5c13ef10 2024-03-28T21:53:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.797+0000 7f4e61200640 1 --2- 172.21.15.153:0/2358258011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5c13ef10 0x7f4e5c137fd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4e48000c00 tx=0x7f4e480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.797+0000 7f4e59600640 1 -- 172.21.15.153:0/2358258011 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48040070 con 0x7f4e5c13ef10 2024-03-28T21:53:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.797+0000 7f4e59600640 1 -- 172.21.15.153:0/2358258011 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e48039cf0 con 0x7f4e5c13ef10 2024-03-28T21:53:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.797+0000 7f4e59600640 1 -- 172.21.15.153:0/2358258011 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48035040 con 0x7f4e5c13ef10 2024-03-28T21:53:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.797+0000 7f4e63000640 1 -- 172.21.15.153:0/2358258011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5c140750 con 0x7f4e5c13ef10 2024-03-28T21:53:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.798+0000 7f4e63000640 1 -- 172.21.15.153:0/2358258011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e5c140d10 con 0x7f4e5c13ef10 2024-03-28T21:53:08.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.799+0000 7f4e63000640 1 -- 172.21.15.153:0/2358258011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e5c068ff0 con 0x7f4e5c13ef10 2024-03-28T21:53:08.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.800+0000 7f4e59600640 1 -- 172.21.15.153:0/2358258011 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f4e4804b060 con 0x7f4e5c13ef10 2024-03-28T21:53:08.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.802+0000 7f4e59600640 1 --2- 172.21.15.153:0/2358258011 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4e3c06b4d0 0x7f4e3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:08.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.802+0000 7f4e59600640 1 -- 172.21.15.153:0/2358258011 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5609+0+0 (secure 0 0 0) 0x7f4e480ac1a0 con 0x7f4e5c13ef10 2024-03-28T21:53:08.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.802+0000 7f4e61c00640 1 --2- 172.21.15.153:0/2358258011 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4e3c06b4d0 0x7f4e3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:08.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.803+0000 7f4e61c00640 1 --2- 172.21.15.153:0/2358258011 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4e3c06b4d0 0x7f4e3c06d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4e50007fd0 tx=0x7f4e50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:08.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:08.806+0000 7f4e59600640 1 -- 172.21.15.153:0/2358258011 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4e4807b0f0 con 0x7f4e5c13ef10 2024-03-28T21:53:09.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.038+0000 7f4e63000640 1 -- 172.21.15.153:0/2358258011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4e5c072c10 con 0x7f4e5c13ef10 2024-03-28T21:53:09.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.584+0000 7f4e59600640 1 -- 172.21.15.153:0/2358258011 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f4e4807a9f0 con 0x7f4e5c13ef10 2024-03-28T21:53:09.586 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 4 and data pool 5 2024-03-28T21:53:09.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.588+0000 7f4e63000640 1 -- 172.21.15.153:0/2358258011 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4e3c06b4d0 msgr2=0x7f4e3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:09.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.588+0000 7f4e63000640 1 --2- 172.21.15.153:0/2358258011 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4e3c06b4d0 0x7f4e3c06d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4e50007fd0 tx=0x7f4e50009040 comp rx=0 tx=0).stop 2024-03-28T21:53:09.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.588+0000 7f4e63000640 1 -- 172.21.15.153:0/2358258011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5c13ef10 msgr2=0x7f4e5c137fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:09.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.588+0000 7f4e63000640 1 --2- 172.21.15.153:0/2358258011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5c13ef10 0x7f4e5c137fd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4e48000c00 tx=0x7f4e480046c0 comp rx=0 tx=0).stop 2024-03-28T21:53:09.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.589+0000 7f4e63000640 1 -- 172.21.15.153:0/2358258011 shutdown_connections 2024-03-28T21:53:09.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.589+0000 7f4e63000640 1 --2- 172.21.15.153:0/2358258011 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f4e3c06b4d0 0x7f4e3c06d990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:09.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.589+0000 7f4e63000640 1 --2- 172.21.15.153:0/2358258011 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e5c141db0 0x7f4e5c071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:09.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.589+0000 7f4e63000640 1 --2- 172.21.15.153:0/2358258011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e5c13ef10 0x7f4e5c137fd0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:09.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.589+0000 7f4e63000640 1 --2- 172.21.15.153:0/2358258011 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e5c0ce7e0 0x7f4e5c136790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:09.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.589+0000 7f4e63000640 1 -- 172.21.15.153:0/2358258011 >> 172.21.15.153:0/2358258011 conn(0x7f4e5c0b1820 msgr2=0x7f4e5c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:09.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.589+0000 7f4e63000640 1 -- 172.21.15.153:0/2358258011 shutdown_connections 2024-03-28T21:53:09.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.589+0000 7f4e63000640 1 -- 172.21.15.153:0/2358258011 wait complete. 2024-03-28T21:53:09.629 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:53:09.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.807+0000 7fe8da800640 1 Processor -- start 2024-03-28T21:53:09.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.807+0000 7fe8da800640 1 -- start start 2024-03-28T21:53:09.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.808+0000 7fe8da800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe8d4159a10 0x7fe8d415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:09.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.808+0000 7fe8da800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8d406e440 0x7fe8d40b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:09.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.808+0000 7fe8da800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8d40b2e60 con 0x7fe8d40ad830 2024-03-28T21:53:09.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.808+0000 7fe8da800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe8d40adc70 con 0x7fe8d406e440 2024-03-28T21:53:09.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.808+0000 7fe8da800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe8d4159df0 con 0x7fe8d4159a10 2024-03-28T21:53:09.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.809+0000 7fe8d3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8d406e440 0x7fe8d40b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:09.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.809+0000 7fe8d3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8d406e440 0x7fe8d40b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46790/0 (socket says 172.21.15.153:46790) 2024-03-28T21:53:09.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.809+0000 7fe8d3e00640 1 -- 172.21.15.153:0/3496680620 learned_addr learned my addr 172.21.15.153:0/3496680620 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:09.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.809+0000 7fe8d3400640 1 --2- 172.21.15.153:0/3496680620 >> v2:172.21.15.165:3300/0 conn(0x7fe8d4159a10 0x7fe8d415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:09.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.809+0000 7fe8d3e00640 1 -- 172.21.15.153:0/3496680620 >> v2:172.21.15.165:3300/0 conn(0x7fe8d4159a10 msgr2=0x7fe8d415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:09.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.809+0000 7fe8d3e00640 1 --2- 172.21.15.153:0/3496680620 >> v2:172.21.15.165:3300/0 conn(0x7fe8d4159a10 0x7fe8d415cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:09.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.809+0000 7fe8d3e00640 1 -- 172.21.15.153:0/3496680620 >> v1:172.21.15.165:6789/0 conn(0x7fe8d40ad830 legacy=0x7fe8d406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:09.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.809+0000 7fe8d3e00640 1 -- 172.21.15.153:0/3496680620 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d40adf10 con 0x7fe8d406e440 2024-03-28T21:53:09.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.809+0000 7fe8d3400640 1 --2- 172.21.15.153:0/3496680620 >> v2:172.21.15.165:3300/0 conn(0x7fe8d4159a10 0x7fe8d415cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:09.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.810+0000 7fe8d3e00640 1 --2- 172.21.15.153:0/3496680620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d406e440 0x7fe8d40b3620 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40b28b0 tx=0x7fe8cc02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a92916deee1279 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:09.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.811+0000 7fe8d2000640 1 -- 172.21.15.153:0/3496680620 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc02c9c0 con 0x7fe8d406e440 2024-03-28T21:53:09.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.811+0000 7fe8d2000640 1 -- 172.21.15.153:0/3496680620 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8cc02cb60 con 0x7fe8d406e440 2024-03-28T21:53:09.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.811+0000 7fe8d2000640 1 -- 172.21.15.153:0/3496680620 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc0343f0 con 0x7fe8d406e440 2024-03-28T21:53:09.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.811+0000 7fe8da800640 1 -- 172.21.15.153:0/3496680620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d406e440 msgr2=0x7fe8d40b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:09.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.811+0000 7fe8da800640 1 --2- 172.21.15.153:0/3496680620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d406e440 0x7fe8d40b3620 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40b28b0 tx=0x7fe8cc02be20 comp rx=0 tx=0).stop 2024-03-28T21:53:09.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.811+0000 7fe8da800640 1 -- 172.21.15.153:0/3496680620 shutdown_connections 2024-03-28T21:53:09.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.811+0000 7fe8da800640 1 --2- 172.21.15.153:0/3496680620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d406e440 0x7fe8d40b3620 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:09.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.811+0000 7fe8da800640 1 --2- 172.21.15.153:0/3496680620 >> v2:172.21.15.165:3300/0 conn(0x7fe8d4159a10 0x7fe8d415cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:09.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.811+0000 7fe8da800640 1 -- 172.21.15.153:0/3496680620 >> 172.21.15.153:0/3496680620 conn(0x7fe8d40b1a30 msgr2=0x7fe8d40b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:09.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.811+0000 7fe8da800640 1 -- 172.21.15.153:0/3496680620 shutdown_connections 2024-03-28T21:53:09.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.811+0000 7fe8da800640 1 -- 172.21.15.153:0/3496680620 wait complete. 2024-03-28T21:53:09.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.813+0000 7fe8da800640 1 Processor -- start 2024-03-28T21:53:09.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.813+0000 7fe8da800640 1 -- start start 2024-03-28T21:53:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.814+0000 7fe8da800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8d406e440 0x7fe8d414e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.814+0000 7fe8da800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8d40ad830 0x7fe8d40ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.814+0000 7fe8da800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d4159a10 0x7fe8d4153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.814+0000 7fe8da800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d40ae4d0 con 0x7fe8d4159a10 2024-03-28T21:53:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.814+0000 7fe8da800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d40b3100 con 0x7fe8d40ad830 2024-03-28T21:53:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.814+0000 7fe8da800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d40b3b60 con 0x7fe8d406e440 2024-03-28T21:53:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.814+0000 7fe8d3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d4159a10 0x7fe8d4153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.814+0000 7fe8d3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d4159a10 0x7fe8d4153b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46806/0 (socket says 172.21.15.153:46806) 2024-03-28T21:53:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.814+0000 7fe8d3e00640 1 -- 172.21.15.153:0/2098129981 learned_addr learned my addr 172.21.15.153:0/2098129981 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:09.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.815+0000 7fe8d3400640 1 --2- 172.21.15.153:0/2098129981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8d406e440 0x7fe8d414e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:09.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.815+0000 7fe8d2a00640 1 --2- 172.21.15.153:0/2098129981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8d40ad830 0x7fe8d40ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:09.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.815+0000 7fe8d3e00640 1 -- 172.21.15.153:0/2098129981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8d406e440 msgr2=0x7fe8d414e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:09.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.815+0000 7fe8d3e00640 1 --2- 172.21.15.153:0/2098129981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8d406e440 0x7fe8d414e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:09.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.815+0000 7fe8d3e00640 1 -- 172.21.15.153:0/2098129981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8d40ad830 msgr2=0x7fe8d40ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:09.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.815+0000 7fe8d3e00640 1 --2- 172.21.15.153:0/2098129981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8d40ad830 0x7fe8d40ced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:09.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.815+0000 7fe8d3e00640 1 -- 172.21.15.153:0/2098129981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d4153720 con 0x7fe8d4159a10 2024-03-28T21:53:09.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.815+0000 7fe8d3e00640 1 --2- 172.21.15.153:0/2098129981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d4159a10 0x7fe8d4153b00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc036040 tx=0x7fe8cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:09.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.815+0000 7fe8cb400640 1 -- 172.21.15.153:0/2098129981 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc043020 con 0x7fe8d4159a10 2024-03-28T21:53:09.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.815+0000 7fe8cb400640 1 -- 172.21.15.153:0/2098129981 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8cc03e450 con 0x7fe8d4159a10 2024-03-28T21:53:09.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.815+0000 7fe8cb400640 1 -- 172.21.15.153:0/2098129981 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc03e860 con 0x7fe8d4159a10 2024-03-28T21:53:09.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.815+0000 7fe8da800640 1 -- 172.21.15.153:0/2098129981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d41546a0 con 0x7fe8d4159a10 2024-03-28T21:53:09.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.816+0000 7fe8da800640 1 -- 172.21.15.153:0/2098129981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d40ce500 con 0x7fe8d4159a10 2024-03-28T21:53:09.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.817+0000 7fe8da800640 1 -- 172.21.15.153:0/2098129981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d4068ff0 con 0x7fe8d4159a10 2024-03-28T21:53:09.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.818+0000 7fe8cb400640 1 -- 172.21.15.153:0/2098129981 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe8cc046020 con 0x7fe8d4159a10 2024-03-28T21:53:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.819+0000 7fe8cb400640 1 --2- 172.21.15.153:0/2098129981 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe8b406b500 0x7fe8b406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.819+0000 7fe8cb400640 1 -- 172.21.15.153:0/2098129981 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe8cc0ac7f0 con 0x7fe8d4159a10 2024-03-28T21:53:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.819+0000 7fe8d3400640 1 --2- 172.21.15.153:0/2098129981 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe8b406b500 0x7fe8b406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:09.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.820+0000 7fe8d3400640 1 --2- 172.21.15.153:0/2098129981 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe8b406b500 0x7fe8b406d9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40b3ad0 tx=0x7fe8c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:09.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:09.823+0000 7fe8cb400640 1 -- 172.21.15.153:0/2098129981 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe8cc04d070 con 0x7fe8d4159a10 2024-03-28T21:53:10.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.005+0000 7fe8da800640 1 -- 172.21.15.153:0/2098129981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8d415cd50 con 0x7fe8d4159a10 2024-03-28T21:53:10.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.007+0000 7fe8cb400640 1 -- 172.21.15.153:0/2098129981 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16730 (secure 0 0 0) 0x7fe8cc07b700 con 0x7fe8d4159a10 2024-03-28T21:53:10.009 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:10.009 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":34,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:53:09.040012+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:53:06.943079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-28T21:53:08.054176+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:53:10.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.010+0000 7fe8da800640 1 -- 172.21.15.153:0/2098129981 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe8b406b500 msgr2=0x7fe8b406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:10.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.010+0000 7fe8da800640 1 --2- 172.21.15.153:0/2098129981 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe8b406b500 0x7fe8b406d9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40b3ad0 tx=0x7fe8c4008040 comp rx=0 tx=0).stop 2024-03-28T21:53:10.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.010+0000 7fe8da800640 1 -- 172.21.15.153:0/2098129981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d4159a10 msgr2=0x7fe8d4153b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:10.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.010+0000 7fe8da800640 1 --2- 172.21.15.153:0/2098129981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d4159a10 0x7fe8d4153b00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc036040 tx=0x7fe8cc004a40 comp rx=0 tx=0).stop 2024-03-28T21:53:10.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.010+0000 7fe8da800640 1 -- 172.21.15.153:0/2098129981 shutdown_connections 2024-03-28T21:53:10.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.010+0000 7fe8da800640 1 --2- 172.21.15.153:0/2098129981 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe8b406b500 0x7fe8b406d9c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.010+0000 7fe8da800640 1 --2- 172.21.15.153:0/2098129981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8d4159a10 0x7fe8d4153b00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.010+0000 7fe8da800640 1 --2- 172.21.15.153:0/2098129981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8d40ad830 0x7fe8d40ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.010+0000 7fe8da800640 1 --2- 172.21.15.153:0/2098129981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8d406e440 0x7fe8d414e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.010+0000 7fe8da800640 1 -- 172.21.15.153:0/2098129981 >> 172.21.15.153:0/2098129981 conn(0x7fe8d40b1a30 msgr2=0x7fe8d40b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:10.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.010+0000 7fe8da800640 1 -- 172.21.15.153:0/2098129981 shutdown_connections 2024-03-28T21:53:10.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.010+0000 7fe8da800640 1 -- 172.21.15.153:0/2098129981 wait complete. 2024-03-28T21:53:10.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:53:10.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.229+0000 7f0ca2a00640 1 Processor -- start 2024-03-28T21:53:10.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.229+0000 7f0ca2a00640 1 -- start start 2024-03-28T21:53:10.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.230+0000 7f0ca2a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0c9c142720 0x7f0c9c06e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:10.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.230+0000 7f0ca2a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0c9c06ee20 0x7f0c9c072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:10.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.230+0000 7f0ca2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c9c072640 0x7f0c9c0cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:10.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.230+0000 7f0ca2a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0c9c071d60 con 0x7f0c9c06ee20 2024-03-28T21:53:10.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.230+0000 7f0ca2a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0c9c142b00 con 0x7f0c9c142720 2024-03-28T21:53:10.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.230+0000 7f0ca2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c9c06db60 con 0x7f0c9c072640 2024-03-28T21:53:10.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.231+0000 7f0ca0c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0c9c06ee20 0x7f0c9c072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:10.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.231+0000 7f0ca0c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0c9c06ee20 0x7f0c9c072100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46814/0 (socket says 172.21.15.153:46814) 2024-03-28T21:53:10.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.231+0000 7f0ca0c00640 1 -- 172.21.15.153:0/4056660949 learned_addr learned my addr 172.21.15.153:0/4056660949 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:10.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.231+0000 7f0ca1600640 1 --2- 172.21.15.153:0/4056660949 >> v2:172.21.15.165:3300/0 conn(0x7f0c9c142720 0x7f0c9c06e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:10.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.231+0000 7f0ca2000640 1 --2- 172.21.15.153:0/4056660949 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c9c072640 0x7f0c9c0cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:10.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.231+0000 7f0ca0c00640 1 -- 172.21.15.153:0/4056660949 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c9c072640 msgr2=0x7f0c9c0cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:10.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.231+0000 7f0ca0c00640 1 --2- 172.21.15.153:0/4056660949 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c9c072640 0x7f0c9c0cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.231+0000 7f0ca0c00640 1 -- 172.21.15.153:0/4056660949 >> v2:172.21.15.165:3300/0 conn(0x7f0c9c142720 msgr2=0x7f0c9c06e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:10.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.231+0000 7f0ca0c00640 1 --2- 172.21.15.153:0/4056660949 >> v2:172.21.15.165:3300/0 conn(0x7f0c9c142720 0x7f0c9c06e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.231+0000 7f0ca0c00640 1 -- 172.21.15.153:0/4056660949 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9c071a80 con 0x7f0c9c06ee20 2024-03-28T21:53:10.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.232+0000 7f0ca0c00640 1 --2- 172.21.15.153:0/4056660949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c9c06ee20 0x7f0c9c072100 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c0b2690 tx=0x7f0c8802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221e6b37eda90ad6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:10.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.233+0000 7f0c9be00640 1 -- 172.21.15.153:0/4056660949 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8802e070 con 0x7f0c9c06ee20 2024-03-28T21:53:10.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.233+0000 7f0c9be00640 1 -- 172.21.15.153:0/4056660949 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c88037070 con 0x7f0c9c06ee20 2024-03-28T21:53:10.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.233+0000 7f0c9be00640 1 -- 172.21.15.153:0/4056660949 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88031a00 con 0x7f0c9c06ee20 2024-03-28T21:53:10.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.233+0000 7f0ca2a00640 1 -- 172.21.15.153:0/4056660949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c9c06ee20 msgr2=0x7f0c9c072100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:10.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.233+0000 7f0ca2a00640 1 --2- 172.21.15.153:0/4056660949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c9c06ee20 0x7f0c9c072100 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c0b2690 tx=0x7f0c8802b880 comp rx=0 tx=0).stop 2024-03-28T21:53:10.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.233+0000 7f0ca2a00640 1 -- 172.21.15.153:0/4056660949 shutdown_connections 2024-03-28T21:53:10.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.233+0000 7f0ca2a00640 1 --2- 172.21.15.153:0/4056660949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c9c06ee20 0x7f0c9c072100 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.233+0000 7f0ca2a00640 1 --2- 172.21.15.153:0/4056660949 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c9c072640 0x7f0c9c0cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.233+0000 7f0ca2a00640 1 --2- 172.21.15.153:0/4056660949 >> v2:172.21.15.165:3300/0 conn(0x7f0c9c142720 0x7f0c9c06e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.233+0000 7f0ca2a00640 1 -- 172.21.15.153:0/4056660949 >> 172.21.15.153:0/4056660949 conn(0x7f0c9c0b1890 msgr2=0x7f0c9c0b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:10.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.234+0000 7f0ca2a00640 1 -- 172.21.15.153:0/4056660949 shutdown_connections 2024-03-28T21:53:10.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.234+0000 7f0ca2a00640 1 -- 172.21.15.153:0/4056660949 wait complete. 2024-03-28T21:53:10.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.235+0000 7f0ca2a00640 1 Processor -- start 2024-03-28T21:53:10.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.235+0000 7f0ca2a00640 1 -- start start 2024-03-28T21:53:10.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.236+0000 7f0ca2a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c9c072640 0x7f0c9c15b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:10.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.236+0000 7f0ca2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c9c142720 0x7f0c9c15d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:10.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.236+0000 7f0ca2a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c9c1f1af0 0x7f0c9c1f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:10.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.236+0000 7f0ca2a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c06e3c0 con 0x7f0c9c1f1af0 2024-03-28T21:53:10.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.236+0000 7f0ca2a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c06e0e0 con 0x7f0c9c072640 2024-03-28T21:53:10.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.236+0000 7f0ca2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c9c0cdc50 con 0x7f0c9c142720 2024-03-28T21:53:10.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.237+0000 7f0ca2000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c9c1f1af0 0x7f0c9c1f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:10.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.237+0000 7f0ca2000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c9c1f1af0 0x7f0c9c1f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46830/0 (socket says 172.21.15.153:46830) 2024-03-28T21:53:10.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.237+0000 7f0ca2000640 1 -- 172.21.15.153:0/152631160 learned_addr learned my addr 172.21.15.153:0/152631160 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:10.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.237+0000 7f0ca1600640 1 --2- 172.21.15.153:0/152631160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c9c072640 0x7f0c9c15b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:10.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.237+0000 7f0ca2000640 1 -- 172.21.15.153:0/152631160 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c9c142720 msgr2=0x7f0c9c15d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:10.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.237+0000 7f0ca2000640 1 --2- 172.21.15.153:0/152631160 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c9c142720 0x7f0c9c15d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.237+0000 7f0ca2000640 1 -- 172.21.15.153:0/152631160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c9c072640 msgr2=0x7f0c9c15b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:10.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.237+0000 7f0ca2000640 1 --2- 172.21.15.153:0/152631160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c9c072640 0x7f0c9c15b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.237+0000 7f0ca2000640 1 -- 172.21.15.153:0/152631160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9c15df30 con 0x7f0c9c1f1af0 2024-03-28T21:53:10.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.237+0000 7f0ca2000640 1 --2- 172.21.15.153:0/152631160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c9c1f1af0 0x7f0c9c1f1fa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0c94007e70 tx=0x7f0c9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:10.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.237+0000 7f0c99600640 1 -- 172.21.15.153:0/152631160 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c94014620 con 0x7f0c9c1f1af0 2024-03-28T21:53:10.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.237+0000 7f0c99600640 1 -- 172.21.15.153:0/152631160 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c94019070 con 0x7f0c9c1f1af0 2024-03-28T21:53:10.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.237+0000 7f0ca2a00640 1 -- 172.21.15.153:0/152631160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c9c1e4c30 con 0x7f0c9c1f1af0 2024-03-28T21:53:10.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.238+0000 7f0c99600640 1 -- 172.21.15.153:0/152631160 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c94014a20 con 0x7f0c9c1f1af0 2024-03-28T21:53:10.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.238+0000 7f0ca2a00640 1 -- 172.21.15.153:0/152631160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c9c15d1f0 con 0x7f0c9c1f1af0 2024-03-28T21:53:10.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.239+0000 7f0ca2a00640 1 -- 172.21.15.153:0/152631160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c9c06d4b0 con 0x7f0c9c1f1af0 2024-03-28T21:53:10.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.240+0000 7f0c99600640 1 -- 172.21.15.153:0/152631160 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0c94014bc0 con 0x7f0c9c1f1af0 2024-03-28T21:53:10.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.240+0000 7f0c99600640 1 --2- 172.21.15.153:0/152631160 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c7c06b500 0x7f0c7c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:10.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.241+0000 7f0c99600640 1 -- 172.21.15.153:0/152631160 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0c9408ab50 con 0x7f0c9c1f1af0 2024-03-28T21:53:10.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.241+0000 7f0ca1600640 1 --2- 172.21.15.153:0/152631160 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c7c06b500 0x7f0c7c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:10.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.241+0000 7f0ca1600640 1 --2- 172.21.15.153:0/152631160 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c7c06b500 0x7f0c7c06d9c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c90006fd0 tx=0x7f0c90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:10.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.244+0000 7f0c99600640 1 -- 172.21.15.153:0/152631160 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0c94059930 con 0x7f0c9c1f1af0 2024-03-28T21:53:10.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.427+0000 7f0ca2a00640 1 -- 172.21.15.153:0/152631160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c9c04f520 con 0x7f0c9c1f1af0 2024-03-28T21:53:10.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.430+0000 7f0c99600640 1 -- 172.21.15.153:0/152631160 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16730 (secure 0 0 0) 0x7f0c94059230 con 0x7f0c9c1f1af0 2024-03-28T21:53:10.432 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:10.432 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":34,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:53:09.040012+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:53:06.943079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-28T21:53:08.054176+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:53:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.433+0000 7f0ca2a00640 1 -- 172.21.15.153:0/152631160 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c7c06b500 msgr2=0x7f0c7c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.433+0000 7f0ca2a00640 1 --2- 172.21.15.153:0/152631160 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c7c06b500 0x7f0c7c06d9c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c90006fd0 tx=0x7f0c90008040 comp rx=0 tx=0).stop 2024-03-28T21:53:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.433+0000 7f0ca2a00640 1 -- 172.21.15.153:0/152631160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c9c1f1af0 msgr2=0x7f0c9c1f1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.433+0000 7f0ca2a00640 1 --2- 172.21.15.153:0/152631160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c9c1f1af0 0x7f0c9c1f1fa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0c94007e70 tx=0x7f0c9400e4b0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.434+0000 7f0ca2a00640 1 -- 172.21.15.153:0/152631160 shutdown_connections 2024-03-28T21:53:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.434+0000 7f0ca2a00640 1 --2- 172.21.15.153:0/152631160 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0c7c06b500 0x7f0c7c06d9c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.434+0000 7f0ca2a00640 1 --2- 172.21.15.153:0/152631160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c9c1f1af0 0x7f0c9c1f1fa0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.434+0000 7f0ca2a00640 1 --2- 172.21.15.153:0/152631160 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c9c142720 0x7f0c9c15d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.434+0000 7f0ca2a00640 1 --2- 172.21.15.153:0/152631160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c9c072640 0x7f0c9c15b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.434+0000 7f0ca2a00640 1 -- 172.21.15.153:0/152631160 >> 172.21.15.153:0/152631160 conn(0x7f0c9c0b1890 msgr2=0x7f0c9c1448d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.434+0000 7f0ca2a00640 1 -- 172.21.15.153:0/152631160 shutdown_connections 2024-03-28T21:53:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.434+0000 7f0ca2a00640 1 -- 172.21.15.153:0/152631160 wait complete. 2024-03-28T21:53:10.453 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-28T21:53:10.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.674+0000 7f8031200640 1 Processor -- start 2024-03-28T21:53:10.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.674+0000 7f8031200640 1 -- start start 2024-03-28T21:53:10.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.676+0000 7f8031200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f802c0b3150 0x7f802c15e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:10.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.676+0000 7f8031200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15ea60 0x7f802c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:10.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.676+0000 7f8031200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f802c06cf10 con 0x7f802c15e140 2024-03-28T21:53:10.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.676+0000 7f8031200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f802c071fd0 con 0x7f802c0b3150 2024-03-28T21:53:10.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.676+0000 7f8031200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f802c0b3590 con 0x7f802c15ea60 2024-03-28T21:53:10.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.676+0000 7f8023e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f802c0b3150 0x7f802c15e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:10.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.676+0000 7f802b400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f802c15e140 0x7f802c070d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40330/0 (socket says 172.21.15.153:40330) 2024-03-28T21:53:10.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.676+0000 7f802b400640 1 -- 172.21.15.153:0/2888172640 learned_addr learned my addr 172.21.15.153:0/2888172640 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:10.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.677+0000 7f802be00640 1 --2- 172.21.15.153:0/2888172640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15ea60 0x7f802c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:10.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.677+0000 7f8023e00640 1 -- 172.21.15.153:0/2888172640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15ea60 msgr2=0x7f802c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:10.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.677+0000 7f8023e00640 1 --2- 172.21.15.153:0/2888172640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15ea60 0x7f802c06d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.677+0000 7f8023e00640 1 -- 172.21.15.153:0/2888172640 >> v1:172.21.15.153:6789/0 conn(0x7f802c15e140 legacy=0x7f802c070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:10.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.677+0000 7f8023e00640 1 -- 172.21.15.153:0/2888172640 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802c071460 con 0x7f802c0b3150 2024-03-28T21:53:10.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.677+0000 7f802aa00640 1 -- 172.21.15.153:0/2888172640 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1664684950 0 0) 0x7f802c06cf10 con 0x7f802c15e140 2024-03-28T21:53:10.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.678+0000 7f8023e00640 1 --2- 172.21.15.153:0/2888172640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c0b3150 0x7f802c15e520 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f80140097a0 tx=0x7f801402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb54fa10828a7dcc server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:10.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.678+0000 7f802aa00640 1 -- 172.21.15.153:0/2888172640 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014034070 con 0x7f802c0b3150 2024-03-28T21:53:10.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.678+0000 7f802aa00640 1 -- 172.21.15.153:0/2888172640 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8014030610 con 0x7f802c0b3150 2024-03-28T21:53:10.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.678+0000 7f802aa00640 1 -- 172.21.15.153:0/2888172640 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80140309e0 con 0x7f802c0b3150 2024-03-28T21:53:10.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.679+0000 7f8031200640 1 -- 172.21.15.153:0/2888172640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c0b3150 msgr2=0x7f802c15e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:10.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.679+0000 7f8031200640 1 --2- 172.21.15.153:0/2888172640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c0b3150 0x7f802c15e520 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f80140097a0 tx=0x7f801402b960 comp rx=0 tx=0).stop 2024-03-28T21:53:10.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.679+0000 7f8031200640 1 -- 172.21.15.153:0/2888172640 shutdown_connections 2024-03-28T21:53:10.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.679+0000 7f8031200640 1 --2- 172.21.15.153:0/2888172640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15ea60 0x7f802c06d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.679+0000 7f8031200640 1 --2- 172.21.15.153:0/2888172640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c0b3150 0x7f802c15e520 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.679+0000 7f8031200640 1 -- 172.21.15.153:0/2888172640 >> 172.21.15.153:0/2888172640 conn(0x7f802c0b1820 msgr2=0x7f802c0b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:10.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.679+0000 7f8031200640 1 -- 172.21.15.153:0/2888172640 shutdown_connections 2024-03-28T21:53:10.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.679+0000 7f8031200640 1 -- 172.21.15.153:0/2888172640 wait complete. 2024-03-28T21:53:10.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.682+0000 7f8031200640 1 Processor -- start 2024-03-28T21:53:10.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.682+0000 7f8031200640 1 -- start start 2024-03-28T21:53:10.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f8031200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c0b3150 0x7f802c0cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:10.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f8031200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15e140 0x7f802c145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:10.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f8031200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f802c15ea60 0x7f802c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:10.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f8031200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f802c071cf0 con 0x7f802c0b3150 2024-03-28T21:53:10.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f8031200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f802c071a10 con 0x7f802c15ea60 2024-03-28T21:53:10.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f8031200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f802c06d1b0 con 0x7f802c15e140 2024-03-28T21:53:10.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f802b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c0b3150 0x7f802c0cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:10.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f802b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c0b3150 0x7f802c0cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46840/0 (socket says 172.21.15.153:46840) 2024-03-28T21:53:10.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f802b400640 1 -- 172.21.15.153:0/2485147821 learned_addr learned my addr 172.21.15.153:0/2485147821 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:10.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f8023e00640 1 --2- 172.21.15.153:0/2485147821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15e140 0x7f802c145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:10.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f802b400640 1 -- 172.21.15.153:0/2485147821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15e140 msgr2=0x7f802c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:10.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f802b400640 1 --2- 172.21.15.153:0/2485147821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15e140 0x7f802c145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f802b400640 1 -- 172.21.15.153:0/2485147821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f802c15ea60 msgr2=0x7f802c156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:10.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f802b400640 1 --2- 172.21.15.153:0/2485147821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f802c15ea60 0x7f802c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:10.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.684+0000 7f802b400640 1 -- 172.21.15.153:0/2485147821 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802c145e90 con 0x7f802c0b3150 2024-03-28T21:53:10.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.685+0000 7f802b400640 1 --2- 172.21.15.153:0/2485147821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c0b3150 0x7f802c0cc050 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c4d0 tx=0x7f801c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:10.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.685+0000 7f8023400640 1 -- 172.21.15.153:0/2485147821 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c018070 con 0x7f802c0b3150 2024-03-28T21:53:10.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.685+0000 7f8023400640 1 -- 172.21.15.153:0/2485147821 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801c007500 con 0x7f802c0b3150 2024-03-28T21:53:10.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.685+0000 7f8023400640 1 -- 172.21.15.153:0/2485147821 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c004a20 con 0x7f802c0b3150 2024-03-28T21:53:10.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.685+0000 7f8031200640 1 -- 172.21.15.153:0/2485147821 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f802c146240 con 0x7f802c0b3150 2024-03-28T21:53:10.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.685+0000 7f8031200640 1 -- 172.21.15.153:0/2485147821 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f802c146800 con 0x7f802c0b3150 2024-03-28T21:53:10.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.687+0000 7f8031200640 1 -- 172.21.15.153:0/2485147821 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f802c068ff0 con 0x7f802c0b3150 2024-03-28T21:53:10.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.687+0000 7f8023400640 1 -- 172.21.15.153:0/2485147821 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f801c004bc0 con 0x7f802c0b3150 2024-03-28T21:53:10.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.688+0000 7f8023400640 1 --2- 172.21.15.153:0/2485147821 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f800806b4d0 0x7f800806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:10.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.688+0000 7f8023400640 1 -- 172.21.15.153:0/2485147821 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f801c0894b0 con 0x7f802c0b3150 2024-03-28T21:53:10.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.688+0000 7f8023e00640 1 --2- 172.21.15.153:0/2485147821 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f800806b4d0 0x7f800806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:10.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.689+0000 7f8023e00640 1 --2- 172.21.15.153:0/2485147821 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f800806b4d0 0x7f800806d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8014036000 tx=0x7f8014008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:10.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.696+0000 7f8023400640 1 -- 172.21.15.153:0/2485147821 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f801c058320 con 0x7f802c0b3150 2024-03-28T21:53:10.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:10.932+0000 7f8031200640 1 -- 172.21.15.153:0/2485147821 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f802c0725d0 con 0x7f802c0b3150 2024-03-28T21:53:11.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.635+0000 7f8023400640 1 -- 172.21.15.153:0/2485147821 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f801c057c20 con 0x7f802c0b3150 2024-03-28T21:53:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.640+0000 7f8031200640 1 -- 172.21.15.153:0/2485147821 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f800806b4d0 msgr2=0x7f800806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.640+0000 7f8031200640 1 --2- 172.21.15.153:0/2485147821 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f800806b4d0 0x7f800806d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8014036000 tx=0x7f8014008030 comp rx=0 tx=0).stop 2024-03-28T21:53:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.640+0000 7f8031200640 1 -- 172.21.15.153:0/2485147821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c0b3150 msgr2=0x7f802c0cc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.640+0000 7f8031200640 1 --2- 172.21.15.153:0/2485147821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c0b3150 0x7f802c0cc050 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c4d0 tx=0x7f801c00c990 comp rx=0 tx=0).stop 2024-03-28T21:53:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.640+0000 7f8031200640 1 -- 172.21.15.153:0/2485147821 shutdown_connections 2024-03-28T21:53:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.640+0000 7f8031200640 1 --2- 172.21.15.153:0/2485147821 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f800806b4d0 0x7f800806d990 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.640+0000 7f8031200640 1 --2- 172.21.15.153:0/2485147821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f802c15ea60 0x7f802c156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.640+0000 7f8031200640 1 --2- 172.21.15.153:0/2485147821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15e140 0x7f802c145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.640+0000 7f8031200640 1 --2- 172.21.15.153:0/2485147821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f802c0b3150 0x7f802c0cc050 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.640+0000 7f8031200640 1 -- 172.21.15.153:0/2485147821 >> 172.21.15.153:0/2485147821 conn(0x7f802c0b1820 msgr2=0x7f802c160000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:11.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.640+0000 7f8031200640 1 -- 172.21.15.153:0/2485147821 shutdown_connections 2024-03-28T21:53:11.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.640+0000 7f8031200640 1 -- 172.21.15.153:0/2485147821 wait complete. 2024-03-28T21:53:11.668 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-28T21:53:11.668 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-28T21:53:11.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.873+0000 7fb71a400640 1 Processor -- start 2024-03-28T21:53:11.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.873+0000 7fb71a400640 1 -- start start 2024-03-28T21:53:11.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.875+0000 7fb71a400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb714162550 0x7fb714169170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:11.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.875+0000 7fb71a400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7140cd450 con 0x7fb71406d290 2024-03-28T21:53:11.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.875+0000 7fb71a400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7140b1be0 con 0x7fb71415e090 2024-03-28T21:53:11.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.875+0000 7fb71a400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb7140b1ec0 con 0x7fb714162550 2024-03-28T21:53:11.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.875+0000 7fb713e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb714162550 0x7fb714169170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:11.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.875+0000 7fb70be00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb71406d290 0x7fb714161e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40334/0 (socket says 172.21.15.153:40334) 2024-03-28T21:53:11.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.875+0000 7fb70be00640 1 -- 172.21.15.153:0/1679032020 learned_addr learned my addr 172.21.15.153:0/1679032020 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:11.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.875+0000 7fb713e00640 1 --2- 172.21.15.153:0/1679032020 >> v2:172.21.15.153:3300/0 conn(0x7fb714162550 0x7fb714169170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46856/0 (socket says 172.21.15.153:46856) 2024-03-28T21:53:11.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.876+0000 7fb713e00640 1 -- 172.21.15.153:0/1679032020 >> v1:172.21.15.165:6789/0 conn(0x7fb71415e090 legacy=0x7fb7140b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:11.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.876+0000 7fb713e00640 1 -- 172.21.15.153:0/1679032020 >> v1:172.21.15.153:6789/0 conn(0x7fb71406d290 legacy=0x7fb714161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:11.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.876+0000 7fb713e00640 1 -- 172.21.15.153:0/1679032020 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7140b21a0 con 0x7fb714162550 2024-03-28T21:53:11.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.877+0000 7fb713e00640 1 --2- 172.21.15.153:0/1679032020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714162550 0x7fb714169170 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009d90 tx=0x7fb70c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdd282e017fe8e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:11.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.877+0000 7fb712a00640 1 -- 172.21.15.153:0/1679032020 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c039070 con 0x7fb714162550 2024-03-28T21:53:11.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.877+0000 7fb712a00640 1 -- 172.21.15.153:0/1679032020 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb70c02cc60 con 0x7fb714162550 2024-03-28T21:53:11.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.877+0000 7fb712a00640 1 -- 172.21.15.153:0/1679032020 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c034660 con 0x7fb714162550 2024-03-28T21:53:11.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.878+0000 7fb71a400640 1 -- 172.21.15.153:0/1679032020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714162550 msgr2=0x7fb714169170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:11.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.878+0000 7fb71a400640 1 --2- 172.21.15.153:0/1679032020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714162550 0x7fb714169170 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009d90 tx=0x7fb70c02beb0 comp rx=0 tx=0).stop 2024-03-28T21:53:11.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.878+0000 7fb71a400640 1 -- 172.21.15.153:0/1679032020 shutdown_connections 2024-03-28T21:53:11.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.878+0000 7fb71a400640 1 --2- 172.21.15.153:0/1679032020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714162550 0x7fb714169170 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:11.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.878+0000 7fb71a400640 1 -- 172.21.15.153:0/1679032020 >> 172.21.15.153:0/1679032020 conn(0x7fb71409aa50 msgr2=0x7fb71409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:11.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.878+0000 7fb71a400640 1 -- 172.21.15.153:0/1679032020 shutdown_connections 2024-03-28T21:53:11.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.878+0000 7fb71a400640 1 -- 172.21.15.153:0/1679032020 wait complete. 2024-03-28T21:53:11.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.880+0000 7fb71a400640 1 Processor -- start 2024-03-28T21:53:11.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.880+0000 7fb71a400640 1 -- start start 2024-03-28T21:53:11.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.881+0000 7fb71a400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb71406d290 0x7fb71415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:11.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.881+0000 7fb71a400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb71415e090 0x7fb7140b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.881+0000 7fb71a400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714162550 0x7fb7140b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.881+0000 7fb71a400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb7140b2c80 con 0x7fb714162550 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.881+0000 7fb71a400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb7140b2760 con 0x7fb71406d290 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.881+0000 7fb71a400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb71415e470 con 0x7fb71415e090 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.881+0000 7fb713e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714162550 0x7fb7140b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.882+0000 7fb713e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714162550 0x7fb7140b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46864/0 (socket says 172.21.15.153:46864) 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.882+0000 7fb713e00640 1 -- 172.21.15.153:0/4014512296 learned_addr learned my addr 172.21.15.153:0/4014512296 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.882+0000 7fb713400640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb71406d290 0x7fb71415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.882+0000 7fb70be00640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb71415e090 0x7fb7140b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.882+0000 7fb713e00640 1 -- 172.21.15.153:0/4014512296 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb71415e090 msgr2=0x7fb7140b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.882+0000 7fb713e00640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb71415e090 0x7fb7140b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.882+0000 7fb713e00640 1 -- 172.21.15.153:0/4014512296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb71406d290 msgr2=0x7fb71415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.882+0000 7fb713e00640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb71406d290 0x7fb71415b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.882+0000 7fb713e00640 1 -- 172.21.15.153:0/4014512296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb714159ef0 con 0x7fb714162550 2024-03-28T21:53:11.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.882+0000 7fb713400640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb71406d290 0x7fb71415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:11.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.882+0000 7fb70be00640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb71415e090 0x7fb7140b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:11.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.882+0000 7fb713e00640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714162550 0x7fb7140b3340 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009d90 tx=0x7fb70c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:11.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.883+0000 7fb70b400640 1 -- 172.21.15.153:0/4014512296 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c039050 con 0x7fb714162550 2024-03-28T21:53:11.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.883+0000 7fb70b400640 1 -- 172.21.15.153:0/4014512296 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb70c045070 con 0x7fb714162550 2024-03-28T21:53:11.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.883+0000 7fb70b400640 1 -- 172.21.15.153:0/4014512296 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c03e850 con 0x7fb714162550 2024-03-28T21:53:11.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.883+0000 7fb71a400640 1 -- 172.21.15.153:0/4014512296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb71415a1d0 con 0x7fb714162550 2024-03-28T21:53:11.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.883+0000 7fb71a400640 1 -- 172.21.15.153:0/4014512296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb71415a790 con 0x7fb714162550 2024-03-28T21:53:11.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.884+0000 7fb71a400640 1 -- 172.21.15.153:0/4014512296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb71415a990 con 0x7fb714162550 2024-03-28T21:53:11.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.885+0000 7fb70b400640 1 -- 172.21.15.153:0/4014512296 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb70c03e9f0 con 0x7fb714162550 2024-03-28T21:53:11.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.886+0000 7fb70b400640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb6f006b4d0 0x7fb6f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:11.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.886+0000 7fb70b400640 1 -- 172.21.15.153:0/4014512296 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fb70c0ad2f0 con 0x7fb714162550 2024-03-28T21:53:11.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.886+0000 7fb713400640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb6f006b4d0 0x7fb6f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:11.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.887+0000 7fb713400640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb6f006b4d0 0x7fb6f006d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb71406f5c0 tx=0x7fb704009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:11.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:11.891+0000 7fb70b400640 1 -- 172.21.15.153:0/4014512296 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb71415a990 con 0x7fb714162550 2024-03-28T21:53:12.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.150+0000 7fb71a400640 1 -- 172.21.15.153:0/4014512296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb714068ff0 con 0x7fb714162550 2024-03-28T21:53:12.544 INFO:tasks.ceph.mds.c.smithi153.stderr:2024-03-28T21:53:12.542+0000 7f40bfc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-28T21:53:12.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.638+0000 7fb70b400640 1 -- 172.21.15.153:0/4014512296 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7fb70c032e20 con 0x7fb714162550 2024-03-28T21:53:12.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.642+0000 7fb71a400640 1 -- 172.21.15.153:0/4014512296 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb6f006b4d0 msgr2=0x7fb6f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:12.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.642+0000 7fb71a400640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb6f006b4d0 0x7fb6f006d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb71406f5c0 tx=0x7fb704009040 comp rx=0 tx=0).stop 2024-03-28T21:53:12.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.642+0000 7fb71a400640 1 -- 172.21.15.153:0/4014512296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714162550 msgr2=0x7fb7140b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:12.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.642+0000 7fb71a400640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714162550 0x7fb7140b3340 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009d90 tx=0x7fb70c004a40 comp rx=0 tx=0).stop 2024-03-28T21:53:12.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.642+0000 7fb71a400640 1 -- 172.21.15.153:0/4014512296 shutdown_connections 2024-03-28T21:53:12.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.642+0000 7fb71a400640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb6f006b4d0 0x7fb6f006d990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:12.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.642+0000 7fb71a400640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb714162550 0x7fb7140b3340 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:12.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.642+0000 7fb71a400640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb71415e090 0x7fb7140b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:12.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.642+0000 7fb71a400640 1 --2- 172.21.15.153:0/4014512296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb71406d290 0x7fb71415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:12.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.642+0000 7fb71a400640 1 -- 172.21.15.153:0/4014512296 >> 172.21.15.153:0/4014512296 conn(0x7fb71409aa50 msgr2=0x7fb714152ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:12.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.642+0000 7fb71a400640 1 -- 172.21.15.153:0/4014512296 shutdown_connections 2024-03-28T21:53:12.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.642+0000 7fb71a400640 1 -- 172.21.15.153:0/4014512296 wait complete. 2024-03-28T21:53:12.663 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-28T21:53:12.663 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T21:53:12.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.859+0000 7f15c7c00640 1 Processor -- start 2024-03-28T21:53:12.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.859+0000 7f15c7c00640 1 -- start start 2024-03-28T21:53:12.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.861+0000 7f15c7c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f15c015c1d0 0x7f15c00cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:12.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.861+0000 7f15c7c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c015c5b0 con 0x7f15c006c890 2024-03-28T21:53:12.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.861+0000 7f15c7c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c015c860 con 0x7f15c00d01a0 2024-03-28T21:53:12.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.861+0000 7f15c7c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f15c015cb40 con 0x7f15c015c1d0 2024-03-28T21:53:12.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.861+0000 7f15c5c00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f15c006c890 0x7f15c00cdad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40340/0 (socket says 172.21.15.153:40340) 2024-03-28T21:53:12.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.861+0000 7f15c5c00640 1 -- 172.21.15.153:0/760302816 learned_addr learned my addr 172.21.15.153:0/760302816 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:12.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15c5200640 1 --2- 172.21.15.153:0/760302816 >> v2:172.21.15.165:3300/0 conn(0x7f15c015c1d0 0x7f15c00cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:12.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 -- 172.21.15.153:0/760302816 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3626322187 0 0) 0x7f15c015c5b0 con 0x7f15c006c890 2024-03-28T21:53:12.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 -- 172.21.15.153:0/760302816 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15a8003520 con 0x7f15c006c890 2024-03-28T21:53:12.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 -- 172.21.15.153:0/760302816 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3625550182 0 0) 0x7f15a8003520 con 0x7f15c006c890 2024-03-28T21:53:12.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 -- 172.21.15.153:0/760302816 >> v2:172.21.15.165:3300/0 conn(0x7f15c015c1d0 msgr2=0x7f15c00cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:12.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 --2- 172.21.15.153:0/760302816 >> v2:172.21.15.165:3300/0 conn(0x7f15c015c1d0 0x7f15c00cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:12.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 -- 172.21.15.153:0/760302816 >> v1:172.21.15.165:6789/0 conn(0x7f15c00d01a0 legacy=0x7f15c006c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 -- 172.21.15.153:0/760302816 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c015ce20 con 0x7f15c006c890 2024-03-28T21:53:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 -- 172.21.15.153:0/760302816 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f15b80019f0 con 0x7f15c006c890 2024-03-28T21:53:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 -- 172.21.15.153:0/760302816 >> v1:172.21.15.153:6789/0 conn(0x7f15c006c890 legacy=0x7f15c00cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 --2- 172.21.15.153:0/760302816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15a8003a00 0x7f15a8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 --2- 172.21.15.153:0/760302816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15a8004800 0x7f15a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 --2- 172.21.15.153:0/760302816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15a80051c0 0x7f15a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 -- 172.21.15.153:0/760302816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f15c015cb40 con 0x7f15a80051c0 2024-03-28T21:53:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 -- 172.21.15.153:0/760302816 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f15a800c0c0 con 0x7f15a8004800 2024-03-28T21:53:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.862+0000 7f15bf400640 1 -- 172.21.15.153:0/760302816 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f15a800c2c0 con 0x7f15a8003a00 2024-03-28T21:53:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.863+0000 7f15c5c00640 1 --2- 172.21.15.153:0/760302816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15a80051c0 0x7f15a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.863+0000 7f15c5200640 1 --2- 172.21.15.153:0/760302816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15a8003a00 0x7f15a8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.863+0000 7f15bfe00640 1 --2- 172.21.15.153:0/760302816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15a8004800 0x7f15a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.863+0000 7f15c5c00640 1 -- 172.21.15.153:0/760302816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15a8003a00 msgr2=0x7f15a8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.863+0000 7f15c5c00640 1 --2- 172.21.15.153:0/760302816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15a8003a00 0x7f15a8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:12.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.863+0000 7f15c5c00640 1 -- 172.21.15.153:0/760302816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15a8004800 msgr2=0x7f15a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:12.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.863+0000 7f15c5c00640 1 --2- 172.21.15.153:0/760302816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15a8004800 0x7f15a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:12.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.863+0000 7f15c5c00640 1 -- 172.21.15.153:0/760302816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a8003520 con 0x7f15a80051c0 2024-03-28T21:53:12.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.863+0000 7f15c5200640 1 --2- 172.21.15.153:0/760302816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15a8003a00 0x7f15a8003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:12.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.863+0000 7f15bfe00640 1 --2- 172.21.15.153:0/760302816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15a8004800 0x7f15a8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:12.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.864+0000 7f15c5c00640 1 -- 172.21.15.153:0/760302816 reap_dead start 2024-03-28T21:53:12.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.864+0000 7f15c5c00640 1 --2- 172.21.15.153:0/760302816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15a80051c0 0x7f15a800b9c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f15b800a770 tx=0x7f15a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d2e174385734ff server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:12.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.864+0000 7f15bf400640 1 -- 172.21.15.153:0/760302816 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b800a390 con 0x7f15a80051c0 2024-03-28T21:53:12.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.864+0000 7f15bf400640 1 -- 172.21.15.153:0/760302816 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b8034650 con 0x7f15a80051c0 2024-03-28T21:53:12.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.865+0000 7f15bf400640 1 -- 172.21.15.153:0/760302816 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8034a40 con 0x7f15a80051c0 2024-03-28T21:53:12.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.865+0000 7f15c7c00640 1 -- 172.21.15.153:0/760302816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15a80051c0 msgr2=0x7f15a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:12.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.865+0000 7f15c7c00640 1 --2- 172.21.15.153:0/760302816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15a80051c0 0x7f15a800b9c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f15b800a770 tx=0x7f15a8005830 comp rx=0 tx=0).stop 2024-03-28T21:53:12.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.865+0000 7f15c7c00640 1 -- 172.21.15.153:0/760302816 shutdown_connections 2024-03-28T21:53:12.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.865+0000 7f15c7c00640 1 --2- 172.21.15.153:0/760302816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15a80051c0 0x7f15a800b9c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.865+0000 7f15c7c00640 1 -- 172.21.15.153:0/760302816 >> 172.21.15.153:0/760302816 conn(0x7f15c0071700 msgr2=0x7f15c0071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.865+0000 7f15c7c00640 1 -- 172.21.15.153:0/760302816 shutdown_connections 2024-03-28T21:53:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.865+0000 7f15c7c00640 1 -- 172.21.15.153:0/760302816 wait complete. 2024-03-28T21:53:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.868+0000 7f15c7c00640 1 Processor -- start 2024-03-28T21:53:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.868+0000 7f15c7c00640 1 -- start start 2024-03-28T21:53:12.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.870+0000 7f15c7c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15a80051c0 0x7f15c014d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:12.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.870+0000 7f15c7c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c01527f0 0x7f15c0152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.870+0000 7f15c7c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15c00ada80 0x7f15c00adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.870+0000 7f15c7c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f15c00b3690 con 0x7f15c01527f0 2024-03-28T21:53:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.870+0000 7f15c7c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f15c015d3e0 con 0x7f15c00ada80 2024-03-28T21:53:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.870+0000 7f15c7c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f15c00b3810 con 0x7f15a80051c0 2024-03-28T21:53:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.870+0000 7f15bfe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c01527f0 0x7f15c0152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.870+0000 7f15bfe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c01527f0 0x7f15c0152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46888/0 (socket says 172.21.15.153:46888) 2024-03-28T21:53:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.870+0000 7f15bfe00640 1 -- 172.21.15.153:0/1537252836 learned_addr learned my addr 172.21.15.153:0/1537252836 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.871+0000 7f15bfe00640 1 -- 172.21.15.153:0/1537252836 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15a80051c0 msgr2=0x7f15c014d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.871+0000 7f15bfe00640 1 --2- 172.21.15.153:0/1537252836 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15a80051c0 0x7f15c014d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.871+0000 7f15bfe00640 1 -- 172.21.15.153:0/1537252836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15c00ada80 msgr2=0x7f15c00adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.871+0000 7f15bfe00640 1 --2- 172.21.15.153:0/1537252836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15c00ada80 0x7f15c00adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.871+0000 7f15bfe00640 1 -- 172.21.15.153:0/1537252836 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c00ae7f0 con 0x7f15c01527f0 2024-03-28T21:53:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.871+0000 7f15bfe00640 1 --2- 172.21.15.153:0/1537252836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c01527f0 0x7f15c0152c70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f15ac000f60 tx=0x7f15ac00d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.871+0000 7f15bcc00640 1 -- 172.21.15.153:0/1537252836 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac005480 con 0x7f15c01527f0 2024-03-28T21:53:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.871+0000 7f15bcc00640 1 -- 172.21.15.153:0/1537252836 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15ac017070 con 0x7f15c01527f0 2024-03-28T21:53:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.871+0000 7f15c7c00640 1 -- 172.21.15.153:0/1537252836 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c00aead0 con 0x7f15c01527f0 2024-03-28T21:53:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.871+0000 7f15bcc00640 1 -- 172.21.15.153:0/1537252836 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac003810 con 0x7f15c01527f0 2024-03-28T21:53:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.871+0000 7f15c7c00640 1 -- 172.21.15.153:0/1537252836 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c00af090 con 0x7f15c01527f0 2024-03-28T21:53:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.873+0000 7f15c7c00640 1 -- 172.21.15.153:0/1537252836 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c0068ff0 con 0x7f15c01527f0 2024-03-28T21:53:12.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.873+0000 7f15bcc00640 1 -- 172.21.15.153:0/1537252836 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f15ac0039b0 con 0x7f15c01527f0 2024-03-28T21:53:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.875+0000 7f15bcc00640 1 --2- 172.21.15.153:0/1537252836 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f15a006b500 0x7f15a006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.875+0000 7f15bcc00640 1 -- 172.21.15.153:0/1537252836 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f15ac089f30 con 0x7f15c01527f0 2024-03-28T21:53:12.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.875+0000 7f15c5200640 1 --2- 172.21.15.153:0/1537252836 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f15a006b500 0x7f15a006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:12.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.876+0000 7f15c5200640 1 --2- 172.21.15.153:0/1537252836 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f15a006b500 0x7f15a006d9c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f15c0154820 tx=0x7f15b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:12.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:12.879+0000 7f15bcc00640 1 -- 172.21.15.153:0/1537252836 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f15ac058e40 con 0x7f15c01527f0 2024-03-28T21:53:13.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.115+0000 7f15c7c00640 1 -- 172.21.15.153:0/1537252836 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15c006ff30 con 0x7f15c01527f0 2024-03-28T21:53:13.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.116+0000 7f15bcc00640 1 -- 172.21.15.153:0/1537252836 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5190 (secure 0 0 0) 0x7f15ac058740 con 0x7f15c01527f0 2024-03-28T21:53:13.118 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:13.118 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3849778471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3849778471},{"type":"v1","addr":"172.21.15.165:6835","nonce":3849778471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/2718440878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2718440878},{"type":"v1","addr":"172.21.15.165:6833","nonce":2718440878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/974086107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":974086107},{"type":"v1","addr":"172.21.15.153:6836","nonce":974086107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T21:53:09.040388+0000","modified":"2024-03-28T21:53:12.151355+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6837/1209499946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1209499946},{"type":"v1","addr":"172.21.15.153:6837","nonce":1209499946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5070,"qdb_cluster":[5070]},"id":2}]} 2024-03-28T21:53:13.118 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 17 2024-03-28T21:53:13.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.119+0000 7f15c7c00640 1 -- 172.21.15.153:0/1537252836 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f15a006b500 msgr2=0x7f15a006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:13.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.119+0000 7f15c7c00640 1 --2- 172.21.15.153:0/1537252836 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f15a006b500 0x7f15a006d9c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f15c0154820 tx=0x7f15b4008040 comp rx=0 tx=0).stop 2024-03-28T21:53:13.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.119+0000 7f15c7c00640 1 -- 172.21.15.153:0/1537252836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c01527f0 msgr2=0x7f15c0152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:13.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.119+0000 7f15c7c00640 1 --2- 172.21.15.153:0/1537252836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c01527f0 0x7f15c0152c70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f15ac000f60 tx=0x7f15ac00d9f0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.119+0000 7f15c7c00640 1 -- 172.21.15.153:0/1537252836 shutdown_connections 2024-03-28T21:53:13.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.119+0000 7f15c7c00640 1 --2- 172.21.15.153:0/1537252836 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f15a006b500 0x7f15a006d9c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.119+0000 7f15c7c00640 1 --2- 172.21.15.153:0/1537252836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15c00ada80 0x7f15c00adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.119+0000 7f15c7c00640 1 --2- 172.21.15.153:0/1537252836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c01527f0 0x7f15c0152c70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.119+0000 7f15c7c00640 1 --2- 172.21.15.153:0/1537252836 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15a80051c0 0x7f15c014d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.119+0000 7f15c7c00640 1 -- 172.21.15.153:0/1537252836 >> 172.21.15.153:0/1537252836 conn(0x7f15c0071700 msgr2=0x7f15c0071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:13.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.119+0000 7f15c7c00640 1 -- 172.21.15.153:0/1537252836 shutdown_connections 2024-03-28T21:53:13.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.119+0000 7f15c7c00640 1 -- 172.21.15.153:0/1537252836 wait complete. 2024-03-28T21:53:13.141 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T21:53:13.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.359+0000 7f8ad1800640 1 Processor -- start 2024-03-28T21:53:13.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.359+0000 7f8ad1800640 1 -- start start 2024-03-28T21:53:13.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.360+0000 7f8ad1800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8acc159a10 0x7f8acc15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:13.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.360+0000 7f8ad1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0ad830 0x7f8acc06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:13.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.360+0000 7f8ad1800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8acc0b2e60 con 0x7f8acc06e270 2024-03-28T21:53:13.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.360+0000 7f8ad1800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8acc0adc70 con 0x7f8acc159a10 2024-03-28T21:53:13.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.360+0000 7f8ad1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8acc159df0 con 0x7f8acc0ad830 2024-03-28T21:53:13.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.361+0000 7f8acaa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8acc159a10 0x7f8acc15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:13.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.361+0000 7f8acaa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8acc159a10 0x7f8acc15cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58392/0 (socket says 172.21.15.153:58392) 2024-03-28T21:53:13.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.361+0000 7f8acaa00640 1 -- 172.21.15.153:0/75321469 learned_addr learned my addr 172.21.15.153:0/75321469 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:13.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.361+0000 7f8aca000640 1 --2- 172.21.15.153:0/75321469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0ad830 0x7f8acc06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:13.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.361+0000 7f8acaa00640 1 -- 172.21.15.153:0/75321469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0ad830 msgr2=0x7f8acc06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:13.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.361+0000 7f8acaa00640 1 --2- 172.21.15.153:0/75321469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0ad830 0x7f8acc06dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.361+0000 7f8acaa00640 1 -- 172.21.15.153:0/75321469 >> v1:172.21.15.165:6789/0 conn(0x7f8acc06e270 legacy=0x7f8acc15fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:13.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.361+0000 7f8acaa00640 1 -- 172.21.15.153:0/75321469 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8acc0adf10 con 0x7f8acc159a10 2024-03-28T21:53:13.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.363+0000 7f8acaa00640 1 --2- 172.21.15.153:0/75321469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc159a10 0x7f8acc15cf00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009870 tx=0x7f8abc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7eb2d27821a145b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:13.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.363+0000 7f8ac9600640 1 -- 172.21.15.153:0/75321469 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0317c0 con 0x7f8acc159a10 2024-03-28T21:53:13.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.363+0000 7f8ac9600640 1 -- 172.21.15.153:0/75321469 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc037070 con 0x7f8acc159a10 2024-03-28T21:53:13.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.363+0000 7f8ac9600640 1 -- 172.21.15.153:0/75321469 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc031b80 con 0x7f8acc159a10 2024-03-28T21:53:13.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.364+0000 7f8ad1800640 1 -- 172.21.15.153:0/75321469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc159a10 msgr2=0x7f8acc15cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:13.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.364+0000 7f8ad1800640 1 --2- 172.21.15.153:0/75321469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc159a10 0x7f8acc15cf00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009870 tx=0x7f8abc02b860 comp rx=0 tx=0).stop 2024-03-28T21:53:13.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.364+0000 7f8ad1800640 1 -- 172.21.15.153:0/75321469 shutdown_connections 2024-03-28T21:53:13.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.364+0000 7f8ad1800640 1 --2- 172.21.15.153:0/75321469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0ad830 0x7f8acc06dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.364+0000 7f8ad1800640 1 --2- 172.21.15.153:0/75321469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc159a10 0x7f8acc15cf00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.364+0000 7f8ad1800640 1 -- 172.21.15.153:0/75321469 >> 172.21.15.153:0/75321469 conn(0x7f8acc0b1a30 msgr2=0x7f8acc0b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:13.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.364+0000 7f8ad1800640 1 -- 172.21.15.153:0/75321469 shutdown_connections 2024-03-28T21:53:13.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.364+0000 7f8ad1800640 1 -- 172.21.15.153:0/75321469 wait complete. 2024-03-28T21:53:13.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.367+0000 7f8ad1800640 1 Processor -- start 2024-03-28T21:53:13.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.367+0000 7f8ad1800640 1 -- start start 2024-03-28T21:53:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.369+0000 7f8ad1800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8acc06e270 0x7f8acc1f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.369+0000 7f8ad1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0ad830 0x7f8acc1f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.369+0000 7f8ad1800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc159a10 0x7f8acc09b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.369+0000 7f8ad1800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc0ae4d0 con 0x7f8acc159a10 2024-03-28T21:53:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.369+0000 7f8ad1800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc0b3100 con 0x7f8acc06e270 2024-03-28T21:53:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.369+0000 7f8ad1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8acc0b4630 con 0x7f8acc0ad830 2024-03-28T21:53:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.369+0000 7f8acb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc159a10 0x7f8acc09b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.369+0000 7f8acb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc159a10 0x7f8acc09b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58396/0 (socket says 172.21.15.153:58396) 2024-03-28T21:53:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.369+0000 7f8acb400640 1 -- 172.21.15.153:0/2209930366 learned_addr learned my addr 172.21.15.153:0/2209930366 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:13.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.370+0000 7f8acaa00640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8acc06e270 0x7f8acc1f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:13.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.370+0000 7f8aca000640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0ad830 0x7f8acc1f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:13.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.370+0000 7f8acb400640 1 -- 172.21.15.153:0/2209930366 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0ad830 msgr2=0x7f8acc1f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:13.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.370+0000 7f8acb400640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0ad830 0x7f8acc1f3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.370+0000 7f8acb400640 1 -- 172.21.15.153:0/2209930366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8acc06e270 msgr2=0x7f8acc1f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:13.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.370+0000 7f8acb400640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8acc06e270 0x7f8acc1f4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.370+0000 7f8acb400640 1 -- 172.21.15.153:0/2209930366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8acc071a80 con 0x7f8acc159a10 2024-03-28T21:53:13.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.370+0000 7f8aca000640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0ad830 0x7f8acc1f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:13.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.370+0000 7f8acb400640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc159a10 0x7f8acc09b700 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400c780 tx=0x7f8ac400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:13.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.370+0000 7f8ac2a00640 1 -- 172.21.15.153:0/2209930366 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4004b60 con 0x7f8acc159a10 2024-03-28T21:53:13.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.370+0000 7f8ac2a00640 1 -- 172.21.15.153:0/2209930366 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac4004d00 con 0x7f8acc159a10 2024-03-28T21:53:13.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.370+0000 7f8ac2a00640 1 -- 172.21.15.153:0/2209930366 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac400aa90 con 0x7f8acc159a10 2024-03-28T21:53:13.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.370+0000 7f8ad1800640 1 -- 172.21.15.153:0/2209930366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8acc071d60 con 0x7f8acc159a10 2024-03-28T21:53:13.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.370+0000 7f8ad1800640 1 -- 172.21.15.153:0/2209930366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8acc072320 con 0x7f8acc159a10 2024-03-28T21:53:13.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.372+0000 7f8ad1800640 1 -- 172.21.15.153:0/2209930366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8acc068ff0 con 0x7f8acc159a10 2024-03-28T21:53:13.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.373+0000 7f8ac2a00640 1 -- 172.21.15.153:0/2209930366 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f8ac400ac30 con 0x7f8acc159a10 2024-03-28T21:53:13.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.373+0000 7f8ac2a00640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8aac06b4d0 0x7f8aac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:13.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.374+0000 7f8ac2a00640 1 -- 172.21.15.153:0/2209930366 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f8ac408a510 con 0x7f8acc159a10 2024-03-28T21:53:13.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.374+0000 7f8acaa00640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8aac06b4d0 0x7f8aac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:13.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.374+0000 7f8acaa00640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8aac06b4d0 0x7f8aac06d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8abc036000 tx=0x7f8abc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:13.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.378+0000 7f8ac2a00640 1 -- 172.21.15.153:0/2209930366 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8ac4020070 con 0x7f8acc159a10 2024-03-28T21:53:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.576+0000 7f8ad1800640 1 -- 172.21.15.153:0/2209930366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8acc0b0690 con 0x7f8acc159a10 2024-03-28T21:53:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.577+0000 7f8ac2a00640 1 -- 172.21.15.153:0/2209930366 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16717 (secure 0 0 0) 0x7f8ac4059390 con 0x7f8acc159a10 2024-03-28T21:53:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:13.579 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":35,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:53:10.602850+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:53:06.943079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-28T21:53:08.054176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T21:53:13.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.580+0000 7f8ad1800640 1 -- 172.21.15.153:0/2209930366 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8aac06b4d0 msgr2=0x7f8aac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:13.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.580+0000 7f8ad1800640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8aac06b4d0 0x7f8aac06d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8abc036000 tx=0x7f8abc008030 comp rx=0 tx=0).stop 2024-03-28T21:53:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.580+0000 7f8ad1800640 1 -- 172.21.15.153:0/2209930366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc159a10 msgr2=0x7f8acc09b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.580+0000 7f8ad1800640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc159a10 0x7f8acc09b700 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400c780 tx=0x7f8ac400cc40 comp rx=0 tx=0).stop 2024-03-28T21:53:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.580+0000 7f8ad1800640 1 -- 172.21.15.153:0/2209930366 shutdown_connections 2024-03-28T21:53:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.580+0000 7f8ad1800640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8aac06b4d0 0x7f8aac06d990 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.580+0000 7f8ad1800640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc159a10 0x7f8acc09b700 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.580+0000 7f8ad1800640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0ad830 0x7f8acc1f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.580+0000 7f8ad1800640 1 --2- 172.21.15.153:0/2209930366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8acc06e270 0x7f8acc1f4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.580+0000 7f8ad1800640 1 -- 172.21.15.153:0/2209930366 >> 172.21.15.153:0/2209930366 conn(0x7f8acc0b1a30 msgr2=0x7f8acc0af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.581+0000 7f8ad1800640 1 -- 172.21.15.153:0/2209930366 shutdown_connections 2024-03-28T21:53:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.581+0000 7f8ad1800640 1 -- 172.21.15.153:0/2209930366 wait complete. 2024-03-28T21:53:13.603 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-28T21:53:13.604 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T21:53:13.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.815+0000 7fdfe9800640 1 Processor -- start 2024-03-28T21:53:13.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.816+0000 7fdfe9800640 1 -- start start 2024-03-28T21:53:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.817+0000 7fdfe9800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdfe4161730 0x7fdfe406c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.817+0000 7fdfe9800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdfe4066f30 0x7fdfe406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.817+0000 7fdfe9800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfe40673f0 con 0x7fdfe4161b10 2024-03-28T21:53:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.817+0000 7fdfe9800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fdfe40b4910 con 0x7fdfe4161730 2024-03-28T21:53:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.817+0000 7fdfe9800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdfe40b42c0 con 0x7fdfe4066f30 2024-03-28T21:53:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.818+0000 7fdfe3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdfe4161730 0x7fdfe406c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.818+0000 7fdfe3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdfe4161730 0x7fdfe406c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58412/0 (socket says 172.21.15.153:58412) 2024-03-28T21:53:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.818+0000 7fdfe3e00640 1 -- 172.21.15.153:0/2866471052 learned_addr learned my addr 172.21.15.153:0/2866471052 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.818+0000 7fdfe3e00640 1 -- 172.21.15.153:0/2866471052 >> v2:172.21.15.165:3300/0 conn(0x7fdfe4066f30 msgr2=0x7fdfe406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.818+0000 7fdfe3400640 1 --2- 172.21.15.153:0/2866471052 >> v2:172.21.15.165:3300/0 conn(0x7fdfe4066f30 0x7fdfe406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.818+0000 7fdfe3e00640 1 --2- 172.21.15.153:0/2866471052 >> v2:172.21.15.165:3300/0 conn(0x7fdfe4066f30 0x7fdfe406c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.818+0000 7fdfe3e00640 1 -- 172.21.15.153:0/2866471052 >> v1:172.21.15.165:6789/0 conn(0x7fdfe4161b10 legacy=0x7fdfe40ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.818+0000 7fdfe3e00640 1 -- 172.21.15.153:0/2866471052 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe40b45a0 con 0x7fdfe4161730 2024-03-28T21:53:13.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.819+0000 7fdfe3e00640 1 --2- 172.21.15.153:0/2866471052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfe4161730 0x7fdfe406c180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4072590 tx=0x7fdfd402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bf96973573d2d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:13.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.820+0000 7fdfe2a00640 1 -- 172.21.15.153:0/2866471052 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4035020 con 0x7fdfe4161730 2024-03-28T21:53:13.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.820+0000 7fdfe2a00640 1 -- 172.21.15.153:0/2866471052 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd4031870 con 0x7fdfe4161730 2024-03-28T21:53:13.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.820+0000 7fdfe2a00640 1 -- 172.21.15.153:0/2866471052 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4031c40 con 0x7fdfe4161730 2024-03-28T21:53:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.820+0000 7fdfe9800640 1 -- 172.21.15.153:0/2866471052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfe4161730 msgr2=0x7fdfe406c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.820+0000 7fdfe9800640 1 --2- 172.21.15.153:0/2866471052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfe4161730 0x7fdfe406c180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4072590 tx=0x7fdfd402b910 comp rx=0 tx=0).stop 2024-03-28T21:53:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.820+0000 7fdfe9800640 1 -- 172.21.15.153:0/2866471052 shutdown_connections 2024-03-28T21:53:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.820+0000 7fdfe9800640 1 --2- 172.21.15.153:0/2866471052 >> v2:172.21.15.165:3300/0 conn(0x7fdfe4066f30 0x7fdfe406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.820+0000 7fdfe9800640 1 --2- 172.21.15.153:0/2866471052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfe4161730 0x7fdfe406c180 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.820+0000 7fdfe9800640 1 -- 172.21.15.153:0/2866471052 >> 172.21.15.153:0/2866471052 conn(0x7fdfe40715e0 msgr2=0x7fdfe40719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.820+0000 7fdfe9800640 1 -- 172.21.15.153:0/2866471052 shutdown_connections 2024-03-28T21:53:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.820+0000 7fdfe9800640 1 -- 172.21.15.153:0/2866471052 wait complete. 2024-03-28T21:53:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.822+0000 7fdfe9800640 1 Processor -- start 2024-03-28T21:53:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.822+0000 7fdfe9800640 1 -- start start 2024-03-28T21:53:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.823+0000 7fdfe9800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfe4066f30 0x7fdfe4147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.823+0000 7fdfe9800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfe4161730 0x7fdfe406f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.823+0000 7fdfe9800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfe4161b10 0x7fdfe41441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.823+0000 7fdfe9800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe40cf6f0 con 0x7fdfe4066f30 2024-03-28T21:53:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.823+0000 7fdfe9800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe40cf570 con 0x7fdfe4161730 2024-03-28T21:53:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.823+0000 7fdfe9800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe406e750 con 0x7fdfe4161b10 2024-03-28T21:53:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.823+0000 7fdfe3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfe4066f30 0x7fdfe4147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.823+0000 7fdfe3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfe4066f30 0x7fdfe4147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58420/0 (socket says 172.21.15.153:58420) 2024-03-28T21:53:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.823+0000 7fdfe3e00640 1 -- 172.21.15.153:0/3167787518 learned_addr learned my addr 172.21.15.153:0/3167787518 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.824+0000 7fdfe3400640 1 --2- 172.21.15.153:0/3167787518 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfe4161730 0x7fdfe406f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.824+0000 7fdfe3e00640 1 -- 172.21.15.153:0/3167787518 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfe4161b10 msgr2=0x7fdfe41441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.824+0000 7fdfe3e00640 1 --2- 172.21.15.153:0/3167787518 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfe4161b10 0x7fdfe41441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.824+0000 7fdfe3e00640 1 -- 172.21.15.153:0/3167787518 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfe4161730 msgr2=0x7fdfe406f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.824+0000 7fdfe3e00640 1 --2- 172.21.15.153:0/3167787518 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfe4161730 0x7fdfe406f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.824+0000 7fdfe3e00640 1 -- 172.21.15.153:0/3167787518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe4159980 con 0x7fdfe4066f30 2024-03-28T21:53:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.824+0000 7fdfe3e00640 1 --2- 172.21.15.153:0/3167787518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfe4066f30 0x7fdfe4147870 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4000c00 tx=0x7fdfd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.824+0000 7fdfdbe00640 1 -- 172.21.15.153:0/3167787518 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4040070 con 0x7fdfe4066f30 2024-03-28T21:53:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.825+0000 7fdfdbe00640 1 -- 172.21.15.153:0/3167787518 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd403a420 con 0x7fdfe4066f30 2024-03-28T21:53:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.825+0000 7fdfdbe00640 1 -- 172.21.15.153:0/3167787518 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4035040 con 0x7fdfe4066f30 2024-03-28T21:53:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.825+0000 7fdfe9800640 1 -- 172.21.15.153:0/3167787518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe4147db0 con 0x7fdfe4066f30 2024-03-28T21:53:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.825+0000 7fdfe9800640 1 -- 172.21.15.153:0/3167787518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe4159c20 con 0x7fdfe4066f30 2024-03-28T21:53:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.826+0000 7fdfe9800640 1 -- 172.21.15.153:0/3167787518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfe404f520 con 0x7fdfe4066f30 2024-03-28T21:53:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.827+0000 7fdfdbe00640 1 -- 172.21.15.153:0/3167787518 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fdfd404b060 con 0x7fdfe4066f30 2024-03-28T21:53:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.828+0000 7fdfdbe00640 1 --2- 172.21.15.153:0/3167787518 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdfc406b520 0x7fdfc406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.828+0000 7fdfdbe00640 1 -- 172.21.15.153:0/3167787518 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fdfd40ac200 con 0x7fdfe4066f30 2024-03-28T21:53:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.828+0000 7fdfe3400640 1 --2- 172.21.15.153:0/3167787518 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdfc406b520 0x7fdfc406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:13.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.829+0000 7fdfe3400640 1 --2- 172.21.15.153:0/3167787518 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdfc406b520 0x7fdfc406d9e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0006fd0 tx=0x7fdfd0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:13.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:13.832+0000 7fdfdbe00640 1 -- 172.21.15.153:0/3167787518 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdfd407b060 con 0x7fdfe4066f30 2024-03-28T21:53:14.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.042+0000 7fdfe9800640 1 -- 172.21.15.153:0/3167787518 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdfe40b58f0 con 0x7fdfc406b520 2024-03-28T21:53:14.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.050+0000 7fdfdbe00640 1 -- 172.21.15.153:0/3167787518 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240952 (secure 0 0 0) 0x7fdfe40b58f0 con 0x7fdfc406b520 2024-03-28T21:53:14.055 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:14.057 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-03-28T21:53:14.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.056+0000 7fdfe9800640 1 -- 172.21.15.153:0/3167787518 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdfc406b520 msgr2=0x7fdfc406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.056+0000 7fdfe9800640 1 --2- 172.21.15.153:0/3167787518 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdfc406b520 0x7fdfc406d9e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0006fd0 tx=0x7fdfd0008040 comp rx=0 tx=0).stop 2024-03-28T21:53:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.056+0000 7fdfe9800640 1 -- 172.21.15.153:0/3167787518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfe4066f30 msgr2=0x7fdfe4147870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.056+0000 7fdfe9800640 1 --2- 172.21.15.153:0/3167787518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfe4066f30 0x7fdfe4147870 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4000c00 tx=0x7fdfd40046c0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.056+0000 7fdfe9800640 1 -- 172.21.15.153:0/3167787518 shutdown_connections 2024-03-28T21:53:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.056+0000 7fdfe9800640 1 --2- 172.21.15.153:0/3167787518 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fdfc406b520 0x7fdfc406d9e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.056+0000 7fdfe9800640 1 --2- 172.21.15.153:0/3167787518 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfe4161b10 0x7fdfe41441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.056+0000 7fdfe9800640 1 --2- 172.21.15.153:0/3167787518 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfe4161730 0x7fdfe406f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.056+0000 7fdfe9800640 1 --2- 172.21.15.153:0/3167787518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfe4066f30 0x7fdfe4147870 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.056+0000 7fdfe9800640 1 -- 172.21.15.153:0/3167787518 >> 172.21.15.153:0/3167787518 conn(0x7fdfe40715e0 msgr2=0x7fdfe40ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.056+0000 7fdfe9800640 1 -- 172.21.15.153:0/3167787518 shutdown_connections 2024-03-28T21:53:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.057+0000 7fdfe9800640 1 -- 172.21.15.153:0/3167787518 wait complete. 2024-03-28T21:53:14.078 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-03-28T21:53:13.487214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224256,"kb_used_data":3920,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750464,"statfs":{"total":773094113280,"available":772864475136,"internally_reserved":0,"allocated":4014080,"data_stored":2250494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.926767"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.584047+0000","last_change":"2024-03-28T21:53:08.584047+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.584047+0000","last_undegraded":"2024-03-28T21:53:08.584047+0000","last_fullsized":"2024-03-28T21:53:08.584047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.583449+0000","last_change":"2024-03-28T21:53:08.583449+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.583449+0000","last_undegraded":"2024-03-28T21:53:08.583449+0000","last_fullsized":"2024-03-28T21:53:08.583449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.583519+0000","last_change":"2024-03-28T21:53:08.583519+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.583519+0000","last_undegraded":"2024-03-28T21:53:08.583519+0000","last_fullsized":"2024-03-28T21:53:08.583519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.583211+0000","last_change":"2024-03-28T21:53:08.583211+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.583211+0000","last_undegraded":"2024-03-28T21:53:08.583211+0000","last_fullsized":"2024-03-28T21:53:08.583211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.584390+0000","last_change":"2024-03-28T21:53:08.584390+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.584390+0000","last_undegraded":"2024-03-28T21:53:08.584390+0000","last_fullsized":"2024-03-28T21:53:08.584390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.569999+0000","last_change":"2024-03-28T21:53:07.569999+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.569999+0000","last_undegraded":"2024-03-28T21:53:07.569999+0000","last_fullsized":"2024-03-28T21:53:07.569999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-03-28T21:53:08.575019+0000","last_change":"2024-03-28T21:53:08.575019+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.575019+0000","last_undegraded":"2024-03-28T21:53:08.575019+0000","last_fullsized":"2024-03-28T21:53:08.575019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.571438+0000","last_change":"2024-03-28T21:53:07.571438+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.571438+0000","last_undegraded":"2024-03-28T21:53:07.571438+0000","last_fullsized":"2024-03-28T21:53:07.571438+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-03-28T21:53:08.575126+0000","last_change":"2024-03-28T21:53:08.575126+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.575126+0000","last_undegraded":"2024-03-28T21:53:08.575126+0000","last_fullsized":"2024-03-28T21:53:08.575126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.567590+0000","last_change":"2024-03-28T21:53:07.567590+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.567590+0000","last_undegraded":"2024-03-28T21:53:07.567590+0000","last_fullsized":"2024-03-28T21:53:07.567590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.565953+0000","last_change":"2024-03-28T21:53:07.565953+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.565953+0000","last_undegraded":"2024-03-28T21:53:07.565953+0000","last_fullsized":"2024-03-28T21:53:07.565953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.573557+0000","last_change":"2024-03-28T21:53:07.573557+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.573557+0000","last_undegraded":"2024-03-28T21:53:07.573557+0000","last_fullsized":"2024-03-28T21:53:07.573557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.565902+0000","last_change":"2024-03-28T21:53:07.565902+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.565902+0000","last_undegraded":"2024-03-28T21:53:07.565902+0000","last_fullsized":"2024-03-28T21:53:07.565902+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.572438+0000","last_change":"2024-03-28T21:53:07.572438+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.572438+0000","last_undegraded":"2024-03-28T21:53:07.572438+0000","last_fullsized":"2024-03-28T21:53:07.572438+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-28T21:53:08.585643+0000","last_change":"2024-03-28T21:53:08.585643+0000","last_active":"2024-03-28T21:53:08.585643+0000","last_peered":"2024-03-28T21:53:08.585643+0000","last_clean":"2024-03-28T21:53:08.585643+0000","last_became_active":"2024-03-28T21:53:08.585344+0000","last_became_peered":"2024-03-28T21:53:08.585344+0000","last_unstale":"2024-03-28T21:53:08.585643+0000","last_undegraded":"2024-03-28T21:53:08.585643+0000","last_fullsized":"2024-03-28T21:53:08.585643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:43:19.841764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.576432+0000","last_change":"2024-03-28T21:53:07.576432+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.576432+0000","last_undegraded":"2024-03-28T21:53:07.576432+0000","last_fullsized":"2024-03-28T21:53:07.576432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570749+0000","last_change":"2024-03-28T21:53:07.570749+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570749+0000","last_undegraded":"2024-03-28T21:53:07.570749+0000","last_fullsized":"2024-03-28T21:53:07.570749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.566263+0000","last_change":"2024-03-28T21:53:07.566263+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.566263+0000","last_undegraded":"2024-03-28T21:53:07.566263+0000","last_fullsized":"2024-03-28T21:53:07.566263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.573957+0000","last_change":"2024-03-28T21:53:07.573957+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.573957+0000","last_undegraded":"2024-03-28T21:53:07.573957+0000","last_fullsized":"2024-03-28T21:53:07.573957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570658+0000","last_change":"2024-03-28T21:53:07.570658+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570658+0000","last_undegraded":"2024-03-28T21:53:07.570658+0000","last_fullsized":"2024-03-28T21:53:07.570658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.573473+0000","last_change":"2024-03-28T21:53:07.573473+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.573473+0000","last_undegraded":"2024-03-28T21:53:07.573473+0000","last_fullsized":"2024-03-28T21:53:07.573473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.571383+0000","last_change":"2024-03-28T21:53:07.571383+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.571383+0000","last_undegraded":"2024-03-28T21:53:07.571383+0000","last_fullsized":"2024-03-28T21:53:07.571383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.566337+0000","last_change":"2024-03-28T21:53:07.566337+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.566337+0000","last_undegraded":"2024-03-28T21:53:07.566337+0000","last_fullsized":"2024-03-28T21:53:07.566337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.566507+0000","last_change":"2024-03-28T21:53:07.566507+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.566507+0000","last_undegraded":"2024-03-28T21:53:07.566507+0000","last_fullsized":"2024-03-28T21:53:07.566507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.580863+0000","last_change":"2024-03-28T21:53:08.580863+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.580863+0000","last_undegraded":"2024-03-28T21:53:08.580863+0000","last_fullsized":"2024-03-28T21:53:08.580863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.568457+0000","last_change":"2024-03-28T21:53:07.568457+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.568457+0000","last_undegraded":"2024-03-28T21:53:07.568457+0000","last_fullsized":"2024-03-28T21:53:07.568457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.579899+0000","last_change":"2024-03-28T21:53:08.579899+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.579899+0000","last_undegraded":"2024-03-28T21:53:08.579899+0000","last_fullsized":"2024-03-28T21:53:08.579899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-28T21:53:08.590224+0000","last_change":"2024-03-28T21:53:08.590224+0000","last_active":"2024-03-28T21:53:08.590224+0000","last_peered":"2024-03-28T21:53:08.590224+0000","last_clean":"2024-03-28T21:53:08.590224+0000","last_became_active":"2024-03-28T21:53:08.589942+0000","last_became_peered":"2024-03-28T21:53:08.589942+0000","last_unstale":"2024-03-28T21:53:08.590224+0000","last_undegraded":"2024-03-28T21:53:08.590224+0000","last_fullsized":"2024-03-28T21:53:08.590224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:10:31.836071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.582093+0000","last_change":"2024-03-28T21:53:08.582093+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.582093+0000","last_undegraded":"2024-03-28T21:53:08.582093+0000","last_fullsized":"2024-03-28T21:53:08.582093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570379+0000","last_change":"2024-03-28T21:53:07.570379+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570379+0000","last_undegraded":"2024-03-28T21:53:07.570379+0000","last_fullsized":"2024-03-28T21:53:07.570379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.578616+0000","last_change":"2024-03-28T21:53:08.578616+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.578616+0000","last_undegraded":"2024-03-28T21:53:08.578616+0000","last_fullsized":"2024-03-28T21:53:08.578616+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.567921+0000","last_change":"2024-03-28T21:53:07.567921+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.567921+0000","last_undegraded":"2024-03-28T21:53:07.567921+0000","last_fullsized":"2024-03-28T21:53:07.567921+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.575921+0000","last_change":"2024-03-28T21:53:07.575921+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.575921+0000","last_undegraded":"2024-03-28T21:53:07.575921+0000","last_fullsized":"2024-03-28T21:53:07.575921+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.578827+0000","last_change":"2024-03-28T21:53:08.578827+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.578827+0000","last_undegraded":"2024-03-28T21:53:08.578827+0000","last_fullsized":"2024-03-28T21:53:08.578827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570877+0000","last_change":"2024-03-28T21:53:07.570877+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570877+0000","last_undegraded":"2024-03-28T21:53:07.570877+0000","last_fullsized":"2024-03-28T21:53:07.570877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-03-28T21:53:08.591740+0000","last_change":"2024-03-28T21:53:08.591668+0000","last_active":"2024-03-28T21:53:08.591740+0000","last_peered":"2024-03-28T21:53:08.591740+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"2024-03-28T21:53:08.591668+0000","last_became_peered":"2024-03-28T21:53:08.591668+0000","last_unstale":"2024-03-28T21:53:08.591740+0000","last_undegraded":"2024-03-28T21:53:08.591740+0000","last_fullsized":"2024-03-28T21:53:08.591740+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.582597+0000","last_change":"2024-03-28T21:53:08.582597+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.582597+0000","last_undegraded":"2024-03-28T21:53:08.582597+0000","last_fullsized":"2024-03-28T21:53:08.582597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.572318+0000","last_change":"2024-03-28T21:53:07.572318+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.572318+0000","last_undegraded":"2024-03-28T21:53:07.572318+0000","last_fullsized":"2024-03-28T21:53:07.572318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-03-28T21:53:08.575519+0000","last_change":"2024-03-28T21:53:08.575519+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.575519+0000","last_undegraded":"2024-03-28T21:53:08.575519+0000","last_fullsized":"2024-03-28T21:53:08.575519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.578562+0000","last_change":"2024-03-28T21:53:08.578562+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.578562+0000","last_undegraded":"2024-03-28T21:53:08.578562+0000","last_fullsized":"2024-03-28T21:53:08.578562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570787+0000","last_change":"2024-03-28T21:53:07.570787+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570787+0000","last_undegraded":"2024-03-28T21:53:07.570787+0000","last_fullsized":"2024-03-28T21:53:07.570787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.565905+0000","last_change":"2024-03-28T21:53:07.565905+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.565905+0000","last_undegraded":"2024-03-28T21:53:07.565905+0000","last_fullsized":"2024-03-28T21:53:07.565905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.571309+0000","last_change":"2024-03-28T21:53:07.571309+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.571309+0000","last_undegraded":"2024-03-28T21:53:07.571309+0000","last_fullsized":"2024-03-28T21:53:07.571309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.569845+0000","last_change":"2024-03-28T21:53:07.569845+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.569845+0000","last_undegraded":"2024-03-28T21:53:07.569845+0000","last_fullsized":"2024-03-28T21:53:07.569845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-28T21:53:07.579288+0000","last_change":"2024-03-28T21:51:51.547812+0000","last_active":"2024-03-28T21:53:07.579288+0000","last_peered":"2024-03-28T21:53:07.579288+0000","last_clean":"2024-03-28T21:53:07.579288+0000","last_became_active":"2024-03-28T21:51:51.545783+0000","last_became_peered":"2024-03-28T21:51:51.545783+0000","last_unstale":"2024-03-28T21:53:07.579288+0000","last_undegraded":"2024-03-28T21:53:07.579288+0000","last_fullsized":"2024-03-28T21:53:07.579288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_clean_scrub_stamp":"2024-03-28T21:51:50.185942+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:08:34.531035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":937984,"data_stored":719725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":129357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":725542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T21:53:14.083 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T21:53:14.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.328+0000 7fb9cac00640 1 Processor -- start 2024-03-28T21:53:14.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.328+0000 7fb9cac00640 1 -- start start 2024-03-28T21:53:14.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.330+0000 7fb9cac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c415ade0 0x7fb9c40acd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:14.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.330+0000 7fb9cac00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb9c415ef20 0x7fb9c415f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:14.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.330+0000 7fb9cac00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9c415ea70 con 0x7fb9c40ae8e0 2024-03-28T21:53:14.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.330+0000 7fb9cac00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb9c40aee50 con 0x7fb9c415ef20 2024-03-28T21:53:14.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.330+0000 7fb9cac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c40af130 con 0x7fb9c415ade0 2024-03-28T21:53:14.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.330+0000 7fb9c8c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb9c415ef20 0x7fb9c415f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:14.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.330+0000 7fb9bb400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb9c40ae8e0 0x7fb9c40b3f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59090/0 (socket says 172.21.15.153:59090) 2024-03-28T21:53:14.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.330+0000 7fb9bb400640 1 -- 172.21.15.153:0/2982673518 learned_addr learned my addr 172.21.15.153:0/2982673518 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:14.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.331+0000 7fb9c3e00640 1 --2- 172.21.15.153:0/2982673518 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c415ade0 0x7fb9c40acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:14.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.331+0000 7fb9c3400640 1 -- 172.21.15.153:0/2982673518 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3558204282 0 0) 0x7fb9c415ea70 con 0x7fb9c40ae8e0 2024-03-28T21:53:14.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.331+0000 7fb9c8c00640 1 -- 172.21.15.153:0/2982673518 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c415ade0 msgr2=0x7fb9c40acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:14.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.331+0000 7fb9c8c00640 1 --2- 172.21.15.153:0/2982673518 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c415ade0 0x7fb9c40acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.331+0000 7fb9c8c00640 1 -- 172.21.15.153:0/2982673518 >> v1:172.21.15.153:6789/0 conn(0x7fb9c40ae8e0 legacy=0x7fb9c40b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:14.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.331+0000 7fb9c8c00640 1 -- 172.21.15.153:0/2982673518 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c40af410 con 0x7fb9c415ef20 2024-03-28T21:53:14.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.333+0000 7fb9c8c00640 1 --2- 172.21.15.153:0/2982673518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c415ef20 0x7fb9c415f3b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009d90 tx=0x7fb9bc02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39fdb8129889ad47 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:14.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.333+0000 7fb9c3400640 1 -- 172.21.15.153:0/2982673518 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc039070 con 0x7fb9c415ef20 2024-03-28T21:53:14.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.333+0000 7fb9c3400640 1 -- 172.21.15.153:0/2982673518 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9bc02cc50 con 0x7fb9c415ef20 2024-03-28T21:53:14.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.333+0000 7fb9c3400640 1 -- 172.21.15.153:0/2982673518 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc034440 con 0x7fb9c415ef20 2024-03-28T21:53:14.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.333+0000 7fb9cac00640 1 -- 172.21.15.153:0/2982673518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c415ef20 msgr2=0x7fb9c415f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:14.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.333+0000 7fb9cac00640 1 --2- 172.21.15.153:0/2982673518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c415ef20 0x7fb9c415f3b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009d90 tx=0x7fb9bc02bea0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.334+0000 7fb9cac00640 1 -- 172.21.15.153:0/2982673518 shutdown_connections 2024-03-28T21:53:14.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.334+0000 7fb9cac00640 1 --2- 172.21.15.153:0/2982673518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c415ef20 0x7fb9c415f3b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.334+0000 7fb9cac00640 1 --2- 172.21.15.153:0/2982673518 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c415ade0 0x7fb9c40acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.334+0000 7fb9cac00640 1 -- 172.21.15.153:0/2982673518 >> 172.21.15.153:0/2982673518 conn(0x7fb9c40b1a30 msgr2=0x7fb9c40b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:14.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.334+0000 7fb9cac00640 1 -- 172.21.15.153:0/2982673518 shutdown_connections 2024-03-28T21:53:14.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.334+0000 7fb9cac00640 1 -- 172.21.15.153:0/2982673518 wait complete. 2024-03-28T21:53:14.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.335+0000 7fb9cac00640 1 Processor -- start 2024-03-28T21:53:14.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.335+0000 7fb9cac00640 1 -- start start 2024-03-28T21:53:14.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.336+0000 7fb9cac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c40ae8e0 0x7fb9c409acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:14.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.336+0000 7fb9cac00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9c415ade0 0x7fb9c4154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:14.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.336+0000 7fb9cac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c415ef20 0x7fb9c4143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:14.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.336+0000 7fb9cac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c40af6f0 con 0x7fb9c40ae8e0 2024-03-28T21:53:14.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.336+0000 7fb9cac00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c40ad2c0 con 0x7fb9c415ade0 2024-03-28T21:53:14.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.336+0000 7fb9cac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c415b1c0 con 0x7fb9c415ef20 2024-03-28T21:53:14.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.337+0000 7fb9c3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c40ae8e0 0x7fb9c409acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:14.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.337+0000 7fb9c3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c40ae8e0 0x7fb9c409acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58442/0 (socket says 172.21.15.153:58442) 2024-03-28T21:53:14.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.337+0000 7fb9c3e00640 1 -- 172.21.15.153:0/916667089 learned_addr learned my addr 172.21.15.153:0/916667089 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:14.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.337+0000 7fb9c3e00640 1 -- 172.21.15.153:0/916667089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c415ef20 msgr2=0x7fb9c4143d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:14.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.337+0000 7fb9c3e00640 1 --2- 172.21.15.153:0/916667089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c415ef20 0x7fb9c4143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.337+0000 7fb9c3e00640 1 -- 172.21.15.153:0/916667089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9c415ade0 msgr2=0x7fb9c4154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:14.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.337+0000 7fb9c3e00640 1 --2- 172.21.15.153:0/916667089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9c415ade0 0x7fb9c4154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.337+0000 7fb9c3e00640 1 -- 172.21.15.153:0/916667089 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c4144860 con 0x7fb9c40ae8e0 2024-03-28T21:53:14.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.337+0000 7fb9c3e00640 1 --2- 172.21.15.153:0/916667089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c40ae8e0 0x7fb9c409acc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400d800 tx=0x7fb9b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:14.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.338+0000 7fb9c0c00640 1 -- 172.21.15.153:0/916667089 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400b6c0 con 0x7fb9c40ae8e0 2024-03-28T21:53:14.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.338+0000 7fb9c0c00640 1 -- 172.21.15.153:0/916667089 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b4019070 con 0x7fb9c40ae8e0 2024-03-28T21:53:14.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.338+0000 7fb9c0c00640 1 -- 172.21.15.153:0/916667089 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400ba80 con 0x7fb9c40ae8e0 2024-03-28T21:53:14.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.338+0000 7fb9cac00640 1 -- 172.21.15.153:0/916667089 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c4144ba0 con 0x7fb9c40ae8e0 2024-03-28T21:53:14.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.338+0000 7fb9cac00640 1 -- 172.21.15.153:0/916667089 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c409ca80 con 0x7fb9c40ae8e0 2024-03-28T21:53:14.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.339+0000 7fb9cac00640 1 -- 172.21.15.153:0/916667089 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c4068ff0 con 0x7fb9c40ae8e0 2024-03-28T21:53:14.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.340+0000 7fb9c0c00640 1 -- 172.21.15.153:0/916667089 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb9b400bc20 con 0x7fb9c40ae8e0 2024-03-28T21:53:14.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.341+0000 7fb9c0c00640 1 --2- 172.21.15.153:0/916667089 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb9a006b4d0 0x7fb9a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:14.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.341+0000 7fb9c0c00640 1 -- 172.21.15.153:0/916667089 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fb9b408a750 con 0x7fb9c40ae8e0 2024-03-28T21:53:14.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.341+0000 7fb9bb400640 1 --2- 172.21.15.153:0/916667089 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb9a006b4d0 0x7fb9a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:14.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.342+0000 7fb9bb400640 1 --2- 172.21.15.153:0/916667089 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb9a006b4d0 0x7fb9a006d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac007fd0 tx=0x7fb9ac007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:14.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.345+0000 7fb9c0c00640 1 -- 172.21.15.153:0/916667089 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb9c4144ba0 con 0x7fb9c40ae8e0 2024-03-28T21:53:14.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.571+0000 7fb9cac00640 1 -- 172.21.15.153:0/916667089 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9c40b28a0 con 0x7fb9a006b4d0 2024-03-28T21:53:14.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.578+0000 7fb9c0c00640 1 -- 172.21.15.153:0/916667089 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240952 (secure 0 0 0) 0x7fb9c40b28a0 con 0x7fb9a006b4d0 2024-03-28T21:53:14.582 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:14.583 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-03-28T21:53:14.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.582+0000 7fb9cac00640 1 -- 172.21.15.153:0/916667089 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb9a006b4d0 msgr2=0x7fb9a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:14.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.582+0000 7fb9cac00640 1 --2- 172.21.15.153:0/916667089 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb9a006b4d0 0x7fb9a006d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac007fd0 tx=0x7fb9ac007960 comp rx=0 tx=0).stop 2024-03-28T21:53:14.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.582+0000 7fb9cac00640 1 -- 172.21.15.153:0/916667089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c40ae8e0 msgr2=0x7fb9c409acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:14.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.582+0000 7fb9cac00640 1 --2- 172.21.15.153:0/916667089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c40ae8e0 0x7fb9c409acc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400d800 tx=0x7fb9b400dcc0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.583+0000 7fb9cac00640 1 -- 172.21.15.153:0/916667089 shutdown_connections 2024-03-28T21:53:14.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.583+0000 7fb9cac00640 1 --2- 172.21.15.153:0/916667089 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb9a006b4d0 0x7fb9a006d990 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.583+0000 7fb9cac00640 1 --2- 172.21.15.153:0/916667089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c415ef20 0x7fb9c4143d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.583+0000 7fb9cac00640 1 --2- 172.21.15.153:0/916667089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9c415ade0 0x7fb9c4154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.583+0000 7fb9cac00640 1 --2- 172.21.15.153:0/916667089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9c40ae8e0 0x7fb9c409acc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.583+0000 7fb9cac00640 1 -- 172.21.15.153:0/916667089 >> 172.21.15.153:0/916667089 conn(0x7fb9c40b1a30 msgr2=0x7fb9c40b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:14.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.583+0000 7fb9cac00640 1 -- 172.21.15.153:0/916667089 shutdown_connections 2024-03-28T21:53:14.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.583+0000 7fb9cac00640 1 -- 172.21.15.153:0/916667089 wait complete. 2024-03-28T21:53:14.601 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-03-28T21:53:13.487214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224256,"kb_used_data":3920,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750464,"statfs":{"total":773094113280,"available":772864475136,"internally_reserved":0,"allocated":4014080,"data_stored":2250494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.926767"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.584047+0000","last_change":"2024-03-28T21:53:08.584047+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.584047+0000","last_undegraded":"2024-03-28T21:53:08.584047+0000","last_fullsized":"2024-03-28T21:53:08.584047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.583449+0000","last_change":"2024-03-28T21:53:08.583449+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.583449+0000","last_undegraded":"2024-03-28T21:53:08.583449+0000","last_fullsized":"2024-03-28T21:53:08.583449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.583519+0000","last_change":"2024-03-28T21:53:08.583519+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.583519+0000","last_undegraded":"2024-03-28T21:53:08.583519+0000","last_fullsized":"2024-03-28T21:53:08.583519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.583211+0000","last_change":"2024-03-28T21:53:08.583211+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.583211+0000","last_undegraded":"2024-03-28T21:53:08.583211+0000","last_fullsized":"2024-03-28T21:53:08.583211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.584390+0000","last_change":"2024-03-28T21:53:08.584390+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.584390+0000","last_undegraded":"2024-03-28T21:53:08.584390+0000","last_fullsized":"2024-03-28T21:53:08.584390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.569999+0000","last_change":"2024-03-28T21:53:07.569999+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.569999+0000","last_undegraded":"2024-03-28T21:53:07.569999+0000","last_fullsized":"2024-03-28T21:53:07.569999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-03-28T21:53:08.575019+0000","last_change":"2024-03-28T21:53:08.575019+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.575019+0000","last_undegraded":"2024-03-28T21:53:08.575019+0000","last_fullsized":"2024-03-28T21:53:08.575019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.571438+0000","last_change":"2024-03-28T21:53:07.571438+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.571438+0000","last_undegraded":"2024-03-28T21:53:07.571438+0000","last_fullsized":"2024-03-28T21:53:07.571438+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-03-28T21:53:08.575126+0000","last_change":"2024-03-28T21:53:08.575126+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.575126+0000","last_undegraded":"2024-03-28T21:53:08.575126+0000","last_fullsized":"2024-03-28T21:53:08.575126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.567590+0000","last_change":"2024-03-28T21:53:07.567590+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.567590+0000","last_undegraded":"2024-03-28T21:53:07.567590+0000","last_fullsized":"2024-03-28T21:53:07.567590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.565953+0000","last_change":"2024-03-28T21:53:07.565953+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.565953+0000","last_undegraded":"2024-03-28T21:53:07.565953+0000","last_fullsized":"2024-03-28T21:53:07.565953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.573557+0000","last_change":"2024-03-28T21:53:07.573557+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.573557+0000","last_undegraded":"2024-03-28T21:53:07.573557+0000","last_fullsized":"2024-03-28T21:53:07.573557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.565902+0000","last_change":"2024-03-28T21:53:07.565902+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.565902+0000","last_undegraded":"2024-03-28T21:53:07.565902+0000","last_fullsized":"2024-03-28T21:53:07.565902+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.572438+0000","last_change":"2024-03-28T21:53:07.572438+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.572438+0000","last_undegraded":"2024-03-28T21:53:07.572438+0000","last_fullsized":"2024-03-28T21:53:07.572438+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-28T21:53:08.585643+0000","last_change":"2024-03-28T21:53:08.585643+0000","last_active":"2024-03-28T21:53:08.585643+0000","last_peered":"2024-03-28T21:53:08.585643+0000","last_clean":"2024-03-28T21:53:08.585643+0000","last_became_active":"2024-03-28T21:53:08.585344+0000","last_became_peered":"2024-03-28T21:53:08.585344+0000","last_unstale":"2024-03-28T21:53:08.585643+0000","last_undegraded":"2024-03-28T21:53:08.585643+0000","last_fullsized":"2024-03-28T21:53:08.585643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:43:19.841764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.576432+0000","last_change":"2024-03-28T21:53:07.576432+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.576432+0000","last_undegraded":"2024-03-28T21:53:07.576432+0000","last_fullsized":"2024-03-28T21:53:07.576432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570749+0000","last_change":"2024-03-28T21:53:07.570749+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570749+0000","last_undegraded":"2024-03-28T21:53:07.570749+0000","last_fullsized":"2024-03-28T21:53:07.570749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.566263+0000","last_change":"2024-03-28T21:53:07.566263+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.566263+0000","last_undegraded":"2024-03-28T21:53:07.566263+0000","last_fullsized":"2024-03-28T21:53:07.566263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.573957+0000","last_change":"2024-03-28T21:53:07.573957+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.573957+0000","last_undegraded":"2024-03-28T21:53:07.573957+0000","last_fullsized":"2024-03-28T21:53:07.573957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570658+0000","last_change":"2024-03-28T21:53:07.570658+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570658+0000","last_undegraded":"2024-03-28T21:53:07.570658+0000","last_fullsized":"2024-03-28T21:53:07.570658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.573473+0000","last_change":"2024-03-28T21:53:07.573473+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.573473+0000","last_undegraded":"2024-03-28T21:53:07.573473+0000","last_fullsized":"2024-03-28T21:53:07.573473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.571383+0000","last_change":"2024-03-28T21:53:07.571383+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.571383+0000","last_undegraded":"2024-03-28T21:53:07.571383+0000","last_fullsized":"2024-03-28T21:53:07.571383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.566337+0000","last_change":"2024-03-28T21:53:07.566337+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.566337+0000","last_undegraded":"2024-03-28T21:53:07.566337+0000","last_fullsized":"2024-03-28T21:53:07.566337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.566507+0000","last_change":"2024-03-28T21:53:07.566507+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.566507+0000","last_undegraded":"2024-03-28T21:53:07.566507+0000","last_fullsized":"2024-03-28T21:53:07.566507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.580863+0000","last_change":"2024-03-28T21:53:08.580863+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.580863+0000","last_undegraded":"2024-03-28T21:53:08.580863+0000","last_fullsized":"2024-03-28T21:53:08.580863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.568457+0000","last_change":"2024-03-28T21:53:07.568457+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.568457+0000","last_undegraded":"2024-03-28T21:53:07.568457+0000","last_fullsized":"2024-03-28T21:53:07.568457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.579899+0000","last_change":"2024-03-28T21:53:08.579899+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.579899+0000","last_undegraded":"2024-03-28T21:53:08.579899+0000","last_fullsized":"2024-03-28T21:53:08.579899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-28T21:53:08.590224+0000","last_change":"2024-03-28T21:53:08.590224+0000","last_active":"2024-03-28T21:53:08.590224+0000","last_peered":"2024-03-28T21:53:08.590224+0000","last_clean":"2024-03-28T21:53:08.590224+0000","last_became_active":"2024-03-28T21:53:08.589942+0000","last_became_peered":"2024-03-28T21:53:08.589942+0000","last_unstale":"2024-03-28T21:53:08.590224+0000","last_undegraded":"2024-03-28T21:53:08.590224+0000","last_fullsized":"2024-03-28T21:53:08.590224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:10:31.836071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.582093+0000","last_change":"2024-03-28T21:53:08.582093+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.582093+0000","last_undegraded":"2024-03-28T21:53:08.582093+0000","last_fullsized":"2024-03-28T21:53:08.582093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570379+0000","last_change":"2024-03-28T21:53:07.570379+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570379+0000","last_undegraded":"2024-03-28T21:53:07.570379+0000","last_fullsized":"2024-03-28T21:53:07.570379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.578616+0000","last_change":"2024-03-28T21:53:08.578616+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.578616+0000","last_undegraded":"2024-03-28T21:53:08.578616+0000","last_fullsized":"2024-03-28T21:53:08.578616+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.567921+0000","last_change":"2024-03-28T21:53:07.567921+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.567921+0000","last_undegraded":"2024-03-28T21:53:07.567921+0000","last_fullsized":"2024-03-28T21:53:07.567921+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.575921+0000","last_change":"2024-03-28T21:53:07.575921+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.575921+0000","last_undegraded":"2024-03-28T21:53:07.575921+0000","last_fullsized":"2024-03-28T21:53:07.575921+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.578827+0000","last_change":"2024-03-28T21:53:08.578827+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.578827+0000","last_undegraded":"2024-03-28T21:53:08.578827+0000","last_fullsized":"2024-03-28T21:53:08.578827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570877+0000","last_change":"2024-03-28T21:53:07.570877+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570877+0000","last_undegraded":"2024-03-28T21:53:07.570877+0000","last_fullsized":"2024-03-28T21:53:07.570877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-03-28T21:53:08.591740+0000","last_change":"2024-03-28T21:53:08.591668+0000","last_active":"2024-03-28T21:53:08.591740+0000","last_peered":"2024-03-28T21:53:08.591740+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"2024-03-28T21:53:08.591668+0000","last_became_peered":"2024-03-28T21:53:08.591668+0000","last_unstale":"2024-03-28T21:53:08.591740+0000","last_undegraded":"2024-03-28T21:53:08.591740+0000","last_fullsized":"2024-03-28T21:53:08.591740+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.582597+0000","last_change":"2024-03-28T21:53:08.582597+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.582597+0000","last_undegraded":"2024-03-28T21:53:08.582597+0000","last_fullsized":"2024-03-28T21:53:08.582597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.572318+0000","last_change":"2024-03-28T21:53:07.572318+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.572318+0000","last_undegraded":"2024-03-28T21:53:07.572318+0000","last_fullsized":"2024-03-28T21:53:07.572318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-03-28T21:53:08.575519+0000","last_change":"2024-03-28T21:53:08.575519+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.575519+0000","last_undegraded":"2024-03-28T21:53:08.575519+0000","last_fullsized":"2024-03-28T21:53:08.575519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.578562+0000","last_change":"2024-03-28T21:53:08.578562+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.578562+0000","last_undegraded":"2024-03-28T21:53:08.578562+0000","last_fullsized":"2024-03-28T21:53:08.578562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570787+0000","last_change":"2024-03-28T21:53:07.570787+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570787+0000","last_undegraded":"2024-03-28T21:53:07.570787+0000","last_fullsized":"2024-03-28T21:53:07.570787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.565905+0000","last_change":"2024-03-28T21:53:07.565905+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.565905+0000","last_undegraded":"2024-03-28T21:53:07.565905+0000","last_fullsized":"2024-03-28T21:53:07.565905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.571309+0000","last_change":"2024-03-28T21:53:07.571309+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.571309+0000","last_undegraded":"2024-03-28T21:53:07.571309+0000","last_fullsized":"2024-03-28T21:53:07.571309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.569845+0000","last_change":"2024-03-28T21:53:07.569845+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.569845+0000","last_undegraded":"2024-03-28T21:53:07.569845+0000","last_fullsized":"2024-03-28T21:53:07.569845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-28T21:53:07.579288+0000","last_change":"2024-03-28T21:51:51.547812+0000","last_active":"2024-03-28T21:53:07.579288+0000","last_peered":"2024-03-28T21:53:07.579288+0000","last_clean":"2024-03-28T21:53:07.579288+0000","last_became_active":"2024-03-28T21:51:51.545783+0000","last_became_peered":"2024-03-28T21:51:51.545783+0000","last_unstale":"2024-03-28T21:53:07.579288+0000","last_undegraded":"2024-03-28T21:53:07.579288+0000","last_fullsized":"2024-03-28T21:53:07.579288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_clean_scrub_stamp":"2024-03-28T21:51:50.185942+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:08:34.531035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":937984,"data_stored":719725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":129357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":725542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T21:53:14.606 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T21:53:14.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.842+0000 7fefb4200640 1 Processor -- start 2024-03-28T21:53:14.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.842+0000 7fefb4200640 1 -- start start 2024-03-28T21:53:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.843+0000 7fefb4200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fefac06e440 0x7fefac15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.843+0000 7fefb4200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fefac0ad830 0x7fefac0b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.843+0000 7fefb4200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefac0b2e60 con 0x7fefac159a10 2024-03-28T21:53:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.843+0000 7fefb4200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fefac0adc70 con 0x7fefac06e440 2024-03-28T21:53:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.843+0000 7fefb4200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fefac159df0 con 0x7fefac0ad830 2024-03-28T21:53:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.843+0000 7fefb0e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fefac06e440 0x7fefac15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.844+0000 7fefb0e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fefac06e440 0x7fefac15cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58454/0 (socket says 172.21.15.153:58454) 2024-03-28T21:53:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.844+0000 7fefb0e00640 1 -- 172.21.15.153:0/2343434286 learned_addr learned my addr 172.21.15.153:0/2343434286 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.844+0000 7fefb2200640 1 --2- 172.21.15.153:0/2343434286 >> v2:172.21.15.165:3300/0 conn(0x7fefac0ad830 0x7fefac0b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:14.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.844+0000 7fefb0e00640 1 -- 172.21.15.153:0/2343434286 >> v2:172.21.15.165:3300/0 conn(0x7fefac0ad830 msgr2=0x7fefac0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:14.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.844+0000 7fefb0e00640 1 --2- 172.21.15.153:0/2343434286 >> v2:172.21.15.165:3300/0 conn(0x7fefac0ad830 0x7fefac0b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.844+0000 7fefb0e00640 1 -- 172.21.15.153:0/2343434286 >> v1:172.21.15.165:6789/0 conn(0x7fefac159a10 legacy=0x7fefac06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:14.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.844+0000 7fefb0e00640 1 -- 172.21.15.153:0/2343434286 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefac0adf10 con 0x7fefac06e440 2024-03-28T21:53:14.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.844+0000 7fefb2200640 1 --2- 172.21.15.153:0/2343434286 >> v2:172.21.15.165:3300/0 conn(0x7fefac0ad830 0x7fefac0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:14.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.845+0000 7fefb0e00640 1 --2- 172.21.15.153:0/2343434286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefac06e440 0x7fefac15cf00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fefac0736e0 tx=0x7fef9802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526c698d4d5b884 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:14.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.845+0000 7fefabe00640 1 -- 172.21.15.153:0/2343434286 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9802c9f0 con 0x7fefac06e440 2024-03-28T21:53:14.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.845+0000 7fefabe00640 1 -- 172.21.15.153:0/2343434286 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef9802cb90 con 0x7fefac06e440 2024-03-28T21:53:14.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.845+0000 7fefabe00640 1 -- 172.21.15.153:0/2343434286 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef980343f0 con 0x7fefac06e440 2024-03-28T21:53:14.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.846+0000 7fefb4200640 1 -- 172.21.15.153:0/2343434286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefac06e440 msgr2=0x7fefac15cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:14.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.846+0000 7fefb4200640 1 --2- 172.21.15.153:0/2343434286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefac06e440 0x7fefac15cf00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fefac0736e0 tx=0x7fef9802be50 comp rx=0 tx=0).stop 2024-03-28T21:53:14.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.846+0000 7fefb4200640 1 -- 172.21.15.153:0/2343434286 shutdown_connections 2024-03-28T21:53:14.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.846+0000 7fefb4200640 1 --2- 172.21.15.153:0/2343434286 >> v2:172.21.15.165:3300/0 conn(0x7fefac0ad830 0x7fefac0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.846+0000 7fefb4200640 1 --2- 172.21.15.153:0/2343434286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefac06e440 0x7fefac15cf00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.846+0000 7fefb4200640 1 -- 172.21.15.153:0/2343434286 >> 172.21.15.153:0/2343434286 conn(0x7fefac0b1a30 msgr2=0x7fefac0b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:14.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.846+0000 7fefb4200640 1 -- 172.21.15.153:0/2343434286 shutdown_connections 2024-03-28T21:53:14.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.846+0000 7fefb4200640 1 -- 172.21.15.153:0/2343434286 wait complete. 2024-03-28T21:53:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.848+0000 7fefb4200640 1 Processor -- start 2024-03-28T21:53:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.848+0000 7fefb4200640 1 -- start start 2024-03-28T21:53:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.849+0000 7fefb4200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefac06e440 0x7fefac144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.849+0000 7fefb4200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fefac0ad830 0x7fefac152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.849+0000 7fefb4200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fefac159a10 0x7fefac141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.849+0000 7fefb4200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fefac0ae4d0 con 0x7fefac06e440 2024-03-28T21:53:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.849+0000 7fefb4200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fefac0b3100 con 0x7fefac159a10 2024-03-28T21:53:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.849+0000 7fefb4200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fefac0b3b60 con 0x7fefac0ad830 2024-03-28T21:53:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.849+0000 7fefb1800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefac06e440 0x7fefac144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.849+0000 7fefb1800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefac06e440 0x7fefac144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58458/0 (socket says 172.21.15.153:58458) 2024-03-28T21:53:14.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.849+0000 7fefb1800640 1 -- 172.21.15.153:0/2967474103 learned_addr learned my addr 172.21.15.153:0/2967474103 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:14.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.850+0000 7fefb1800640 1 -- 172.21.15.153:0/2967474103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fefac0ad830 msgr2=0x7fefac152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:14.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.850+0000 7fefb1800640 1 --2- 172.21.15.153:0/2967474103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fefac0ad830 0x7fefac152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.850+0000 7fefb1800640 1 -- 172.21.15.153:0/2967474103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fefac159a10 msgr2=0x7fefac141440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:14.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.850+0000 7fefb1800640 1 --2- 172.21.15.153:0/2967474103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fefac159a10 0x7fefac141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:14.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.850+0000 7fefb1800640 1 -- 172.21.15.153:0/2967474103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefac153180 con 0x7fefac06e440 2024-03-28T21:53:14.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.850+0000 7fefb1800640 1 --2- 172.21.15.153:0/2967474103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefac06e440 0x7fefac144a10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00b3e0 tx=0x7fef9c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:14.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.850+0000 7fefa9600640 1 -- 172.21.15.153:0/2967474103 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c015020 con 0x7fefac06e440 2024-03-28T21:53:14.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.850+0000 7fefa9600640 1 -- 172.21.15.153:0/2967474103 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef9c011850 con 0x7fefac06e440 2024-03-28T21:53:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.850+0000 7fefa9600640 1 -- 172.21.15.153:0/2967474103 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c011c40 con 0x7fefac06e440 2024-03-28T21:53:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.850+0000 7fefb4200640 1 -- 172.21.15.153:0/2967474103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefac153460 con 0x7fefac06e440 2024-03-28T21:53:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.850+0000 7fefb4200640 1 -- 172.21.15.153:0/2967474103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefac153a20 con 0x7fefac06e440 2024-03-28T21:53:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.852+0000 7fefb4200640 1 -- 172.21.15.153:0/2967474103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefac068ff0 con 0x7fefac06e440 2024-03-28T21:53:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.852+0000 7fefa9600640 1 -- 172.21.15.153:0/2967474103 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fef9c018020 con 0x7fefac06e440 2024-03-28T21:53:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.853+0000 7fefa9600640 1 --2- 172.21.15.153:0/2967474103 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fef8c06b4d0 0x7fef8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.853+0000 7fefa9600640 1 -- 172.21.15.153:0/2967474103 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fef9c08a160 con 0x7fefac06e440 2024-03-28T21:53:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.854+0000 7fefb0e00640 1 --2- 172.21.15.153:0/2967474103 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fef8c06b4d0 0x7fef8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.854+0000 7fefb0e00640 1 --2- 172.21.15.153:0/2967474103 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fef8c06b4d0 0x7fef8c06d990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fef98035000 tx=0x7fef9802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:14.858+0000 7fefa9600640 1 -- 172.21.15.153:0/2967474103 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fef9c01f020 con 0x7fefac06e440 2024-03-28T21:53:15.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.047+0000 7fefb4200640 1 -- 172.21.15.153:0/2967474103 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fefac155c40 con 0x7fef8c06b4d0 2024-03-28T21:53:15.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.056+0000 7fefa9600640 1 -- 172.21.15.153:0/2967474103 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240952 (secure 0 0 0) 0x7fefac155c40 con 0x7fef8c06b4d0 2024-03-28T21:53:15.060 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:15.061 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-03-28T21:53:15.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.060+0000 7fefb4200640 1 -- 172.21.15.153:0/2967474103 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fef8c06b4d0 msgr2=0x7fef8c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:15.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.060+0000 7fefb4200640 1 --2- 172.21.15.153:0/2967474103 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fef8c06b4d0 0x7fef8c06d990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fef98035000 tx=0x7fef9802e000 comp rx=0 tx=0).stop 2024-03-28T21:53:15.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.060+0000 7fefb4200640 1 -- 172.21.15.153:0/2967474103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefac06e440 msgr2=0x7fefac144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:15.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.060+0000 7fefb4200640 1 --2- 172.21.15.153:0/2967474103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefac06e440 0x7fefac144a10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00b3e0 tx=0x7fef9c00b8a0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.060+0000 7fefb4200640 1 -- 172.21.15.153:0/2967474103 shutdown_connections 2024-03-28T21:53:15.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.060+0000 7fefb4200640 1 --2- 172.21.15.153:0/2967474103 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fef8c06b4d0 0x7fef8c06d990 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.060+0000 7fefb4200640 1 --2- 172.21.15.153:0/2967474103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fefac159a10 0x7fefac141440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.060+0000 7fefb4200640 1 --2- 172.21.15.153:0/2967474103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fefac0ad830 0x7fefac152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.060+0000 7fefb4200640 1 --2- 172.21.15.153:0/2967474103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefac06e440 0x7fefac144a10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.060+0000 7fefb4200640 1 -- 172.21.15.153:0/2967474103 >> 172.21.15.153:0/2967474103 conn(0x7fefac0b1a30 msgr2=0x7fefac074180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:15.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.060+0000 7fefb4200640 1 -- 172.21.15.153:0/2967474103 shutdown_connections 2024-03-28T21:53:15.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.060+0000 7fefb4200640 1 -- 172.21.15.153:0/2967474103 wait complete. 2024-03-28T21:53:15.082 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-03-28T21:53:13.487214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224256,"kb_used_data":3920,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750464,"statfs":{"total":773094113280,"available":772864475136,"internally_reserved":0,"allocated":4014080,"data_stored":2250494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.926767"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.584047+0000","last_change":"2024-03-28T21:53:08.584047+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.584047+0000","last_undegraded":"2024-03-28T21:53:08.584047+0000","last_fullsized":"2024-03-28T21:53:08.584047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.583449+0000","last_change":"2024-03-28T21:53:08.583449+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.583449+0000","last_undegraded":"2024-03-28T21:53:08.583449+0000","last_fullsized":"2024-03-28T21:53:08.583449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.583519+0000","last_change":"2024-03-28T21:53:08.583519+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.583519+0000","last_undegraded":"2024-03-28T21:53:08.583519+0000","last_fullsized":"2024-03-28T21:53:08.583519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.583211+0000","last_change":"2024-03-28T21:53:08.583211+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.583211+0000","last_undegraded":"2024-03-28T21:53:08.583211+0000","last_fullsized":"2024-03-28T21:53:08.583211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.584390+0000","last_change":"2024-03-28T21:53:08.584390+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.584390+0000","last_undegraded":"2024-03-28T21:53:08.584390+0000","last_fullsized":"2024-03-28T21:53:08.584390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.569999+0000","last_change":"2024-03-28T21:53:07.569999+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.569999+0000","last_undegraded":"2024-03-28T21:53:07.569999+0000","last_fullsized":"2024-03-28T21:53:07.569999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-03-28T21:53:08.575019+0000","last_change":"2024-03-28T21:53:08.575019+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.575019+0000","last_undegraded":"2024-03-28T21:53:08.575019+0000","last_fullsized":"2024-03-28T21:53:08.575019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.571438+0000","last_change":"2024-03-28T21:53:07.571438+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.571438+0000","last_undegraded":"2024-03-28T21:53:07.571438+0000","last_fullsized":"2024-03-28T21:53:07.571438+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-03-28T21:53:08.575126+0000","last_change":"2024-03-28T21:53:08.575126+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.575126+0000","last_undegraded":"2024-03-28T21:53:08.575126+0000","last_fullsized":"2024-03-28T21:53:08.575126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.567590+0000","last_change":"2024-03-28T21:53:07.567590+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.567590+0000","last_undegraded":"2024-03-28T21:53:07.567590+0000","last_fullsized":"2024-03-28T21:53:07.567590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.565953+0000","last_change":"2024-03-28T21:53:07.565953+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.565953+0000","last_undegraded":"2024-03-28T21:53:07.565953+0000","last_fullsized":"2024-03-28T21:53:07.565953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.573557+0000","last_change":"2024-03-28T21:53:07.573557+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.573557+0000","last_undegraded":"2024-03-28T21:53:07.573557+0000","last_fullsized":"2024-03-28T21:53:07.573557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.565902+0000","last_change":"2024-03-28T21:53:07.565902+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.565902+0000","last_undegraded":"2024-03-28T21:53:07.565902+0000","last_fullsized":"2024-03-28T21:53:07.565902+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.572438+0000","last_change":"2024-03-28T21:53:07.572438+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.572438+0000","last_undegraded":"2024-03-28T21:53:07.572438+0000","last_fullsized":"2024-03-28T21:53:07.572438+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-28T21:53:08.585643+0000","last_change":"2024-03-28T21:53:08.585643+0000","last_active":"2024-03-28T21:53:08.585643+0000","last_peered":"2024-03-28T21:53:08.585643+0000","last_clean":"2024-03-28T21:53:08.585643+0000","last_became_active":"2024-03-28T21:53:08.585344+0000","last_became_peered":"2024-03-28T21:53:08.585344+0000","last_unstale":"2024-03-28T21:53:08.585643+0000","last_undegraded":"2024-03-28T21:53:08.585643+0000","last_fullsized":"2024-03-28T21:53:08.585643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:43:19.841764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.576432+0000","last_change":"2024-03-28T21:53:07.576432+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.576432+0000","last_undegraded":"2024-03-28T21:53:07.576432+0000","last_fullsized":"2024-03-28T21:53:07.576432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570749+0000","last_change":"2024-03-28T21:53:07.570749+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570749+0000","last_undegraded":"2024-03-28T21:53:07.570749+0000","last_fullsized":"2024-03-28T21:53:07.570749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.566263+0000","last_change":"2024-03-28T21:53:07.566263+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.566263+0000","last_undegraded":"2024-03-28T21:53:07.566263+0000","last_fullsized":"2024-03-28T21:53:07.566263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.573957+0000","last_change":"2024-03-28T21:53:07.573957+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.573957+0000","last_undegraded":"2024-03-28T21:53:07.573957+0000","last_fullsized":"2024-03-28T21:53:07.573957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570658+0000","last_change":"2024-03-28T21:53:07.570658+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570658+0000","last_undegraded":"2024-03-28T21:53:07.570658+0000","last_fullsized":"2024-03-28T21:53:07.570658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.573473+0000","last_change":"2024-03-28T21:53:07.573473+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.573473+0000","last_undegraded":"2024-03-28T21:53:07.573473+0000","last_fullsized":"2024-03-28T21:53:07.573473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.571383+0000","last_change":"2024-03-28T21:53:07.571383+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.571383+0000","last_undegraded":"2024-03-28T21:53:07.571383+0000","last_fullsized":"2024-03-28T21:53:07.571383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.566337+0000","last_change":"2024-03-28T21:53:07.566337+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.566337+0000","last_undegraded":"2024-03-28T21:53:07.566337+0000","last_fullsized":"2024-03-28T21:53:07.566337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.566507+0000","last_change":"2024-03-28T21:53:07.566507+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.566507+0000","last_undegraded":"2024-03-28T21:53:07.566507+0000","last_fullsized":"2024-03-28T21:53:07.566507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.580863+0000","last_change":"2024-03-28T21:53:08.580863+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.580863+0000","last_undegraded":"2024-03-28T21:53:08.580863+0000","last_fullsized":"2024-03-28T21:53:08.580863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.568457+0000","last_change":"2024-03-28T21:53:07.568457+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.568457+0000","last_undegraded":"2024-03-28T21:53:07.568457+0000","last_fullsized":"2024-03-28T21:53:07.568457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.579899+0000","last_change":"2024-03-28T21:53:08.579899+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.579899+0000","last_undegraded":"2024-03-28T21:53:08.579899+0000","last_fullsized":"2024-03-28T21:53:08.579899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-28T21:53:08.590224+0000","last_change":"2024-03-28T21:53:08.590224+0000","last_active":"2024-03-28T21:53:08.590224+0000","last_peered":"2024-03-28T21:53:08.590224+0000","last_clean":"2024-03-28T21:53:08.590224+0000","last_became_active":"2024-03-28T21:53:08.589942+0000","last_became_peered":"2024-03-28T21:53:08.589942+0000","last_unstale":"2024-03-28T21:53:08.590224+0000","last_undegraded":"2024-03-28T21:53:08.590224+0000","last_fullsized":"2024-03-28T21:53:08.590224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:10:31.836071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.582093+0000","last_change":"2024-03-28T21:53:08.582093+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.582093+0000","last_undegraded":"2024-03-28T21:53:08.582093+0000","last_fullsized":"2024-03-28T21:53:08.582093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570379+0000","last_change":"2024-03-28T21:53:07.570379+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570379+0000","last_undegraded":"2024-03-28T21:53:07.570379+0000","last_fullsized":"2024-03-28T21:53:07.570379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.578616+0000","last_change":"2024-03-28T21:53:08.578616+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.578616+0000","last_undegraded":"2024-03-28T21:53:08.578616+0000","last_fullsized":"2024-03-28T21:53:08.578616+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.567921+0000","last_change":"2024-03-28T21:53:07.567921+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.567921+0000","last_undegraded":"2024-03-28T21:53:07.567921+0000","last_fullsized":"2024-03-28T21:53:07.567921+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.575921+0000","last_change":"2024-03-28T21:53:07.575921+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.575921+0000","last_undegraded":"2024-03-28T21:53:07.575921+0000","last_fullsized":"2024-03-28T21:53:07.575921+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.578827+0000","last_change":"2024-03-28T21:53:08.578827+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.578827+0000","last_undegraded":"2024-03-28T21:53:08.578827+0000","last_fullsized":"2024-03-28T21:53:08.578827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570877+0000","last_change":"2024-03-28T21:53:07.570877+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570877+0000","last_undegraded":"2024-03-28T21:53:07.570877+0000","last_fullsized":"2024-03-28T21:53:07.570877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-03-28T21:53:08.591740+0000","last_change":"2024-03-28T21:53:08.591668+0000","last_active":"2024-03-28T21:53:08.591740+0000","last_peered":"2024-03-28T21:53:08.591740+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"2024-03-28T21:53:08.591668+0000","last_became_peered":"2024-03-28T21:53:08.591668+0000","last_unstale":"2024-03-28T21:53:08.591740+0000","last_undegraded":"2024-03-28T21:53:08.591740+0000","last_fullsized":"2024-03-28T21:53:08.591740+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.582597+0000","last_change":"2024-03-28T21:53:08.582597+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.582597+0000","last_undegraded":"2024-03-28T21:53:08.582597+0000","last_fullsized":"2024-03-28T21:53:08.582597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.572318+0000","last_change":"2024-03-28T21:53:07.572318+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.572318+0000","last_undegraded":"2024-03-28T21:53:07.572318+0000","last_fullsized":"2024-03-28T21:53:07.572318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":3,"reported_epoch":33,"state":"creating+activating","last_fresh":"2024-03-28T21:53:08.575519+0000","last_change":"2024-03-28T21:53:08.575519+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.575519+0000","last_undegraded":"2024-03-28T21:53:08.575519+0000","last_fullsized":"2024-03-28T21:53:08.575519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-28T21:53:08.578562+0000","last_change":"2024-03-28T21:53:08.578562+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.578562+0000","last_undegraded":"2024-03-28T21:53:08.578562+0000","last_fullsized":"2024-03-28T21:53:08.578562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.570787+0000","last_change":"2024-03-28T21:53:07.570787+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.570787+0000","last_undegraded":"2024-03-28T21:53:07.570787+0000","last_fullsized":"2024-03-28T21:53:07.570787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.565905+0000","last_change":"2024-03-28T21:53:07.565905+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.565905+0000","last_undegraded":"2024-03-28T21:53:07.565905+0000","last_fullsized":"2024-03-28T21:53:07.565905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.571309+0000","last_change":"2024-03-28T21:53:07.571309+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.571309+0000","last_undegraded":"2024-03-28T21:53:07.571309+0000","last_fullsized":"2024-03-28T21:53:07.571309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-28T21:53:08.558652+0000","last_change":"2024-03-28T21:53:08.558652+0000","last_active":"2024-03-28T21:53:08.558652+0000","last_peered":"2024-03-28T21:53:08.558652+0000","last_clean":"2024-03-28T21:53:08.558652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:08.558652+0000","last_undegraded":"2024-03-28T21:53:08.558652+0000","last_fullsized":"2024-03-28T21:53:08.558652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-28T21:53:07.569845+0000","last_change":"2024-03-28T21:53:07.569845+0000","last_active":"2024-03-28T21:53:07.544422+0000","last_peered":"2024-03-28T21:53:07.544422+0000","last_clean":"2024-03-28T21:53:07.544422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-28T21:53:07.569845+0000","last_undegraded":"2024-03-28T21:53:07.569845+0000","last_fullsized":"2024-03-28T21:53:07.569845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-28T21:53:07.579288+0000","last_change":"2024-03-28T21:51:51.547812+0000","last_active":"2024-03-28T21:53:07.579288+0000","last_peered":"2024-03-28T21:53:07.579288+0000","last_clean":"2024-03-28T21:53:07.579288+0000","last_became_active":"2024-03-28T21:51:51.545783+0000","last_became_peered":"2024-03-28T21:51:51.545783+0000","last_unstale":"2024-03-28T21:53:07.579288+0000","last_undegraded":"2024-03-28T21:53:07.579288+0000","last_fullsized":"2024-03-28T21:53:07.579288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_clean_scrub_stamp":"2024-03-28T21:51:50.185942+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:08:34.531035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":937984,"data_stored":719725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":129357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":725542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T21:53:15.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-03-28T21:53:15.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-03-28T21:53:15.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-03-28T21:53:15.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-03-28T21:53:15.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-03-28T21:53:15.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:08.584047+0000', 'last_change': '2024-03-28T21:53:08.584047+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.584047+0000', 'last_undegraded': '2024-03-28T21:53:08.584047+0000', 'last_fullsized': '2024-03-28T21:53:08.584047+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-28T21:53:15.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-03-28T21:53:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-03-28T21:53:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-03-28T21:53:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-03-28T21:53:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-03-28T21:53:15.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-03-28T21:53:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-03-28T21:53:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-03-28T21:53:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:08.583449+0000', 'last_change': '2024-03-28T21:53:08.583449+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.583449+0000', 'last_undegraded': '2024-03-28T21:53:08.583449+0000', 'last_fullsized': '2024-03-28T21:53:08.583449+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-28T21:53:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-03-28T21:53:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-03-28T21:53:15.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-03-28T21:53:15.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-03-28T21:53:15.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-03-28T21:53:15.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-03-28T21:53:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-03-28T21:53:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:08.583519+0000', 'last_change': '2024-03-28T21:53:08.583519+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.583519+0000', 'last_undegraded': '2024-03-28T21:53:08.583519+0000', 'last_fullsized': '2024-03-28T21:53:08.583519+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-28T21:53:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-03-28T21:53:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-03-28T21:53:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-03-28T21:53:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:08.583211+0000', 'last_change': '2024-03-28T21:53:08.583211+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.583211+0000', 'last_undegraded': '2024-03-28T21:53:08.583211+0000', 'last_fullsized': '2024-03-28T21:53:08.583211+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-28T21:53:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-03-28T21:53:15.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-03-28T21:53:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-03-28T21:53:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-03-28T21:53:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-03-28T21:53:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-03-28T21:53:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-03-28T21:53:15.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-03-28T21:53:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-03-28T21:53:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-03-28T21:53:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:08.584390+0000', 'last_change': '2024-03-28T21:53:08.584390+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.584390+0000', 'last_undegraded': '2024-03-28T21:53:08.584390+0000', 'last_fullsized': '2024-03-28T21:53:08.584390+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-28T21:53:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-03-28T21:53:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.569999+0000', 'last_change': '2024-03-28T21:53:07.569999+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.569999+0000', 'last_undegraded': '2024-03-28T21:53:07.569999+0000', 'last_fullsized': '2024-03-28T21:53:07.569999+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-28T21:53:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-03-28T21:53:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-03-28T21:53:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-03-28T21:53:08.575019+0000', 'last_change': '2024-03-28T21:53:08.575019+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.575019+0000', 'last_undegraded': '2024-03-28T21:53:08.575019+0000', 'last_fullsized': '2024-03-28T21:53:08.575019+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': ['0', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-28T21:53:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-03-28T21:53:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-03-28T21:53:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.571438+0000', 'last_change': '2024-03-28T21:53:07.571438+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.571438+0000', 'last_undegraded': '2024-03-28T21:53:07.571438+0000', 'last_fullsized': '2024-03-28T21:53:07.571438+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-28T21:53:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-03-28T21:53:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-03-28T21:53:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-03-28T21:53:08.575126+0000', 'last_change': '2024-03-28T21:53:08.575126+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.575126+0000', 'last_undegraded': '2024-03-28T21:53:08.575126+0000', 'last_fullsized': '2024-03-28T21:53:08.575126+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': ['2', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-28T21:53:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-03-28T21:53:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-03-28T21:53:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.567590+0000', 'last_change': '2024-03-28T21:53:07.567590+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.567590+0000', 'last_undegraded': '2024-03-28T21:53:07.567590+0000', 'last_fullsized': '2024-03-28T21:53:07.567590+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-28T21:53:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-03-28T21:53:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-03-28T21:53:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.565953+0000', 'last_change': '2024-03-28T21:53:07.565953+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.565953+0000', 'last_undegraded': '2024-03-28T21:53:07.565953+0000', 'last_fullsized': '2024-03-28T21:53:07.565953+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-28T21:53:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-03-28T21:53:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-03-28T21:53:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.573557+0000', 'last_change': '2024-03-28T21:53:07.573557+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.573557+0000', 'last_undegraded': '2024-03-28T21:53:07.573557+0000', 'last_fullsized': '2024-03-28T21:53:07.573557+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-28T21:53:15.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-03-28T21:53:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-03-28T21:53:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.565902+0000', 'last_change': '2024-03-28T21:53:07.565902+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.565902+0000', 'last_undegraded': '2024-03-28T21:53:07.565902+0000', 'last_fullsized': '2024-03-28T21:53:07.565902+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-28T21:53:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-03-28T21:53:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-03-28T21:53:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.572438+0000', 'last_change': '2024-03-28T21:53:07.572438+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.572438+0000', 'last_undegraded': '2024-03-28T21:53:07.572438+0000', 'last_fullsized': '2024-03-28T21:53:07.572438+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-28T21:53:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-03-28T21:53:15.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-03-28T21:53:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-03-28T21:53:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.576432+0000', 'last_change': '2024-03-28T21:53:07.576432+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.576432+0000', 'last_undegraded': '2024-03-28T21:53:07.576432+0000', 'last_fullsized': '2024-03-28T21:53:07.576432+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-28T21:53:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-03-28T21:53:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-03-28T21:53:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.570749+0000', 'last_change': '2024-03-28T21:53:07.570749+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.570749+0000', 'last_undegraded': '2024-03-28T21:53:07.570749+0000', 'last_fullsized': '2024-03-28T21:53:07.570749+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-28T21:53:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-03-28T21:53:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-03-28T21:53:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.566263+0000', 'last_change': '2024-03-28T21:53:07.566263+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.566263+0000', 'last_undegraded': '2024-03-28T21:53:07.566263+0000', 'last_fullsized': '2024-03-28T21:53:07.566263+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-28T21:53:15.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-03-28T21:53:15.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-03-28T21:53:15.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.573957+0000', 'last_change': '2024-03-28T21:53:07.573957+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.573957+0000', 'last_undegraded': '2024-03-28T21:53:07.573957+0000', 'last_fullsized': '2024-03-28T21:53:07.573957+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-28T21:53:15.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-03-28T21:53:15.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-03-28T21:53:15.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.570658+0000', 'last_change': '2024-03-28T21:53:07.570658+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.570658+0000', 'last_undegraded': '2024-03-28T21:53:07.570658+0000', 'last_fullsized': '2024-03-28T21:53:07.570658+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-28T21:53:15.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-03-28T21:53:15.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-03-28T21:53:15.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.573473+0000', 'last_change': '2024-03-28T21:53:07.573473+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.573473+0000', 'last_undegraded': '2024-03-28T21:53:07.573473+0000', 'last_fullsized': '2024-03-28T21:53:07.573473+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-28T21:53:15.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-03-28T21:53:15.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-03-28T21:53:15.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.571383+0000', 'last_change': '2024-03-28T21:53:07.571383+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.571383+0000', 'last_undegraded': '2024-03-28T21:53:07.571383+0000', 'last_fullsized': '2024-03-28T21:53:07.571383+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-28T21:53:15.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-03-28T21:53:15.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-03-28T21:53:15.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.566337+0000', 'last_change': '2024-03-28T21:53:07.566337+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.566337+0000', 'last_undegraded': '2024-03-28T21:53:07.566337+0000', 'last_fullsized': '2024-03-28T21:53:07.566337+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-28T21:53:15.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-03-28T21:53:15.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-03-28T21:53:15.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.566507+0000', 'last_change': '2024-03-28T21:53:07.566507+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.566507+0000', 'last_undegraded': '2024-03-28T21:53:07.566507+0000', 'last_fullsized': '2024-03-28T21:53:07.566507+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-28T21:53:15.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-03-28T21:53:15.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:08.580863+0000', 'last_change': '2024-03-28T21:53:08.580863+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.580863+0000', 'last_undegraded': '2024-03-28T21:53:08.580863+0000', 'last_fullsized': '2024-03-28T21:53:08.580863+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-28T21:53:15.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-03-28T21:53:15.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.568457+0000', 'last_change': '2024-03-28T21:53:07.568457+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.568457+0000', 'last_undegraded': '2024-03-28T21:53:07.568457+0000', 'last_fullsized': '2024-03-28T21:53:07.568457+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-28T21:53:15.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-03-28T21:53:15.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:08.579899+0000', 'last_change': '2024-03-28T21:53:08.579899+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.579899+0000', 'last_undegraded': '2024-03-28T21:53:08.579899+0000', 'last_fullsized': '2024-03-28T21:53:08.579899+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-28T21:53:15.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-03-28T21:53:15.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:08.582093+0000', 'last_change': '2024-03-28T21:53:08.582093+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.582093+0000', 'last_undegraded': '2024-03-28T21:53:08.582093+0000', 'last_fullsized': '2024-03-28T21:53:08.582093+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-28T21:53:15.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-03-28T21:53:15.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.570379+0000', 'last_change': '2024-03-28T21:53:07.570379+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.570379+0000', 'last_undegraded': '2024-03-28T21:53:07.570379+0000', 'last_fullsized': '2024-03-28T21:53:07.570379+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-28T21:53:15.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-03-28T21:53:15.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:08.578616+0000', 'last_change': '2024-03-28T21:53:08.578616+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.578616+0000', 'last_undegraded': '2024-03-28T21:53:08.578616+0000', 'last_fullsized': '2024-03-28T21:53:08.578616+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-28T21:53:15.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-03-28T21:53:15.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.567921+0000', 'last_change': '2024-03-28T21:53:07.567921+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.567921+0000', 'last_undegraded': '2024-03-28T21:53:07.567921+0000', 'last_fullsized': '2024-03-28T21:53:07.567921+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-28T21:53:15.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-03-28T21:53:15.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-03-28T21:53:15.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.575921+0000', 'last_change': '2024-03-28T21:53:07.575921+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.575921+0000', 'last_undegraded': '2024-03-28T21:53:07.575921+0000', 'last_fullsized': '2024-03-28T21:53:07.575921+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-28T21:53:15.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-03-28T21:53:15.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:08.578827+0000', 'last_change': '2024-03-28T21:53:08.578827+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.578827+0000', 'last_undegraded': '2024-03-28T21:53:08.578827+0000', 'last_fullsized': '2024-03-28T21:53:08.578827+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-28T21:53:15.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-03-28T21:53:15.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.570877+0000', 'last_change': '2024-03-28T21:53:07.570877+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.570877+0000', 'last_undegraded': '2024-03-28T21:53:07.570877+0000', 'last_fullsized': '2024-03-28T21:53:07.570877+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-28T21:53:15.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-03-28T21:53:15.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-03-28T21:53:15.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 33, 'state': 'active', 'last_fresh': '2024-03-28T21:53:08.591740+0000', 'last_change': '2024-03-28T21:53:08.591668+0000', 'last_active': '2024-03-28T21:53:08.591740+0000', 'last_peered': '2024-03-28T21:53:08.591740+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '2024-03-28T21:53:08.591668+0000', 'last_became_peered': '2024-03-28T21:53:08.591668+0000', 'last_unstale': '2024-03-28T21:53:08.591740+0000', 'last_undegraded': '2024-03-28T21:53:08.591740+0000', 'last_fullsized': '2024-03-28T21:53:08.591740+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-28T21:53:15.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-03-28T21:53:15.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:08.582597+0000', 'last_change': '2024-03-28T21:53:08.582597+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.582597+0000', 'last_undegraded': '2024-03-28T21:53:08.582597+0000', 'last_fullsized': '2024-03-28T21:53:08.582597+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-28T21:53:15.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-03-28T21:53:15.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.572318+0000', 'last_change': '2024-03-28T21:53:07.572318+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.572318+0000', 'last_undegraded': '2024-03-28T21:53:07.572318+0000', 'last_fullsized': '2024-03-28T21:53:07.572318+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-28T21:53:15.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-03-28T21:53:15.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-03-28T21:53:15.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 33, 'state': 'creating+activating', 'last_fresh': '2024-03-28T21:53:08.575519+0000', 'last_change': '2024-03-28T21:53:08.575519+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.575519+0000', 'last_undegraded': '2024-03-28T21:53:08.575519+0000', 'last_fullsized': '2024-03-28T21:53:08.575519+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-28T21:53:15.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-03-28T21:53:15.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:08.578562+0000', 'last_change': '2024-03-28T21:53:08.578562+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.578562+0000', 'last_undegraded': '2024-03-28T21:53:08.578562+0000', 'last_fullsized': '2024-03-28T21:53:08.578562+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-28T21:53:15.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-03-28T21:53:15.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.570787+0000', 'last_change': '2024-03-28T21:53:07.570787+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.570787+0000', 'last_undegraded': '2024-03-28T21:53:07.570787+0000', 'last_fullsized': '2024-03-28T21:53:07.570787+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-28T21:53:15.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-03-28T21:53:15.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-03-28T21:53:15.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.565905+0000', 'last_change': '2024-03-28T21:53:07.565905+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.565905+0000', 'last_undegraded': '2024-03-28T21:53:07.565905+0000', 'last_fullsized': '2024-03-28T21:53:07.565905+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-28T21:53:15.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-03-28T21:53:15.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-03-28T21:53:15.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.571309+0000', 'last_change': '2024-03-28T21:53:07.571309+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.571309+0000', 'last_undegraded': '2024-03-28T21:53:07.571309+0000', 'last_fullsized': '2024-03-28T21:53:07.571309+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-28T21:53:15.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-03-28T21:53:15.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-28T21:53:08.558652+0000', 'last_change': '2024-03-28T21:53:08.558652+0000', 'last_active': '2024-03-28T21:53:08.558652+0000', 'last_peered': '2024-03-28T21:53:08.558652+0000', 'last_clean': '2024-03-28T21:53:08.558652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:08.558652+0000', 'last_undegraded': '2024-03-28T21:53:08.558652+0000', 'last_fullsized': '2024-03-28T21:53:08.558652+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:08.558652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-28T21:53:15.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-03-28T21:53:15.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-28T21:53:07.569845+0000', 'last_change': '2024-03-28T21:53:07.569845+0000', 'last_active': '2024-03-28T21:53:07.544422+0000', 'last_peered': '2024-03-28T21:53:07.544422+0000', 'last_clean': '2024-03-28T21:53:07.544422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-28T21:53:07.569845+0000', 'last_undegraded': '2024-03-28T21:53:07.569845+0000', 'last_fullsized': '2024-03-28T21:53:07.569845+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'last_clean_scrub_stamp': '2024-03-28T21:53:07.544422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-28T21:53:15.105 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-28T21:53:15.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.320+0000 7f35ed600640 1 Processor -- start 2024-03-28T21:53:15.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.320+0000 7f35ed600640 1 -- start start 2024-03-28T21:53:15.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.321+0000 7f35ed600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e806e440 0x7f35e815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:15.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.321+0000 7f35ed600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f35e80ad830 0x7f35e80b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:15.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.321+0000 7f35ed600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e80b2e60 con 0x7f35e8159a10 2024-03-28T21:53:15.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.321+0000 7f35ed600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f35e80adce0 con 0x7f35e80ad830 2024-03-28T21:53:15.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.321+0000 7f35ed600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35e8159df0 con 0x7f35e806e440 2024-03-28T21:53:15.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.322+0000 7f35e7400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f35e80ad830 0x7f35e80b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:15.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.322+0000 7f35dfe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e806e440 0x7f35e815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:15.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.322+0000 7f35dfe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e806e440 0x7f35e815cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:56126/0 (socket says 172.21.15.153:56126) 2024-03-28T21:53:15.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.322+0000 7f35dfe00640 1 -- 172.21.15.153:0/4235225916 learned_addr learned my addr 172.21.15.153:0/4235225916 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:15.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.323+0000 7f35dfe00640 1 -- 172.21.15.153:0/4235225916 >> v2:172.21.15.165:3300/0 conn(0x7f35e80ad830 msgr2=0x7f35e80b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:15.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.323+0000 7f35dfe00640 1 --2- 172.21.15.153:0/4235225916 >> v2:172.21.15.165:3300/0 conn(0x7f35e80ad830 0x7f35e80b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.323+0000 7f35dfe00640 1 -- 172.21.15.153:0/4235225916 >> v1:172.21.15.165:6789/0 conn(0x7f35e8159a10 legacy=0x7f35e806dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:15.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.323+0000 7f35dfe00640 1 -- 172.21.15.153:0/4235225916 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e80adf10 con 0x7f35e806e440 2024-03-28T21:53:15.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.324+0000 7f35dfe00640 1 --2- 172.21.15.153:0/4235225916 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e806e440 0x7f35e815cf00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009870 tx=0x7f35d002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c79b810ec60116ed server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.325+0000 7f35e6000640 1 -- 172.21.15.153:0/4235225916 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0035020 con 0x7f35e806e440 2024-03-28T21:53:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.325+0000 7f35e6000640 1 -- 172.21.15.153:0/4235225916 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d0031640 con 0x7f35e806e440 2024-03-28T21:53:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.325+0000 7f35e6000640 1 -- 172.21.15.153:0/4235225916 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d002d040 con 0x7f35e806e440 2024-03-28T21:53:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.325+0000 7f35ed600640 1 -- 172.21.15.153:0/4235225916 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e806e440 msgr2=0x7f35e815cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.325+0000 7f35ed600640 1 --2- 172.21.15.153:0/4235225916 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e806e440 0x7f35e815cf00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009870 tx=0x7f35d002b8f0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.326+0000 7f35ed600640 1 -- 172.21.15.153:0/4235225916 shutdown_connections 2024-03-28T21:53:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.326+0000 7f35ed600640 1 --2- 172.21.15.153:0/4235225916 >> v2:172.21.15.165:3300/0 conn(0x7f35e80ad830 0x7f35e80b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.326+0000 7f35ed600640 1 --2- 172.21.15.153:0/4235225916 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e806e440 0x7f35e815cf00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.326+0000 7f35ed600640 1 -- 172.21.15.153:0/4235225916 >> 172.21.15.153:0/4235225916 conn(0x7f35e80b1a30 msgr2=0x7f35e80b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:15.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.326+0000 7f35ed600640 1 -- 172.21.15.153:0/4235225916 shutdown_connections 2024-03-28T21:53:15.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.326+0000 7f35ed600640 1 -- 172.21.15.153:0/4235225916 wait complete. 2024-03-28T21:53:15.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.327+0000 7f35ed600640 1 Processor -- start 2024-03-28T21:53:15.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.327+0000 7f35ed600640 1 -- start start 2024-03-28T21:53:15.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.328+0000 7f35ed600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35e806e440 0x7f35e81f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:15.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.328+0000 7f35ed600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e80ad830 0x7f35e809b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:15.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.328+0000 7f35ed600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35e8159a10 0x7f35e80ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:15.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.328+0000 7f35ed600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f35e80ae4d0 con 0x7f35e8159a10 2024-03-28T21:53:15.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.328+0000 7f35ed600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35e80b3100 con 0x7f35e806e440 2024-03-28T21:53:15.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.328+0000 7f35ed600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35e80b3b60 con 0x7f35e80ad830 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.329+0000 7f35e7400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35e8159a10 0x7f35e80ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.329+0000 7f35e7400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35e8159a10 0x7f35e80ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58466/0 (socket says 172.21.15.153:58466) 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.329+0000 7f35e7400640 1 -- 172.21.15.153:0/1585378897 learned_addr learned my addr 172.21.15.153:0/1585378897 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.329+0000 7f35dfe00640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e80ad830 0x7f35e809b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.329+0000 7f35e6a00640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35e806e440 0x7f35e81f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.329+0000 7f35e7400640 1 -- 172.21.15.153:0/1585378897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e80ad830 msgr2=0x7f35e809b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.329+0000 7f35e7400640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e80ad830 0x7f35e809b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.329+0000 7f35e7400640 1 -- 172.21.15.153:0/1585378897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35e806e440 msgr2=0x7f35e81f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.329+0000 7f35e7400640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35e806e440 0x7f35e81f3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.329+0000 7f35e7400640 1 -- 172.21.15.153:0/1585378897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e80cf8b0 con 0x7f35e8159a10 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.329+0000 7f35dfe00640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e80ad830 0x7f35e809b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.330+0000 7f35e7400640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35e8159a10 0x7f35e80ccb70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f35e000efc0 tx=0x7f35e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.330+0000 7f35dea00640 1 -- 172.21.15.153:0/1585378897 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e0018020 con 0x7f35e8159a10 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.330+0000 7f35dea00640 1 -- 172.21.15.153:0/1585378897 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e0014480 con 0x7f35e8159a10 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.330+0000 7f35dea00640 1 -- 172.21.15.153:0/1585378897 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e0014870 con 0x7f35e8159a10 2024-03-28T21:53:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.330+0000 7f35ed600640 1 -- 172.21.15.153:0/1585378897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e809bee0 con 0x7f35e8159a10 2024-03-28T21:53:15.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.330+0000 7f35ed600640 1 -- 172.21.15.153:0/1585378897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e809c4a0 con 0x7f35e8159a10 2024-03-28T21:53:15.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.331+0000 7f35ed600640 1 -- 172.21.15.153:0/1585378897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e8068ff0 con 0x7f35e8159a10 2024-03-28T21:53:15.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.332+0000 7f35dea00640 1 -- 172.21.15.153:0/1585378897 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f35e0005d10 con 0x7f35e8159a10 2024-03-28T21:53:15.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.333+0000 7f35dea00640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f35c406b4d0 0x7f35c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:15.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.333+0000 7f35dea00640 1 -- 172.21.15.153:0/1585378897 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f35e008ad90 con 0x7f35e8159a10 2024-03-28T21:53:15.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.334+0000 7f35e6a00640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f35c406b4d0 0x7f35c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:15.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.334+0000 7f35e6a00640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f35c406b4d0 0x7f35c406d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f35d8007fd0 tx=0x7f35d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:15.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.338+0000 7f35dea00640 1 -- 172.21.15.153:0/1585378897 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f35e0022070 con 0x7f35e8159a10 2024-03-28T21:53:15.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.615+0000 7f35ed600640 1 -- 172.21.15.153:0/1585378897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f35e80748a0 con 0x7f35e8159a10 2024-03-28T21:53:15.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.615+0000 7f35dea00640 1 -- 172.21.15.153:0/1585378897 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1350 (secure 0 0 0) 0x7f35e0010040 con 0x7f35e8159a10 2024-03-28T21:53:15.617 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:15.617 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":99,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1711662708,"num_in_osds":8,"osd_in_since":1711662699,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":52},{"state_name":"creating+peering","count":38},{"state_name":"active+clean","count":3},{"state_name":"creating+activating","count":3},{"state_name":"active","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":229638144,"bytes_avail":772864475136,"bytes_total":773094113280,"unknown_pgs_ratio":0.53608244657516479,"inactive_pgs_ratio":0.42268040776252747},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5070}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-03-28T21:52:51.480543+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-03-28T21:53:15.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.618+0000 7f35ed600640 1 -- 172.21.15.153:0/1585378897 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f35c406b4d0 msgr2=0x7f35c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:15.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.618+0000 7f35ed600640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f35c406b4d0 0x7f35c406d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f35d8007fd0 tx=0x7f35d8009040 comp rx=0 tx=0).stop 2024-03-28T21:53:15.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.618+0000 7f35ed600640 1 -- 172.21.15.153:0/1585378897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35e8159a10 msgr2=0x7f35e80ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:15.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.618+0000 7f35ed600640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35e8159a10 0x7f35e80ccb70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f35e000efc0 tx=0x7f35e000c490 comp rx=0 tx=0).stop 2024-03-28T21:53:15.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.618+0000 7f35ed600640 1 -- 172.21.15.153:0/1585378897 shutdown_connections 2024-03-28T21:53:15.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.618+0000 7f35ed600640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f35c406b4d0 0x7f35c406d990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.618+0000 7f35ed600640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35e8159a10 0x7f35e80ccb70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.618+0000 7f35ed600640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e80ad830 0x7f35e809b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.618+0000 7f35ed600640 1 --2- 172.21.15.153:0/1585378897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35e806e440 0x7f35e81f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.618+0000 7f35ed600640 1 -- 172.21.15.153:0/1585378897 >> 172.21.15.153:0/1585378897 conn(0x7f35e80b1a30 msgr2=0x7f35e806da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:15.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.619+0000 7f35ed600640 1 -- 172.21.15.153:0/1585378897 shutdown_connections 2024-03-28T21:53:15.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.619+0000 7f35ed600640 1 -- 172.21.15.153:0/1585378897 wait complete. 2024-03-28T21:53:15.637 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-28T21:53:15.637 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T21:53:15.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.828+0000 7f7443e00640 1 Processor -- start 2024-03-28T21:53:15.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.828+0000 7f7443e00640 1 -- start start 2024-03-28T21:53:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.829+0000 7f7443e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74440cde20 0x7f7444072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.829+0000 7f7443e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f744406db60 con 0x7f7444142720 2024-03-28T21:53:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.829+0000 7f7443e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f744406eff0 con 0x7f7444072100 2024-03-28T21:53:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.829+0000 7f7443e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7444071d60 con 0x7f74440cde20 2024-03-28T21:53:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.830+0000 7f7442a00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7444142720 0x7f744406e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59098/0 (socket says 172.21.15.153:59098) 2024-03-28T21:53:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.830+0000 7f7442a00640 1 -- 172.21.15.153:0/580881887 learned_addr learned my addr 172.21.15.153:0/580881887 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:15.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.830+0000 7f7443400640 1 --2- 172.21.15.153:0/580881887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74440cde20 0x7f7444072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.830+0000 7f7442000640 1 -- 172.21.15.153:0/580881887 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2771639560 0 0) 0x7f744406db60 con 0x7f7444142720 2024-03-28T21:53:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.830+0000 7f7442000640 1 -- 172.21.15.153:0/580881887 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7428003520 con 0x7f7444142720 2024-03-28T21:53:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7442000640 1 -- 172.21.15.153:0/580881887 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2243868723 0 0) 0x7f7428003520 con 0x7f7444142720 2024-03-28T21:53:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7442000640 1 -- 172.21.15.153:0/580881887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74440cde20 msgr2=0x7f7444072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7442000640 1 --2- 172.21.15.153:0/580881887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74440cde20 0x7f7444072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7442000640 1 -- 172.21.15.153:0/580881887 >> v1:172.21.15.165:6789/0 conn(0x7f7444072100 legacy=0x7f74440cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7442000640 1 -- 172.21.15.153:0/580881887 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7444071a80 con 0x7f7444142720 2024-03-28T21:53:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7442000640 1 -- 172.21.15.153:0/580881887 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f7434001670 con 0x7f7444142720 2024-03-28T21:53:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7442000640 1 -- 172.21.15.153:0/580881887 >> v1:172.21.15.153:6789/0 conn(0x7f7444142720 legacy=0x7f744406e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7442000640 1 --2- 172.21.15.153:0/580881887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7428003a50 0x7f7428003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7442000640 1 --2- 172.21.15.153:0/580881887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74440cde20 0x7f7428004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7442000640 1 --2- 172.21.15.153:0/580881887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7428004d40 0x7f74280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7442000640 1 -- 172.21.15.153:0/580881887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f742800bba0 con 0x7f7428004d40 2024-03-28T21:53:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7442000640 1 -- 172.21.15.153:0/580881887 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f742800bd50 con 0x7f7428003a50 2024-03-28T21:53:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7442000640 1 -- 172.21.15.153:0/580881887 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f742800bf50 con 0x7f74440cde20 2024-03-28T21:53:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7443400640 1 --2- 172.21.15.153:0/580881887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7428004d40 0x7f74280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.831+0000 7f7442a00640 1 --2- 172.21.15.153:0/580881887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7428003a50 0x7f7428003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.832+0000 7f7443400640 1 -- 172.21.15.153:0/580881887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74440cde20 msgr2=0x7f7428004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.832+0000 7f743be00640 1 --2- 172.21.15.153:0/580881887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74440cde20 0x7f7428004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.832+0000 7f7443400640 1 --2- 172.21.15.153:0/580881887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74440cde20 0x7f7428004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.832+0000 7f7443400640 1 -- 172.21.15.153:0/580881887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7428003a50 msgr2=0x7f7428003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.832+0000 7f7443400640 1 --2- 172.21.15.153:0/580881887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7428003a50 0x7f7428003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.832+0000 7f7443400640 1 -- 172.21.15.153:0/580881887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7428003520 con 0x7f7428004d40 2024-03-28T21:53:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.832+0000 7f7442a00640 1 --2- 172.21.15.153:0/580881887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7428003a50 0x7f7428003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.833+0000 7f7443400640 1 --2- 172.21.15.153:0/580881887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7428004d40 0x7f74280051c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f743c009fc0 tx=0x7f7428005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c841915371c205 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.833+0000 7f7442000640 1 -- 172.21.15.153:0/580881887 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c039070 con 0x7f7428004d40 2024-03-28T21:53:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.833+0000 7f7442000640 1 -- 172.21.15.153:0/580881887 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743c02cc20 con 0x7f7428004d40 2024-03-28T21:53:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.833+0000 7f7442000640 1 -- 172.21.15.153:0/580881887 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c009c10 con 0x7f7428004d40 2024-03-28T21:53:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.833+0000 7f7443e00640 1 -- 172.21.15.153:0/580881887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7428004d40 msgr2=0x7f74280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.833+0000 7f7443e00640 1 --2- 172.21.15.153:0/580881887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7428004d40 0x7f74280051c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f743c009fc0 tx=0x7f7428005830 comp rx=0 tx=0).stop 2024-03-28T21:53:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.833+0000 7f7443400640 1 -- 172.21.15.153:0/580881887 reap_dead start 2024-03-28T21:53:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.834+0000 7f7443e00640 1 -- 172.21.15.153:0/580881887 shutdown_connections 2024-03-28T21:53:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.834+0000 7f7443e00640 1 -- 172.21.15.153:0/580881887 >> 172.21.15.153:0/580881887 conn(0x7f74440b1890 msgr2=0x7f74440b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.834+0000 7f7443e00640 1 -- 172.21.15.153:0/580881887 shutdown_connections 2024-03-28T21:53:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.834+0000 7f7443e00640 1 -- 172.21.15.153:0/580881887 wait complete. 2024-03-28T21:53:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.835+0000 7f7443e00640 1 Processor -- start 2024-03-28T21:53:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.835+0000 7f7443e00640 1 -- start start 2024-03-28T21:53:15.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.836+0000 7f7443e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7428004d40 0x7f74441e4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.836+0000 7f7443e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7444140bf0 0x7f744415bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.836+0000 7f7443e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7444131ff0 0x7f74441e6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.836+0000 7f7443e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f744406e0e0 con 0x7f7428004d40 2024-03-28T21:53:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.836+0000 7f7443e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7444142b00 con 0x7f7444131ff0 2024-03-28T21:53:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.836+0000 7f7443e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f744406e3c0 con 0x7f7444140bf0 2024-03-28T21:53:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.837+0000 7f7442a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7428004d40 0x7f74441e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.837+0000 7f7442a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7428004d40 0x7f74441e4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58486/0 (socket says 172.21.15.153:58486) 2024-03-28T21:53:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.837+0000 7f7442a00640 1 -- 172.21.15.153:0/155124223 learned_addr learned my addr 172.21.15.153:0/155124223 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.837+0000 7f743be00640 1 --2- 172.21.15.153:0/155124223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7444140bf0 0x7f744415bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.837+0000 7f7442a00640 1 -- 172.21.15.153:0/155124223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7444140bf0 msgr2=0x7f744415bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.837+0000 7f7443400640 1 --2- 172.21.15.153:0/155124223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7444131ff0 0x7f74441e6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.837+0000 7f7442a00640 1 --2- 172.21.15.153:0/155124223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7444140bf0 0x7f744415bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.837+0000 7f7442a00640 1 -- 172.21.15.153:0/155124223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7444131ff0 msgr2=0x7f74441e6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.837+0000 7f7442a00640 1 --2- 172.21.15.153:0/155124223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7444131ff0 0x7f74441e6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:15.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.837+0000 7f7442a00640 1 -- 172.21.15.153:0/155124223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74441e4ba0 con 0x7f7428004d40 2024-03-28T21:53:15.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.837+0000 7f7442a00640 1 --2- 172.21.15.153:0/155124223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7428004d40 0x7f74441e4660 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f743400d800 tx=0x7f743400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:15.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.838+0000 7f743b400640 1 -- 172.21.15.153:0/155124223 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7434019070 con 0x7f7428004d40 2024-03-28T21:53:15.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.838+0000 7f743b400640 1 -- 172.21.15.153:0/155124223 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74340074e0 con 0x7f7428004d40 2024-03-28T21:53:15.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.838+0000 7f743b400640 1 -- 172.21.15.153:0/155124223 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7434004a00 con 0x7f7428004d40 2024-03-28T21:53:15.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.838+0000 7f7443e00640 1 -- 172.21.15.153:0/155124223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74441e4e20 con 0x7f7428004d40 2024-03-28T21:53:15.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.838+0000 7f7443e00640 1 -- 172.21.15.153:0/155124223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74441e53e0 con 0x7f7428004d40 2024-03-28T21:53:15.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.839+0000 7f7443e00640 1 -- 172.21.15.153:0/155124223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f744404f520 con 0x7f7428004d40 2024-03-28T21:53:15.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.840+0000 7f743b400640 1 -- 172.21.15.153:0/155124223 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f7434004ba0 con 0x7f7428004d40 2024-03-28T21:53:15.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.841+0000 7f743b400640 1 --2- 172.21.15.153:0/155124223 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f742006b4d0 0x7f742006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:15.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.841+0000 7f743b400640 1 -- 172.21.15.153:0/155124223 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f7434089d00 con 0x7f7428004d40 2024-03-28T21:53:15.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.841+0000 7f743be00640 1 --2- 172.21.15.153:0/155124223 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f742006b4d0 0x7f742006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:15.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.842+0000 7f743be00640 1 --2- 172.21.15.153:0/155124223 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f742006b4d0 0x7f742006d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f742c000c00 tx=0x7f742c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:15.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:15.846+0000 7f743b400640 1 -- 172.21.15.153:0/155124223 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f74441e4ba0 con 0x7f7428004d40 2024-03-28T21:53:16.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:16.141+0000 7f7443e00640 1 -- 172.21.15.153:0/155124223 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74440b1530 con 0x7f742006b4d0 2024-03-28T21:53:16.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:16.159+0000 7f743b400640 1 -- 172.21.15.153:0/155124223 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251950 (secure 0 0 0) 0x7f74440b1530 con 0x7f742006b4d0 2024-03-28T21:53:16.164 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:16.165 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-03-28T21:53:16.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:16.164+0000 7f7443e00640 1 -- 172.21.15.153:0/155124223 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f742006b4d0 msgr2=0x7f742006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:16.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:16.164+0000 7f7443e00640 1 --2- 172.21.15.153:0/155124223 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f742006b4d0 0x7f742006d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f742c000c00 tx=0x7f742c009040 comp rx=0 tx=0).stop 2024-03-28T21:53:16.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:16.164+0000 7f7443e00640 1 -- 172.21.15.153:0/155124223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7428004d40 msgr2=0x7f74441e4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:16.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:16.164+0000 7f7443e00640 1 --2- 172.21.15.153:0/155124223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7428004d40 0x7f74441e4660 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f743400d800 tx=0x7f743400dcc0 comp rx=0 tx=0).stop 2024-03-28T21:53:16.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:16.164+0000 7f7443e00640 1 -- 172.21.15.153:0/155124223 shutdown_connections 2024-03-28T21:53:16.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:16.164+0000 7f7443e00640 1 --2- 172.21.15.153:0/155124223 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f742006b4d0 0x7f742006d990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:16.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:16.164+0000 7f7443e00640 1 --2- 172.21.15.153:0/155124223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7444131ff0 0x7f74441e6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:16.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:16.164+0000 7f7443e00640 1 --2- 172.21.15.153:0/155124223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7444140bf0 0x7f744415bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:16.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:16.164+0000 7f7443e00640 1 --2- 172.21.15.153:0/155124223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7428004d40 0x7f74441e4660 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:16.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:16.164+0000 7f7443e00640 1 -- 172.21.15.153:0/155124223 >> 172.21.15.153:0/155124223 conn(0x7f74440b1890 msgr2=0x7f7444070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:16.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:16.164+0000 7f7443e00640 1 -- 172.21.15.153:0/155124223 shutdown_connections 2024-03-28T21:53:16.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:16.164+0000 7f7443e00640 1 -- 172.21.15.153:0/155124223 wait complete. 2024-03-28T21:53:16.183 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-03-28T21:53:15.487547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228776,"kb_used_data":4296,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745944,"statfs":{"total":773094113280,"available":772859846656,"internally_reserved":0,"allocated":4399104,"data_stored":2421684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.920458"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628213+0000","last_change":"2024-03-28T21:53:09.618053+0000","last_active":"2024-03-28T21:53:10.628213+0000","last_peered":"2024-03-28T21:53:10.628213+0000","last_clean":"2024-03-28T21:53:10.628213+0000","last_became_active":"2024-03-28T21:53:09.617703+0000","last_became_peered":"2024-03-28T21:53:09.617703+0000","last_unstale":"2024-03-28T21:53:10.628213+0000","last_undegraded":"2024-03-28T21:53:10.628213+0000","last_fullsized":"2024-03-28T21:53:10.628213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:11:49.665221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.258055+0000","last_change":"2024-03-28T21:53:09.616006+0000","last_active":"2024-03-28T21:53:12.258055+0000","last_peered":"2024-03-28T21:53:12.258055+0000","last_clean":"2024-03-28T21:53:12.258055+0000","last_became_active":"2024-03-28T21:53:09.615731+0000","last_became_peered":"2024-03-28T21:53:09.615731+0000","last_unstale":"2024-03-28T21:53:12.258055+0000","last_undegraded":"2024-03-28T21:53:12.258055+0000","last_fullsized":"2024-03-28T21:53:12.258055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:06:48.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051141+0000","last_change":"2024-03-28T21:53:09.627422+0000","last_active":"2024-03-28T21:53:12.051141+0000","last_peered":"2024-03-28T21:53:12.051141+0000","last_clean":"2024-03-28T21:53:12.051141+0000","last_became_active":"2024-03-28T21:53:09.627120+0000","last_became_peered":"2024-03-28T21:53:09.627120+0000","last_unstale":"2024-03-28T21:53:12.051141+0000","last_undegraded":"2024-03-28T21:53:12.051141+0000","last_fullsized":"2024-03-28T21:53:12.051141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:07:54.472904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.600705+0000","last_change":"2024-03-28T21:53:09.623788+0000","last_active":"2024-03-28T21:53:11.600705+0000","last_peered":"2024-03-28T21:53:11.600705+0000","last_clean":"2024-03-28T21:53:11.600705+0000","last_became_active":"2024-03-28T21:53:09.623475+0000","last_became_peered":"2024-03-28T21:53:09.623475+0000","last_unstale":"2024-03-28T21:53:11.600705+0000","last_undegraded":"2024-03-28T21:53:11.600705+0000","last_fullsized":"2024-03-28T21:53:11.600705+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:13:41.380432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.255919+0000","last_change":"2024-03-28T21:53:09.620252+0000","last_active":"2024-03-28T21:53:12.255919+0000","last_peered":"2024-03-28T21:53:12.255919+0000","last_clean":"2024-03-28T21:53:12.255919+0000","last_became_active":"2024-03-28T21:53:09.617820+0000","last_became_peered":"2024-03-28T21:53:09.617820+0000","last_unstale":"2024-03-28T21:53:12.255919+0000","last_undegraded":"2024-03-28T21:53:12.255919+0000","last_fullsized":"2024-03-28T21:53:12.255919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:46:34.700897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256050+0000","last_change":"2024-03-28T21:53:09.619811+0000","last_active":"2024-03-28T21:53:12.256050+0000","last_peered":"2024-03-28T21:53:12.256050+0000","last_clean":"2024-03-28T21:53:12.256050+0000","last_became_active":"2024-03-28T21:53:09.618302+0000","last_became_peered":"2024-03-28T21:53:09.618302+0000","last_unstale":"2024-03-28T21:53:12.256050+0000","last_undegraded":"2024-03-28T21:53:12.256050+0000","last_fullsized":"2024-03-28T21:53:12.256050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:07:54.472904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.622826+0000","last_change":"2024-03-28T21:53:09.630575+0000","last_active":"2024-03-28T21:53:10.622826+0000","last_peered":"2024-03-28T21:53:10.622826+0000","last_clean":"2024-03-28T21:53:10.622826+0000","last_became_active":"2024-03-28T21:53:09.629388+0000","last_became_peered":"2024-03-28T21:53:09.629388+0000","last_unstale":"2024-03-28T21:53:10.622826+0000","last_undegraded":"2024-03-28T21:53:10.622826+0000","last_fullsized":"2024-03-28T21:53:10.622826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:07:27.859237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.623803+0000","last_change":"2024-03-28T21:53:09.633481+0000","last_active":"2024-03-28T21:53:10.623803+0000","last_peered":"2024-03-28T21:53:10.623803+0000","last_clean":"2024-03-28T21:53:10.623803+0000","last_became_active":"2024-03-28T21:53:09.633056+0000","last_became_peered":"2024-03-28T21:53:09.633056+0000","last_unstale":"2024-03-28T21:53:10.623803+0000","last_undegraded":"2024-03-28T21:53:10.623803+0000","last_fullsized":"2024-03-28T21:53:10.623803+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:49:59.744298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.629581+0000","last_change":"2024-03-28T21:53:09.622925+0000","last_active":"2024-03-28T21:53:10.629581+0000","last_peered":"2024-03-28T21:53:10.629581+0000","last_clean":"2024-03-28T21:53:10.629581+0000","last_became_active":"2024-03-28T21:53:09.622653+0000","last_became_peered":"2024-03-28T21:53:09.622653+0000","last_unstale":"2024-03-28T21:53:10.629581+0000","last_undegraded":"2024-03-28T21:53:10.629581+0000","last_fullsized":"2024-03-28T21:53:10.629581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:07:27.859237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.601244+0000","last_change":"2024-03-28T21:53:09.631295+0000","last_active":"2024-03-28T21:53:11.601244+0000","last_peered":"2024-03-28T21:53:11.601244+0000","last_clean":"2024-03-28T21:53:11.601244+0000","last_became_active":"2024-03-28T21:53:09.631053+0000","last_became_peered":"2024-03-28T21:53:09.631053+0000","last_unstale":"2024-03-28T21:53:11.601244+0000","last_undegraded":"2024-03-28T21:53:11.601244+0000","last_fullsized":"2024-03-28T21:53:11.601244+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:34:01.660116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.622823+0000","last_change":"2024-03-28T21:53:09.632217+0000","last_active":"2024-03-28T21:53:10.622823+0000","last_peered":"2024-03-28T21:53:10.622823+0000","last_clean":"2024-03-28T21:53:10.622823+0000","last_became_active":"2024-03-28T21:53:09.631929+0000","last_became_peered":"2024-03-28T21:53:09.631929+0000","last_unstale":"2024-03-28T21:53:10.622823+0000","last_undegraded":"2024-03-28T21:53:10.622823+0000","last_fullsized":"2024-03-28T21:53:10.622823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:56.340710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051425+0000","last_change":"2024-03-28T21:53:09.632254+0000","last_active":"2024-03-28T21:53:12.051425+0000","last_peered":"2024-03-28T21:53:12.051425+0000","last_clean":"2024-03-28T21:53:12.051425+0000","last_became_active":"2024-03-28T21:53:09.631088+0000","last_became_peered":"2024-03-28T21:53:09.631088+0000","last_unstale":"2024-03-28T21:53:12.051425+0000","last_undegraded":"2024-03-28T21:53:12.051425+0000","last_fullsized":"2024-03-28T21:53:12.051425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:00:32.856094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256335+0000","last_change":"2024-03-28T21:53:09.618169+0000","last_active":"2024-03-28T21:53:12.256335+0000","last_peered":"2024-03-28T21:53:12.256335+0000","last_clean":"2024-03-28T21:53:12.256335+0000","last_became_active":"2024-03-28T21:53:09.617873+0000","last_became_peered":"2024-03-28T21:53:09.617873+0000","last_unstale":"2024-03-28T21:53:12.256335+0000","last_undegraded":"2024-03-28T21:53:12.256335+0000","last_fullsized":"2024-03-28T21:53:12.256335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:38:51.121719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256238+0000","last_change":"2024-03-28T21:53:09.614050+0000","last_active":"2024-03-28T21:53:12.256238+0000","last_peered":"2024-03-28T21:53:12.256238+0000","last_clean":"2024-03-28T21:53:12.256238+0000","last_became_active":"2024-03-28T21:53:09.613795+0000","last_became_peered":"2024-03-28T21:53:09.613795+0000","last_unstale":"2024-03-28T21:53:12.256238+0000","last_undegraded":"2024-03-28T21:53:12.256238+0000","last_fullsized":"2024-03-28T21:53:12.256238+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:49:59.744298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.050893+0000","last_change":"2024-03-28T21:53:09.628800+0000","last_active":"2024-03-28T21:53:12.050893+0000","last_peered":"2024-03-28T21:53:12.050893+0000","last_clean":"2024-03-28T21:53:12.050893+0000","last_became_active":"2024-03-28T21:53:09.627923+0000","last_became_peered":"2024-03-28T21:53:09.627923+0000","last_unstale":"2024-03-28T21:53:12.050893+0000","last_undegraded":"2024-03-28T21:53:12.050893+0000","last_fullsized":"2024-03-28T21:53:12.050893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:32:59.827309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.624007+0000","last_change":"2024-03-28T21:53:09.635624+0000","last_active":"2024-03-28T21:53:10.624007+0000","last_peered":"2024-03-28T21:53:10.624007+0000","last_clean":"2024-03-28T21:53:10.624007+0000","last_became_active":"2024-03-28T21:53:09.635012+0000","last_became_peered":"2024-03-28T21:53:09.635012+0000","last_unstale":"2024-03-28T21:53:10.624007+0000","last_undegraded":"2024-03-28T21:53:10.624007+0000","last_fullsized":"2024-03-28T21:53:10.624007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:40.286505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.623689+0000","last_change":"2024-03-28T21:53:09.632916+0000","last_active":"2024-03-28T21:53:10.623689+0000","last_peered":"2024-03-28T21:53:10.623689+0000","last_clean":"2024-03-28T21:53:10.623689+0000","last_became_active":"2024-03-28T21:53:09.631664+0000","last_became_peered":"2024-03-28T21:53:09.631664+0000","last_unstale":"2024-03-28T21:53:10.623689+0000","last_undegraded":"2024-03-28T21:53:10.623689+0000","last_fullsized":"2024-03-28T21:53:10.623689+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:07:54.472904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.258209+0000","last_change":"2024-03-28T21:53:09.624131+0000","last_active":"2024-03-28T21:53:12.258209+0000","last_peered":"2024-03-28T21:53:12.258209+0000","last_clean":"2024-03-28T21:53:12.258209+0000","last_became_active":"2024-03-28T21:53:09.623872+0000","last_became_peered":"2024-03-28T21:53:09.623872+0000","last_unstale":"2024-03-28T21:53:12.258209+0000","last_undegraded":"2024-03-28T21:53:12.258209+0000","last_fullsized":"2024-03-28T21:53:12.258209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:11:23.833555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.257174+0000","last_change":"2024-03-28T21:53:09.618227+0000","last_active":"2024-03-28T21:53:12.257174+0000","last_peered":"2024-03-28T21:53:12.257174+0000","last_clean":"2024-03-28T21:53:12.257174+0000","last_became_active":"2024-03-28T21:53:09.617950+0000","last_became_peered":"2024-03-28T21:53:09.617950+0000","last_unstale":"2024-03-28T21:53:12.257174+0000","last_undegraded":"2024-03-28T21:53:12.257174+0000","last_fullsized":"2024-03-28T21:53:12.257174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:00:32.856094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.257067+0000","last_change":"2024-03-28T21:53:09.617120+0000","last_active":"2024-03-28T21:53:12.257067+0000","last_peered":"2024-03-28T21:53:12.257067+0000","last_clean":"2024-03-28T21:53:12.257067+0000","last_became_active":"2024-03-28T21:53:09.616822+0000","last_became_peered":"2024-03-28T21:53:09.616822+0000","last_unstale":"2024-03-28T21:53:12.257067+0000","last_undegraded":"2024-03-28T21:53:12.257067+0000","last_fullsized":"2024-03-28T21:53:12.257067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:09:12.244061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628303+0000","last_change":"2024-03-28T21:53:09.608181+0000","last_active":"2024-03-28T21:53:10.628303+0000","last_peered":"2024-03-28T21:53:10.628303+0000","last_clean":"2024-03-28T21:53:10.628303+0000","last_became_active":"2024-03-28T21:53:09.607781+0000","last_became_peered":"2024-03-28T21:53:09.607781+0000","last_unstale":"2024-03-28T21:53:10.628303+0000","last_undegraded":"2024-03-28T21:53:10.628303+0000","last_fullsized":"2024-03-28T21:53:10.628303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:56.340710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.626655+0000","last_change":"2024-03-28T21:53:09.612138+0000","last_active":"2024-03-28T21:53:10.626655+0000","last_peered":"2024-03-28T21:53:10.626655+0000","last_clean":"2024-03-28T21:53:10.626655+0000","last_became_active":"2024-03-28T21:53:09.611835+0000","last_became_peered":"2024-03-28T21:53:09.611835+0000","last_unstale":"2024-03-28T21:53:10.626655+0000","last_undegraded":"2024-03-28T21:53:10.626655+0000","last_fullsized":"2024-03-28T21:53:10.626655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:56:09.547479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.585907+0000","last_change":"2024-03-28T21:53:09.620970+0000","last_active":"2024-03-28T21:53:11.585907+0000","last_peered":"2024-03-28T21:53:11.585907+0000","last_clean":"2024-03-28T21:53:11.585907+0000","last_became_active":"2024-03-28T21:53:09.620701+0000","last_became_peered":"2024-03-28T21:53:09.620701+0000","last_unstale":"2024-03-28T21:53:11.585907+0000","last_undegraded":"2024-03-28T21:53:11.585907+0000","last_fullsized":"2024-03-28T21:53:11.585907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:54:01.195978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.050675+0000","last_change":"2024-03-28T21:53:09.614003+0000","last_active":"2024-03-28T21:53:12.050675+0000","last_peered":"2024-03-28T21:53:12.050675+0000","last_clean":"2024-03-28T21:53:12.050675+0000","last_became_active":"2024-03-28T21:53:09.613725+0000","last_became_peered":"2024-03-28T21:53:09.613725+0000","last_unstale":"2024-03-28T21:53:12.050675+0000","last_undegraded":"2024-03-28T21:53:12.050675+0000","last_fullsized":"2024-03-28T21:53:12.050675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:00:55.729726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.600909+0000","last_change":"2024-03-28T21:53:09.635921+0000","last_active":"2024-03-28T21:53:11.600909+0000","last_peered":"2024-03-28T21:53:11.600909+0000","last_clean":"2024-03-28T21:53:11.600909+0000","last_became_active":"2024-03-28T21:53:09.635612+0000","last_became_peered":"2024-03-28T21:53:09.635612+0000","last_unstale":"2024-03-28T21:53:11.600909+0000","last_undegraded":"2024-03-28T21:53:11.600909+0000","last_fullsized":"2024-03-28T21:53:11.600909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:56.340710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.258368+0000","last_change":"2024-03-28T21:53:09.620547+0000","last_active":"2024-03-28T21:53:12.258368+0000","last_peered":"2024-03-28T21:53:12.258368+0000","last_clean":"2024-03-28T21:53:12.258368+0000","last_became_active":"2024-03-28T21:53:09.619959+0000","last_became_peered":"2024-03-28T21:53:09.619959+0000","last_unstale":"2024-03-28T21:53:12.258368+0000","last_undegraded":"2024-03-28T21:53:12.258368+0000","last_fullsized":"2024-03-28T21:53:12.258368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:10:30.139050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.601035+0000","last_change":"2024-03-28T21:53:09.625360+0000","last_active":"2024-03-28T21:53:11.601035+0000","last_peered":"2024-03-28T21:53:11.601035+0000","last_clean":"2024-03-28T21:53:11.601035+0000","last_became_active":"2024-03-28T21:53:09.624624+0000","last_became_peered":"2024-03-28T21:53:09.624624+0000","last_unstale":"2024-03-28T21:53:11.601035+0000","last_undegraded":"2024-03-28T21:53:11.601035+0000","last_fullsized":"2024-03-28T21:53:11.601035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:07:27.859237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051385+0000","last_change":"2024-03-28T21:53:09.621553+0000","last_active":"2024-03-28T21:53:12.051385+0000","last_peered":"2024-03-28T21:53:12.051385+0000","last_clean":"2024-03-28T21:53:12.051385+0000","last_became_active":"2024-03-28T21:53:09.621098+0000","last_became_peered":"2024-03-28T21:53:09.621098+0000","last_unstale":"2024-03-28T21:53:12.051385+0000","last_undegraded":"2024-03-28T21:53:12.051385+0000","last_fullsized":"2024-03-28T21:53:12.051385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:40.286505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628254+0000","last_change":"2024-03-28T21:53:09.616868+0000","last_active":"2024-03-28T21:53:10.628254+0000","last_peered":"2024-03-28T21:53:10.628254+0000","last_clean":"2024-03-28T21:53:10.628254+0000","last_became_active":"2024-03-28T21:53:09.616556+0000","last_became_peered":"2024-03-28T21:53:09.616556+0000","last_unstale":"2024-03-28T21:53:10.628254+0000","last_undegraded":"2024-03-28T21:53:10.628254+0000","last_fullsized":"2024-03-28T21:53:10.628254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:53:29.426892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.623157+0000","last_change":"2024-03-28T21:53:09.635624+0000","last_active":"2024-03-28T21:53:10.623157+0000","last_peered":"2024-03-28T21:53:10.623157+0000","last_clean":"2024-03-28T21:53:10.623157+0000","last_became_active":"2024-03-28T21:53:09.635253+0000","last_became_peered":"2024-03-28T21:53:09.635253+0000","last_unstale":"2024-03-28T21:53:10.623157+0000","last_undegraded":"2024-03-28T21:53:10.623157+0000","last_fullsized":"2024-03-28T21:53:10.623157+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:34:01.660116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.627185+0000","last_change":"2024-03-28T21:53:09.613838+0000","last_active":"2024-03-28T21:53:10.627185+0000","last_peered":"2024-03-28T21:53:10.627185+0000","last_clean":"2024-03-28T21:53:10.627185+0000","last_became_active":"2024-03-28T21:53:09.613516+0000","last_became_peered":"2024-03-28T21:53:09.613516+0000","last_unstale":"2024-03-28T21:53:10.627185+0000","last_undegraded":"2024-03-28T21:53:10.627185+0000","last_fullsized":"2024-03-28T21:53:10.627185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:42:45.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.622884+0000","last_change":"2024-03-28T21:53:09.635652+0000","last_active":"2024-03-28T21:53:10.622884+0000","last_peered":"2024-03-28T21:53:10.622884+0000","last_clean":"2024-03-28T21:53:10.622884+0000","last_became_active":"2024-03-28T21:53:09.634521+0000","last_became_peered":"2024-03-28T21:53:09.634521+0000","last_unstale":"2024-03-28T21:53:10.622884+0000","last_undegraded":"2024-03-28T21:53:10.622884+0000","last_fullsized":"2024-03-28T21:53:10.622884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:14:11.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.586463+0000","last_change":"2024-03-28T21:53:09.631992+0000","last_active":"2024-03-28T21:53:11.586463+0000","last_peered":"2024-03-28T21:53:11.586463+0000","last_clean":"2024-03-28T21:53:11.586463+0000","last_became_active":"2024-03-28T21:53:09.631634+0000","last_became_peered":"2024-03-28T21:53:09.631634+0000","last_unstale":"2024-03-28T21:53:11.586463+0000","last_undegraded":"2024-03-28T21:53:11.586463+0000","last_fullsized":"2024-03-28T21:53:11.586463+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:38:26.182761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628757+0000","last_change":"2024-03-28T21:53:08.596850+0000","last_active":"2024-03-28T21:53:10.628757+0000","last_peered":"2024-03-28T21:53:10.628757+0000","last_clean":"2024-03-28T21:53:10.628757+0000","last_became_active":"2024-03-28T21:53:08.595486+0000","last_became_peered":"2024-03-28T21:53:08.595486+0000","last_unstale":"2024-03-28T21:53:10.628757+0000","last_undegraded":"2024-03-28T21:53:10.628757+0000","last_fullsized":"2024-03-28T21:53:10.628757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:45:27.076818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628619+0000","last_change":"2024-03-28T21:53:09.623425+0000","last_active":"2024-03-28T21:53:10.628619+0000","last_peered":"2024-03-28T21:53:10.628619+0000","last_clean":"2024-03-28T21:53:10.628619+0000","last_became_active":"2024-03-28T21:53:09.621716+0000","last_became_peered":"2024-03-28T21:53:09.621716+0000","last_unstale":"2024-03-28T21:53:10.628619+0000","last_undegraded":"2024-03-28T21:53:10.628619+0000","last_fullsized":"2024-03-28T21:53:10.628619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:26:19.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.586697+0000","last_change":"2024-03-28T21:53:08.606169+0000","last_active":"2024-03-28T21:53:11.586697+0000","last_peered":"2024-03-28T21:53:11.586697+0000","last_clean":"2024-03-28T21:53:11.586697+0000","last_became_active":"2024-03-28T21:53:08.605835+0000","last_became_peered":"2024-03-28T21:53:08.605835+0000","last_unstale":"2024-03-28T21:53:11.586697+0000","last_undegraded":"2024-03-28T21:53:11.586697+0000","last_fullsized":"2024-03-28T21:53:11.586697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:38:50.107490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628274+0000","last_change":"2024-03-28T21:53:09.623865+0000","last_active":"2024-03-28T21:53:10.628274+0000","last_peered":"2024-03-28T21:53:10.628274+0000","last_clean":"2024-03-28T21:53:10.628274+0000","last_became_active":"2024-03-28T21:53:09.620661+0000","last_became_peered":"2024-03-28T21:53:09.620661+0000","last_unstale":"2024-03-28T21:53:10.628274+0000","last_undegraded":"2024-03-28T21:53:10.628274+0000","last_fullsized":"2024-03-28T21:53:10.628274+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:13:41.380432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.257289+0000","last_change":"2024-03-28T21:53:08.598731+0000","last_active":"2024-03-28T21:53:12.257289+0000","last_peered":"2024-03-28T21:53:12.257289+0000","last_clean":"2024-03-28T21:53:12.257289+0000","last_became_active":"2024-03-28T21:53:08.596715+0000","last_became_peered":"2024-03-28T21:53:08.596715+0000","last_unstale":"2024-03-28T21:53:12.257289+0000","last_undegraded":"2024-03-28T21:53:12.257289+0000","last_fullsized":"2024-03-28T21:53:12.257289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:36:54.751944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.601166+0000","last_change":"2024-03-28T21:53:09.626103+0000","last_active":"2024-03-28T21:53:11.601166+0000","last_peered":"2024-03-28T21:53:11.601166+0000","last_clean":"2024-03-28T21:53:11.601166+0000","last_became_active":"2024-03-28T21:53:09.625802+0000","last_became_peered":"2024-03-28T21:53:09.625802+0000","last_unstale":"2024-03-28T21:53:11.601166+0000","last_undegraded":"2024-03-28T21:53:11.601166+0000","last_fullsized":"2024-03-28T21:53:11.601166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:14:11.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256996+0000","last_change":"2024-03-28T21:53:08.595268+0000","last_active":"2024-03-28T21:53:12.256996+0000","last_peered":"2024-03-28T21:53:12.256996+0000","last_clean":"2024-03-28T21:53:12.256996+0000","last_became_active":"2024-03-28T21:53:08.594957+0000","last_became_peered":"2024-03-28T21:53:08.594957+0000","last_unstale":"2024-03-28T21:53:12.256996+0000","last_undegraded":"2024-03-28T21:53:12.256996+0000","last_fullsized":"2024-03-28T21:53:12.256996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:10:31.700961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.623615+0000","last_change":"2024-03-28T21:53:09.634559+0000","last_active":"2024-03-28T21:53:10.623615+0000","last_peered":"2024-03-28T21:53:10.623615+0000","last_clean":"2024-03-28T21:53:10.623615+0000","last_became_active":"2024-03-28T21:53:09.633553+0000","last_became_peered":"2024-03-28T21:53:09.633553+0000","last_unstale":"2024-03-28T21:53:10.623615+0000","last_undegraded":"2024-03-28T21:53:10.623615+0000","last_fullsized":"2024-03-28T21:53:10.623615+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:11:20.975294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628460+0000","last_change":"2024-03-28T21:53:08.597379+0000","last_active":"2024-03-28T21:53:10.628460+0000","last_peered":"2024-03-28T21:53:10.628460+0000","last_clean":"2024-03-28T21:53:10.628460+0000","last_became_active":"2024-03-28T21:53:08.596837+0000","last_became_peered":"2024-03-28T21:53:08.596837+0000","last_unstale":"2024-03-28T21:53:10.628460+0000","last_undegraded":"2024-03-28T21:53:10.628460+0000","last_fullsized":"2024-03-28T21:53:10.628460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:03:40.656238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051284+0000","last_change":"2024-03-28T21:53:09.625533+0000","last_active":"2024-03-28T21:53:12.051284+0000","last_peered":"2024-03-28T21:53:12.051284+0000","last_clean":"2024-03-28T21:53:12.051284+0000","last_became_active":"2024-03-28T21:53:09.625191+0000","last_became_peered":"2024-03-28T21:53:09.625191+0000","last_unstale":"2024-03-28T21:53:12.051284+0000","last_undegraded":"2024-03-28T21:53:12.051284+0000","last_fullsized":"2024-03-28T21:53:12.051284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:49:59.744298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.627526+0000","last_change":"2024-03-28T21:53:08.597642+0000","last_active":"2024-03-28T21:53:10.627526+0000","last_peered":"2024-03-28T21:53:10.627526+0000","last_clean":"2024-03-28T21:53:10.627526+0000","last_became_active":"2024-03-28T21:53:08.596815+0000","last_became_peered":"2024-03-28T21:53:08.596815+0000","last_unstale":"2024-03-28T21:53:10.627526+0000","last_undegraded":"2024-03-28T21:53:10.627526+0000","last_fullsized":"2024-03-28T21:53:10.627526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:10:07.461391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.626175+0000","last_change":"2024-03-28T21:53:09.608645+0000","last_active":"2024-03-28T21:53:10.626175+0000","last_peered":"2024-03-28T21:53:10.626175+0000","last_clean":"2024-03-28T21:53:10.626175+0000","last_became_active":"2024-03-28T21:53:09.608342+0000","last_became_peered":"2024-03-28T21:53:09.608342+0000","last_unstale":"2024-03-28T21:53:10.626175+0000","last_undegraded":"2024-03-28T21:53:10.626175+0000","last_fullsized":"2024-03-28T21:53:10.626175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:26:19.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.255597+0000","last_change":"2024-03-28T21:53:08.588066+0000","last_active":"2024-03-28T21:53:12.255597+0000","last_peered":"2024-03-28T21:53:12.255597+0000","last_clean":"2024-03-28T21:53:12.255597+0000","last_became_active":"2024-03-28T21:53:08.587768+0000","last_became_peered":"2024-03-28T21:53:08.587768+0000","last_unstale":"2024-03-28T21:53:12.255597+0000","last_undegraded":"2024-03-28T21:53:12.255597+0000","last_fullsized":"2024-03-28T21:53:12.255597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:42:44.182375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.599886+0000","last_change":"2024-03-28T21:53:09.620021+0000","last_active":"2024-03-28T21:53:11.599886+0000","last_peered":"2024-03-28T21:53:11.599886+0000","last_clean":"2024-03-28T21:53:11.599886+0000","last_became_active":"2024-03-28T21:53:09.619763+0000","last_became_peered":"2024-03-28T21:53:09.619763+0000","last_unstale":"2024-03-28T21:53:11.599886+0000","last_undegraded":"2024-03-28T21:53:11.599886+0000","last_fullsized":"2024-03-28T21:53:11.599886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:56:09.547479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.625957+0000","last_change":"2024-03-28T21:53:08.595394+0000","last_active":"2024-03-28T21:53:10.625957+0000","last_peered":"2024-03-28T21:53:10.625957+0000","last_clean":"2024-03-28T21:53:10.625957+0000","last_became_active":"2024-03-28T21:53:08.595044+0000","last_became_peered":"2024-03-28T21:53:08.595044+0000","last_unstale":"2024-03-28T21:53:10.625957+0000","last_undegraded":"2024-03-28T21:53:10.625957+0000","last_fullsized":"2024-03-28T21:53:10.625957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:27:26.855633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051426+0000","last_change":"2024-03-28T21:53:09.633712+0000","last_active":"2024-03-28T21:53:12.051426+0000","last_peered":"2024-03-28T21:53:12.051426+0000","last_clean":"2024-03-28T21:53:12.051426+0000","last_became_active":"2024-03-28T21:53:09.631966+0000","last_became_peered":"2024-03-28T21:53:09.631966+0000","last_unstale":"2024-03-28T21:53:12.051426+0000","last_undegraded":"2024-03-28T21:53:12.051426+0000","last_fullsized":"2024-03-28T21:53:12.051426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:31:13.152688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.258085+0000","last_change":"2024-03-28T21:53:08.603951+0000","last_active":"2024-03-28T21:53:12.258085+0000","last_peered":"2024-03-28T21:53:12.258085+0000","last_clean":"2024-03-28T21:53:12.258085+0000","last_became_active":"2024-03-28T21:53:08.603672+0000","last_became_peered":"2024-03-28T21:53:08.603672+0000","last_unstale":"2024-03-28T21:53:12.258085+0000","last_undegraded":"2024-03-28T21:53:12.258085+0000","last_fullsized":"2024-03-28T21:53:12.258085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:26:18.310739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.258185+0000","last_change":"2024-03-28T21:53:09.624037+0000","last_active":"2024-03-28T21:53:12.258185+0000","last_peered":"2024-03-28T21:53:12.258185+0000","last_clean":"2024-03-28T21:53:12.258185+0000","last_became_active":"2024-03-28T21:53:09.623257+0000","last_became_peered":"2024-03-28T21:53:09.623257+0000","last_unstale":"2024-03-28T21:53:12.258185+0000","last_undegraded":"2024-03-28T21:53:12.258185+0000","last_fullsized":"2024-03-28T21:53:12.258185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:52:52.388490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.586907+0000","last_change":"2024-03-28T21:53:08.585643+0000","last_active":"2024-03-28T21:53:11.586907+0000","last_peered":"2024-03-28T21:53:11.586907+0000","last_clean":"2024-03-28T21:53:11.586907+0000","last_became_active":"2024-03-28T21:53:08.585344+0000","last_became_peered":"2024-03-28T21:53:08.585344+0000","last_unstale":"2024-03-28T21:53:11.586907+0000","last_undegraded":"2024-03-28T21:53:11.586907+0000","last_fullsized":"2024-03-28T21:53:11.586907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:40:56.188213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.257244+0000","last_change":"2024-03-28T21:53:09.620252+0000","last_active":"2024-03-28T21:53:12.257244+0000","last_peered":"2024-03-28T21:53:12.257244+0000","last_clean":"2024-03-28T21:53:12.257244+0000","last_became_active":"2024-03-28T21:53:09.619965+0000","last_became_peered":"2024-03-28T21:53:09.619965+0000","last_unstale":"2024-03-28T21:53:12.257244+0000","last_undegraded":"2024-03-28T21:53:12.257244+0000","last_fullsized":"2024-03-28T21:53:12.257244+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:00:50.697398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051334+0000","last_change":"2024-03-28T21:53:08.604403+0000","last_active":"2024-03-28T21:53:12.051334+0000","last_peered":"2024-03-28T21:53:12.051334+0000","last_clean":"2024-03-28T21:53:12.051334+0000","last_became_active":"2024-03-28T21:53:08.604079+0000","last_became_peered":"2024-03-28T21:53:08.604079+0000","last_unstale":"2024-03-28T21:53:12.051334+0000","last_undegraded":"2024-03-28T21:53:12.051334+0000","last_fullsized":"2024-03-28T21:53:12.051334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:14:16.355179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.050966+0000","last_change":"2024-03-28T21:53:09.627484+0000","last_active":"2024-03-28T21:53:12.050966+0000","last_peered":"2024-03-28T21:53:12.050966+0000","last_clean":"2024-03-28T21:53:12.050966+0000","last_became_active":"2024-03-28T21:53:09.627213+0000","last_became_peered":"2024-03-28T21:53:09.627213+0000","last_unstale":"2024-03-28T21:53:12.050966+0000","last_undegraded":"2024-03-28T21:53:12.050966+0000","last_fullsized":"2024-03-28T21:53:12.050966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:11:20.975294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.257310+0000","last_change":"2024-03-28T21:53:08.596610+0000","last_active":"2024-03-28T21:53:12.257310+0000","last_peered":"2024-03-28T21:53:12.257310+0000","last_clean":"2024-03-28T21:53:12.257310+0000","last_became_active":"2024-03-28T21:53:08.596231+0000","last_became_peered":"2024-03-28T21:53:08.596231+0000","last_unstale":"2024-03-28T21:53:12.257310+0000","last_undegraded":"2024-03-28T21:53:12.257310+0000","last_fullsized":"2024-03-28T21:53:12.257310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:56:08.533250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.600179+0000","last_change":"2024-03-28T21:53:09.623499+0000","last_active":"2024-03-28T21:53:11.600179+0000","last_peered":"2024-03-28T21:53:11.600179+0000","last_clean":"2024-03-28T21:53:11.600179+0000","last_became_active":"2024-03-28T21:53:09.623232+0000","last_became_peered":"2024-03-28T21:53:09.623232+0000","last_unstale":"2024-03-28T21:53:11.600179+0000","last_undegraded":"2024-03-28T21:53:11.600179+0000","last_fullsized":"2024-03-28T21:53:11.600179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:23:48.311189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628520+0000","last_change":"2024-03-28T21:53:08.595393+0000","last_active":"2024-03-28T21:53:10.628520+0000","last_peered":"2024-03-28T21:53:10.628520+0000","last_clean":"2024-03-28T21:53:10.628520+0000","last_became_active":"2024-03-28T21:53:08.595003+0000","last_became_peered":"2024-03-28T21:53:08.595003+0000","last_unstale":"2024-03-28T21:53:10.628520+0000","last_undegraded":"2024-03-28T21:53:10.628520+0000","last_fullsized":"2024-03-28T21:53:10.628520+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:28:42.470143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256774+0000","last_change":"2024-03-28T21:53:09.610150+0000","last_active":"2024-03-28T21:53:12.256774+0000","last_peered":"2024-03-28T21:53:12.256774+0000","last_clean":"2024-03-28T21:53:12.256774+0000","last_became_active":"2024-03-28T21:53:09.607380+0000","last_became_peered":"2024-03-28T21:53:09.607380+0000","last_unstale":"2024-03-28T21:53:12.256774+0000","last_undegraded":"2024-03-28T21:53:12.256774+0000","last_fullsized":"2024-03-28T21:53:12.256774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:31:13.152688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.599929+0000","last_change":"2024-03-28T21:53:08.590316+0000","last_active":"2024-03-28T21:53:11.599929+0000","last_peered":"2024-03-28T21:53:11.599929+0000","last_clean":"2024-03-28T21:53:11.599929+0000","last_became_active":"2024-03-28T21:53:08.589964+0000","last_became_peered":"2024-03-28T21:53:08.589964+0000","last_unstale":"2024-03-28T21:53:11.599929+0000","last_undegraded":"2024-03-28T21:53:11.599929+0000","last_fullsized":"2024-03-28T21:53:11.599929+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:53:15.412340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.623291+0000","last_change":"2024-03-28T21:53:09.635312+0000","last_active":"2024-03-28T21:53:10.623291+0000","last_peered":"2024-03-28T21:53:10.623291+0000","last_clean":"2024-03-28T21:53:10.623291+0000","last_became_active":"2024-03-28T21:53:09.634668+0000","last_became_peered":"2024-03-28T21:53:09.634668+0000","last_unstale":"2024-03-28T21:53:10.623291+0000","last_undegraded":"2024-03-28T21:53:10.623291+0000","last_fullsized":"2024-03-28T21:53:10.623291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:00:55.729726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.255554+0000","last_change":"2024-03-28T21:53:08.603935+0000","last_active":"2024-03-28T21:53:12.255554+0000","last_peered":"2024-03-28T21:53:12.255554+0000","last_clean":"2024-03-28T21:53:12.255554+0000","last_became_active":"2024-03-28T21:53:08.603613+0000","last_became_peered":"2024-03-28T21:53:08.603613+0000","last_unstale":"2024-03-28T21:53:12.255554+0000","last_undegraded":"2024-03-28T21:53:12.255554+0000","last_fullsized":"2024-03-28T21:53:12.255554+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:24:33.731404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.627373+0000","last_change":"2024-03-28T21:53:09.618816+0000","last_active":"2024-03-28T21:53:10.627373+0000","last_peered":"2024-03-28T21:53:10.627373+0000","last_clean":"2024-03-28T21:53:10.627373+0000","last_became_active":"2024-03-28T21:53:09.618529+0000","last_became_peered":"2024-03-28T21:53:09.618529+0000","last_unstale":"2024-03-28T21:53:10.627373+0000","last_undegraded":"2024-03-28T21:53:10.627373+0000","last_fullsized":"2024-03-28T21:53:10.627373+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:24:34.745634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.255733+0000","last_change":"2024-03-28T21:53:08.582325+0000","last_active":"2024-03-28T21:53:12.255733+0000","last_peered":"2024-03-28T21:53:12.255733+0000","last_clean":"2024-03-28T21:53:12.255733+0000","last_became_active":"2024-03-28T21:53:08.582041+0000","last_became_peered":"2024-03-28T21:53:08.582041+0000","last_unstale":"2024-03-28T21:53:12.255733+0000","last_undegraded":"2024-03-28T21:53:12.255733+0000","last_fullsized":"2024-03-28T21:53:12.255733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:14:16.355179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628139+0000","last_change":"2024-03-28T21:53:09.624214+0000","last_active":"2024-03-28T21:53:10.628139+0000","last_peered":"2024-03-28T21:53:10.628139+0000","last_clean":"2024-03-28T21:53:10.628139+0000","last_became_active":"2024-03-28T21:53:09.623924+0000","last_became_peered":"2024-03-28T21:53:09.623924+0000","last_unstale":"2024-03-28T21:53:10.628139+0000","last_undegraded":"2024-03-28T21:53:10.628139+0000","last_fullsized":"2024-03-28T21:53:10.628139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:23:48.311189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.601060+0000","last_change":"2024-03-28T21:53:08.593464+0000","last_active":"2024-03-28T21:53:11.601060+0000","last_peered":"2024-03-28T21:53:11.601060+0000","last_clean":"2024-03-28T21:53:11.601060+0000","last_became_active":"2024-03-28T21:53:08.593134+0000","last_became_peered":"2024-03-28T21:53:08.593134+0000","last_unstale":"2024-03-28T21:53:11.601060+0000","last_undegraded":"2024-03-28T21:53:11.601060+0000","last_fullsized":"2024-03-28T21:53:11.601060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:03:40.680559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051801+0000","last_change":"2024-03-28T21:53:09.623522+0000","last_active":"2024-03-28T21:53:12.051801+0000","last_peered":"2024-03-28T21:53:12.051801+0000","last_clean":"2024-03-28T21:53:12.051801+0000","last_became_active":"2024-03-28T21:53:09.621232+0000","last_became_peered":"2024-03-28T21:53:09.621232+0000","last_unstale":"2024-03-28T21:53:12.051801+0000","last_undegraded":"2024-03-28T21:53:12.051801+0000","last_fullsized":"2024-03-28T21:53:12.051801+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:00:50.697398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628998+0000","last_change":"2024-03-28T21:53:08.603156+0000","last_active":"2024-03-28T21:53:10.628998+0000","last_peered":"2024-03-28T21:53:10.628998+0000","last_clean":"2024-03-28T21:53:10.628998+0000","last_became_active":"2024-03-28T21:53:08.602876+0000","last_became_peered":"2024-03-28T21:53:08.602876+0000","last_unstale":"2024-03-28T21:53:10.628998+0000","last_undegraded":"2024-03-28T21:53:10.628998+0000","last_fullsized":"2024-03-28T21:53:10.628998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:56:49.605103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.600541+0000","last_change":"2024-03-28T21:53:09.623590+0000","last_active":"2024-03-28T21:53:11.600541+0000","last_peered":"2024-03-28T21:53:11.600541+0000","last_clean":"2024-03-28T21:53:11.600541+0000","last_became_active":"2024-03-28T21:53:09.623323+0000","last_became_peered":"2024-03-28T21:53:09.623323+0000","last_unstale":"2024-03-28T21:53:11.600541+0000","last_undegraded":"2024-03-28T21:53:11.600541+0000","last_fullsized":"2024-03-28T21:53:11.600541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:53:29.426892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628545+0000","last_change":"2024-03-28T21:53:08.601162+0000","last_active":"2024-03-28T21:53:10.628545+0000","last_peered":"2024-03-28T21:53:10.628545+0000","last_clean":"2024-03-28T21:53:10.628545+0000","last_became_active":"2024-03-28T21:53:08.600737+0000","last_became_peered":"2024-03-28T21:53:08.600737+0000","last_unstale":"2024-03-28T21:53:10.628545+0000","last_undegraded":"2024-03-28T21:53:10.628545+0000","last_fullsized":"2024-03-28T21:53:10.628545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:08:17.955335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.257157+0000","last_change":"2024-03-28T21:53:09.635624+0000","last_active":"2024-03-28T21:53:12.257157+0000","last_peered":"2024-03-28T21:53:12.257157+0000","last_clean":"2024-03-28T21:53:12.257157+0000","last_became_active":"2024-03-28T21:53:09.635293+0000","last_became_peered":"2024-03-28T21:53:09.635293+0000","last_unstale":"2024-03-28T21:53:12.257157+0000","last_undegraded":"2024-03-28T21:53:12.257157+0000","last_fullsized":"2024-03-28T21:53:12.257157+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:00:50.826912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628311+0000","last_change":"2024-03-28T21:53:08.597140+0000","last_active":"2024-03-28T21:53:10.628311+0000","last_peered":"2024-03-28T21:53:10.628311+0000","last_clean":"2024-03-28T21:53:10.628311+0000","last_became_active":"2024-03-28T21:53:08.596798+0000","last_became_peered":"2024-03-28T21:53:08.596798+0000","last_unstale":"2024-03-28T21:53:10.628311+0000","last_undegraded":"2024-03-28T21:53:10.628311+0000","last_fullsized":"2024-03-28T21:53:10.628311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:16:26.224226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.255908+0000","last_change":"2024-03-28T21:53:09.619444+0000","last_active":"2024-03-28T21:53:12.255908+0000","last_peered":"2024-03-28T21:53:12.255908+0000","last_clean":"2024-03-28T21:53:12.255908+0000","last_became_active":"2024-03-28T21:53:09.619154+0000","last_became_peered":"2024-03-28T21:53:09.619154+0000","last_unstale":"2024-03-28T21:53:12.255908+0000","last_undegraded":"2024-03-28T21:53:12.255908+0000","last_fullsized":"2024-03-28T21:53:12.255908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:24:04.014206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.586539+0000","last_change":"2024-03-28T21:53:08.590224+0000","last_active":"2024-03-28T21:53:11.586539+0000","last_peered":"2024-03-28T21:53:11.586539+0000","last_clean":"2024-03-28T21:53:11.586539+0000","last_became_active":"2024-03-28T21:53:08.589942+0000","last_became_peered":"2024-03-28T21:53:08.589942+0000","last_unstale":"2024-03-28T21:53:11.586539+0000","last_undegraded":"2024-03-28T21:53:11.586539+0000","last_fullsized":"2024-03-28T21:53:11.586539+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:24:02.999976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256461+0000","last_change":"2024-03-28T21:53:09.611117+0000","last_active":"2024-03-28T21:53:12.256461+0000","last_peered":"2024-03-28T21:53:12.256461+0000","last_clean":"2024-03-28T21:53:12.256461+0000","last_became_active":"2024-03-28T21:53:09.610848+0000","last_became_peered":"2024-03-28T21:53:09.610848+0000","last_unstale":"2024-03-28T21:53:12.256461+0000","last_undegraded":"2024-03-28T21:53:12.256461+0000","last_fullsized":"2024-03-28T21:53:12.256461+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:40:57.202442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.627288+0000","last_change":"2024-03-28T21:53:08.592919+0000","last_active":"2024-03-28T21:53:10.627288+0000","last_peered":"2024-03-28T21:53:10.627288+0000","last_clean":"2024-03-28T21:53:10.627288+0000","last_became_active":"2024-03-28T21:53:08.592606+0000","last_became_peered":"2024-03-28T21:53:08.592606+0000","last_unstale":"2024-03-28T21:53:10.627288+0000","last_undegraded":"2024-03-28T21:53:10.627288+0000","last_fullsized":"2024-03-28T21:53:10.627288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:03:40.680559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.255173+0000","last_change":"2024-03-28T21:53:09.609784+0000","last_active":"2024-03-28T21:53:12.255173+0000","last_peered":"2024-03-28T21:53:12.255173+0000","last_clean":"2024-03-28T21:53:12.255173+0000","last_became_active":"2024-03-28T21:53:09.608220+0000","last_became_peered":"2024-03-28T21:53:09.608220+0000","last_unstale":"2024-03-28T21:53:12.255173+0000","last_undegraded":"2024-03-28T21:53:12.255173+0000","last_fullsized":"2024-03-28T21:53:12.255173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:19:14.468275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.626562+0000","last_change":"2024-03-28T21:53:08.602311+0000","last_active":"2024-03-28T21:53:10.626562+0000","last_peered":"2024-03-28T21:53:10.626562+0000","last_clean":"2024-03-28T21:53:10.626562+0000","last_became_active":"2024-03-28T21:53:08.600825+0000","last_became_peered":"2024-03-28T21:53:08.600825+0000","last_unstale":"2024-03-28T21:53:10.626562+0000","last_undegraded":"2024-03-28T21:53:10.626562+0000","last_fullsized":"2024-03-28T21:53:10.626562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:45:27.076818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.624701+0000","last_change":"2024-03-28T21:53:09.625383+0000","last_active":"2024-03-28T21:53:10.624701+0000","last_peered":"2024-03-28T21:53:10.624701+0000","last_clean":"2024-03-28T21:53:10.624701+0000","last_became_active":"2024-03-28T21:53:09.624174+0000","last_became_peered":"2024-03-28T21:53:09.624174+0000","last_unstale":"2024-03-28T21:53:10.624701+0000","last_undegraded":"2024-03-28T21:53:10.624701+0000","last_fullsized":"2024-03-28T21:53:10.624701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:31:13.152688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.050359+0000","last_change":"2024-03-28T21:53:08.609017+0000","last_active":"2024-03-28T21:53:12.050359+0000","last_peered":"2024-03-28T21:53:12.050359+0000","last_clean":"2024-03-28T21:53:12.050359+0000","last_became_active":"2024-03-28T21:53:08.608608+0000","last_became_peered":"2024-03-28T21:53:08.608608+0000","last_unstale":"2024-03-28T21:53:12.050359+0000","last_undegraded":"2024-03-28T21:53:12.050359+0000","last_fullsized":"2024-03-28T21:53:12.050359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:24:33.731404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.257537+0000","last_change":"2024-03-28T21:53:09.616101+0000","last_active":"2024-03-28T21:53:12.257537+0000","last_peered":"2024-03-28T21:53:12.257537+0000","last_clean":"2024-03-28T21:53:12.257537+0000","last_became_active":"2024-03-28T21:53:09.615795+0000","last_became_peered":"2024-03-28T21:53:09.615795+0000","last_unstale":"2024-03-28T21:53:12.257537+0000","last_undegraded":"2024-03-28T21:53:12.257537+0000","last_fullsized":"2024-03-28T21:53:12.257537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:48:57.391624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.601073+0000","last_change":"2024-03-28T21:53:08.595909+0000","last_active":"2024-03-28T21:53:11.601073+0000","last_peered":"2024-03-28T21:53:11.601073+0000","last_clean":"2024-03-28T21:53:11.601073+0000","last_became_active":"2024-03-28T21:53:08.595615+0000","last_became_peered":"2024-03-28T21:53:08.595615+0000","last_unstale":"2024-03-28T21:53:11.601073+0000","last_undegraded":"2024-03-28T21:53:11.601073+0000","last_fullsized":"2024-03-28T21:53:11.601073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:56:49.605103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051807+0000","last_change":"2024-03-28T21:53:09.631031+0000","last_active":"2024-03-28T21:53:12.051807+0000","last_peered":"2024-03-28T21:53:12.051807+0000","last_clean":"2024-03-28T21:53:12.051807+0000","last_became_active":"2024-03-28T21:53:09.629053+0000","last_became_peered":"2024-03-28T21:53:09.629053+0000","last_unstale":"2024-03-28T21:53:12.051807+0000","last_undegraded":"2024-03-28T21:53:12.051807+0000","last_fullsized":"2024-03-28T21:53:12.051807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:06:48.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.587059+0000","last_change":"2024-03-28T21:53:08.592359+0000","last_active":"2024-03-28T21:53:11.587059+0000","last_peered":"2024-03-28T21:53:11.587059+0000","last_clean":"2024-03-28T21:53:11.587059+0000","last_became_active":"2024-03-28T21:53:08.591668+0000","last_became_peered":"2024-03-28T21:53:08.591668+0000","last_unstale":"2024-03-28T21:53:11.587059+0000","last_undegraded":"2024-03-28T21:53:11.587059+0000","last_fullsized":"2024-03-28T21:53:11.587059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:09:11.229831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.586259+0000","last_change":"2024-03-28T21:53:09.619198+0000","last_active":"2024-03-28T21:53:11.586259+0000","last_peered":"2024-03-28T21:53:11.586259+0000","last_clean":"2024-03-28T21:53:11.586259+0000","last_became_active":"2024-03-28T21:53:09.618334+0000","last_became_peered":"2024-03-28T21:53:09.618334+0000","last_unstale":"2024-03-28T21:53:11.586259+0000","last_undegraded":"2024-03-28T21:53:11.586259+0000","last_fullsized":"2024-03-28T21:53:11.586259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:02.344669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.600863+0000","last_change":"2024-03-28T21:53:08.600185+0000","last_active":"2024-03-28T21:53:11.600863+0000","last_peered":"2024-03-28T21:53:11.600863+0000","last_clean":"2024-03-28T21:53:11.600863+0000","last_became_active":"2024-03-28T21:53:08.599480+0000","last_became_peered":"2024-03-28T21:53:08.599480+0000","last_unstale":"2024-03-28T21:53:11.600863+0000","last_undegraded":"2024-03-28T21:53:11.600863+0000","last_fullsized":"2024-03-28T21:53:11.600863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:45:27.076818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.627449+0000","last_change":"2024-03-28T21:53:09.612508+0000","last_active":"2024-03-28T21:53:10.627449+0000","last_peered":"2024-03-28T21:53:10.627449+0000","last_clean":"2024-03-28T21:53:10.627449+0000","last_became_active":"2024-03-28T21:53:09.610715+0000","last_became_peered":"2024-03-28T21:53:09.610715+0000","last_unstale":"2024-03-28T21:53:10.627449+0000","last_undegraded":"2024-03-28T21:53:10.627449+0000","last_fullsized":"2024-03-28T21:53:10.627449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:14:17.369409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.586803+0000","last_change":"2024-03-28T21:53:08.593408+0000","last_active":"2024-03-28T21:53:11.586803+0000","last_peered":"2024-03-28T21:53:11.586803+0000","last_clean":"2024-03-28T21:53:11.586803+0000","last_became_active":"2024-03-28T21:53:08.593172+0000","last_became_peered":"2024-03-28T21:53:08.593172+0000","last_unstale":"2024-03-28T21:53:11.586803+0000","last_undegraded":"2024-03-28T21:53:11.586803+0000","last_fullsized":"2024-03-28T21:53:11.586803+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:46:33.686667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.586384+0000","last_change":"2024-03-28T21:53:09.606604+0000","last_active":"2024-03-28T21:53:11.586384+0000","last_peered":"2024-03-28T21:53:11.586384+0000","last_clean":"2024-03-28T21:53:11.586384+0000","last_became_active":"2024-03-28T21:53:09.606017+0000","last_became_peered":"2024-03-28T21:53:09.606017+0000","last_unstale":"2024-03-28T21:53:11.586384+0000","last_undegraded":"2024-03-28T21:53:11.586384+0000","last_fullsized":"2024-03-28T21:53:11.586384+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:46:49.126711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.600199+0000","last_change":"2024-03-28T21:53:08.595087+0000","last_active":"2024-03-28T21:53:11.600199+0000","last_peered":"2024-03-28T21:53:11.600199+0000","last_clean":"2024-03-28T21:53:11.600199+0000","last_became_active":"2024-03-28T21:53:08.594789+0000","last_became_peered":"2024-03-28T21:53:08.594789+0000","last_unstale":"2024-03-28T21:53:11.600199+0000","last_undegraded":"2024-03-28T21:53:11.600199+0000","last_fullsized":"2024-03-28T21:53:11.600199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:03:30.068393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256459+0000","last_change":"2024-03-28T21:53:09.615355+0000","last_active":"2024-03-28T21:53:12.256459+0000","last_peered":"2024-03-28T21:53:12.256459+0000","last_clean":"2024-03-28T21:53:12.256459+0000","last_became_active":"2024-03-28T21:53:09.614964+0000","last_became_peered":"2024-03-28T21:53:09.614964+0000","last_unstale":"2024-03-28T21:53:12.256459+0000","last_undegraded":"2024-03-28T21:53:12.256459+0000","last_fullsized":"2024-03-28T21:53:12.256459+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:40.286505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.626815+0000","last_change":"2024-03-28T21:53:08.596206+0000","last_active":"2024-03-28T21:53:10.626815+0000","last_peered":"2024-03-28T21:53:10.626815+0000","last_clean":"2024-03-28T21:53:10.626815+0000","last_became_active":"2024-03-28T21:53:08.595891+0000","last_became_peered":"2024-03-28T21:53:08.595891+0000","last_unstale":"2024-03-28T21:53:10.626815+0000","last_undegraded":"2024-03-28T21:53:10.626815+0000","last_fullsized":"2024-03-28T21:53:10.626815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:03:40.680559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.626420+0000","last_change":"2024-03-28T21:53:09.617847+0000","last_active":"2024-03-28T21:53:10.626420+0000","last_peered":"2024-03-28T21:53:10.626420+0000","last_clean":"2024-03-28T21:53:10.626420+0000","last_became_active":"2024-03-28T21:53:09.617568+0000","last_became_peered":"2024-03-28T21:53:09.617568+0000","last_unstale":"2024-03-28T21:53:10.626420+0000","last_undegraded":"2024-03-28T21:53:10.626420+0000","last_fullsized":"2024-03-28T21:53:10.626420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:36:55.766174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256017+0000","last_change":"2024-03-28T21:53:08.606874+0000","last_active":"2024-03-28T21:53:12.256017+0000","last_peered":"2024-03-28T21:53:12.256017+0000","last_clean":"2024-03-28T21:53:12.256017+0000","last_became_active":"2024-03-28T21:53:08.606636+0000","last_became_peered":"2024-03-28T21:53:08.606636+0000","last_unstale":"2024-03-28T21:53:12.256017+0000","last_undegraded":"2024-03-28T21:53:12.256017+0000","last_fullsized":"2024-03-28T21:53:12.256017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:11:48.650992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.623363+0000","last_change":"2024-03-28T21:53:09.631157+0000","last_active":"2024-03-28T21:53:10.623363+0000","last_peered":"2024-03-28T21:53:10.623363+0000","last_clean":"2024-03-28T21:53:10.623363+0000","last_became_active":"2024-03-28T21:53:09.630473+0000","last_became_peered":"2024-03-28T21:53:09.630473+0000","last_unstale":"2024-03-28T21:53:10.623363+0000","last_undegraded":"2024-03-28T21:53:10.623363+0000","last_fullsized":"2024-03-28T21:53:10.623363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:32:59.827309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.627018+0000","last_change":"2024-03-28T21:53:08.601567+0000","last_active":"2024-03-28T21:53:10.627018+0000","last_peered":"2024-03-28T21:53:10.627018+0000","last_clean":"2024-03-28T21:53:10.627018+0000","last_became_active":"2024-03-28T21:53:08.601261+0000","last_became_peered":"2024-03-28T21:53:08.601261+0000","last_unstale":"2024-03-28T21:53:10.627018+0000","last_undegraded":"2024-03-28T21:53:10.627018+0000","last_fullsized":"2024-03-28T21:53:10.627018+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:28:42.470143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.623942+0000","last_change":"2024-03-28T21:51:51.547812+0000","last_active":"2024-03-28T21:53:10.623942+0000","last_peered":"2024-03-28T21:53:10.623942+0000","last_clean":"2024-03-28T21:53:10.623942+0000","last_became_active":"2024-03-28T21:51:51.545783+0000","last_became_peered":"2024-03-28T21:51:51.545783+0000","last_unstale":"2024-03-28T21:53:10.623942+0000","last_undegraded":"2024-03-28T21:53:10.623942+0000","last_fullsized":"2024-03-28T21:53:10.623942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_clean_scrub_stamp":"2024-03-28T21:51:50.185942+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:08:34.531035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":744974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":155132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542164,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":155188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542164,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":154620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":156150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":154586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":156150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":744884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T21:53:19.188 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T21:53:19.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.404+0000 7ff0db200640 1 Processor -- start 2024-03-28T21:53:19.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.404+0000 7ff0db200640 1 -- start start 2024-03-28T21:53:19.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.406+0000 7ff0db200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff0d406e440 0x7ff0d415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:19.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.406+0000 7ff0db200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d40b2e60 con 0x7ff0d4159a10 2024-03-28T21:53:19.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.406+0000 7ff0db200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d40adc70 con 0x7ff0d40ad830 2024-03-28T21:53:19.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.406+0000 7ff0db200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff0d4159df0 con 0x7ff0d406e440 2024-03-28T21:53:19.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.406+0000 7ff0d3400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff0d406e440 0x7ff0d415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:19.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.406+0000 7ff0d3400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff0d406e440 0x7ff0d415cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58500/0 (socket says 172.21.15.153:58500) 2024-03-28T21:53:19.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.406+0000 7ff0d3400640 1 -- 172.21.15.153:0/213914648 learned_addr learned my addr 172.21.15.153:0/213914648 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:19.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.406+0000 7ff0d3e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff0d4159a10 0x7ff0d406dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59112/0 (socket says 172.21.15.153:59112) 2024-03-28T21:53:19.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.407+0000 7ff0d3400640 1 -- 172.21.15.153:0/213914648 >> v1:172.21.15.165:6789/0 conn(0x7ff0d40ad830 legacy=0x7ff0d40b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:19.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.407+0000 7ff0d3400640 1 -- 172.21.15.153:0/213914648 >> v1:172.21.15.153:6789/0 conn(0x7ff0d4159a10 legacy=0x7ff0d406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:19.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.407+0000 7ff0d3400640 1 -- 172.21.15.153:0/213914648 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d40adf10 con 0x7ff0d406e440 2024-03-28T21:53:19.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.408+0000 7ff0d3400640 1 --2- 172.21.15.153:0/213914648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d406e440 0x7ff0d415cf00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009870 tx=0x7ff0bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1505777de07f0c server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:19.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.408+0000 7ff0d2a00640 1 -- 172.21.15.153:0/213914648 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc035020 con 0x7ff0d406e440 2024-03-28T21:53:19.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.408+0000 7ff0d2a00640 1 -- 172.21.15.153:0/213914648 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0bc031870 con 0x7ff0d406e440 2024-03-28T21:53:19.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.408+0000 7ff0d2a00640 1 -- 172.21.15.153:0/213914648 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc031c40 con 0x7ff0d406e440 2024-03-28T21:53:19.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.409+0000 7ff0db200640 1 -- 172.21.15.153:0/213914648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d406e440 msgr2=0x7ff0d415cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:19.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.409+0000 7ff0db200640 1 --2- 172.21.15.153:0/213914648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d406e440 0x7ff0d415cf00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009870 tx=0x7ff0bc02b910 comp rx=0 tx=0).stop 2024-03-28T21:53:19.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.409+0000 7ff0db200640 1 -- 172.21.15.153:0/213914648 shutdown_connections 2024-03-28T21:53:19.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.409+0000 7ff0db200640 1 --2- 172.21.15.153:0/213914648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d406e440 0x7ff0d415cf00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:19.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.409+0000 7ff0db200640 1 -- 172.21.15.153:0/213914648 >> 172.21.15.153:0/213914648 conn(0x7ff0d40b1a30 msgr2=0x7ff0d40b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:19.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.409+0000 7ff0db200640 1 -- 172.21.15.153:0/213914648 shutdown_connections 2024-03-28T21:53:19.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.409+0000 7ff0db200640 1 -- 172.21.15.153:0/213914648 wait complete. 2024-03-28T21:53:19.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.411+0000 7ff0db200640 1 Processor -- start 2024-03-28T21:53:19.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.411+0000 7ff0db200640 1 -- start start 2024-03-28T21:53:19.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.412+0000 7ff0db200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0d406e440 0x7ff0d41f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:19.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.412+0000 7ff0db200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d40ad830 0x7ff0d41f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:19.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.412+0000 7ff0db200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0d4159a10 0x7ff0d40cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:19.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.412+0000 7ff0db200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d40ae4d0 con 0x7ff0d40ad830 2024-03-28T21:53:19.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.412+0000 7ff0db200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d40b3100 con 0x7ff0d406e440 2024-03-28T21:53:19.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.412+0000 7ff0db200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d40b3d30 con 0x7ff0d4159a10 2024-03-28T21:53:19.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.412+0000 7ff0d3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d40ad830 0x7ff0d41f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:19.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.412+0000 7ff0d3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d40ad830 0x7ff0d41f48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58506/0 (socket says 172.21.15.153:58506) 2024-03-28T21:53:19.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.412+0000 7ff0d3400640 1 -- 172.21.15.153:0/2031095643 learned_addr learned my addr 172.21.15.153:0/2031095643 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:19.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.412+0000 7ff0d3400640 1 -- 172.21.15.153:0/2031095643 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0d4159a10 msgr2=0x7ff0d40cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:19.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.412+0000 7ff0d3400640 1 --2- 172.21.15.153:0/2031095643 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0d4159a10 0x7ff0d40cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:19.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.412+0000 7ff0d3400640 1 -- 172.21.15.153:0/2031095643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0d406e440 msgr2=0x7ff0d41f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:19.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.412+0000 7ff0d3400640 1 --2- 172.21.15.153:0/2031095643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0d406e440 0x7ff0d41f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:19.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.412+0000 7ff0d3400640 1 -- 172.21.15.153:0/2031095643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d41f4e30 con 0x7ff0d40ad830 2024-03-28T21:53:19.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.413+0000 7ff0d3400640 1 --2- 172.21.15.153:0/2031095643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d40ad830 0x7ff0d41f48f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009870 tx=0x7ff0bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:19.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.413+0000 7ff0cbe00640 1 -- 172.21.15.153:0/2031095643 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc040070 con 0x7ff0d40ad830 2024-03-28T21:53:19.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.413+0000 7ff0cbe00640 1 -- 172.21.15.153:0/2031095643 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0bc03a420 con 0x7ff0d40ad830 2024-03-28T21:53:19.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.413+0000 7ff0cbe00640 1 -- 172.21.15.153:0/2031095643 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc035040 con 0x7ff0d40ad830 2024-03-28T21:53:19.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.413+0000 7ff0db200640 1 -- 172.21.15.153:0/2031095643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d414b4e0 con 0x7ff0d40ad830 2024-03-28T21:53:19.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.413+0000 7ff0db200640 1 -- 172.21.15.153:0/2031095643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d414baa0 con 0x7ff0d40ad830 2024-03-28T21:53:19.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.414+0000 7ff0db200640 1 -- 172.21.15.153:0/2031095643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d4068ff0 con 0x7ff0d40ad830 2024-03-28T21:53:19.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.415+0000 7ff0cbe00640 1 -- 172.21.15.153:0/2031095643 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff0bc04b060 con 0x7ff0d40ad830 2024-03-28T21:53:19.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.416+0000 7ff0cbe00640 1 --2- 172.21.15.153:0/2031095643 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff0b006b4d0 0x7ff0b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:19.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.416+0000 7ff0cbe00640 1 -- 172.21.15.153:0/2031095643 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7ff0bc0ac2c0 con 0x7ff0d40ad830 2024-03-28T21:53:19.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.416+0000 7ff0d3e00640 1 --2- 172.21.15.153:0/2031095643 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff0b006b4d0 0x7ff0b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:19.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.417+0000 7ff0d3e00640 1 --2- 172.21.15.153:0/2031095643 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff0b006b4d0 0x7ff0b006d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40b3030 tx=0x7ff0c4007d20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:19.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.421+0000 7ff0cbe00640 1 -- 172.21.15.153:0/2031095643 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff0bc07b020 con 0x7ff0d40ad830 2024-03-28T21:53:19.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.615+0000 7ff0db200640 1 -- 172.21.15.153:0/2031095643 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff0d409d860 con 0x7ff0b006b4d0 2024-03-28T21:53:19.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.633+0000 7ff0cbe00640 1 -- 172.21.15.153:0/2031095643 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251839 (secure 0 0 0) 0x7ff0d409d860 con 0x7ff0b006b4d0 2024-03-28T21:53:19.637 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:19.639 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-03-28T21:53:19.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.638+0000 7ff0db200640 1 -- 172.21.15.153:0/2031095643 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff0b006b4d0 msgr2=0x7ff0b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:19.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.638+0000 7ff0db200640 1 --2- 172.21.15.153:0/2031095643 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff0b006b4d0 0x7ff0b006d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40b3030 tx=0x7ff0c4007d20 comp rx=0 tx=0).stop 2024-03-28T21:53:19.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.638+0000 7ff0db200640 1 -- 172.21.15.153:0/2031095643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d40ad830 msgr2=0x7ff0d41f48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:19.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.638+0000 7ff0db200640 1 --2- 172.21.15.153:0/2031095643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d40ad830 0x7ff0d41f48f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009870 tx=0x7ff0bc0046c0 comp rx=0 tx=0).stop 2024-03-28T21:53:19.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.638+0000 7ff0db200640 1 -- 172.21.15.153:0/2031095643 shutdown_connections 2024-03-28T21:53:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.638+0000 7ff0db200640 1 --2- 172.21.15.153:0/2031095643 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff0b006b4d0 0x7ff0b006d990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.638+0000 7ff0db200640 1 --2- 172.21.15.153:0/2031095643 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0d4159a10 0x7ff0d40cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.638+0000 7ff0db200640 1 --2- 172.21.15.153:0/2031095643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0d40ad830 0x7ff0d41f48f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.638+0000 7ff0db200640 1 --2- 172.21.15.153:0/2031095643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0d406e440 0x7ff0d41f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.638+0000 7ff0db200640 1 -- 172.21.15.153:0/2031095643 >> 172.21.15.153:0/2031095643 conn(0x7ff0d40b1a30 msgr2=0x7ff0d40b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.638+0000 7ff0db200640 1 -- 172.21.15.153:0/2031095643 shutdown_connections 2024-03-28T21:53:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.638+0000 7ff0db200640 1 -- 172.21.15.153:0/2031095643 wait complete. 2024-03-28T21:53:19.659 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-03-28T21:53:19.488905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228776,"kb_used_data":4296,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745944,"statfs":{"total":773094113280,"available":772859846656,"internally_reserved":0,"allocated":4399104,"data_stored":2421684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.901387"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628213+0000","last_change":"2024-03-28T21:53:09.618053+0000","last_active":"2024-03-28T21:53:10.628213+0000","last_peered":"2024-03-28T21:53:10.628213+0000","last_clean":"2024-03-28T21:53:10.628213+0000","last_became_active":"2024-03-28T21:53:09.617703+0000","last_became_peered":"2024-03-28T21:53:09.617703+0000","last_unstale":"2024-03-28T21:53:10.628213+0000","last_undegraded":"2024-03-28T21:53:10.628213+0000","last_fullsized":"2024-03-28T21:53:10.628213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:11:49.665221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.258055+0000","last_change":"2024-03-28T21:53:09.616006+0000","last_active":"2024-03-28T21:53:12.258055+0000","last_peered":"2024-03-28T21:53:12.258055+0000","last_clean":"2024-03-28T21:53:12.258055+0000","last_became_active":"2024-03-28T21:53:09.615731+0000","last_became_peered":"2024-03-28T21:53:09.615731+0000","last_unstale":"2024-03-28T21:53:12.258055+0000","last_undegraded":"2024-03-28T21:53:12.258055+0000","last_fullsized":"2024-03-28T21:53:12.258055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:06:48.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051141+0000","last_change":"2024-03-28T21:53:09.627422+0000","last_active":"2024-03-28T21:53:12.051141+0000","last_peered":"2024-03-28T21:53:12.051141+0000","last_clean":"2024-03-28T21:53:12.051141+0000","last_became_active":"2024-03-28T21:53:09.627120+0000","last_became_peered":"2024-03-28T21:53:09.627120+0000","last_unstale":"2024-03-28T21:53:12.051141+0000","last_undegraded":"2024-03-28T21:53:12.051141+0000","last_fullsized":"2024-03-28T21:53:12.051141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:07:54.472904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.600705+0000","last_change":"2024-03-28T21:53:09.623788+0000","last_active":"2024-03-28T21:53:11.600705+0000","last_peered":"2024-03-28T21:53:11.600705+0000","last_clean":"2024-03-28T21:53:11.600705+0000","last_became_active":"2024-03-28T21:53:09.623475+0000","last_became_peered":"2024-03-28T21:53:09.623475+0000","last_unstale":"2024-03-28T21:53:11.600705+0000","last_undegraded":"2024-03-28T21:53:11.600705+0000","last_fullsized":"2024-03-28T21:53:11.600705+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:13:41.380432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.255919+0000","last_change":"2024-03-28T21:53:09.620252+0000","last_active":"2024-03-28T21:53:12.255919+0000","last_peered":"2024-03-28T21:53:12.255919+0000","last_clean":"2024-03-28T21:53:12.255919+0000","last_became_active":"2024-03-28T21:53:09.617820+0000","last_became_peered":"2024-03-28T21:53:09.617820+0000","last_unstale":"2024-03-28T21:53:12.255919+0000","last_undegraded":"2024-03-28T21:53:12.255919+0000","last_fullsized":"2024-03-28T21:53:12.255919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:46:34.700897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256050+0000","last_change":"2024-03-28T21:53:09.619811+0000","last_active":"2024-03-28T21:53:12.256050+0000","last_peered":"2024-03-28T21:53:12.256050+0000","last_clean":"2024-03-28T21:53:12.256050+0000","last_became_active":"2024-03-28T21:53:09.618302+0000","last_became_peered":"2024-03-28T21:53:09.618302+0000","last_unstale":"2024-03-28T21:53:12.256050+0000","last_undegraded":"2024-03-28T21:53:12.256050+0000","last_fullsized":"2024-03-28T21:53:12.256050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:07:54.472904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.622826+0000","last_change":"2024-03-28T21:53:09.630575+0000","last_active":"2024-03-28T21:53:10.622826+0000","last_peered":"2024-03-28T21:53:10.622826+0000","last_clean":"2024-03-28T21:53:10.622826+0000","last_became_active":"2024-03-28T21:53:09.629388+0000","last_became_peered":"2024-03-28T21:53:09.629388+0000","last_unstale":"2024-03-28T21:53:10.622826+0000","last_undegraded":"2024-03-28T21:53:10.622826+0000","last_fullsized":"2024-03-28T21:53:10.622826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:07:27.859237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.623803+0000","last_change":"2024-03-28T21:53:09.633481+0000","last_active":"2024-03-28T21:53:10.623803+0000","last_peered":"2024-03-28T21:53:10.623803+0000","last_clean":"2024-03-28T21:53:10.623803+0000","last_became_active":"2024-03-28T21:53:09.633056+0000","last_became_peered":"2024-03-28T21:53:09.633056+0000","last_unstale":"2024-03-28T21:53:10.623803+0000","last_undegraded":"2024-03-28T21:53:10.623803+0000","last_fullsized":"2024-03-28T21:53:10.623803+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:49:59.744298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.629581+0000","last_change":"2024-03-28T21:53:09.622925+0000","last_active":"2024-03-28T21:53:10.629581+0000","last_peered":"2024-03-28T21:53:10.629581+0000","last_clean":"2024-03-28T21:53:10.629581+0000","last_became_active":"2024-03-28T21:53:09.622653+0000","last_became_peered":"2024-03-28T21:53:09.622653+0000","last_unstale":"2024-03-28T21:53:10.629581+0000","last_undegraded":"2024-03-28T21:53:10.629581+0000","last_fullsized":"2024-03-28T21:53:10.629581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:07:27.859237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.601244+0000","last_change":"2024-03-28T21:53:09.631295+0000","last_active":"2024-03-28T21:53:11.601244+0000","last_peered":"2024-03-28T21:53:11.601244+0000","last_clean":"2024-03-28T21:53:11.601244+0000","last_became_active":"2024-03-28T21:53:09.631053+0000","last_became_peered":"2024-03-28T21:53:09.631053+0000","last_unstale":"2024-03-28T21:53:11.601244+0000","last_undegraded":"2024-03-28T21:53:11.601244+0000","last_fullsized":"2024-03-28T21:53:11.601244+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:34:01.660116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.622823+0000","last_change":"2024-03-28T21:53:09.632217+0000","last_active":"2024-03-28T21:53:10.622823+0000","last_peered":"2024-03-28T21:53:10.622823+0000","last_clean":"2024-03-28T21:53:10.622823+0000","last_became_active":"2024-03-28T21:53:09.631929+0000","last_became_peered":"2024-03-28T21:53:09.631929+0000","last_unstale":"2024-03-28T21:53:10.622823+0000","last_undegraded":"2024-03-28T21:53:10.622823+0000","last_fullsized":"2024-03-28T21:53:10.622823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:56.340710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051425+0000","last_change":"2024-03-28T21:53:09.632254+0000","last_active":"2024-03-28T21:53:12.051425+0000","last_peered":"2024-03-28T21:53:12.051425+0000","last_clean":"2024-03-28T21:53:12.051425+0000","last_became_active":"2024-03-28T21:53:09.631088+0000","last_became_peered":"2024-03-28T21:53:09.631088+0000","last_unstale":"2024-03-28T21:53:12.051425+0000","last_undegraded":"2024-03-28T21:53:12.051425+0000","last_fullsized":"2024-03-28T21:53:12.051425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:00:32.856094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256335+0000","last_change":"2024-03-28T21:53:09.618169+0000","last_active":"2024-03-28T21:53:12.256335+0000","last_peered":"2024-03-28T21:53:12.256335+0000","last_clean":"2024-03-28T21:53:12.256335+0000","last_became_active":"2024-03-28T21:53:09.617873+0000","last_became_peered":"2024-03-28T21:53:09.617873+0000","last_unstale":"2024-03-28T21:53:12.256335+0000","last_undegraded":"2024-03-28T21:53:12.256335+0000","last_fullsized":"2024-03-28T21:53:12.256335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:38:51.121719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256238+0000","last_change":"2024-03-28T21:53:09.614050+0000","last_active":"2024-03-28T21:53:12.256238+0000","last_peered":"2024-03-28T21:53:12.256238+0000","last_clean":"2024-03-28T21:53:12.256238+0000","last_became_active":"2024-03-28T21:53:09.613795+0000","last_became_peered":"2024-03-28T21:53:09.613795+0000","last_unstale":"2024-03-28T21:53:12.256238+0000","last_undegraded":"2024-03-28T21:53:12.256238+0000","last_fullsized":"2024-03-28T21:53:12.256238+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:49:59.744298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.050893+0000","last_change":"2024-03-28T21:53:09.628800+0000","last_active":"2024-03-28T21:53:12.050893+0000","last_peered":"2024-03-28T21:53:12.050893+0000","last_clean":"2024-03-28T21:53:12.050893+0000","last_became_active":"2024-03-28T21:53:09.627923+0000","last_became_peered":"2024-03-28T21:53:09.627923+0000","last_unstale":"2024-03-28T21:53:12.050893+0000","last_undegraded":"2024-03-28T21:53:12.050893+0000","last_fullsized":"2024-03-28T21:53:12.050893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:32:59.827309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.624007+0000","last_change":"2024-03-28T21:53:09.635624+0000","last_active":"2024-03-28T21:53:10.624007+0000","last_peered":"2024-03-28T21:53:10.624007+0000","last_clean":"2024-03-28T21:53:10.624007+0000","last_became_active":"2024-03-28T21:53:09.635012+0000","last_became_peered":"2024-03-28T21:53:09.635012+0000","last_unstale":"2024-03-28T21:53:10.624007+0000","last_undegraded":"2024-03-28T21:53:10.624007+0000","last_fullsized":"2024-03-28T21:53:10.624007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:40.286505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.623689+0000","last_change":"2024-03-28T21:53:09.632916+0000","last_active":"2024-03-28T21:53:10.623689+0000","last_peered":"2024-03-28T21:53:10.623689+0000","last_clean":"2024-03-28T21:53:10.623689+0000","last_became_active":"2024-03-28T21:53:09.631664+0000","last_became_peered":"2024-03-28T21:53:09.631664+0000","last_unstale":"2024-03-28T21:53:10.623689+0000","last_undegraded":"2024-03-28T21:53:10.623689+0000","last_fullsized":"2024-03-28T21:53:10.623689+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:07:54.472904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.258209+0000","last_change":"2024-03-28T21:53:09.624131+0000","last_active":"2024-03-28T21:53:12.258209+0000","last_peered":"2024-03-28T21:53:12.258209+0000","last_clean":"2024-03-28T21:53:12.258209+0000","last_became_active":"2024-03-28T21:53:09.623872+0000","last_became_peered":"2024-03-28T21:53:09.623872+0000","last_unstale":"2024-03-28T21:53:12.258209+0000","last_undegraded":"2024-03-28T21:53:12.258209+0000","last_fullsized":"2024-03-28T21:53:12.258209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:11:23.833555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.257174+0000","last_change":"2024-03-28T21:53:09.618227+0000","last_active":"2024-03-28T21:53:12.257174+0000","last_peered":"2024-03-28T21:53:12.257174+0000","last_clean":"2024-03-28T21:53:12.257174+0000","last_became_active":"2024-03-28T21:53:09.617950+0000","last_became_peered":"2024-03-28T21:53:09.617950+0000","last_unstale":"2024-03-28T21:53:12.257174+0000","last_undegraded":"2024-03-28T21:53:12.257174+0000","last_fullsized":"2024-03-28T21:53:12.257174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:00:32.856094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.257067+0000","last_change":"2024-03-28T21:53:09.617120+0000","last_active":"2024-03-28T21:53:12.257067+0000","last_peered":"2024-03-28T21:53:12.257067+0000","last_clean":"2024-03-28T21:53:12.257067+0000","last_became_active":"2024-03-28T21:53:09.616822+0000","last_became_peered":"2024-03-28T21:53:09.616822+0000","last_unstale":"2024-03-28T21:53:12.257067+0000","last_undegraded":"2024-03-28T21:53:12.257067+0000","last_fullsized":"2024-03-28T21:53:12.257067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:09:12.244061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628303+0000","last_change":"2024-03-28T21:53:09.608181+0000","last_active":"2024-03-28T21:53:10.628303+0000","last_peered":"2024-03-28T21:53:10.628303+0000","last_clean":"2024-03-28T21:53:10.628303+0000","last_became_active":"2024-03-28T21:53:09.607781+0000","last_became_peered":"2024-03-28T21:53:09.607781+0000","last_unstale":"2024-03-28T21:53:10.628303+0000","last_undegraded":"2024-03-28T21:53:10.628303+0000","last_fullsized":"2024-03-28T21:53:10.628303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:56.340710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.626655+0000","last_change":"2024-03-28T21:53:09.612138+0000","last_active":"2024-03-28T21:53:10.626655+0000","last_peered":"2024-03-28T21:53:10.626655+0000","last_clean":"2024-03-28T21:53:10.626655+0000","last_became_active":"2024-03-28T21:53:09.611835+0000","last_became_peered":"2024-03-28T21:53:09.611835+0000","last_unstale":"2024-03-28T21:53:10.626655+0000","last_undegraded":"2024-03-28T21:53:10.626655+0000","last_fullsized":"2024-03-28T21:53:10.626655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:56:09.547479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.585907+0000","last_change":"2024-03-28T21:53:09.620970+0000","last_active":"2024-03-28T21:53:11.585907+0000","last_peered":"2024-03-28T21:53:11.585907+0000","last_clean":"2024-03-28T21:53:11.585907+0000","last_became_active":"2024-03-28T21:53:09.620701+0000","last_became_peered":"2024-03-28T21:53:09.620701+0000","last_unstale":"2024-03-28T21:53:11.585907+0000","last_undegraded":"2024-03-28T21:53:11.585907+0000","last_fullsized":"2024-03-28T21:53:11.585907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:54:01.195978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.050675+0000","last_change":"2024-03-28T21:53:09.614003+0000","last_active":"2024-03-28T21:53:12.050675+0000","last_peered":"2024-03-28T21:53:12.050675+0000","last_clean":"2024-03-28T21:53:12.050675+0000","last_became_active":"2024-03-28T21:53:09.613725+0000","last_became_peered":"2024-03-28T21:53:09.613725+0000","last_unstale":"2024-03-28T21:53:12.050675+0000","last_undegraded":"2024-03-28T21:53:12.050675+0000","last_fullsized":"2024-03-28T21:53:12.050675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:00:55.729726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.600909+0000","last_change":"2024-03-28T21:53:09.635921+0000","last_active":"2024-03-28T21:53:11.600909+0000","last_peered":"2024-03-28T21:53:11.600909+0000","last_clean":"2024-03-28T21:53:11.600909+0000","last_became_active":"2024-03-28T21:53:09.635612+0000","last_became_peered":"2024-03-28T21:53:09.635612+0000","last_unstale":"2024-03-28T21:53:11.600909+0000","last_undegraded":"2024-03-28T21:53:11.600909+0000","last_fullsized":"2024-03-28T21:53:11.600909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:56.340710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.258368+0000","last_change":"2024-03-28T21:53:09.620547+0000","last_active":"2024-03-28T21:53:12.258368+0000","last_peered":"2024-03-28T21:53:12.258368+0000","last_clean":"2024-03-28T21:53:12.258368+0000","last_became_active":"2024-03-28T21:53:09.619959+0000","last_became_peered":"2024-03-28T21:53:09.619959+0000","last_unstale":"2024-03-28T21:53:12.258368+0000","last_undegraded":"2024-03-28T21:53:12.258368+0000","last_fullsized":"2024-03-28T21:53:12.258368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:10:30.139050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.601035+0000","last_change":"2024-03-28T21:53:09.625360+0000","last_active":"2024-03-28T21:53:11.601035+0000","last_peered":"2024-03-28T21:53:11.601035+0000","last_clean":"2024-03-28T21:53:11.601035+0000","last_became_active":"2024-03-28T21:53:09.624624+0000","last_became_peered":"2024-03-28T21:53:09.624624+0000","last_unstale":"2024-03-28T21:53:11.601035+0000","last_undegraded":"2024-03-28T21:53:11.601035+0000","last_fullsized":"2024-03-28T21:53:11.601035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:07:27.859237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051385+0000","last_change":"2024-03-28T21:53:09.621553+0000","last_active":"2024-03-28T21:53:12.051385+0000","last_peered":"2024-03-28T21:53:12.051385+0000","last_clean":"2024-03-28T21:53:12.051385+0000","last_became_active":"2024-03-28T21:53:09.621098+0000","last_became_peered":"2024-03-28T21:53:09.621098+0000","last_unstale":"2024-03-28T21:53:12.051385+0000","last_undegraded":"2024-03-28T21:53:12.051385+0000","last_fullsized":"2024-03-28T21:53:12.051385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:40.286505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628254+0000","last_change":"2024-03-28T21:53:09.616868+0000","last_active":"2024-03-28T21:53:10.628254+0000","last_peered":"2024-03-28T21:53:10.628254+0000","last_clean":"2024-03-28T21:53:10.628254+0000","last_became_active":"2024-03-28T21:53:09.616556+0000","last_became_peered":"2024-03-28T21:53:09.616556+0000","last_unstale":"2024-03-28T21:53:10.628254+0000","last_undegraded":"2024-03-28T21:53:10.628254+0000","last_fullsized":"2024-03-28T21:53:10.628254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:53:29.426892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.623157+0000","last_change":"2024-03-28T21:53:09.635624+0000","last_active":"2024-03-28T21:53:10.623157+0000","last_peered":"2024-03-28T21:53:10.623157+0000","last_clean":"2024-03-28T21:53:10.623157+0000","last_became_active":"2024-03-28T21:53:09.635253+0000","last_became_peered":"2024-03-28T21:53:09.635253+0000","last_unstale":"2024-03-28T21:53:10.623157+0000","last_undegraded":"2024-03-28T21:53:10.623157+0000","last_fullsized":"2024-03-28T21:53:10.623157+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:34:01.660116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.627185+0000","last_change":"2024-03-28T21:53:09.613838+0000","last_active":"2024-03-28T21:53:10.627185+0000","last_peered":"2024-03-28T21:53:10.627185+0000","last_clean":"2024-03-28T21:53:10.627185+0000","last_became_active":"2024-03-28T21:53:09.613516+0000","last_became_peered":"2024-03-28T21:53:09.613516+0000","last_unstale":"2024-03-28T21:53:10.627185+0000","last_undegraded":"2024-03-28T21:53:10.627185+0000","last_fullsized":"2024-03-28T21:53:10.627185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:42:45.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.622884+0000","last_change":"2024-03-28T21:53:09.635652+0000","last_active":"2024-03-28T21:53:10.622884+0000","last_peered":"2024-03-28T21:53:10.622884+0000","last_clean":"2024-03-28T21:53:10.622884+0000","last_became_active":"2024-03-28T21:53:09.634521+0000","last_became_peered":"2024-03-28T21:53:09.634521+0000","last_unstale":"2024-03-28T21:53:10.622884+0000","last_undegraded":"2024-03-28T21:53:10.622884+0000","last_fullsized":"2024-03-28T21:53:10.622884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:14:11.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.586463+0000","last_change":"2024-03-28T21:53:09.631992+0000","last_active":"2024-03-28T21:53:11.586463+0000","last_peered":"2024-03-28T21:53:11.586463+0000","last_clean":"2024-03-28T21:53:11.586463+0000","last_became_active":"2024-03-28T21:53:09.631634+0000","last_became_peered":"2024-03-28T21:53:09.631634+0000","last_unstale":"2024-03-28T21:53:11.586463+0000","last_undegraded":"2024-03-28T21:53:11.586463+0000","last_fullsized":"2024-03-28T21:53:11.586463+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:38:26.182761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628757+0000","last_change":"2024-03-28T21:53:08.596850+0000","last_active":"2024-03-28T21:53:10.628757+0000","last_peered":"2024-03-28T21:53:10.628757+0000","last_clean":"2024-03-28T21:53:10.628757+0000","last_became_active":"2024-03-28T21:53:08.595486+0000","last_became_peered":"2024-03-28T21:53:08.595486+0000","last_unstale":"2024-03-28T21:53:10.628757+0000","last_undegraded":"2024-03-28T21:53:10.628757+0000","last_fullsized":"2024-03-28T21:53:10.628757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:45:27.076818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628619+0000","last_change":"2024-03-28T21:53:09.623425+0000","last_active":"2024-03-28T21:53:10.628619+0000","last_peered":"2024-03-28T21:53:10.628619+0000","last_clean":"2024-03-28T21:53:10.628619+0000","last_became_active":"2024-03-28T21:53:09.621716+0000","last_became_peered":"2024-03-28T21:53:09.621716+0000","last_unstale":"2024-03-28T21:53:10.628619+0000","last_undegraded":"2024-03-28T21:53:10.628619+0000","last_fullsized":"2024-03-28T21:53:10.628619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:26:19.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.586697+0000","last_change":"2024-03-28T21:53:08.606169+0000","last_active":"2024-03-28T21:53:11.586697+0000","last_peered":"2024-03-28T21:53:11.586697+0000","last_clean":"2024-03-28T21:53:11.586697+0000","last_became_active":"2024-03-28T21:53:08.605835+0000","last_became_peered":"2024-03-28T21:53:08.605835+0000","last_unstale":"2024-03-28T21:53:11.586697+0000","last_undegraded":"2024-03-28T21:53:11.586697+0000","last_fullsized":"2024-03-28T21:53:11.586697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:38:50.107490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628274+0000","last_change":"2024-03-28T21:53:09.623865+0000","last_active":"2024-03-28T21:53:10.628274+0000","last_peered":"2024-03-28T21:53:10.628274+0000","last_clean":"2024-03-28T21:53:10.628274+0000","last_became_active":"2024-03-28T21:53:09.620661+0000","last_became_peered":"2024-03-28T21:53:09.620661+0000","last_unstale":"2024-03-28T21:53:10.628274+0000","last_undegraded":"2024-03-28T21:53:10.628274+0000","last_fullsized":"2024-03-28T21:53:10.628274+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:13:41.380432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.257289+0000","last_change":"2024-03-28T21:53:08.598731+0000","last_active":"2024-03-28T21:53:12.257289+0000","last_peered":"2024-03-28T21:53:12.257289+0000","last_clean":"2024-03-28T21:53:12.257289+0000","last_became_active":"2024-03-28T21:53:08.596715+0000","last_became_peered":"2024-03-28T21:53:08.596715+0000","last_unstale":"2024-03-28T21:53:12.257289+0000","last_undegraded":"2024-03-28T21:53:12.257289+0000","last_fullsized":"2024-03-28T21:53:12.257289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:36:54.751944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.601166+0000","last_change":"2024-03-28T21:53:09.626103+0000","last_active":"2024-03-28T21:53:11.601166+0000","last_peered":"2024-03-28T21:53:11.601166+0000","last_clean":"2024-03-28T21:53:11.601166+0000","last_became_active":"2024-03-28T21:53:09.625802+0000","last_became_peered":"2024-03-28T21:53:09.625802+0000","last_unstale":"2024-03-28T21:53:11.601166+0000","last_undegraded":"2024-03-28T21:53:11.601166+0000","last_fullsized":"2024-03-28T21:53:11.601166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:14:11.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256996+0000","last_change":"2024-03-28T21:53:08.595268+0000","last_active":"2024-03-28T21:53:12.256996+0000","last_peered":"2024-03-28T21:53:12.256996+0000","last_clean":"2024-03-28T21:53:12.256996+0000","last_became_active":"2024-03-28T21:53:08.594957+0000","last_became_peered":"2024-03-28T21:53:08.594957+0000","last_unstale":"2024-03-28T21:53:12.256996+0000","last_undegraded":"2024-03-28T21:53:12.256996+0000","last_fullsized":"2024-03-28T21:53:12.256996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:10:31.700961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.623615+0000","last_change":"2024-03-28T21:53:09.634559+0000","last_active":"2024-03-28T21:53:10.623615+0000","last_peered":"2024-03-28T21:53:10.623615+0000","last_clean":"2024-03-28T21:53:10.623615+0000","last_became_active":"2024-03-28T21:53:09.633553+0000","last_became_peered":"2024-03-28T21:53:09.633553+0000","last_unstale":"2024-03-28T21:53:10.623615+0000","last_undegraded":"2024-03-28T21:53:10.623615+0000","last_fullsized":"2024-03-28T21:53:10.623615+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:11:20.975294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628460+0000","last_change":"2024-03-28T21:53:08.597379+0000","last_active":"2024-03-28T21:53:10.628460+0000","last_peered":"2024-03-28T21:53:10.628460+0000","last_clean":"2024-03-28T21:53:10.628460+0000","last_became_active":"2024-03-28T21:53:08.596837+0000","last_became_peered":"2024-03-28T21:53:08.596837+0000","last_unstale":"2024-03-28T21:53:10.628460+0000","last_undegraded":"2024-03-28T21:53:10.628460+0000","last_fullsized":"2024-03-28T21:53:10.628460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:03:40.656238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051284+0000","last_change":"2024-03-28T21:53:09.625533+0000","last_active":"2024-03-28T21:53:12.051284+0000","last_peered":"2024-03-28T21:53:12.051284+0000","last_clean":"2024-03-28T21:53:12.051284+0000","last_became_active":"2024-03-28T21:53:09.625191+0000","last_became_peered":"2024-03-28T21:53:09.625191+0000","last_unstale":"2024-03-28T21:53:12.051284+0000","last_undegraded":"2024-03-28T21:53:12.051284+0000","last_fullsized":"2024-03-28T21:53:12.051284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:49:59.744298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.627526+0000","last_change":"2024-03-28T21:53:08.597642+0000","last_active":"2024-03-28T21:53:10.627526+0000","last_peered":"2024-03-28T21:53:10.627526+0000","last_clean":"2024-03-28T21:53:10.627526+0000","last_became_active":"2024-03-28T21:53:08.596815+0000","last_became_peered":"2024-03-28T21:53:08.596815+0000","last_unstale":"2024-03-28T21:53:10.627526+0000","last_undegraded":"2024-03-28T21:53:10.627526+0000","last_fullsized":"2024-03-28T21:53:10.627526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:10:07.461391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.626175+0000","last_change":"2024-03-28T21:53:09.608645+0000","last_active":"2024-03-28T21:53:10.626175+0000","last_peered":"2024-03-28T21:53:10.626175+0000","last_clean":"2024-03-28T21:53:10.626175+0000","last_became_active":"2024-03-28T21:53:09.608342+0000","last_became_peered":"2024-03-28T21:53:09.608342+0000","last_unstale":"2024-03-28T21:53:10.626175+0000","last_undegraded":"2024-03-28T21:53:10.626175+0000","last_fullsized":"2024-03-28T21:53:10.626175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:26:19.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.255597+0000","last_change":"2024-03-28T21:53:08.588066+0000","last_active":"2024-03-28T21:53:12.255597+0000","last_peered":"2024-03-28T21:53:12.255597+0000","last_clean":"2024-03-28T21:53:12.255597+0000","last_became_active":"2024-03-28T21:53:08.587768+0000","last_became_peered":"2024-03-28T21:53:08.587768+0000","last_unstale":"2024-03-28T21:53:12.255597+0000","last_undegraded":"2024-03-28T21:53:12.255597+0000","last_fullsized":"2024-03-28T21:53:12.255597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:42:44.182375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.599886+0000","last_change":"2024-03-28T21:53:09.620021+0000","last_active":"2024-03-28T21:53:11.599886+0000","last_peered":"2024-03-28T21:53:11.599886+0000","last_clean":"2024-03-28T21:53:11.599886+0000","last_became_active":"2024-03-28T21:53:09.619763+0000","last_became_peered":"2024-03-28T21:53:09.619763+0000","last_unstale":"2024-03-28T21:53:11.599886+0000","last_undegraded":"2024-03-28T21:53:11.599886+0000","last_fullsized":"2024-03-28T21:53:11.599886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:56:09.547479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.625957+0000","last_change":"2024-03-28T21:53:08.595394+0000","last_active":"2024-03-28T21:53:10.625957+0000","last_peered":"2024-03-28T21:53:10.625957+0000","last_clean":"2024-03-28T21:53:10.625957+0000","last_became_active":"2024-03-28T21:53:08.595044+0000","last_became_peered":"2024-03-28T21:53:08.595044+0000","last_unstale":"2024-03-28T21:53:10.625957+0000","last_undegraded":"2024-03-28T21:53:10.625957+0000","last_fullsized":"2024-03-28T21:53:10.625957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:27:26.855633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051426+0000","last_change":"2024-03-28T21:53:09.633712+0000","last_active":"2024-03-28T21:53:12.051426+0000","last_peered":"2024-03-28T21:53:12.051426+0000","last_clean":"2024-03-28T21:53:12.051426+0000","last_became_active":"2024-03-28T21:53:09.631966+0000","last_became_peered":"2024-03-28T21:53:09.631966+0000","last_unstale":"2024-03-28T21:53:12.051426+0000","last_undegraded":"2024-03-28T21:53:12.051426+0000","last_fullsized":"2024-03-28T21:53:12.051426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:31:13.152688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.258085+0000","last_change":"2024-03-28T21:53:08.603951+0000","last_active":"2024-03-28T21:53:12.258085+0000","last_peered":"2024-03-28T21:53:12.258085+0000","last_clean":"2024-03-28T21:53:12.258085+0000","last_became_active":"2024-03-28T21:53:08.603672+0000","last_became_peered":"2024-03-28T21:53:08.603672+0000","last_unstale":"2024-03-28T21:53:12.258085+0000","last_undegraded":"2024-03-28T21:53:12.258085+0000","last_fullsized":"2024-03-28T21:53:12.258085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:26:18.310739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.258185+0000","last_change":"2024-03-28T21:53:09.624037+0000","last_active":"2024-03-28T21:53:12.258185+0000","last_peered":"2024-03-28T21:53:12.258185+0000","last_clean":"2024-03-28T21:53:12.258185+0000","last_became_active":"2024-03-28T21:53:09.623257+0000","last_became_peered":"2024-03-28T21:53:09.623257+0000","last_unstale":"2024-03-28T21:53:12.258185+0000","last_undegraded":"2024-03-28T21:53:12.258185+0000","last_fullsized":"2024-03-28T21:53:12.258185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:52:52.388490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.586907+0000","last_change":"2024-03-28T21:53:08.585643+0000","last_active":"2024-03-28T21:53:11.586907+0000","last_peered":"2024-03-28T21:53:11.586907+0000","last_clean":"2024-03-28T21:53:11.586907+0000","last_became_active":"2024-03-28T21:53:08.585344+0000","last_became_peered":"2024-03-28T21:53:08.585344+0000","last_unstale":"2024-03-28T21:53:11.586907+0000","last_undegraded":"2024-03-28T21:53:11.586907+0000","last_fullsized":"2024-03-28T21:53:11.586907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:40:56.188213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.257244+0000","last_change":"2024-03-28T21:53:09.620252+0000","last_active":"2024-03-28T21:53:12.257244+0000","last_peered":"2024-03-28T21:53:12.257244+0000","last_clean":"2024-03-28T21:53:12.257244+0000","last_became_active":"2024-03-28T21:53:09.619965+0000","last_became_peered":"2024-03-28T21:53:09.619965+0000","last_unstale":"2024-03-28T21:53:12.257244+0000","last_undegraded":"2024-03-28T21:53:12.257244+0000","last_fullsized":"2024-03-28T21:53:12.257244+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:00:50.697398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051334+0000","last_change":"2024-03-28T21:53:08.604403+0000","last_active":"2024-03-28T21:53:12.051334+0000","last_peered":"2024-03-28T21:53:12.051334+0000","last_clean":"2024-03-28T21:53:12.051334+0000","last_became_active":"2024-03-28T21:53:08.604079+0000","last_became_peered":"2024-03-28T21:53:08.604079+0000","last_unstale":"2024-03-28T21:53:12.051334+0000","last_undegraded":"2024-03-28T21:53:12.051334+0000","last_fullsized":"2024-03-28T21:53:12.051334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:14:16.355179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.050966+0000","last_change":"2024-03-28T21:53:09.627484+0000","last_active":"2024-03-28T21:53:12.050966+0000","last_peered":"2024-03-28T21:53:12.050966+0000","last_clean":"2024-03-28T21:53:12.050966+0000","last_became_active":"2024-03-28T21:53:09.627213+0000","last_became_peered":"2024-03-28T21:53:09.627213+0000","last_unstale":"2024-03-28T21:53:12.050966+0000","last_undegraded":"2024-03-28T21:53:12.050966+0000","last_fullsized":"2024-03-28T21:53:12.050966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:11:20.975294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.257310+0000","last_change":"2024-03-28T21:53:08.596610+0000","last_active":"2024-03-28T21:53:12.257310+0000","last_peered":"2024-03-28T21:53:12.257310+0000","last_clean":"2024-03-28T21:53:12.257310+0000","last_became_active":"2024-03-28T21:53:08.596231+0000","last_became_peered":"2024-03-28T21:53:08.596231+0000","last_unstale":"2024-03-28T21:53:12.257310+0000","last_undegraded":"2024-03-28T21:53:12.257310+0000","last_fullsized":"2024-03-28T21:53:12.257310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:56:08.533250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.600179+0000","last_change":"2024-03-28T21:53:09.623499+0000","last_active":"2024-03-28T21:53:11.600179+0000","last_peered":"2024-03-28T21:53:11.600179+0000","last_clean":"2024-03-28T21:53:11.600179+0000","last_became_active":"2024-03-28T21:53:09.623232+0000","last_became_peered":"2024-03-28T21:53:09.623232+0000","last_unstale":"2024-03-28T21:53:11.600179+0000","last_undegraded":"2024-03-28T21:53:11.600179+0000","last_fullsized":"2024-03-28T21:53:11.600179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:23:48.311189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628520+0000","last_change":"2024-03-28T21:53:08.595393+0000","last_active":"2024-03-28T21:53:10.628520+0000","last_peered":"2024-03-28T21:53:10.628520+0000","last_clean":"2024-03-28T21:53:10.628520+0000","last_became_active":"2024-03-28T21:53:08.595003+0000","last_became_peered":"2024-03-28T21:53:08.595003+0000","last_unstale":"2024-03-28T21:53:10.628520+0000","last_undegraded":"2024-03-28T21:53:10.628520+0000","last_fullsized":"2024-03-28T21:53:10.628520+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:28:42.470143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256774+0000","last_change":"2024-03-28T21:53:09.610150+0000","last_active":"2024-03-28T21:53:12.256774+0000","last_peered":"2024-03-28T21:53:12.256774+0000","last_clean":"2024-03-28T21:53:12.256774+0000","last_became_active":"2024-03-28T21:53:09.607380+0000","last_became_peered":"2024-03-28T21:53:09.607380+0000","last_unstale":"2024-03-28T21:53:12.256774+0000","last_undegraded":"2024-03-28T21:53:12.256774+0000","last_fullsized":"2024-03-28T21:53:12.256774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:31:13.152688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.599929+0000","last_change":"2024-03-28T21:53:08.590316+0000","last_active":"2024-03-28T21:53:11.599929+0000","last_peered":"2024-03-28T21:53:11.599929+0000","last_clean":"2024-03-28T21:53:11.599929+0000","last_became_active":"2024-03-28T21:53:08.589964+0000","last_became_peered":"2024-03-28T21:53:08.589964+0000","last_unstale":"2024-03-28T21:53:11.599929+0000","last_undegraded":"2024-03-28T21:53:11.599929+0000","last_fullsized":"2024-03-28T21:53:11.599929+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:53:15.412340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.623291+0000","last_change":"2024-03-28T21:53:09.635312+0000","last_active":"2024-03-28T21:53:10.623291+0000","last_peered":"2024-03-28T21:53:10.623291+0000","last_clean":"2024-03-28T21:53:10.623291+0000","last_became_active":"2024-03-28T21:53:09.634668+0000","last_became_peered":"2024-03-28T21:53:09.634668+0000","last_unstale":"2024-03-28T21:53:10.623291+0000","last_undegraded":"2024-03-28T21:53:10.623291+0000","last_fullsized":"2024-03-28T21:53:10.623291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:00:55.729726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.255554+0000","last_change":"2024-03-28T21:53:08.603935+0000","last_active":"2024-03-28T21:53:12.255554+0000","last_peered":"2024-03-28T21:53:12.255554+0000","last_clean":"2024-03-28T21:53:12.255554+0000","last_became_active":"2024-03-28T21:53:08.603613+0000","last_became_peered":"2024-03-28T21:53:08.603613+0000","last_unstale":"2024-03-28T21:53:12.255554+0000","last_undegraded":"2024-03-28T21:53:12.255554+0000","last_fullsized":"2024-03-28T21:53:12.255554+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:24:33.731404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.627373+0000","last_change":"2024-03-28T21:53:09.618816+0000","last_active":"2024-03-28T21:53:10.627373+0000","last_peered":"2024-03-28T21:53:10.627373+0000","last_clean":"2024-03-28T21:53:10.627373+0000","last_became_active":"2024-03-28T21:53:09.618529+0000","last_became_peered":"2024-03-28T21:53:09.618529+0000","last_unstale":"2024-03-28T21:53:10.627373+0000","last_undegraded":"2024-03-28T21:53:10.627373+0000","last_fullsized":"2024-03-28T21:53:10.627373+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:24:34.745634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.255733+0000","last_change":"2024-03-28T21:53:08.582325+0000","last_active":"2024-03-28T21:53:12.255733+0000","last_peered":"2024-03-28T21:53:12.255733+0000","last_clean":"2024-03-28T21:53:12.255733+0000","last_became_active":"2024-03-28T21:53:08.582041+0000","last_became_peered":"2024-03-28T21:53:08.582041+0000","last_unstale":"2024-03-28T21:53:12.255733+0000","last_undegraded":"2024-03-28T21:53:12.255733+0000","last_fullsized":"2024-03-28T21:53:12.255733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:14:16.355179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628139+0000","last_change":"2024-03-28T21:53:09.624214+0000","last_active":"2024-03-28T21:53:10.628139+0000","last_peered":"2024-03-28T21:53:10.628139+0000","last_clean":"2024-03-28T21:53:10.628139+0000","last_became_active":"2024-03-28T21:53:09.623924+0000","last_became_peered":"2024-03-28T21:53:09.623924+0000","last_unstale":"2024-03-28T21:53:10.628139+0000","last_undegraded":"2024-03-28T21:53:10.628139+0000","last_fullsized":"2024-03-28T21:53:10.628139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:23:48.311189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.601060+0000","last_change":"2024-03-28T21:53:08.593464+0000","last_active":"2024-03-28T21:53:11.601060+0000","last_peered":"2024-03-28T21:53:11.601060+0000","last_clean":"2024-03-28T21:53:11.601060+0000","last_became_active":"2024-03-28T21:53:08.593134+0000","last_became_peered":"2024-03-28T21:53:08.593134+0000","last_unstale":"2024-03-28T21:53:11.601060+0000","last_undegraded":"2024-03-28T21:53:11.601060+0000","last_fullsized":"2024-03-28T21:53:11.601060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:03:40.680559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051801+0000","last_change":"2024-03-28T21:53:09.623522+0000","last_active":"2024-03-28T21:53:12.051801+0000","last_peered":"2024-03-28T21:53:12.051801+0000","last_clean":"2024-03-28T21:53:12.051801+0000","last_became_active":"2024-03-28T21:53:09.621232+0000","last_became_peered":"2024-03-28T21:53:09.621232+0000","last_unstale":"2024-03-28T21:53:12.051801+0000","last_undegraded":"2024-03-28T21:53:12.051801+0000","last_fullsized":"2024-03-28T21:53:12.051801+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:00:50.697398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628998+0000","last_change":"2024-03-28T21:53:08.603156+0000","last_active":"2024-03-28T21:53:10.628998+0000","last_peered":"2024-03-28T21:53:10.628998+0000","last_clean":"2024-03-28T21:53:10.628998+0000","last_became_active":"2024-03-28T21:53:08.602876+0000","last_became_peered":"2024-03-28T21:53:08.602876+0000","last_unstale":"2024-03-28T21:53:10.628998+0000","last_undegraded":"2024-03-28T21:53:10.628998+0000","last_fullsized":"2024-03-28T21:53:10.628998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:56:49.605103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.600541+0000","last_change":"2024-03-28T21:53:09.623590+0000","last_active":"2024-03-28T21:53:11.600541+0000","last_peered":"2024-03-28T21:53:11.600541+0000","last_clean":"2024-03-28T21:53:11.600541+0000","last_became_active":"2024-03-28T21:53:09.623323+0000","last_became_peered":"2024-03-28T21:53:09.623323+0000","last_unstale":"2024-03-28T21:53:11.600541+0000","last_undegraded":"2024-03-28T21:53:11.600541+0000","last_fullsized":"2024-03-28T21:53:11.600541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:53:29.426892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628545+0000","last_change":"2024-03-28T21:53:08.601162+0000","last_active":"2024-03-28T21:53:10.628545+0000","last_peered":"2024-03-28T21:53:10.628545+0000","last_clean":"2024-03-28T21:53:10.628545+0000","last_became_active":"2024-03-28T21:53:08.600737+0000","last_became_peered":"2024-03-28T21:53:08.600737+0000","last_unstale":"2024-03-28T21:53:10.628545+0000","last_undegraded":"2024-03-28T21:53:10.628545+0000","last_fullsized":"2024-03-28T21:53:10.628545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:08:17.955335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.257157+0000","last_change":"2024-03-28T21:53:09.635624+0000","last_active":"2024-03-28T21:53:12.257157+0000","last_peered":"2024-03-28T21:53:12.257157+0000","last_clean":"2024-03-28T21:53:12.257157+0000","last_became_active":"2024-03-28T21:53:09.635293+0000","last_became_peered":"2024-03-28T21:53:09.635293+0000","last_unstale":"2024-03-28T21:53:12.257157+0000","last_undegraded":"2024-03-28T21:53:12.257157+0000","last_fullsized":"2024-03-28T21:53:12.257157+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:00:50.826912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.628311+0000","last_change":"2024-03-28T21:53:08.597140+0000","last_active":"2024-03-28T21:53:10.628311+0000","last_peered":"2024-03-28T21:53:10.628311+0000","last_clean":"2024-03-28T21:53:10.628311+0000","last_became_active":"2024-03-28T21:53:08.596798+0000","last_became_peered":"2024-03-28T21:53:08.596798+0000","last_unstale":"2024-03-28T21:53:10.628311+0000","last_undegraded":"2024-03-28T21:53:10.628311+0000","last_fullsized":"2024-03-28T21:53:10.628311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:16:26.224226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.255908+0000","last_change":"2024-03-28T21:53:09.619444+0000","last_active":"2024-03-28T21:53:12.255908+0000","last_peered":"2024-03-28T21:53:12.255908+0000","last_clean":"2024-03-28T21:53:12.255908+0000","last_became_active":"2024-03-28T21:53:09.619154+0000","last_became_peered":"2024-03-28T21:53:09.619154+0000","last_unstale":"2024-03-28T21:53:12.255908+0000","last_undegraded":"2024-03-28T21:53:12.255908+0000","last_fullsized":"2024-03-28T21:53:12.255908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:24:04.014206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.586539+0000","last_change":"2024-03-28T21:53:08.590224+0000","last_active":"2024-03-28T21:53:11.586539+0000","last_peered":"2024-03-28T21:53:11.586539+0000","last_clean":"2024-03-28T21:53:11.586539+0000","last_became_active":"2024-03-28T21:53:08.589942+0000","last_became_peered":"2024-03-28T21:53:08.589942+0000","last_unstale":"2024-03-28T21:53:11.586539+0000","last_undegraded":"2024-03-28T21:53:11.586539+0000","last_fullsized":"2024-03-28T21:53:11.586539+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:24:02.999976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256461+0000","last_change":"2024-03-28T21:53:09.611117+0000","last_active":"2024-03-28T21:53:12.256461+0000","last_peered":"2024-03-28T21:53:12.256461+0000","last_clean":"2024-03-28T21:53:12.256461+0000","last_became_active":"2024-03-28T21:53:09.610848+0000","last_became_peered":"2024-03-28T21:53:09.610848+0000","last_unstale":"2024-03-28T21:53:12.256461+0000","last_undegraded":"2024-03-28T21:53:12.256461+0000","last_fullsized":"2024-03-28T21:53:12.256461+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:40:57.202442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.627288+0000","last_change":"2024-03-28T21:53:08.592919+0000","last_active":"2024-03-28T21:53:10.627288+0000","last_peered":"2024-03-28T21:53:10.627288+0000","last_clean":"2024-03-28T21:53:10.627288+0000","last_became_active":"2024-03-28T21:53:08.592606+0000","last_became_peered":"2024-03-28T21:53:08.592606+0000","last_unstale":"2024-03-28T21:53:10.627288+0000","last_undegraded":"2024-03-28T21:53:10.627288+0000","last_fullsized":"2024-03-28T21:53:10.627288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:03:40.680559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.255173+0000","last_change":"2024-03-28T21:53:09.609784+0000","last_active":"2024-03-28T21:53:12.255173+0000","last_peered":"2024-03-28T21:53:12.255173+0000","last_clean":"2024-03-28T21:53:12.255173+0000","last_became_active":"2024-03-28T21:53:09.608220+0000","last_became_peered":"2024-03-28T21:53:09.608220+0000","last_unstale":"2024-03-28T21:53:12.255173+0000","last_undegraded":"2024-03-28T21:53:12.255173+0000","last_fullsized":"2024-03-28T21:53:12.255173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:19:14.468275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.626562+0000","last_change":"2024-03-28T21:53:08.602311+0000","last_active":"2024-03-28T21:53:10.626562+0000","last_peered":"2024-03-28T21:53:10.626562+0000","last_clean":"2024-03-28T21:53:10.626562+0000","last_became_active":"2024-03-28T21:53:08.600825+0000","last_became_peered":"2024-03-28T21:53:08.600825+0000","last_unstale":"2024-03-28T21:53:10.626562+0000","last_undegraded":"2024-03-28T21:53:10.626562+0000","last_fullsized":"2024-03-28T21:53:10.626562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:45:27.076818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.624701+0000","last_change":"2024-03-28T21:53:09.625383+0000","last_active":"2024-03-28T21:53:10.624701+0000","last_peered":"2024-03-28T21:53:10.624701+0000","last_clean":"2024-03-28T21:53:10.624701+0000","last_became_active":"2024-03-28T21:53:09.624174+0000","last_became_peered":"2024-03-28T21:53:09.624174+0000","last_unstale":"2024-03-28T21:53:10.624701+0000","last_undegraded":"2024-03-28T21:53:10.624701+0000","last_fullsized":"2024-03-28T21:53:10.624701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:31:13.152688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.050359+0000","last_change":"2024-03-28T21:53:08.609017+0000","last_active":"2024-03-28T21:53:12.050359+0000","last_peered":"2024-03-28T21:53:12.050359+0000","last_clean":"2024-03-28T21:53:12.050359+0000","last_became_active":"2024-03-28T21:53:08.608608+0000","last_became_peered":"2024-03-28T21:53:08.608608+0000","last_unstale":"2024-03-28T21:53:12.050359+0000","last_undegraded":"2024-03-28T21:53:12.050359+0000","last_fullsized":"2024-03-28T21:53:12.050359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:24:33.731404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.257537+0000","last_change":"2024-03-28T21:53:09.616101+0000","last_active":"2024-03-28T21:53:12.257537+0000","last_peered":"2024-03-28T21:53:12.257537+0000","last_clean":"2024-03-28T21:53:12.257537+0000","last_became_active":"2024-03-28T21:53:09.615795+0000","last_became_peered":"2024-03-28T21:53:09.615795+0000","last_unstale":"2024-03-28T21:53:12.257537+0000","last_undegraded":"2024-03-28T21:53:12.257537+0000","last_fullsized":"2024-03-28T21:53:12.257537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:48:57.391624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.601073+0000","last_change":"2024-03-28T21:53:08.595909+0000","last_active":"2024-03-28T21:53:11.601073+0000","last_peered":"2024-03-28T21:53:11.601073+0000","last_clean":"2024-03-28T21:53:11.601073+0000","last_became_active":"2024-03-28T21:53:08.595615+0000","last_became_peered":"2024-03-28T21:53:08.595615+0000","last_unstale":"2024-03-28T21:53:11.601073+0000","last_undegraded":"2024-03-28T21:53:11.601073+0000","last_fullsized":"2024-03-28T21:53:11.601073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:56:49.605103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.051807+0000","last_change":"2024-03-28T21:53:09.631031+0000","last_active":"2024-03-28T21:53:12.051807+0000","last_peered":"2024-03-28T21:53:12.051807+0000","last_clean":"2024-03-28T21:53:12.051807+0000","last_became_active":"2024-03-28T21:53:09.629053+0000","last_became_peered":"2024-03-28T21:53:09.629053+0000","last_unstale":"2024-03-28T21:53:12.051807+0000","last_undegraded":"2024-03-28T21:53:12.051807+0000","last_fullsized":"2024-03-28T21:53:12.051807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:06:48.078389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.587059+0000","last_change":"2024-03-28T21:53:08.592359+0000","last_active":"2024-03-28T21:53:11.587059+0000","last_peered":"2024-03-28T21:53:11.587059+0000","last_clean":"2024-03-28T21:53:11.587059+0000","last_became_active":"2024-03-28T21:53:08.591668+0000","last_became_peered":"2024-03-28T21:53:08.591668+0000","last_unstale":"2024-03-28T21:53:11.587059+0000","last_undegraded":"2024-03-28T21:53:11.587059+0000","last_fullsized":"2024-03-28T21:53:11.587059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:09:11.229831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.586259+0000","last_change":"2024-03-28T21:53:09.619198+0000","last_active":"2024-03-28T21:53:11.586259+0000","last_peered":"2024-03-28T21:53:11.586259+0000","last_clean":"2024-03-28T21:53:11.586259+0000","last_became_active":"2024-03-28T21:53:09.618334+0000","last_became_peered":"2024-03-28T21:53:09.618334+0000","last_unstale":"2024-03-28T21:53:11.586259+0000","last_undegraded":"2024-03-28T21:53:11.586259+0000","last_fullsized":"2024-03-28T21:53:11.586259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:02.344669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.600863+0000","last_change":"2024-03-28T21:53:08.600185+0000","last_active":"2024-03-28T21:53:11.600863+0000","last_peered":"2024-03-28T21:53:11.600863+0000","last_clean":"2024-03-28T21:53:11.600863+0000","last_became_active":"2024-03-28T21:53:08.599480+0000","last_became_peered":"2024-03-28T21:53:08.599480+0000","last_unstale":"2024-03-28T21:53:11.600863+0000","last_undegraded":"2024-03-28T21:53:11.600863+0000","last_fullsized":"2024-03-28T21:53:11.600863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:45:27.076818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.627449+0000","last_change":"2024-03-28T21:53:09.612508+0000","last_active":"2024-03-28T21:53:10.627449+0000","last_peered":"2024-03-28T21:53:10.627449+0000","last_clean":"2024-03-28T21:53:10.627449+0000","last_became_active":"2024-03-28T21:53:09.610715+0000","last_became_peered":"2024-03-28T21:53:09.610715+0000","last_unstale":"2024-03-28T21:53:10.627449+0000","last_undegraded":"2024-03-28T21:53:10.627449+0000","last_fullsized":"2024-03-28T21:53:10.627449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:14:17.369409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.586803+0000","last_change":"2024-03-28T21:53:08.593408+0000","last_active":"2024-03-28T21:53:11.586803+0000","last_peered":"2024-03-28T21:53:11.586803+0000","last_clean":"2024-03-28T21:53:11.586803+0000","last_became_active":"2024-03-28T21:53:08.593172+0000","last_became_peered":"2024-03-28T21:53:08.593172+0000","last_unstale":"2024-03-28T21:53:11.586803+0000","last_undegraded":"2024-03-28T21:53:11.586803+0000","last_fullsized":"2024-03-28T21:53:11.586803+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:46:33.686667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.586384+0000","last_change":"2024-03-28T21:53:09.606604+0000","last_active":"2024-03-28T21:53:11.586384+0000","last_peered":"2024-03-28T21:53:11.586384+0000","last_clean":"2024-03-28T21:53:11.586384+0000","last_became_active":"2024-03-28T21:53:09.606017+0000","last_became_peered":"2024-03-28T21:53:09.606017+0000","last_unstale":"2024-03-28T21:53:11.586384+0000","last_undegraded":"2024-03-28T21:53:11.586384+0000","last_fullsized":"2024-03-28T21:53:11.586384+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:46:49.126711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:11.600199+0000","last_change":"2024-03-28T21:53:08.595087+0000","last_active":"2024-03-28T21:53:11.600199+0000","last_peered":"2024-03-28T21:53:11.600199+0000","last_clean":"2024-03-28T21:53:11.600199+0000","last_became_active":"2024-03-28T21:53:08.594789+0000","last_became_peered":"2024-03-28T21:53:08.594789+0000","last_unstale":"2024-03-28T21:53:11.600199+0000","last_undegraded":"2024-03-28T21:53:11.600199+0000","last_fullsized":"2024-03-28T21:53:11.600199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:03:30.068393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256459+0000","last_change":"2024-03-28T21:53:09.615355+0000","last_active":"2024-03-28T21:53:12.256459+0000","last_peered":"2024-03-28T21:53:12.256459+0000","last_clean":"2024-03-28T21:53:12.256459+0000","last_became_active":"2024-03-28T21:53:09.614964+0000","last_became_peered":"2024-03-28T21:53:09.614964+0000","last_unstale":"2024-03-28T21:53:12.256459+0000","last_undegraded":"2024-03-28T21:53:12.256459+0000","last_fullsized":"2024-03-28T21:53:12.256459+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:40.286505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.626815+0000","last_change":"2024-03-28T21:53:08.596206+0000","last_active":"2024-03-28T21:53:10.626815+0000","last_peered":"2024-03-28T21:53:10.626815+0000","last_clean":"2024-03-28T21:53:10.626815+0000","last_became_active":"2024-03-28T21:53:08.595891+0000","last_became_peered":"2024-03-28T21:53:08.595891+0000","last_unstale":"2024-03-28T21:53:10.626815+0000","last_undegraded":"2024-03-28T21:53:10.626815+0000","last_fullsized":"2024-03-28T21:53:10.626815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T03:03:40.680559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.626420+0000","last_change":"2024-03-28T21:53:09.617847+0000","last_active":"2024-03-28T21:53:10.626420+0000","last_peered":"2024-03-28T21:53:10.626420+0000","last_clean":"2024-03-28T21:53:10.626420+0000","last_became_active":"2024-03-28T21:53:09.617568+0000","last_became_peered":"2024-03-28T21:53:09.617568+0000","last_unstale":"2024-03-28T21:53:10.626420+0000","last_undegraded":"2024-03-28T21:53:10.626420+0000","last_fullsized":"2024-03-28T21:53:10.626420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:36:55.766174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:12.256017+0000","last_change":"2024-03-28T21:53:08.606874+0000","last_active":"2024-03-28T21:53:12.256017+0000","last_peered":"2024-03-28T21:53:12.256017+0000","last_clean":"2024-03-28T21:53:12.256017+0000","last_became_active":"2024-03-28T21:53:08.606636+0000","last_became_peered":"2024-03-28T21:53:08.606636+0000","last_unstale":"2024-03-28T21:53:12.256017+0000","last_undegraded":"2024-03-28T21:53:12.256017+0000","last_fullsized":"2024-03-28T21:53:12.256017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:11:48.650992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.623363+0000","last_change":"2024-03-28T21:53:09.631157+0000","last_active":"2024-03-28T21:53:10.623363+0000","last_peered":"2024-03-28T21:53:10.623363+0000","last_clean":"2024-03-28T21:53:10.623363+0000","last_became_active":"2024-03-28T21:53:09.630473+0000","last_became_peered":"2024-03-28T21:53:09.630473+0000","last_unstale":"2024-03-28T21:53:10.623363+0000","last_undegraded":"2024-03-28T21:53:10.623363+0000","last_fullsized":"2024-03-28T21:53:10.623363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:08.558652+0000","last_clean_scrub_stamp":"2024-03-28T21:53:08.558652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T02:32:59.827309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.627018+0000","last_change":"2024-03-28T21:53:08.601567+0000","last_active":"2024-03-28T21:53:10.627018+0000","last_peered":"2024-03-28T21:53:10.627018+0000","last_clean":"2024-03-28T21:53:10.627018+0000","last_became_active":"2024-03-28T21:53:08.601261+0000","last_became_peered":"2024-03-28T21:53:08.601261+0000","last_unstale":"2024-03-28T21:53:10.627018+0000","last_undegraded":"2024-03-28T21:53:10.627018+0000","last_fullsized":"2024-03-28T21:53:10.627018+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:53:07.544422+0000","last_clean_scrub_stamp":"2024-03-28T21:53:07.544422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:28:42.470143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-28T21:53:10.623942+0000","last_change":"2024-03-28T21:51:51.547812+0000","last_active":"2024-03-28T21:53:10.623942+0000","last_peered":"2024-03-28T21:53:10.623942+0000","last_clean":"2024-03-28T21:53:10.623942+0000","last_became_active":"2024-03-28T21:51:51.545783+0000","last_became_peered":"2024-03-28T21:51:51.545783+0000","last_unstale":"2024-03-28T21:53:10.623942+0000","last_undegraded":"2024-03-28T21:53:10.623942+0000","last_fullsized":"2024-03-28T21:53:10.623942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_clean_scrub_stamp":"2024-03-28T21:51:50.185942+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:08:34.531035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":744974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":155132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":155188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":154620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":156150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":154586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":156150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":744884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T21:53:19.664 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-28T21:53:19.664 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-28T21:53:19.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.913+0000 7f7ab6600640 1 Processor -- start 2024-03-28T21:53:19.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.913+0000 7f7ab6600640 1 -- start start 2024-03-28T21:53:19.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.915+0000 7f7ab6600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7ab015e2e0 0x7f7ab00d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:19.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.915+0000 7f7ab6600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ab00d1560 0x7f7ab00b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:19.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.915+0000 7f7ab6600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ab00d2f90 con 0x7f7ab00d09a0 2024-03-28T21:53:19.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.915+0000 7f7ab6600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7ab00b0d90 con 0x7f7ab015e2e0 2024-03-28T21:53:19.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.915+0000 7f7ab6600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab00b1630 con 0x7f7ab00d1560 2024-03-28T21:53:19.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.916+0000 7f7aaf400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7ab015e2e0 0x7f7ab00d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:19.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.916+0000 7f7aafe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ab00d1560 0x7f7ab00b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:19.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.916+0000 7f7aaf400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7ab015e2e0 0x7f7ab00d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:40730/0 (socket says 172.21.15.153:40730) 2024-03-28T21:53:19.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.916+0000 7f7aafe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ab00d1560 0x7f7ab00b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:56190/0 (socket says 172.21.15.153:56190) 2024-03-28T21:53:19.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.916+0000 7f7aaf400640 1 -- 172.21.15.153:0/3789627385 learned_addr learned my addr 172.21.15.153:0/3789627385 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:19.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.916+0000 7f7aaea00640 1 --1- 172.21.15.153:0/3789627385 >> v1:172.21.15.165:6789/0 conn(0x7f7ab00d09a0 0x7f7ab00d0e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:54272/0 (socket says 172.21.15.153:54272) 2024-03-28T21:53:19.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.917+0000 7f7aafe00640 1 -- 172.21.15.153:0/3789627385 >> v2:172.21.15.165:3300/0 conn(0x7f7ab015e2e0 msgr2=0x7f7ab00d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:19.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.917+0000 7f7aafe00640 1 --2- 172.21.15.153:0/3789627385 >> v2:172.21.15.165:3300/0 conn(0x7f7ab015e2e0 0x7f7ab00d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:19.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.917+0000 7f7aafe00640 1 -- 172.21.15.153:0/3789627385 >> v1:172.21.15.165:6789/0 conn(0x7f7ab00d09a0 legacy=0x7f7ab00d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:19.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.917+0000 7f7aafe00640 1 -- 172.21.15.153:0/3789627385 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab00b0fe0 con 0x7f7ab00d1560 2024-03-28T21:53:19.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.917+0000 7f7aaf400640 1 --2- 172.21.15.153:0/3789627385 >> v2:172.21.15.165:3300/0 conn(0x7f7ab015e2e0 0x7f7ab00d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T21:53:19.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.918+0000 7f7aafe00640 1 --2- 172.21.15.153:0/3789627385 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ab00d1560 0x7f7ab00b1ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009d90 tx=0x7f7aa802be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c260f18bcba38cb2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:19.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.919+0000 7f7aae000640 1 -- 172.21.15.153:0/3789627385 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8039070 con 0x7f7ab00d1560 2024-03-28T21:53:19.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.919+0000 7f7aae000640 1 -- 172.21.15.153:0/3789627385 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa802cbd0 con 0x7f7ab00d1560 2024-03-28T21:53:19.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.919+0000 7f7aae000640 1 -- 172.21.15.153:0/3789627385 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8034440 con 0x7f7ab00d1560 2024-03-28T21:53:19.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.919+0000 7f7ab6600640 1 -- 172.21.15.153:0/3789627385 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ab00d1560 msgr2=0x7f7ab00b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:19.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.919+0000 7f7ab6600640 1 --2- 172.21.15.153:0/3789627385 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ab00d1560 0x7f7ab00b1ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009d90 tx=0x7f7aa802be20 comp rx=0 tx=0).stop 2024-03-28T21:53:19.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.919+0000 7f7ab6600640 1 -- 172.21.15.153:0/3789627385 shutdown_connections 2024-03-28T21:53:19.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.919+0000 7f7ab6600640 1 --2- 172.21.15.153:0/3789627385 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ab00d1560 0x7f7ab00b1ac0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:19.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.919+0000 7f7ab6600640 1 --2- 172.21.15.153:0/3789627385 >> v2:172.21.15.165:3300/0 conn(0x7f7ab015e2e0 0x7f7ab00d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:19.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.919+0000 7f7ab6600640 1 -- 172.21.15.153:0/3789627385 >> 172.21.15.153:0/3789627385 conn(0x7f7ab009d4a0 msgr2=0x7f7ab00d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:19.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.920+0000 7f7ab6600640 1 -- 172.21.15.153:0/3789627385 shutdown_connections 2024-03-28T21:53:19.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.920+0000 7f7ab6600640 1 -- 172.21.15.153:0/3789627385 wait complete. 2024-03-28T21:53:19.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.921+0000 7f7ab6600640 1 Processor -- start 2024-03-28T21:53:19.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.922+0000 7f7ab6600640 1 -- start start 2024-03-28T21:53:19.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.923+0000 7f7ab6600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab00d09a0 0x7f7ab00c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:19.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.923+0000 7f7ab6600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ab00d1560 0x7f7ab00cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:19.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.923+0000 7f7ab6600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ab015e2e0 0x7f7ab0153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:19.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.923+0000 7f7ab6600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab015e6c0 con 0x7f7ab00d09a0 2024-03-28T21:53:19.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.923+0000 7f7ab6600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab00d2c80 con 0x7f7ab00d1560 2024-03-28T21:53:19.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.923+0000 7f7ab6600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab00b2000 con 0x7f7ab015e2e0 2024-03-28T21:53:19.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.923+0000 7f7aaf400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab00d09a0 0x7f7ab00c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:19.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.923+0000 7f7aaf400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab00d09a0 0x7f7ab00c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58522/0 (socket says 172.21.15.153:58522) 2024-03-28T21:53:19.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.923+0000 7f7aaf400640 1 -- 172.21.15.153:0/1425009427 learned_addr learned my addr 172.21.15.153:0/1425009427 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:19.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.923+0000 7f7aaea00640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ab00d1560 0x7f7ab00cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:19.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.924+0000 7f7aafe00640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ab015e2e0 0x7f7ab0153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:19.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.924+0000 7f7aaf400640 1 -- 172.21.15.153:0/1425009427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ab015e2e0 msgr2=0x7f7ab0153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:19.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.924+0000 7f7aaf400640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ab015e2e0 0x7f7ab0153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:19.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.924+0000 7f7aaf400640 1 -- 172.21.15.153:0/1425009427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ab00d1560 msgr2=0x7f7ab00cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:19.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.924+0000 7f7aaf400640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ab00d1560 0x7f7ab00cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:19.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.924+0000 7f7aaf400640 1 -- 172.21.15.153:0/1425009427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab00c91b0 con 0x7f7ab00d09a0 2024-03-28T21:53:19.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.924+0000 7f7aafe00640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ab015e2e0 0x7f7ab0153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:19.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.924+0000 7f7aaf400640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab00d09a0 0x7f7ab00c8b60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000e9b0 tx=0x7f7aa000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:19.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.924+0000 7f7aa7400640 1 -- 172.21.15.153:0/1425009427 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0017070 con 0x7f7ab00d09a0 2024-03-28T21:53:19.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.924+0000 7f7aa7400640 1 -- 172.21.15.153:0/1425009427 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa000c9a0 con 0x7f7ab00d09a0 2024-03-28T21:53:19.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.924+0000 7f7ab6600640 1 -- 172.21.15.153:0/1425009427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab00c9490 con 0x7f7ab00d09a0 2024-03-28T21:53:19.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.924+0000 7f7aa7400640 1 -- 172.21.15.153:0/1425009427 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000cd50 con 0x7f7ab00d09a0 2024-03-28T21:53:19.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.925+0000 7f7ab6600640 1 -- 172.21.15.153:0/1425009427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab00c9a50 con 0x7f7ab00d09a0 2024-03-28T21:53:19.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.926+0000 7f7ab6600640 1 -- 172.21.15.153:0/1425009427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ab0151ac0 con 0x7f7ab00d09a0 2024-03-28T21:53:19.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.927+0000 7f7aa7400640 1 -- 172.21.15.153:0/1425009427 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f7aa001a070 con 0x7f7ab00d09a0 2024-03-28T21:53:19.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.928+0000 7f7aa7400640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7a8c06b4d0 0x7f7a8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:19.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.928+0000 7f7aa7400640 1 -- 172.21.15.153:0/1425009427 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f7aa008a480 con 0x7f7ab00d09a0 2024-03-28T21:53:19.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.928+0000 7f7aaea00640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7a8c06b4d0 0x7f7a8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:19.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.929+0000 7f7aaea00640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7a8c06b4d0 0x7f7a8c06d990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7ab006c1d0 tx=0x7f7a98007cc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:19.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:19.934+0000 7f7aa7400640 1 -- 172.21.15.153:0/1425009427 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7aa0059280 con 0x7f7ab00d09a0 2024-03-28T21:53:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.200+0000 7f7ab6600640 1 -- 172.21.15.153:0/1425009427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f7ab0068ff0 con 0x7f7ab00d09a0 2024-03-28T21:53:20.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.204+0000 7f7aa7400640 1 -- 172.21.15.153:0/1425009427 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f7aa0058b80 con 0x7f7ab00d09a0 2024-03-28T21:53:20.206 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-03-28T21:53:20.206 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBA5gVmoG2wARAAshqkf7uwt2GxtPnRirjPtA== 2024-03-28T21:53:20.206 INFO:teuthology.orchestra.run.smithi153.stdout: caps mds = "allow" 2024-03-28T21:53:20.206 INFO:teuthology.orchestra.run.smithi153.stdout: caps mon = "allow r" 2024-03-28T21:53:20.206 INFO:teuthology.orchestra.run.smithi153.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-28T21:53:20.206 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2024-03-28T21:53:20.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.207+0000 7f7ab6600640 1 -- 172.21.15.153:0/1425009427 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7a8c06b4d0 msgr2=0x7f7a8c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:20.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.207+0000 7f7ab6600640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7a8c06b4d0 0x7f7a8c06d990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7ab006c1d0 tx=0x7f7a98007cc0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.207+0000 7f7ab6600640 1 -- 172.21.15.153:0/1425009427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab00d09a0 msgr2=0x7f7ab00c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:20.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.207+0000 7f7ab6600640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab00d09a0 0x7f7ab00c8b60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000e9b0 tx=0x7f7aa000ee70 comp rx=0 tx=0).stop 2024-03-28T21:53:20.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.207+0000 7f7ab6600640 1 -- 172.21.15.153:0/1425009427 shutdown_connections 2024-03-28T21:53:20.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.207+0000 7f7ab6600640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7a8c06b4d0 0x7f7a8c06d990 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.207+0000 7f7ab6600640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ab015e2e0 0x7f7ab0153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.207+0000 7f7ab6600640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ab00d1560 0x7f7ab00cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.207+0000 7f7ab6600640 1 --2- 172.21.15.153:0/1425009427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab00d09a0 0x7f7ab00c8b60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.207+0000 7f7ab6600640 1 -- 172.21.15.153:0/1425009427 >> 172.21.15.153:0/1425009427 conn(0x7f7ab009d4a0 msgr2=0x7f7ab00cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:20.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.207+0000 7f7ab6600640 1 -- 172.21.15.153:0/1425009427 shutdown_connections 2024-03-28T21:53:20.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.207+0000 7f7ab6600640 1 -- 172.21.15.153:0/1425009427 wait complete. 2024-03-28T21:53:20.227 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T21:53:20.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.424+0000 7efd2b200640 1 Processor -- start 2024-03-28T21:53:20.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.425+0000 7efd2b200640 1 -- start start 2024-03-28T21:53:20.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.426+0000 7efd2b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7efd2c0d2550 0x7efd2c0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:20.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.426+0000 7efd2b200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd2c0d1950 con 0x7efd2c15e440 2024-03-28T21:53:20.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.426+0000 7efd2b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd2c0d2a30 con 0x7efd2c15e060 2024-03-28T21:53:20.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.426+0000 7efd2b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7efd2c0d2d10 con 0x7efd2c0d2550 2024-03-28T21:53:20.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.426+0000 7efd2a800640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7efd2c15e440 0x7efd2c0b42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59120/0 (socket says 172.21.15.153:59120) 2024-03-28T21:53:20.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.426+0000 7efd2a800640 1 -- 172.21.15.153:0/532652903 learned_addr learned my addr 172.21.15.153:0/532652903 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:20.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd21400640 1 --2- 172.21.15.153:0/532652903 >> v2:172.21.15.165:3300/0 conn(0x7efd2c0d2550 0x7efd2c0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:20.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 -- 172.21.15.153:0/532652903 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503162354 0 0) 0x7efd2c0d1950 con 0x7efd2c15e440 2024-03-28T21:53:20.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 -- 172.21.15.153:0/532652903 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd10003520 con 0x7efd2c15e440 2024-03-28T21:53:20.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 -- 172.21.15.153:0/532652903 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3003380929 0 0) 0x7efd10003520 con 0x7efd2c15e440 2024-03-28T21:53:20.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 -- 172.21.15.153:0/532652903 >> v2:172.21.15.165:3300/0 conn(0x7efd2c0d2550 msgr2=0x7efd2c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:20.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 --2- 172.21.15.153:0/532652903 >> v2:172.21.15.165:3300/0 conn(0x7efd2c0d2550 0x7efd2c0cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 -- 172.21.15.153:0/532652903 >> v1:172.21.15.165:6789/0 conn(0x7efd2c15e060 legacy=0x7efd2c0cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:20.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 -- 172.21.15.153:0/532652903 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c0b3ac0 con 0x7efd2c15e440 2024-03-28T21:53:20.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 -- 172.21.15.153:0/532652903 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7efd240019f0 con 0x7efd2c15e440 2024-03-28T21:53:20.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 -- 172.21.15.153:0/532652903 >> v1:172.21.15.153:6789/0 conn(0x7efd2c15e440 legacy=0x7efd2c0b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:20.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 --2- 172.21.15.153:0/532652903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd10003a20 0x7efd10003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:20.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 --2- 172.21.15.153:0/532652903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd10004800 0x7efd10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:20.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 --2- 172.21.15.153:0/532652903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd100051c0 0x7efd1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:20.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 -- 172.21.15.153:0/532652903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c0d2d10 con 0x7efd10003a20 2024-03-28T21:53:20.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 -- 172.21.15.153:0/532652903 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efd1000c0f0 con 0x7efd10004800 2024-03-28T21:53:20.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.427+0000 7efd29400640 1 -- 172.21.15.153:0/532652903 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efd1000c2f0 con 0x7efd100051c0 2024-03-28T21:53:20.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.428+0000 7efd29e00640 1 --2- 172.21.15.153:0/532652903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd10003a20 0x7efd10003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:20.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.428+0000 7efd2a800640 1 --2- 172.21.15.153:0/532652903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd100051c0 0x7efd1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:20.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.428+0000 7efd29e00640 1 -- 172.21.15.153:0/532652903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd100051c0 msgr2=0x7efd1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:20.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.428+0000 7efd29e00640 1 --2- 172.21.15.153:0/532652903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd100051c0 0x7efd1000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.428+0000 7efd29e00640 1 -- 172.21.15.153:0/532652903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd10004800 msgr2=0x7efd10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:20.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.428+0000 7efd21400640 1 --2- 172.21.15.153:0/532652903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd10004800 0x7efd10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:20.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.428+0000 7efd29e00640 1 --2- 172.21.15.153:0/532652903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd10004800 0x7efd10004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.428+0000 7efd29e00640 1 -- 172.21.15.153:0/532652903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd10003520 con 0x7efd10003a20 2024-03-28T21:53:20.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.428+0000 7efd2a800640 1 -- 172.21.15.153:0/532652903 reap_dead start 2024-03-28T21:53:20.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.429+0000 7efd29e00640 1 --2- 172.21.15.153:0/532652903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd10003a20 0x7efd10003e40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efd14001750 tx=0x7efd10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e7da5097bf17a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:20.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.429+0000 7efd29400640 1 -- 172.21.15.153:0/532652903 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14001370 con 0x7efd10003a20 2024-03-28T21:53:20.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.429+0000 7efd29400640 1 -- 172.21.15.153:0/532652903 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd140052d0 con 0x7efd10003a20 2024-03-28T21:53:20.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.429+0000 7efd29400640 1 -- 172.21.15.153:0/532652903 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14003830 con 0x7efd10003a20 2024-03-28T21:53:20.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.430+0000 7efd2b200640 1 -- 172.21.15.153:0/532652903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd10003a20 msgr2=0x7efd10003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:20.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.430+0000 7efd2b200640 1 --2- 172.21.15.153:0/532652903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd10003a20 0x7efd10003e40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efd14001750 tx=0x7efd10005830 comp rx=0 tx=0).stop 2024-03-28T21:53:20.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.430+0000 7efd2b200640 1 -- 172.21.15.153:0/532652903 shutdown_connections 2024-03-28T21:53:20.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.430+0000 7efd2b200640 1 --2- 172.21.15.153:0/532652903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd10003a20 0x7efd10003e40 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.430+0000 7efd2b200640 1 -- 172.21.15.153:0/532652903 >> 172.21.15.153:0/532652903 conn(0x7efd2c0d3f70 msgr2=0x7efd2c0d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:20.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.430+0000 7efd2b200640 1 -- 172.21.15.153:0/532652903 shutdown_connections 2024-03-28T21:53:20.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.430+0000 7efd2b200640 1 -- 172.21.15.153:0/532652903 wait complete. 2024-03-28T21:53:20.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.432+0000 7efd2b200640 1 Processor -- start 2024-03-28T21:53:20.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.432+0000 7efd2b200640 1 -- start start 2024-03-28T21:53:20.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.433+0000 7efd2b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd10003a20 0x7efd2c1614a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:20.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.433+0000 7efd2b200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1584f0 0x7efd2c1f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.433+0000 7efd2b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2c06c170 0x7efd2c0cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.433+0000 7efd2b200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c0d0940 con 0x7efd2c1584f0 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.433+0000 7efd2b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c0d4d20 con 0x7efd2c06c170 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.433+0000 7efd2b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efd2c0d0ac0 con 0x7efd10003a20 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.433+0000 7efd21400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1584f0 0x7efd2c1f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.433+0000 7efd21400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1584f0 0x7efd2c1f4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58530/0 (socket says 172.21.15.153:58530) 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.433+0000 7efd21400640 1 -- 172.21.15.153:0/1579440609 learned_addr learned my addr 172.21.15.153:0/1579440609 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.434+0000 7efd29e00640 1 --2- 172.21.15.153:0/1579440609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd10003a20 0x7efd2c1614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.434+0000 7efd21400640 1 -- 172.21.15.153:0/1579440609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd10003a20 msgr2=0x7efd2c1614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.434+0000 7efd21400640 1 --2- 172.21.15.153:0/1579440609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd10003a20 0x7efd2c1614a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.434+0000 7efd21400640 1 -- 172.21.15.153:0/1579440609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2c06c170 msgr2=0x7efd2c0cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.434+0000 7efd21400640 1 --2- 172.21.15.153:0/1579440609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2c06c170 0x7efd2c0cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.434+0000 7efd21400640 1 -- 172.21.15.153:0/1579440609 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c0cc5c0 con 0x7efd2c1584f0 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.434+0000 7efd21400640 1 --2- 172.21.15.153:0/1579440609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1584f0 0x7efd2c1f4120 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efd1c010750 tx=0x7efd1c010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.434+0000 7efd22a00640 1 -- 172.21.15.153:0/1579440609 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c00f040 con 0x7efd2c1584f0 2024-03-28T21:53:20.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.434+0000 7efd22a00640 1 -- 172.21.15.153:0/1579440609 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c00eb60 con 0x7efd2c1584f0 2024-03-28T21:53:20.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.434+0000 7efd2b200640 1 -- 172.21.15.153:0/1579440609 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2c0cc860 con 0x7efd2c1584f0 2024-03-28T21:53:20.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.434+0000 7efd22a00640 1 -- 172.21.15.153:0/1579440609 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c010e60 con 0x7efd2c1584f0 2024-03-28T21:53:20.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.434+0000 7efd2b200640 1 -- 172.21.15.153:0/1579440609 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2c0cce20 con 0x7efd2c1584f0 2024-03-28T21:53:20.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.436+0000 7efd2b200640 1 -- 172.21.15.153:0/1579440609 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd2c04f520 con 0x7efd2c1584f0 2024-03-28T21:53:20.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.437+0000 7efd22a00640 1 -- 172.21.15.153:0/1579440609 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7efd1c01c400 con 0x7efd2c1584f0 2024-03-28T21:53:20.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.437+0000 7efd22a00640 1 --2- 172.21.15.153:0/1579440609 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0806b500 0x7efd0806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:20.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.438+0000 7efd22a00640 1 -- 172.21.15.153:0/1579440609 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7efd1c08a730 con 0x7efd2c1584f0 2024-03-28T21:53:20.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.438+0000 7efd29e00640 1 --2- 172.21.15.153:0/1579440609 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0806b500 0x7efd0806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:20.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.438+0000 7efd29e00640 1 --2- 172.21.15.153:0/1579440609 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0806b500 0x7efd0806d9c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efd14033000 tx=0x7efd14009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:20.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.446+0000 7efd22a00640 1 -- 172.21.15.153:0/1579440609 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7efd1c018030 con 0x7efd2c1584f0 2024-03-28T21:53:20.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.685+0000 7efd2b200640 1 -- 172.21.15.153:0/1579440609 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd2c0b20f0 con 0x7efd2c1584f0 2024-03-28T21:53:20.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.686+0000 7efd22a00640 1 -- 172.21.15.153:0/1579440609 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5190 (secure 0 0 0) 0x7efd1c059520 con 0x7efd2c1584f0 2024-03-28T21:53:20.688 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:20.688 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3849778471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3849778471},{"type":"v1","addr":"172.21.15.165:6835","nonce":3849778471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/2718440878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2718440878},{"type":"v1","addr":"172.21.15.165:6833","nonce":2718440878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/974086107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":974086107},{"type":"v1","addr":"172.21.15.153:6836","nonce":974086107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T21:53:09.040388+0000","modified":"2024-03-28T21:53:12.151355+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6837/1209499946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1209499946},{"type":"v1","addr":"172.21.15.153:6837","nonce":1209499946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5070,"qdb_cluster":[5070]},"id":2}]} 2024-03-28T21:53:20.688 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 17 2024-03-28T21:53:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.689+0000 7efd2b200640 1 -- 172.21.15.153:0/1579440609 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0806b500 msgr2=0x7efd0806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.689+0000 7efd2b200640 1 --2- 172.21.15.153:0/1579440609 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0806b500 0x7efd0806d9c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efd14033000 tx=0x7efd14009030 comp rx=0 tx=0).stop 2024-03-28T21:53:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.689+0000 7efd2b200640 1 -- 172.21.15.153:0/1579440609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1584f0 msgr2=0x7efd2c1f4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.689+0000 7efd2b200640 1 --2- 172.21.15.153:0/1579440609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1584f0 0x7efd2c1f4120 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efd1c010750 tx=0x7efd1c010c10 comp rx=0 tx=0).stop 2024-03-28T21:53:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.689+0000 7efd2b200640 1 -- 172.21.15.153:0/1579440609 shutdown_connections 2024-03-28T21:53:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.689+0000 7efd2b200640 1 --2- 172.21.15.153:0/1579440609 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0806b500 0x7efd0806d9c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.689+0000 7efd2b200640 1 --2- 172.21.15.153:0/1579440609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2c06c170 0x7efd2c0cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.689+0000 7efd2b200640 1 --2- 172.21.15.153:0/1579440609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1584f0 0x7efd2c1f4120 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.689+0000 7efd2b200640 1 --2- 172.21.15.153:0/1579440609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd10003a20 0x7efd2c1614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.689+0000 7efd2b200640 1 -- 172.21.15.153:0/1579440609 >> 172.21.15.153:0/1579440609 conn(0x7efd2c0d3f70 msgr2=0x7efd2c0d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.689+0000 7efd2b200640 1 -- 172.21.15.153:0/1579440609 shutdown_connections 2024-03-28T21:53:20.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:20.689+0000 7efd2b200640 1 -- 172.21.15.153:0/1579440609 wait complete. 2024-03-28T21:53:21.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-28T21:53:09.040388+0000', 'modified': '2024-03-28T21:53:12.151355+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5070}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5070': {'gid': 5070, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.153:6837/1209499946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 1209499946}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 1209499946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5070, 'qdb_cluster': [5070]} 2024-03-28T21:53:21.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-28T21:53:21.113 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-28T21:53:21.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.327+0000 7f8cd3c00640 1 Processor -- start 2024-03-28T21:53:21.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.327+0000 7f8cd3c00640 1 -- start start 2024-03-28T21:53:21.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.329+0000 7f8cd3c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8ccc161f00 0x7f8ccc0d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.329+0000 7f8cd3c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ccc1622e0 0x7f8ccc162790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.329+0000 7f8cd3c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ccc0d11c0 con 0x7f8ccc06f2b0 2024-03-28T21:53:21.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.329+0000 7f8cd3c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8ccc070670 con 0x7f8ccc1622e0 2024-03-28T21:53:21.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.329+0000 7f8cd3c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8ccc0d1460 con 0x7f8ccc161f00 2024-03-28T21:53:21.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.329+0000 7f8ccbe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ccc1622e0 0x7f8ccc162790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.329+0000 7f8cd1c00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8ccc06f2b0 0x7f8ccc06f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59134/0 (socket says 172.21.15.153:59134) 2024-03-28T21:53:21.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.329+0000 7f8cd1c00640 1 -- 172.21.15.153:0/3012540357 learned_addr learned my addr 172.21.15.153:0/3012540357 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:21.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.330+0000 7f8cd1200640 1 --2- 172.21.15.153:0/3012540357 >> v2:172.21.15.165:3300/0 conn(0x7f8ccc161f00 0x7f8ccc0d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.330+0000 7f8ccb400640 1 -- 172.21.15.153:0/3012540357 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2768006687 0 0) 0x7f8ccc0d11c0 con 0x7f8ccc06f2b0 2024-03-28T21:53:21.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.330+0000 7f8ccbe00640 1 -- 172.21.15.153:0/3012540357 >> v2:172.21.15.165:3300/0 conn(0x7f8ccc161f00 msgr2=0x7f8ccc0d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:21.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.330+0000 7f8ccbe00640 1 --2- 172.21.15.153:0/3012540357 >> v2:172.21.15.165:3300/0 conn(0x7f8ccc161f00 0x7f8ccc0d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.330+0000 7f8ccbe00640 1 -- 172.21.15.153:0/3012540357 >> v1:172.21.15.153:6789/0 conn(0x7f8ccc06f2b0 legacy=0x7f8ccc06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:21.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.330+0000 7f8ccbe00640 1 -- 172.21.15.153:0/3012540357 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ccc06c280 con 0x7f8ccc1622e0 2024-03-28T21:53:21.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.330+0000 7f8cd1200640 1 --2- 172.21.15.153:0/3012540357 >> v2:172.21.15.165:3300/0 conn(0x7f8ccc161f00 0x7f8ccc0d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T21:53:21.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.331+0000 7f8ccbe00640 1 --2- 172.21.15.153:0/3012540357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ccc1622e0 0x7f8ccc162790 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80097a0 tx=0x7f8cb802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32830213a418116 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:21.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.332+0000 7f8ccb400640 1 -- 172.21.15.153:0/3012540357 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb80315a0 con 0x7f8ccc1622e0 2024-03-28T21:53:21.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.332+0000 7f8ccb400640 1 -- 172.21.15.153:0/3012540357 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb8037070 con 0x7f8ccc1622e0 2024-03-28T21:53:21.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.332+0000 7f8ccb400640 1 -- 172.21.15.153:0/3012540357 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8031960 con 0x7f8ccc1622e0 2024-03-28T21:53:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.332+0000 7f8cd3c00640 1 -- 172.21.15.153:0/3012540357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ccc1622e0 msgr2=0x7f8ccc162790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.332+0000 7f8cd3c00640 1 --2- 172.21.15.153:0/3012540357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ccc1622e0 0x7f8ccc162790 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80097a0 tx=0x7f8cb802b840 comp rx=0 tx=0).stop 2024-03-28T21:53:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.333+0000 7f8cd3c00640 1 -- 172.21.15.153:0/3012540357 shutdown_connections 2024-03-28T21:53:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.333+0000 7f8cd3c00640 1 --2- 172.21.15.153:0/3012540357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ccc1622e0 0x7f8ccc162790 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.333+0000 7f8cd3c00640 1 --2- 172.21.15.153:0/3012540357 >> v2:172.21.15.165:3300/0 conn(0x7f8ccc161f00 0x7f8ccc0d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.333+0000 7f8cd3c00640 1 -- 172.21.15.153:0/3012540357 >> 172.21.15.153:0/3012540357 conn(0x7f8ccc0b3950 msgr2=0x7f8ccc0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:21.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.333+0000 7f8cd3c00640 1 -- 172.21.15.153:0/3012540357 shutdown_connections 2024-03-28T21:53:21.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.333+0000 7f8cd3c00640 1 -- 172.21.15.153:0/3012540357 wait complete. 2024-03-28T21:53:21.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.334+0000 7f8cd3c00640 1 Processor -- start 2024-03-28T21:53:21.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.334+0000 7f8cd3c00640 1 -- start start 2024-03-28T21:53:21.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.335+0000 7f8cd3c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ccc06f2b0 0x7f8ccc0aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.335+0000 7f8cd3c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ccc161f00 0x7f8ccc0af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.335+0000 7f8cd3c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ccc1622e0 0x7f8ccc0b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.335+0000 7f8cd3c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ccc06cb20 con 0x7f8ccc1622e0 2024-03-28T21:53:21.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.335+0000 7f8cd3c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8ccc06c840 con 0x7f8ccc06f2b0 2024-03-28T21:53:21.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.335+0000 7f8cd3c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8ccc162cd0 con 0x7f8ccc161f00 2024-03-28T21:53:21.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.336+0000 7f8cd1c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ccc1622e0 0x7f8ccc0b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.336+0000 7f8cd1c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ccc1622e0 0x7f8ccc0b6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58546/0 (socket says 172.21.15.153:58546) 2024-03-28T21:53:21.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.336+0000 7f8cd1c00640 1 -- 172.21.15.153:0/2263671391 learned_addr learned my addr 172.21.15.153:0/2263671391 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:21.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.336+0000 7f8cd1200640 1 --2- 172.21.15.153:0/2263671391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ccc06f2b0 0x7f8ccc0aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.336+0000 7f8ccbe00640 1 --2- 172.21.15.153:0/2263671391 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ccc161f00 0x7f8ccc0af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.336+0000 7f8cd1c00640 1 -- 172.21.15.153:0/2263671391 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ccc161f00 msgr2=0x7f8ccc0af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:21.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.336+0000 7f8cd1c00640 1 --2- 172.21.15.153:0/2263671391 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ccc161f00 0x7f8ccc0af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.336+0000 7f8cd1c00640 1 -- 172.21.15.153:0/2263671391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ccc06f2b0 msgr2=0x7f8ccc0aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:21.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.336+0000 7f8cd1c00640 1 --2- 172.21.15.153:0/2263671391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ccc06f2b0 0x7f8ccc0aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.336+0000 7f8cd1c00640 1 -- 172.21.15.153:0/2263671391 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ccc1f7420 con 0x7f8ccc1622e0 2024-03-28T21:53:21.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.337+0000 7f8cd1c00640 1 --2- 172.21.15.153:0/2263671391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ccc1622e0 0x7f8ccc0b6f60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400c700 tx=0x7f8cc400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:21.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.337+0000 7f8cc8c00640 1 -- 172.21.15.153:0/2263671391 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4018070 con 0x7f8ccc1622e0 2024-03-28T21:53:21.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.337+0000 7f8cc8c00640 1 -- 172.21.15.153:0/2263671391 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc400ce10 con 0x7f8ccc1622e0 2024-03-28T21:53:21.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.337+0000 7f8cc8c00640 1 -- 172.21.15.153:0/2263671391 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc400a860 con 0x7f8ccc1622e0 2024-03-28T21:53:21.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.337+0000 7f8cd3c00640 1 -- 172.21.15.153:0/2263671391 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ccc1f7700 con 0x7f8ccc1622e0 2024-03-28T21:53:21.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.337+0000 7f8cd3c00640 1 -- 172.21.15.153:0/2263671391 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ccc1f7cc0 con 0x7f8ccc1622e0 2024-03-28T21:53:21.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.339+0000 7f8cc8c00640 1 -- 172.21.15.153:0/2263671391 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f8cc401b070 con 0x7f8ccc1622e0 2024-03-28T21:53:21.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.340+0000 7f8cc8c00640 1 --2- 172.21.15.153:0/2263671391 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8cac06b4d0 0x7f8cac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.340+0000 7f8cc8c00640 1 -- 172.21.15.153:0/2263671391 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f8cc40898a0 con 0x7f8ccc1622e0 2024-03-28T21:53:21.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.340+0000 7f8cd1200640 1 --2- 172.21.15.153:0/2263671391 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8cac06b4d0 0x7f8cac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.341+0000 7f8cd1200640 1 --2- 172.21.15.153:0/2263671391 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8cac06b4d0 0x7f8cac06d990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc006fd0 tx=0x7f8cbc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:21.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.343+0000 7f8cd6826740 1 Processor -- start 2024-03-28T21:53:21.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.343+0000 7f8cd6826740 1 -- start start 2024-03-28T21:53:21.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.344+0000 7f8cd6826740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd0c310 0x56198dd0c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.344+0000 7f8cd6826740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdc5c0 0x56198dd09580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.344+0000 7f8cd6826740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dcdfe90 0x56198dd09ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.344+0000 7f8cd6826740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56198dc459c0 con 0x56198dd0c310 2024-03-28T21:53:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.344+0000 7f8cd6826740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56198dbeec30 con 0x56198dcdc5c0 2024-03-28T21:53:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.344+0000 7f8cd6826740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56198dc41a60 con 0x56198dcdfe90 2024-03-28T21:53:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.345+0000 7f8cd1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd0c310 0x56198dd0c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.345+0000 7f8cd1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd0c310 0x56198dd0c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58558/0 (socket says 172.21.15.153:58558) 2024-03-28T21:53:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.345+0000 7f8cd1200640 1 -- 172.21.15.153:0/1788326756 learned_addr learned my addr 172.21.15.153:0/1788326756 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.345+0000 7f8ccbe00640 1 --2- 172.21.15.153:0/1788326756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdc5c0 0x56198dd09580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.345+0000 7f8cd1200640 1 -- 172.21.15.153:0/1788326756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dcdfe90 msgr2=0x56198dd09ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.345+0000 7f8cd1c00640 1 --2- 172.21.15.153:0/1788326756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dcdfe90 0x56198dd09ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.345+0000 7f8cd1200640 1 --2- 172.21.15.153:0/1788326756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dcdfe90 0x56198dd09ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.345+0000 7f8cd1200640 1 -- 172.21.15.153:0/1788326756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdc5c0 msgr2=0x56198dd09580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.345+0000 7f8cd1200640 1 --2- 172.21.15.153:0/1788326756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdc5c0 0x56198dd09580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.345+0000 7f8cd1200640 1 -- 172.21.15.153:0/1788326756 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56198d95a2d0 con 0x56198dd0c310 2024-03-28T21:53:21.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.345+0000 7f8ccbe00640 1 --2- 172.21.15.153:0/1788326756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdc5c0 0x56198dd09580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:21.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.345+0000 7f8cd1200640 1 --2- 172.21.15.153:0/1788326756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd0c310 0x56198dd0c6f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00f960 tx=0x7f8cbc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37fef443a6dec4 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.346+0000 7f8cc1600640 1 -- 172.21.15.153:0/1788326756 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc01b050 con 0x56198dd0c310 2024-03-28T21:53:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.346+0000 7f8cc1600640 1 -- 172.21.15.153:0/1788326756 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cbc025070 con 0x56198dd0c310 2024-03-28T21:53:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.346+0000 7f8cc1600640 1 -- 172.21.15.153:0/1788326756 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc014de0 con 0x56198dd0c310 2024-03-28T21:53:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.346+0000 7f8cd6826740 1 -- 172.21.15.153:0/1788326756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd0c310 msgr2=0x56198dd0c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.346+0000 7f8cd6826740 1 --2- 172.21.15.153:0/1788326756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd0c310 0x56198dd0c6f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00f960 tx=0x7f8cbc012000 comp rx=0 tx=0).stop 2024-03-28T21:53:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.347+0000 7f8cd6826740 1 -- 172.21.15.153:0/1788326756 shutdown_connections 2024-03-28T21:53:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.347+0000 7f8cd6826740 1 --2- 172.21.15.153:0/1788326756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dcdfe90 0x56198dd09ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.347+0000 7f8cd6826740 1 --2- 172.21.15.153:0/1788326756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdc5c0 0x56198dd09580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.347+0000 7f8cd6826740 1 --2- 172.21.15.153:0/1788326756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd0c310 0x56198dd0c6f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.347+0000 7f8cd6826740 1 -- 172.21.15.153:0/1788326756 >> 172.21.15.153:0/1788326756 conn(0x56198dcde830 msgr2=0x56198dd27120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:21.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.347+0000 7f8cd6826740 1 -- 172.21.15.153:0/1788326756 shutdown_connections 2024-03-28T21:53:21.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.347+0000 7f8cd6826740 1 -- 172.21.15.153:0/1788326756 wait complete. 2024-03-28T21:53:21.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.347+0000 7f8cd6826740 1 -- start start 2024-03-28T21:53:21.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.348+0000 7f8cd6826740 1 Processor -- start 2024-03-28T21:53:21.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.349+0000 7f8cd6826740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdfe90 0x56198dd0fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.349+0000 7f8cd6826740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dd0c310 0x56198dd07b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.349+0000 7f8cd6826740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd10110 0x56198dd080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.349+0000 7f8cd6826740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56198dce1040 con 0x56198dd10110 2024-03-28T21:53:21.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.349+0000 7f8cd6826740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56198dbe4180 con 0x56198dcdfe90 2024-03-28T21:53:21.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.349+0000 7f8cd6826740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56198dce0430 con 0x56198dd0c310 2024-03-28T21:53:21.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.349+0000 7f8cd6826740 10 client.0 _ll_register_callbacks cb 0x56198d959ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T21:53:21.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.350+0000 7f8cd1c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd10110 0x56198dd080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.350+0000 7f8cd1c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd10110 0x56198dd080d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58560/0 (socket says 172.21.15.153:58560) 2024-03-28T21:53:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.350+0000 7f8cd1c00640 1 -- 172.21.15.153:0/694278753 learned_addr learned my addr 172.21.15.153:0/694278753 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.350+0000 7f8cd1200640 1 --2- 172.21.15.153:0/694278753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdfe90 0x56198dd0fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.350+0000 7f8ccbe00640 1 --2- 172.21.15.153:0/694278753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dd0c310 0x56198dd07b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.350+0000 7f8cd1c00640 1 -- 172.21.15.153:0/694278753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dd0c310 msgr2=0x56198dd07b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.350+0000 7f8cd1c00640 1 --2- 172.21.15.153:0/694278753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dd0c310 0x56198dd07b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.350+0000 7f8cd1c00640 1 -- 172.21.15.153:0/694278753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdfe90 msgr2=0x56198dd0fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.350+0000 7f8cd1c00640 1 --2- 172.21.15.153:0/694278753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdfe90 0x56198dd0fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.350+0000 7f8cd1c00640 1 -- 172.21.15.153:0/694278753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56198da246b0 con 0x56198dd10110 2024-03-28T21:53:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.350+0000 7f8cd1c00640 1 --2- 172.21.15.153:0/694278753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd10110 0x56198dd080d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4087d30 tx=0x7f8cc40587c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a774e5753937ebc7 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.350+0000 7f8cb6000640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-28T21:53:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.351+0000 7f8cb6000640 1 -- 172.21.15.153:0/694278753 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40575d0 con 0x56198dd10110 2024-03-28T21:53:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.351+0000 7f8cb6000640 1 -- 172.21.15.153:0/694278753 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f8cc4082d40 con 0x56198dd10110 2024-03-28T21:53:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.351+0000 7f8cd6826740 1 -- 172.21.15.153:0/694278753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cbc025070 con 0x56198dd10110 2024-03-28T21:53:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.351+0000 7f8cb6000640 1 -- 172.21.15.153:0/694278753 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8cc4060690 con 0x56198dd10110 2024-03-28T21:53:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.351+0000 7f8cd6826740 10 client.5277 fetch_fsmap learned FSMap version 17 2024-03-28T21:53:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.351+0000 7f8cd6826740 1 -- 172.21.15.153:0/694278753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x56198dd37d70 con 0x56198dd10110 2024-03-28T21:53:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.351+0000 7f8cb6000640 1 -- 172.21.15.153:0/694278753 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cbc025070 con 0x56198dd10110 2024-03-28T21:53:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.351+0000 7f8cb6000640 1 -- 172.21.15.153:0/694278753 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f8cc405e060 con 0x56198dd10110 2024-03-28T21:53:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.351+0000 7f8cd6826740 10 client.5277 fetch_fsmap finished waiting for FSMap version 17 2024-03-28T21:53:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.351+0000 7f8cd6826740 10 client.5277 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-28T21:53:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.351+0000 7f8cd6826740 20 client.5277 populate_metadata read hostname 'smithi153' 2024-03-28T21:53:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.351+0000 7f8cd6826740 1 --2- 172.21.15.153:0/694278753 >> [v2:172.21.15.153:6834/1209499946,v1:172.21.15.153:6837/1209499946] conn(0x56198dd043a0 0x56198dd461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.351+0000 7f8cd6826740 4 client.5277 mds_command: new command op to 5070 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T21:53:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.351+0000 7f8cd6826740 1 -- 172.21.15.153:0/694278753 --> [v2:172.21.15.153:6834/1209499946,v1:172.21.15.153:6837/1209499946] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56198dc52f00 con 0x56198dd043a0 2024-03-28T21:53:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.352+0000 7f8cd1200640 1 --2- 172.21.15.153:0/694278753 >> [v2:172.21.15.153:6834/1209499946,v1:172.21.15.153:6837/1209499946] conn(0x56198dd043a0 0x56198dd461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.352+0000 7f8cd1200640 1 --2- 172.21.15.153:0/694278753 >> [v2:172.21.15.153:6834/1209499946,v1:172.21.15.153:6837/1209499946] conn(0x56198dd043a0 0x56198dd461c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=861004e87326b9c4 server_cookie=e52ad23427f51c3c in_seq=0 out_seq=0 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.352+0000 7f8cb6000640 10 client.5277 ms_handle_connect on v2:172.21.15.153:6834/1209499946 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.353+0000 7f8cb6000640 1 -- 172.21.15.153:0/694278753 <== mds.0 v2:172.21.15.153:6834/1209499946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56198dc52f00 con 0x56198dd043a0 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.353+0000 7f8cb6000640 10 client.5277 handle_command_reply: tid=0 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.353+0000 7f8cd6826740 1 client.5277 shutdown 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.353+0000 7f8cd6826740 1 -- 172.21.15.153:0/694278753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd10110 msgr2=0x56198dd080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.353+0000 7f8cd6826740 1 --2- 172.21.15.153:0/694278753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd10110 0x56198dd080d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4087d30 tx=0x7f8cc40587c0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.353+0000 7f8cd6826740 1 -- 172.21.15.153:0/694278753 shutdown_connections 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.353+0000 7f8cd6826740 1 --2- 172.21.15.153:0/694278753 >> [v2:172.21.15.153:6834/1209499946,v1:172.21.15.153:6837/1209499946] conn(0x56198dd043a0 0x56198dd461c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.353+0000 7f8cd6826740 1 --2- 172.21.15.153:0/694278753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd10110 0x56198dd080d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.353+0000 7f8cd6826740 1 --2- 172.21.15.153:0/694278753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dd0c310 0x56198dd07b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.353+0000 7f8cd6826740 1 --2- 172.21.15.153:0/694278753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdfe90 0x56198dd0fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.353+0000 7f8cb6000640 0 client.5277 ms_handle_reset on v2:172.21.15.153:6834/1209499946 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.353+0000 7f8cd6826740 1 -- 172.21.15.153:0/694278753 >> 172.21.15.153:0/694278753 conn(0x56198dcdc5c0 msgr2=0x56198dd286c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.353+0000 7f8cd6826740 1 -- 172.21.15.153:0/694278753 shutdown_connections 2024-03-28T21:53:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.354+0000 7f8cd6826740 1 -- 172.21.15.153:0/694278753 wait complete. 2024-03-28T21:53:21.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.354+0000 7f8cd6826740 20 client.5277 trim_cache size 0 max 16384 2024-03-28T21:53:21.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.373+0000 7f8cd6826740 1 Processor -- start 2024-03-28T21:53:21.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.373+0000 7f8cd6826740 1 -- start start 2024-03-28T21:53:21.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.374+0000 7f8cd6826740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdfe90 0x56198dd0d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.374+0000 7f8cd6826740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dd0c310 0x56198dd080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.374+0000 7f8cd6826740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd10110 0x56198dd283b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.374+0000 7f8cd6826740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ccc2007a0 con 0x56198dd10110 2024-03-28T21:53:21.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.374+0000 7f8cd6826740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8ccc1ff820 con 0x56198dcdfe90 2024-03-28T21:53:21.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.374+0000 7f8cd6826740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8ccc1f4a00 con 0x56198dd0c310 2024-03-28T21:53:21.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.375+0000 7f8cd1c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd10110 0x56198dd283b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.375+0000 7f8cd1c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd10110 0x56198dd283b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58574/0 (socket says 172.21.15.153:58574) 2024-03-28T21:53:21.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.375+0000 7f8cd1c00640 1 -- 172.21.15.153:0/2358206709 learned_addr learned my addr 172.21.15.153:0/2358206709 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:21.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.375+0000 7f8cd1c00640 1 -- 172.21.15.153:0/2358206709 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dd0c310 msgr2=0x56198dd080c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:21.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.375+0000 7f8cd1c00640 1 --2- 172.21.15.153:0/2358206709 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dd0c310 0x56198dd080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.375+0000 7f8cd1c00640 1 -- 172.21.15.153:0/2358206709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdfe90 msgr2=0x56198dd0d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:21.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.375+0000 7f8cd1c00640 1 --2- 172.21.15.153:0/2358206709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdfe90 0x56198dd0d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.375+0000 7f8cd1c00640 1 -- 172.21.15.153:0/2358206709 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56198dc79e50 con 0x56198dd10110 2024-03-28T21:53:21.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.376+0000 7f8cd1c00640 1 --2- 172.21.15.153:0/2358206709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd10110 0x56198dd283b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4058830 tx=0x7f8cc4009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203cda6d755d8edf server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:21.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.376+0000 7f8cc0c00640 1 -- 172.21.15.153:0/2358206709 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc407b070 con 0x56198dd10110 2024-03-28T21:53:21.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.376+0000 7f8cc0c00640 1 -- 172.21.15.153:0/2358206709 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc4076e50 con 0x56198dd10110 2024-03-28T21:53:21.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.376+0000 7f8cc0c00640 1 -- 172.21.15.153:0/2358206709 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40575f0 con 0x56198dd10110 2024-03-28T21:53:21.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.377+0000 7f8cd6826740 1 -- 172.21.15.153:0/2358206709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd10110 msgr2=0x56198dd283b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:21.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.377+0000 7f8cd6826740 1 --2- 172.21.15.153:0/2358206709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd10110 0x56198dd283b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4058830 tx=0x7f8cc4009070 comp rx=0 tx=0).stop 2024-03-28T21:53:21.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.377+0000 7f8cd6826740 1 -- 172.21.15.153:0/2358206709 shutdown_connections 2024-03-28T21:53:21.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.377+0000 7f8cd6826740 1 --2- 172.21.15.153:0/2358206709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd10110 0x56198dd283b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.377+0000 7f8cd6826740 1 --2- 172.21.15.153:0/2358206709 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dd0c310 0x56198dd080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.377+0000 7f8cd6826740 1 --2- 172.21.15.153:0/2358206709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dcdfe90 0x56198dd0d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.377+0000 7f8cd6826740 1 -- 172.21.15.153:0/2358206709 >> 172.21.15.153:0/2358206709 conn(0x56198dcdc5c0 msgr2=0x56198dcdd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:21.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.377+0000 7f8cd6826740 1 -- 172.21.15.153:0/2358206709 shutdown_connections 2024-03-28T21:53:21.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.377+0000 7f8cd6826740 1 -- 172.21.15.153:0/2358206709 wait complete. 2024-03-28T21:53:21.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.378+0000 7f8cd6826740 1 -- start start 2024-03-28T21:53:21.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.378+0000 7f8cd6826740 1 Processor -- start 2024-03-28T21:53:21.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.379+0000 7f8cd6826740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dcdfe90 0x56198dd3d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.379+0000 7f8cd6826740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd0c310 0x56198dda4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.379+0000 7f8cd6826740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dd10110 0x56198dd283b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.379+0000 7f8cd6826740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56198dd02070 con 0x56198dd0c310 2024-03-28T21:53:21.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.379+0000 7f8cd6826740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8ccc1f5fe0 con 0x56198dd10110 2024-03-28T21:53:21.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.379+0000 7f8cd6826740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56198dd38610 con 0x56198dcdfe90 2024-03-28T21:53:21.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.379+0000 7f8cd6826740 10 client.0 _ll_register_callbacks cb 0x7f8cc4001250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T21:53:21.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.379+0000 7f8ccbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd0c310 0x56198dda4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.379+0000 7f8ccbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd0c310 0x56198dda4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58580/0 (socket says 172.21.15.153:58580) 2024-03-28T21:53:21.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.379+0000 7f8ccbe00640 1 -- 172.21.15.153:0/3015431763 learned_addr learned my addr 172.21.15.153:0/3015431763 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:21.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.380+0000 7f8cd1c00640 1 --2- 172.21.15.153:0/3015431763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dd10110 0x56198dd283b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.380+0000 7f8cd1200640 1 --2- 172.21.15.153:0/3015431763 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dcdfe90 0x56198dd3d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.380+0000 7f8ccbe00640 1 -- 172.21.15.153:0/3015431763 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dcdfe90 msgr2=0x56198dd3d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:21.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.380+0000 7f8ccbe00640 1 --2- 172.21.15.153:0/3015431763 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dcdfe90 0x56198dd3d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.380+0000 7f8ccbe00640 1 -- 172.21.15.153:0/3015431763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dd10110 msgr2=0x56198dd283b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:21.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.380+0000 7f8ccbe00640 1 --2- 172.21.15.153:0/3015431763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dd10110 0x56198dd283b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.380+0000 7f8ccbe00640 1 -- 172.21.15.153:0/3015431763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56198dd34be0 con 0x56198dd0c310 2024-03-28T21:53:21.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.380+0000 7f8cd1200640 1 --2- 172.21.15.153:0/3015431763 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dcdfe90 0x56198dd3d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T21:53:21.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.380+0000 7f8ccbe00640 1 --2- 172.21.15.153:0/3015431763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd0c310 0x56198dda4440 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80097a0 tx=0x7f8cb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396d04b0e2eaac5e server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.380+0000 7f8cb6000640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.380+0000 7f8cb6000640 1 -- 172.21.15.153:0/3015431763 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb804a020 con 0x56198dd0c310 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.380+0000 7f8cb6000640 1 -- 172.21.15.153:0/3015431763 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f8cb8046640 con 0x56198dd0c310 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.380+0000 7f8cd6826740 1 -- 172.21.15.153:0/3015431763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cc4076e50 con 0x56198dd0c310 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.381+0000 7f8cb6000640 1 -- 172.21.15.153:0/3015431763 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8cb8006e10 con 0x56198dd0c310 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.381+0000 7f8cd6826740 10 client.5283 fetch_fsmap learned FSMap version 17 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.381+0000 7f8cd6826740 1 -- 172.21.15.153:0/3015431763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x56198dd08190 con 0x56198dd0c310 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.381+0000 7f8cb6000640 1 -- 172.21.15.153:0/3015431763 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc4076e50 con 0x56198dd0c310 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.381+0000 7f8cb6000640 1 -- 172.21.15.153:0/3015431763 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f8cb8031070 con 0x56198dd0c310 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.381+0000 7f8cd6826740 10 client.5283 fetch_fsmap finished waiting for FSMap version 17 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.381+0000 7f8cd6826740 10 client.5283 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.381+0000 7f8cd6826740 20 client.5283 populate_metadata read hostname 'smithi153' 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.381+0000 7f8cd6826740 1 --2- 172.21.15.153:0/3015431763 >> [v2:172.21.15.153:6834/1209499946,v1:172.21.15.153:6837/1209499946] conn(0x56198ddaace0 0x56198ddad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.381+0000 7f8cd6826740 4 client.5283 mds_command: new command op to 5070 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-28T21:53:21.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.381+0000 7f8cd6826740 1 -- 172.21.15.153:0/3015431763 --> [v2:172.21.15.153:6834/1209499946,v1:172.21.15.153:6837/1209499946] -- command(tid 0: {"prefix": "status"}) -- 0x56198dcdcdc0 con 0x56198ddaace0 2024-03-28T21:53:21.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.382+0000 7f8cd1200640 1 --2- 172.21.15.153:0/3015431763 >> [v2:172.21.15.153:6834/1209499946,v1:172.21.15.153:6837/1209499946] conn(0x56198ddaace0 0x56198ddad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.382+0000 7f8cd1200640 1 --2- 172.21.15.153:0/3015431763 >> [v2:172.21.15.153:6834/1209499946,v1:172.21.15.153:6837/1209499946] conn(0x56198ddaace0 0x56198ddad0d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10e31fad1add01fb server_cookie=8ace4b14300f49b4 in_seq=0 out_seq=0 2024-03-28T21:53:21.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.382+0000 7f8cb6000640 10 client.5283 ms_handle_connect on v2:172.21.15.153:6834/1209499946 2024-03-28T21:53:21.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.382+0000 7f8cb6000640 1 -- 172.21.15.153:0/3015431763 <== mds.0 v2:172.21.15.153:6834/1209499946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56198dcdcdc0 con 0x56198ddaace0 2024-03-28T21:53:21.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.382+0000 7f8cb6000640 10 client.5283 handle_command_reply: tid=0 2024-03-28T21:53:21.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.382+0000 7f8cd6826740 1 client.5283 shutdown 2024-03-28T21:53:21.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.383+0000 7f8cd6826740 1 -- 172.21.15.153:0/3015431763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd0c310 msgr2=0x56198dda4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:21.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.383+0000 7f8cd6826740 1 --2- 172.21.15.153:0/3015431763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd0c310 0x56198dda4440 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80097a0 tx=0x7f8cb80046c0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.383+0000 7f8cd6826740 1 -- 172.21.15.153:0/3015431763 shutdown_connections 2024-03-28T21:53:21.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.383+0000 7f8cd6826740 1 --2- 172.21.15.153:0/3015431763 >> [v2:172.21.15.153:6834/1209499946,v1:172.21.15.153:6837/1209499946] conn(0x56198ddaace0 0x56198ddad0d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.383+0000 7f8cd6826740 1 --2- 172.21.15.153:0/3015431763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56198dd10110 0x56198dd283b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.383+0000 7f8cd6826740 1 --2- 172.21.15.153:0/3015431763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56198dd0c310 0x56198dda4440 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.383+0000 7f8cd6826740 1 --2- 172.21.15.153:0/3015431763 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56198dcdfe90 0x56198dd3d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.383+0000 7f8cb6000640 0 client.5283 ms_handle_reset on v2:172.21.15.153:6834/1209499946 2024-03-28T21:53:21.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.383+0000 7f8cd6826740 1 -- 172.21.15.153:0/3015431763 >> 172.21.15.153:0/3015431763 conn(0x56198dcdc5c0 msgr2=0x56198dd0f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:21.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.383+0000 7f8cd6826740 1 -- 172.21.15.153:0/3015431763 shutdown_connections 2024-03-28T21:53:21.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.383+0000 7f8cd6826740 1 -- 172.21.15.153:0/3015431763 wait complete. 2024-03-28T21:53:21.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.383+0000 7f8cd6826740 20 client.5283 trim_cache size 0 max 16384 2024-03-28T21:53:21.388 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-28T21:53:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "2549e48d-ef7b-419c-89c4-4d0726d7d873", 2024-03-28T21:53:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2024-03-28T21:53:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5070, 2024-03-28T21:53:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2024-03-28T21:53:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2024-03-28T21:53:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2024-03-28T21:53:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 11.796685202000001, 2024-03-28T21:53:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 17, 2024-03-28T21:53:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 35, 2024-03-28T21:53:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 35, 2024-03-28T21:53:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 20.619465498 2024-03-28T21:53:21.389 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-28T21:53:21.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.384+0000 7f8cd3c00640 1 -- 172.21.15.153:0/2263671391 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8cac06b4d0 msgr2=0x7f8cac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:21.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.384+0000 7f8cd3c00640 1 --2- 172.21.15.153:0/2263671391 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8cac06b4d0 0x7f8cac06d990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc006fd0 tx=0x7f8cbc008040 comp rx=0 tx=0).stop 2024-03-28T21:53:21.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.384+0000 7f8cd3c00640 1 -- 172.21.15.153:0/2263671391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ccc1622e0 msgr2=0x7f8ccc0b6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:21.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.384+0000 7f8cd3c00640 1 --2- 172.21.15.153:0/2263671391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ccc1622e0 0x7f8ccc0b6f60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400c700 tx=0x7f8cc400cbc0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.384+0000 7f8cd3c00640 1 -- 172.21.15.153:0/2263671391 shutdown_connections 2024-03-28T21:53:21.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.384+0000 7f8cd3c00640 1 --2- 172.21.15.153:0/2263671391 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f8cac06b4d0 0x7f8cac06d990 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.384+0000 7f8cd3c00640 1 --2- 172.21.15.153:0/2263671391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ccc1622e0 0x7f8ccc0b6f60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.384+0000 7f8cd3c00640 1 --2- 172.21.15.153:0/2263671391 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ccc161f00 0x7f8ccc0af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.384+0000 7f8cd3c00640 1 --2- 172.21.15.153:0/2263671391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ccc06f2b0 0x7f8ccc0aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.384+0000 7f8cd3c00640 1 -- 172.21.15.153:0/2263671391 >> 172.21.15.153:0/2263671391 conn(0x7f8ccc0b3950 msgr2=0x7f8ccc0b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:21.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.384+0000 7f8cd3c00640 1 -- 172.21.15.153:0/2263671391 shutdown_connections 2024-03-28T21:53:21.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.384+0000 7f8cd3c00640 1 -- 172.21.15.153:0/2263671391 wait complete. 2024-03-28T21:53:21.402 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-28T21:53:21.426 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:53:21.453 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:53:21.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.598+0000 7f2f7a800640 1 Processor -- start 2024-03-28T21:53:21.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.598+0000 7f2f7a800640 1 -- start start 2024-03-28T21:53:21.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.599+0000 7f2f7a800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2f7415ade0 0x7f2f740acd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.599+0000 7f2f7a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f7415ef20 0x7f2f7415f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.599+0000 7f2f7a800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f7415ea70 con 0x7f2f740ae8e0 2024-03-28T21:53:21.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.599+0000 7f2f7a800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f2f740aee50 con 0x7f2f7415ade0 2024-03-28T21:53:21.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.599+0000 7f2f7a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2f740af130 con 0x7f2f7415ef20 2024-03-28T21:53:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.600+0000 7f2f6be00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2f740ae8e0 0x7f2f740b3f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59150/0 (socket says 172.21.15.153:59150) 2024-03-28T21:53:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.600+0000 7f2f73400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2f7415ade0 0x7f2f740acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.600+0000 7f2f6be00640 1 -- 172.21.15.153:0/3821008029 learned_addr learned my addr 172.21.15.153:0/3821008029 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:53:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.600+0000 7f2f73e00640 1 --2- 172.21.15.153:0/3821008029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f7415ef20 0x7f2f7415f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.600+0000 7f2f72a00640 1 -- 172.21.15.153:0/3821008029 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3380836750 0 0) 0x7f2f7415ea70 con 0x7f2f740ae8e0 2024-03-28T21:53:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.600+0000 7f2f73400640 1 -- 172.21.15.153:0/3821008029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f7415ef20 msgr2=0x7f2f7415f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:53:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.600+0000 7f2f73400640 1 --2- 172.21.15.153:0/3821008029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f7415ef20 0x7f2f7415f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.600+0000 7f2f73400640 1 -- 172.21.15.153:0/3821008029 >> v1:172.21.15.153:6789/0 conn(0x7f2f740ae8e0 legacy=0x7f2f740b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.600+0000 7f2f73400640 1 -- 172.21.15.153:0/3821008029 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f740af410 con 0x7f2f7415ade0 2024-03-28T21:53:21.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.602+0000 7f2f73400640 1 --2- 172.21.15.153:0/3821008029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f7415ade0 0x7f2f740acd80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2f640097a0 tx=0x7f2f6402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84ad95852de8b6f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:21.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.602+0000 7f2f72a00640 1 -- 172.21.15.153:0/3821008029 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64035020 con 0x7f2f7415ade0 2024-03-28T21:53:21.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.602+0000 7f2f72a00640 1 -- 172.21.15.153:0/3821008029 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f64031830 con 0x7f2f7415ade0 2024-03-28T21:53:21.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.602+0000 7f2f72a00640 1 -- 172.21.15.153:0/3821008029 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64031c00 con 0x7f2f7415ade0 2024-03-28T21:53:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.603+0000 7f2f7a800640 1 -- 172.21.15.153:0/3821008029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f7415ade0 msgr2=0x7f2f740acd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.603+0000 7f2f7a800640 1 --2- 172.21.15.153:0/3821008029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f7415ade0 0x7f2f740acd80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2f640097a0 tx=0x7f2f6402b8d0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.603+0000 7f2f7a800640 1 -- 172.21.15.153:0/3821008029 shutdown_connections 2024-03-28T21:53:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.603+0000 7f2f7a800640 1 --2- 172.21.15.153:0/3821008029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f7415ef20 0x7f2f7415f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.603+0000 7f2f7a800640 1 --2- 172.21.15.153:0/3821008029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f7415ade0 0x7f2f740acd80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.603+0000 7f2f7a800640 1 -- 172.21.15.153:0/3821008029 >> 172.21.15.153:0/3821008029 conn(0x7f2f740b1a30 msgr2=0x7f2f740b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.603+0000 7f2f7a800640 1 -- 172.21.15.153:0/3821008029 shutdown_connections 2024-03-28T21:53:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.603+0000 7f2f7a800640 1 -- 172.21.15.153:0/3821008029 wait complete. 2024-03-28T21:53:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.605+0000 7f2f7a800640 1 Processor -- start 2024-03-28T21:53:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.605+0000 7f2f7a800640 1 -- start start 2024-03-28T21:53:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.606+0000 7f2f7a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f740ae8e0 0x7f2f7415d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.606+0000 7f2f7a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f7415ade0 0x7f2f74159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.606+0000 7f2f7a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f7415ef20 0x7f2f7414e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.606+0000 7f2f7a800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2f740af6f0 con 0x7f2f740ae8e0 2024-03-28T21:53:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.606+0000 7f2f7a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2f740ad2c0 con 0x7f2f7415ade0 2024-03-28T21:53:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.606+0000 7f2f7a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7415b1c0 con 0x7f2f7415ef20 2024-03-28T21:53:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.606+0000 7f2f73400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f740ae8e0 0x7f2f7415d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.606+0000 7f2f73400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f740ae8e0 0x7f2f7415d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58584/0 (socket says 172.21.15.153:58584) 2024-03-28T21:53:21.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.606+0000 7f2f73400640 1 -- 172.21.15.153:0/3378242200 learned_addr learned my addr 172.21.15.153:0/3378242200 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:53:21.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.607+0000 7f2f73400640 1 -- 172.21.15.153:0/3378242200 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f7415ef20 msgr2=0x7f2f7414e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:21.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.607+0000 7f2f73400640 1 --2- 172.21.15.153:0/3378242200 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f7415ef20 0x7f2f7414e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.607+0000 7f2f73400640 1 -- 172.21.15.153:0/3378242200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f7415ade0 msgr2=0x7f2f74159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:21.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.607+0000 7f2f73400640 1 --2- 172.21.15.153:0/3378242200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f7415ade0 0x7f2f74159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:21.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.607+0000 7f2f73400640 1 -- 172.21.15.153:0/3378242200 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f74157df0 con 0x7f2f740ae8e0 2024-03-28T21:53:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.607+0000 7f2f73400640 1 --2- 172.21.15.153:0/3378242200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f740ae8e0 0x7f2f7415d750 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2f6402bee0 tx=0x7f2f640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.607+0000 7f2f6b400640 1 -- 172.21.15.153:0/3378242200 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64041070 con 0x7f2f740ae8e0 2024-03-28T21:53:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.607+0000 7f2f6b400640 1 -- 172.21.15.153:0/3378242200 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6403b920 con 0x7f2f740ae8e0 2024-03-28T21:53:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.607+0000 7f2f7a800640 1 -- 172.21.15.153:0/3378242200 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f741580d0 con 0x7f2f740ae8e0 2024-03-28T21:53:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.607+0000 7f2f6b400640 1 -- 172.21.15.153:0/3378242200 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64035040 con 0x7f2f740ae8e0 2024-03-28T21:53:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.607+0000 7f2f7a800640 1 -- 172.21.15.153:0/3378242200 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f74158690 con 0x7f2f740ae8e0 2024-03-28T21:53:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.609+0000 7f2f7a800640 1 -- 172.21.15.153:0/3378242200 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f74068ff0 con 0x7f2f740ae8e0 2024-03-28T21:53:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.610+0000 7f2f6b400640 1 -- 172.21.15.153:0/3378242200 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f2f6404c060 con 0x7f2f740ae8e0 2024-03-28T21:53:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.610+0000 7f2f6b400640 1 --2- 172.21.15.153:0/3378242200 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2f5006b4d0 0x7f2f5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:53:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.611+0000 7f2f6b400640 1 -- 172.21.15.153:0/3378242200 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f2f640abc30 con 0x7f2f740ae8e0 2024-03-28T21:53:21.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.611+0000 7f2f6be00640 1 --2- 172.21.15.153:0/3378242200 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2f5006b4d0 0x7f2f5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:53:21.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.611+0000 7f2f6be00640 1 --2- 172.21.15.153:0/3378242200 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2f5006b4d0 0x7f2f5006d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c007fd0 tx=0x7f2f5c007920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:53:21.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:21.615+0000 7f2f6b400640 1 -- 172.21.15.153:0/3378242200 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2f6407aa20 con 0x7f2f740ae8e0 2024-03-28T21:53:22.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22.006+0000 7f2f7a800640 1 -- 172.21.15.153:0/3378242200 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2f740b28a0 con 0x7f2f740ae8e0 2024-03-28T21:53:22.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22.007+0000 7f2f6b400640 1 -- 172.21.15.153:0/3378242200 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f2f6407a320 con 0x7f2f740ae8e0 2024-03-28T21:53:22.008 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-28T21:53:22.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22.009+0000 7f2f7a800640 1 -- 172.21.15.153:0/3378242200 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2f5006b4d0 msgr2=0x7f2f5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:22.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22.009+0000 7f2f7a800640 1 --2- 172.21.15.153:0/3378242200 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2f5006b4d0 0x7f2f5006d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c007fd0 tx=0x7f2f5c007920 comp rx=0 tx=0).stop 2024-03-28T21:53:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22.009+0000 7f2f7a800640 1 -- 172.21.15.153:0/3378242200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f740ae8e0 msgr2=0x7f2f7415d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:53:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22.009+0000 7f2f7a800640 1 --2- 172.21.15.153:0/3378242200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f740ae8e0 0x7f2f7415d750 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2f6402bee0 tx=0x7f2f640046c0 comp rx=0 tx=0).stop 2024-03-28T21:53:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22.009+0000 7f2f7a800640 1 -- 172.21.15.153:0/3378242200 shutdown_connections 2024-03-28T21:53:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22.009+0000 7f2f7a800640 1 --2- 172.21.15.153:0/3378242200 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f2f5006b4d0 0x7f2f5006d990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22.009+0000 7f2f7a800640 1 --2- 172.21.15.153:0/3378242200 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f7415ef20 0x7f2f7414e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22.009+0000 7f2f7a800640 1 --2- 172.21.15.153:0/3378242200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f7415ade0 0x7f2f74159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22.009+0000 7f2f7a800640 1 --2- 172.21.15.153:0/3378242200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f740ae8e0 0x7f2f7415d750 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:53:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22.009+0000 7f2f7a800640 1 -- 172.21.15.153:0/3378242200 >> 172.21.15.153:0/3378242200 conn(0x7f2f740b1a30 msgr2=0x7f2f74071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:53:22.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22.009+0000 7f2f7a800640 1 -- 172.21.15.153:0/3378242200 shutdown_connections 2024-03-28T21:53:22.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22.010+0000 7f2f7a800640 1 -- 172.21.15.153:0/3378242200 wait complete. 2024-03-28T21:53:22.029 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-28T21:53:22.029 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-28T21:53:22.029 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-03-28T21:53:22.029 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-28T21:53:22.029 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-28T21:53:22.029 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-28T21:53:22.029 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-28T21:53:22.030 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-28T21:53:22.030 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-28T21:53:22.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:53:22.030 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-03-28T21:53:22.123 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-28T21:53:22.123 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-28T21:53:22.123 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-03-28T21:53:22.123 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:53:22.123 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-03-28T21:53:22.123 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:53:22.123 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:53:22.123 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:53:22.123 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-03-28T21:53:22.123 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:53:22.123 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42499sec preferred_lft 42499sec 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 2a:9f:2c:04:d2:5c brd ff:ff:ff:ff:ff:ff 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::3485:dcff:fe35:8e7b/64 scope link 2024-03-28T21:53:22.124 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:53:22.125 INFO:teuthology.orchestra.run.smithi153.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-28T21:53:22.125 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 2a:9f:2c:04:d2:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-28T21:53:22.125 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::289f:2cff:fe04:d25c/64 scope link 2024-03-28T21:53:22.125 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:53:22.125 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-28T21:53:22.125 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 8e:76:72:a6:20:a8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-28T21:53:22.125 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::8c76:72ff:fea6:20a8/64 scope link 2024-03-28T21:53:22.125 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-03-28T21:53:22.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:53:22.126 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-28T21:53:22.204 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-03-28T21:53:22.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:53:22.209 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-03-28T21:53:22.253 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-03-28T21:53:22.253 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-28T21:53:22.253 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-28T21:53:22.253 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-28T21:53:22.253 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-28T21:53:22.254 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T21:53:22.254 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-03-28T21:53:22.254 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-28T21:53:22.254 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-28T21:53:22.254 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-28T21:53:22.254 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-03-28T21:53:22.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T21:53:22.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:53:22.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:53:22.531 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-03-28T21:53:22.571 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-28T21:53:22.572 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-28T21:53:22.572 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-28T21:53:22.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:53:22.572 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-03-28T21:53:22.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T21:53:22.701 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-28T21:53:22.750 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-28T21:53:22.750 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T21:53:22.751 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-28T21:53:22.843 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-28T21:53:22.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:53:22.843 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-28T21:53:22.961 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-28T21:53:22.962 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-28T21:53:22.962 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-03-28T21:53:22.979 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-28T21:53:22.979 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-28T21:53:22.979 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-03-28T21:53:22.979 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-03-28T21:53:22.979 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-28T21:53:23.004 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-28T21:53:23.004 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-28T21:53:23.004 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-03-28T21:53:23.004 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-03-28T21:53:23.004 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-28T21:53:23.004 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.165:6789,172.21.15.165:6790" 2024-03-28T21:53:23.005 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.165:6789,172.21.15.165:6790:/ 2024-03-28T21:53:23.005 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=2549e48d-ef7b-419c-89c4-4d0726d7d873" will pass to kernel 2024-03-28T21:53:23.006 INFO:teuthology.orchestra.run.smithi153.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-28T21:53:23.006 INFO:teuthology.orchestra.run.smithi153.stdout: You just mounted a file system that supports labels which does not 2024-03-28T21:53:23.007 INFO:teuthology.orchestra.run.smithi153.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-28T21:53:23.007 INFO:teuthology.orchestra.run.smithi153.stdout: applications will generate AVC messages and not be allowed access to 2024-03-28T21:53:23.007 INFO:teuthology.orchestra.run.smithi153.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-28T21:53:23.011 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-28T21:53:23.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:53:23.011 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-28T21:53:23.093 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T21:53:23.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T21:53:23.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:53:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T21:53:23.219 INFO:teuthology.orchestra.run.smithi153.stdout:client4562 2024-03-28T21:53:23.219 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:53:23.219 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T21:53:23.268 DEBUG:teuthology.orchestra.run.smithi153:> mktemp -d --suffix=xfstests-dev 2024-03-28T21:53:23.361 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.0cGUU1Musyxfstests-dev 2024-03-28T21:53:23.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:53:23.362 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.0cGUU1Musyxfstests-dev) 2024-03-28T21:53:23.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:53:23.448 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.0cGUU1Musyxfstests-dev) 2024-03-28T21:53:23.500 INFO:teuthology.orchestra.run.smithi153.stderr:Cloning into '/tmp/tmp.0cGUU1Musyxfstests-dev'... 2024-03-28T21:53:24.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:53:24.553 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-03-28T21:53:24.612 DEBUG:teuthology.orchestra.run.smithi153:> mktemp -d --suffix=test 2024-03-28T21:53:24.655 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.l0v0NkF9eFtest 2024-03-28T21:53:24.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:53:24.656 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-03-28T21:53:24.750 DEBUG:teuthology.orchestra.run.smithi153:> mktemp -d --suffix=scratch 2024-03-28T21:53:24.795 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.qtMzJmHuchscratch 2024-03-28T21:53:24.796 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-03-28T21:53:24.796 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-03-28T21:53:25.687 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:04:18 ago on Thu 28 Mar 2024 09:49:07 PM UTC. 2024-03-28T21:53:25.817 INFO:teuthology.orchestra.run.smithi153.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-03-28T21:53:25.818 INFO:teuthology.orchestra.run.smithi153.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-03-28T21:53:25.818 INFO:teuthology.orchestra.run.smithi153.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-03-28T21:53:25.819 INFO:teuthology.orchestra.run.smithi153.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-03-28T21:53:25.820 INFO:teuthology.orchestra.run.smithi153.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-03-28T21:53:25.822 INFO:teuthology.orchestra.run.smithi153.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-03-28T21:53:25.824 INFO:teuthology.orchestra.run.smithi153.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-03-28T21:53:25.825 INFO:teuthology.orchestra.run.smithi153.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-03-28T21:53:25.827 INFO:teuthology.orchestra.run.smithi153.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-03-28T21:53:25.829 INFO:teuthology.orchestra.run.smithi153.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-03-28T21:53:25.830 INFO:teuthology.orchestra.run.smithi153.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-03-28T21:53:25.832 INFO:teuthology.orchestra.run.smithi153.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-03-28T21:53:25.833 INFO:teuthology.orchestra.run.smithi153.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-03-28T21:53:25.834 INFO:teuthology.orchestra.run.smithi153.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-03-28T21:53:25.835 INFO:teuthology.orchestra.run.smithi153.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-03-28T21:53:25.836 INFO:teuthology.orchestra.run.smithi153.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-03-28T21:53:25.837 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-03-28T21:53:25.838 INFO:teuthology.orchestra.run.smithi153.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-03-28T21:53:25.839 INFO:teuthology.orchestra.run.smithi153.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-03-28T21:53:25.842 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-03-28T21:53:25.913 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-03-28T21:53:25.917 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-03-28T21:53:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-03-28T21:53:25.917 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-03-28T21:53:25.917 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-03-28T21:53:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-03-28T21:53:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2024-03-28T21:53:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2024-03-28T21:53:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-03-28T21:53:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-devel x86_64 5.14.0-434.el9 CentOS-AppStream 16 M 2024-03-28T21:53:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2024-03-28T21:53:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: sqlite x86_64 3.34.1-7.el9 CentOS-AppStream 747 k 2024-03-28T21:53:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2024-03-28T21:53:25.918 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-03-28T21:53:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: cpp x86_64 11.4.1-3.el9 appstream 11 M 2024-03-28T21:53:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: device-mapper x86_64 9:1.02.197-2.el9 baseos 141 k 2024-03-28T21:53:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: device-mapper-event x86_64 9:1.02.197-2.el9 baseos 34 k 2024-03-28T21:53:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: device-mapper-event-libs x86_64 9:1.02.197-2.el9 baseos 32 k 2024-03-28T21:53:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: device-mapper-libs x86_64 9:1.02.197-2.el9 baseos 179 k 2024-03-28T21:53:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: e2fsprogs x86_64 1.46.5-5.el9 baseos 1.0 M 2024-03-28T21:53:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: e2fsprogs-libs x86_64 1.46.5-5.el9 baseos 222 k 2024-03-28T21:53:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: gcc x86_64 11.4.1-3.el9 appstream 32 M 2024-03-28T21:53:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: gcc-c++ x86_64 11.4.1-3.el9 appstream 13 M 2024-03-28T21:53:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: gcc-plugin-annobin x86_64 11.4.1-3.el9 appstream 47 k 2024-03-28T21:53:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: git x86_64 2.43.0-1.el9 appstream 51 k 2024-03-28T21:53:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: git-core x86_64 2.43.0-1.el9 appstream 4.4 M 2024-03-28T21:53:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: git-core-doc noarch 2.43.0-1.el9 appstream 2.9 M 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: libcom_err x86_64 1.46.5-5.el9 baseos 26 k 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: libgcc x86_64 11.4.1-3.el9 baseos 92 k 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: libgomp x86_64 11.4.1-3.el9 baseos 268 k 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: libss x86_64 1.46.5-5.el9 baseos 32 k 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: libstdc++ x86_64 11.4.1-3.el9 baseos 743 k 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: libstdc++-devel x86_64 11.4.1-3.el9 appstream 2.4 M 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: lvm2 x86_64 9:2.03.23-2.el9 baseos 1.5 M 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: lvm2-libs x86_64 9:2.03.23-2.el9 baseos 1.0 M 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: make x86_64 1:4.3-8.el9 baseos 536 k 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: perl-Git noarch 2.43.0-1.el9 appstream 38 k 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: python-unversioned-command noarch 3.9.18-3.el9 CentOS-AppStream 8.3 k 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: python3 x86_64 3.9.18-3.el9 CentOS-BaseOS 25 k 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel x86_64 3.9.18-3.el9 CentOS-AppStream 204 k 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: python3-libs x86_64 3.9.18-3.el9 CentOS-BaseOS 7.3 M 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: sqlite-libs x86_64 3.34.1-7.el9 CentOS-BaseOS 619 k 2024-03-28T21:53:25.919 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-03-28T21:53:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2024-03-28T21:53:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-03-28T21:53:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2024-03-28T21:53:25.920 INFO:teuthology.orchestra.run.smithi153.stdout:Installing weak dependencies: 2024-03-28T21:53:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2024-03-28T21:53:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2024-03-28T21:53:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2024-03-28T21:53:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-28T21:53:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-28T21:53:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2024-03-28T21:53:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:25.920 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-03-28T21:53:25.920 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-03-28T21:53:25.920 INFO:teuthology.orchestra.run.smithi153.stdout:Install 17 Packages 2024-03-28T21:53:25.921 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 28 Packages 2024-03-28T21:53:25.921 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:53:25.921 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 103 M 2024-03-28T21:53:25.921 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-03-28T21:53:26.672 INFO:teuthology.orchestra.run.smithi153.stdout:(1/45): fio-engine-http-3.35-1.el9.x86_64.rpm 70 kB/s | 17 kB 00:00 2024-03-28T21:53:26.697 INFO:teuthology.orchestra.run.smithi153.stdout:(2/45): fio-engine-libaio-3.35-1.el9.x86_64.rpm 54 kB/s | 14 kB 00:00 2024-03-28T21:53:26.839 INFO:teuthology.orchestra.run.smithi153.stdout:(3/45): fio-engine-nbd-3.35-1.el9.x86_64.rpm 81 kB/s | 13 kB 00:00 2024-03-28T21:53:26.864 INFO:teuthology.orchestra.run.smithi153.stdout:(4/45): fio-engine-rados-3.35-1.el9.x86_64.rpm 88 kB/s | 15 kB 00:00 2024-03-28T21:53:27.014 INFO:teuthology.orchestra.run.smithi153.stdout:(5/45): fio-engine-rbd-3.35-1.el9.x86_64.rpm 87 kB/s | 15 kB 00:00 2024-03-28T21:53:27.048 INFO:teuthology.orchestra.run.smithi153.stdout:(6/45): fio-engine-rdma-3.35-1.el9.x86_64.rpm 110 kB/s | 20 kB 00:00 2024-03-28T21:53:27.173 INFO:teuthology.orchestra.run.smithi153.stdout:(7/45): fio-3.35-1.el9.x86_64.rpm 8.4 MB/s | 6.2 MB 00:00 2024-03-28T21:53:27.198 INFO:teuthology.orchestra.run.smithi153.stdout:(8/45): libcap-devel-2.48-9.el9.x86_64.rpm 226 kB/s | 33 kB 00:00 2024-03-28T21:53:27.357 INFO:teuthology.orchestra.run.smithi153.stdout:(9/45): udftools-2.2-5.el9.x86_64.rpm 987 kB/s | 144 kB 00:00 2024-03-28T21:53:27.400 INFO:teuthology.orchestra.run.smithi153.stdout:(10/45): sqlite-3.34.1-7.el9.x86_64.rpm 3.3 MB/s | 747 kB 00:00 2024-03-28T21:53:27.608 INFO:teuthology.orchestra.run.smithi153.stdout:(11/45): kernel-devel-5.14.0-434.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-03-28T21:53:27.633 INFO:teuthology.orchestra.run.smithi153.stdout:(12/45): rmt-1.6-6.el9.x86_64.rpm 167 kB/s | 45 kB 00:00 2024-03-28T21:53:27.991 INFO:teuthology.orchestra.run.smithi153.stdout:(13/45): gdbm-devel-1.19-4.el9.x86_64.rpm 164 kB/s | 59 kB 00:00 2024-03-28T21:53:28.058 INFO:teuthology.orchestra.run.smithi153.stdout:(14/45): libnbd-1.18.1-3.el9.x86_64.rpm 257 kB/s | 166 kB 00:00 2024-03-28T21:53:28.185 INFO:teuthology.orchestra.run.smithi153.stdout:(15/45): gdbm-1.19-4.el9.x86_64.rpm 240 kB/s | 132 kB 00:00 2024-03-28T21:53:28.292 INFO:teuthology.orchestra.run.smithi153.stdout:(16/45): python-unversioned-command-3.9.18-3.el 195 kB/s | 8.3 kB 00:00 2024-03-28T21:53:28.334 INFO:teuthology.orchestra.run.smithi153.stdout:(17/45): python3-devel-3.9.18-3.el9.x86_64.rpm 4.9 MB/s | 204 kB 00:00 2024-03-28T21:53:28.376 INFO:teuthology.orchestra.run.smithi153.stdout:(18/45): python3-3.9.18-3.el9.x86_64.rpm 612 kB/s | 25 kB 00:00 2024-03-28T21:53:28.401 INFO:teuthology.orchestra.run.smithi153.stdout:(19/45): dump-0.4-0.51.b47.el9.x86_64.rpm 215 kB/s | 88 kB 00:00 2024-03-28T21:53:28.502 INFO:teuthology.orchestra.run.smithi153.stdout:(20/45): sqlite-libs-3.34.1-7.el9.x86_64.rpm 6.9 MB/s | 619 kB 00:00 2024-03-28T21:53:28.636 INFO:teuthology.orchestra.run.smithi153.stdout:(21/45): python3-libs-3.9.18-3.el9.x86_64.rpm 28 MB/s | 7.3 MB 00:00 2024-03-28T21:53:28.669 INFO:teuthology.orchestra.run.smithi153.stdout:(22/45): indent-2.2.13-5.el9.x86_64.rpm 334 kB/s | 179 kB 00:00 2024-03-28T21:53:29.020 INFO:teuthology.orchestra.run.smithi153.stdout:(23/45): device-mapper-event-1.02.197-2.el9.x86 89 kB/s | 34 kB 00:00 2024-03-28T21:53:29.036 INFO:teuthology.orchestra.run.smithi153.stdout:(24/45): device-mapper-event-libs-1.02.197-2.el 88 kB/s | 32 kB 00:00 2024-03-28T21:53:29.112 INFO:teuthology.orchestra.run.smithi153.stdout:(25/45): device-mapper-1.02.197-2.el9.x86_64.rp 234 kB/s | 141 kB 00:00 2024-03-28T21:53:29.162 INFO:teuthology.orchestra.run.smithi153.stdout:(26/45): device-mapper-libs-1.02.197-2.el9.x86_ 1.2 MB/s | 179 kB 00:00 2024-03-28T21:53:29.229 INFO:teuthology.orchestra.run.smithi153.stdout:(27/45): libcom_err-1.46.5-5.el9.x86_64.rpm 401 kB/s | 26 kB 00:00 2024-03-28T21:53:29.279 INFO:teuthology.orchestra.run.smithi153.stdout:(28/45): e2fsprogs-libs-1.46.5-5.el9.x86_64.rpm 1.3 MB/s | 222 kB 00:00 2024-03-28T21:53:29.338 INFO:teuthology.orchestra.run.smithi153.stdout:(29/45): e2fsprogs-1.46.5-5.el9.x86_64.rpm 3.3 MB/s | 1.0 MB 00:00 2024-03-28T21:53:29.363 INFO:teuthology.orchestra.run.smithi153.stdout:(30/45): libgcc-11.4.1-3.el9.x86_64.rpm 695 kB/s | 92 kB 00:00 2024-03-28T21:53:29.405 INFO:teuthology.orchestra.run.smithi153.stdout:(31/45): libgomp-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 268 kB 00:00 2024-03-28T21:53:29.431 INFO:teuthology.orchestra.run.smithi153.stdout:(32/45): libss-1.46.5-5.el9.x86_64.rpm 349 kB/s | 32 kB 00:00 2024-03-28T21:53:29.506 INFO:teuthology.orchestra.run.smithi153.stdout:(33/45): libstdc++-11.4.1-3.el9.x86_64.rpm 5.1 MB/s | 743 kB 00:00 2024-03-28T21:53:29.581 INFO:teuthology.orchestra.run.smithi153.stdout:(34/45): lvm2-libs-2.03.23-2.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-03-28T21:53:29.634 INFO:teuthology.orchestra.run.smithi153.stdout:(35/45): lvm2-2.03.23-2.el9.x86_64.rpm 6.8 MB/s | 1.5 MB 00:00 2024-03-28T21:53:29.673 INFO:teuthology.orchestra.run.smithi153.stdout:(36/45): make-4.3-8.el9.x86_64.rpm 3.2 MB/s | 536 kB 00:00 2024-03-28T21:53:36.623 INFO:teuthology.orchestra.run.smithi153.stdout:(37/45): gcc-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 32 MB 00:06 2024-03-28T21:53:36.748 INFO:teuthology.orchestra.run.smithi153.stdout:(38/45): gcc-plugin-annobin-11.4.1-3.el9.x86_64 409 kB/s | 47 kB 00:00 2024-03-28T21:53:36.882 INFO:teuthology.orchestra.run.smithi153.stdout:(39/45): git-2.43.0-1.el9.x86_64.rpm 382 kB/s | 51 kB 00:00 2024-03-28T21:53:37.150 INFO:teuthology.orchestra.run.smithi153.stdout:(40/45): git-core-2.43.0-1.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-03-28T21:53:37.341 INFO:teuthology.orchestra.run.smithi153.stdout:(41/45): git-core-doc-2.43.0-1.el9.noarch.rpm 15 MB/s | 2.9 MB 00:00 2024-03-28T21:53:37.524 INFO:teuthology.orchestra.run.smithi153.stdout:(42/45): libstdc++-devel-11.4.1-3.el9.x86_64.rp 13 MB/s | 2.4 MB 00:00 2024-03-28T21:53:37.650 INFO:teuthology.orchestra.run.smithi153.stdout:(43/45): perl-Git-2.43.0-1.el9.noarch.rpm 305 kB/s | 38 kB 00:00 2024-03-28T21:53:38.242 INFO:teuthology.orchestra.run.smithi153.stdout:(44/45): cpp-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 11 MB 00:08 2024-03-28T21:53:40.484 INFO:teuthology.orchestra.run.smithi153.stdout:(45/45): gcc-c++-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 13 MB 00:10 2024-03-28T21:53:40.486 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-03-28T21:53:40.486 INFO:teuthology.orchestra.run.smithi153.stdout:Total 7.1 MB/s | 103 MB 00:14 2024-03-28T21:53:42.026 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-03-28T21:53:42.443 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-03-28T21:53:42.443 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-03-28T21:53:44.005 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-03-28T21:53:44.006 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-03-28T21:53:47.203 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-03-28T21:53:47.266 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-28T21:53:47.349 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-28T21:53:47.467 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libcom_err-1.46.5-5.el9.x86_64 2/73 2024-03-28T21:53:47.552 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libstdc++-11.4.1-3.el9.x86_64 3/73 2024-03-28T21:53:47.623 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : e2fsprogs-libs-1.46.5-5.el9.x86_64 4/73 2024-03-28T21:53:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : device-mapper-libs-9:1.02.197-2.el9.x86_64 5/73 2024-03-28T21:53:47.786 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : device-mapper-9:1.02.197-2.el9.x86_64 6/73 2024-03-28T21:53:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 7/73 2024-03-28T21:53:48.299 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : git-core-2.43.0-1.el9.x86_64 8/73 2024-03-28T21:53:48.381 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : make-1:4.3-8.el9.x86_64 9/73 2024-03-28T21:53:50.056 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : sqlite-libs-3.34.1-7.el9.x86_64 10/73 2024-03-28T21:53:50.203 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : python3-libs-3.9.18-3.el9.x86_64 11/73 2024-03-28T21:53:50.238 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : python3-3.9.18-3.el9.x86_64 12/73 2024-03-28T21:53:51.213 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : python-unversioned-command-3.9.18-3.el9.noarch 13/73 2024-03-28T21:53:51.337 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : git-core-doc-2.43.0-1.el9.noarch 14/73 2024-03-28T21:53:51.383 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : perl-Git-2.43.0-1.el9.noarch 15/73 2024-03-28T21:53:51.432 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : git-2.43.0-1.el9.x86_64 16/73 2024-03-28T21:53:51.468 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-28T21:53:51.581 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:53:51.589 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:53:51.864 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-28T21:53:52.603 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : lvm2-libs-9:2.03.23-2.el9.x86_64 18/73 2024-03-28T21:53:52.711 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libstdc++-devel-11.4.1-3.el9.x86_64 19/73 2024-03-28T21:53:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libss-1.46.5-5.el9.x86_64 20/73 2024-03-28T21:53:53.207 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : cpp-11.4.1-3.el9.x86_64 21/73 2024-03-28T21:53:54.571 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libgomp-11.4.1-3.el9.x86_64 22/73 2024-03-28T21:53:54.723 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : gcc-11.4.1-3.el9.x86_64 23/73 2024-03-28T21:53:54.811 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: gcc-11.4.1-3.el9.x86_64 23/73 2024-03-28T21:53:54.849 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 24/73 2024-03-28T21:53:54.876 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 25/73 2024-03-28T21:53:54.901 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 26/73 2024-03-28T21:53:54.927 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 27/73 2024-03-28T21:53:54.971 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 28/73 2024-03-28T21:53:55.004 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 29/73 2024-03-28T21:53:55.036 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 30/73 2024-03-28T21:53:55.285 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 31/73 2024-03-28T21:53:55.325 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fio-3.35-1.el9.x86_64 32/73 2024-03-28T21:53:55.353 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rmt-2:1.6-6.el9.x86_64 33/73 2024-03-28T21:53:55.385 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 34/73 2024-03-28T21:54:07.680 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 35/73 2024-03-28T21:54:07.862 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-devel-5.14.0-434.el9.x86_64 36/73 2024-03-28T21:54:21.861 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:54:21.869 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:54:51.997 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:54:52.005 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:54:54.545 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-devel-5.14.0-434.el9.x86_64 36/73 2024-03-28T21:54:54.691 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : gcc-c++-11.4.1-3.el9.x86_64 37/73 2024-03-28T21:54:54.730 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-28T21:54:54.907 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-28T21:54:55.215 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : e2fsprogs-1.46.5-5.el9.x86_64 39/73 2024-03-28T21:54:55.216 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-28T21:54:55.216 INFO:teuthology.orchestra.run.smithi153.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2024-03-28T21:54:55.216 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:54:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-28T21:54:55.765 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : python3-devel-3.9.18-3.el9.x86_64 41/73 2024-03-28T21:54:55.833 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 42/73 2024-03-28T21:54:55.891 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : indent-2.2.13-5.el9.x86_64 43/73 2024-03-28T21:54:55.959 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : udftools-2.2-5.el9.x86_64 44/73 2024-03-28T21:54:55.992 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 45/73 2024-03-28T21:54:56.031 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : git-2.39.3-1.el9.x86_64 46/73 2024-03-28T21:54:56.075 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 47/73 2024-03-28T21:54:56.114 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 48/73 2024-03-28T21:54:56.153 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 49/73 2024-03-28T21:54:56.186 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 50/73 2024-03-28T21:54:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 51/73 2024-03-28T21:54:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-28T21:54:56.323 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-28T21:54:56.382 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 53/73 2024-03-28T21:54:56.416 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-28T21:54:56.417 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-28T21:54:56.537 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-28T21:54:56.622 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 55/73 2024-03-28T21:54:56.684 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : git-core-doc-2.39.3-1.el9.noarch 56/73 2024-03-28T21:54:56.717 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : perl-Git-2.39.3-1.el9.noarch 57/73 2024-03-28T21:54:56.748 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : lvm2-libs-9:2.03.21-3.el9.x86_64 58/73 2024-03-28T21:54:56.775 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-28T21:54:56.818 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-28T21:54:56.849 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 60/73 2024-03-28T21:54:56.874 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 61/73 2024-03-28T21:54:56.908 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 62/73 2024-03-28T21:54:56.942 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 63/73 2024-03-28T21:54:56.977 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : device-mapper-libs-9:1.02.195-3.el9.x86_64 64/73 2024-03-28T21:54:57.102 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : device-mapper-9:1.02.195-3.el9.x86_64 65/73 2024-03-28T21:54:57.180 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 66/73 2024-03-28T21:54:57.212 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : sqlite-libs-3.34.1-6.el9.x86_64 67/73 2024-03-28T21:54:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 68/73 2024-03-28T21:54:57.246 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-28T21:54:57.394 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-28T21:54:57.442 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : git-core-2.39.3-1.el9.x86_64 70/73 2024-03-28T21:54:57.482 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 71/73 2024-03-28T21:54:57.517 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 72/73 2024-03-28T21:54:57.648 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : make-1:4.3-7.el9.x86_64 73/73 2024-03-28T21:54:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: make-1:4.3-7.el9.x86_64 73/73 2024-03-28T21:54:59.567 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fio-3.35-1.el9.x86_64 1/73 2024-03-28T21:54:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/73 2024-03-28T21:54:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/73 2024-03-28T21:54:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/73 2024-03-28T21:54:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/73 2024-03-28T21:54:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/73 2024-03-28T21:54:59.568 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/73 2024-03-28T21:54:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-devel-5.14.0-434.el9.x86_64 8/73 2024-03-28T21:54:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 9/73 2024-03-28T21:54:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 10/73 2024-03-28T21:54:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : udftools-2.2-5.el9.x86_64 11/73 2024-03-28T21:54:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 12/73 2024-03-28T21:54:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 13/73 2024-03-28T21:54:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/73 2024-03-28T21:54:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/73 2024-03-28T21:54:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/73 2024-03-28T21:54:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/73 2024-03-28T21:54:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python-unversioned-command-3.9.18-3.el9.noarch 18/73 2024-03-28T21:54:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 19/73 2024-03-28T21:54:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 20/73 2024-03-28T21:54:59.569 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 21/73 2024-03-28T21:54:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-3.9.18-3.el9.x86_64 22/73 2024-03-28T21:54:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-3.9.17-2.el9.x86_64 23/73 2024-03-28T21:54:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-libs-3.9.18-3.el9.x86_64 24/73 2024-03-28T21:54:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 25/73 2024-03-28T21:54:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : sqlite-libs-3.34.1-7.el9.x86_64 26/73 2024-03-28T21:54:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : sqlite-libs-3.34.1-6.el9.x86_64 27/73 2024-03-28T21:54:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : device-mapper-9:1.02.197-2.el9.x86_64 28/73 2024-03-28T21:54:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : device-mapper-9:1.02.195-3.el9.x86_64 29/73 2024-03-28T21:54:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : device-mapper-event-9:1.02.197-2.el9.x86_64 30/73 2024-03-28T21:54:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : device-mapper-event-9:1.02.195-3.el9.x86_64 31/73 2024-03-28T21:54:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 32/73 2024-03-28T21:54:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 33/73 2024-03-28T21:54:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : device-mapper-libs-9:1.02.197-2.el9.x86_64 34/73 2024-03-28T21:54:59.570 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : device-mapper-libs-9:1.02.195-3.el9.x86_64 35/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : e2fsprogs-1.46.5-5.el9.x86_64 36/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 37/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : e2fsprogs-libs-1.46.5-5.el9.x86_64 38/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 39/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcom_err-1.46.5-5.el9.x86_64 40/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 41/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgcc-11.4.1-3.el9.x86_64 42/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 43/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgomp-11.4.1-3.el9.x86_64 44/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 45/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libss-1.46.5-5.el9.x86_64 46/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libss-1.46.5-3.el9.x86_64 47/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libstdc++-11.4.1-3.el9.x86_64 48/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 49/73 2024-03-28T21:54:59.571 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lvm2-9:2.03.23-2.el9.x86_64 50/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lvm2-9:2.03.21-3.el9.x86_64 51/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lvm2-libs-9:2.03.23-2.el9.x86_64 52/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lvm2-libs-9:2.03.21-3.el9.x86_64 53/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : make-1:4.3-8.el9.x86_64 54/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : make-1:4.3-7.el9.x86_64 55/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cpp-11.4.1-3.el9.x86_64 56/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 57/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gcc-11.4.1-3.el9.x86_64 58/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 59/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gcc-c++-11.4.1-3.el9.x86_64 60/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 61/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gcc-plugin-annobin-11.4.1-3.el9.x86_64 62/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 63/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : git-2.43.0-1.el9.x86_64 64/73 2024-03-28T21:54:59.572 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : git-2.39.3-1.el9.x86_64 65/73 2024-03-28T21:54:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : git-core-2.43.0-1.el9.x86_64 66/73 2024-03-28T21:54:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : git-core-2.39.3-1.el9.x86_64 67/73 2024-03-28T21:54:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : git-core-doc-2.43.0-1.el9.noarch 68/73 2024-03-28T21:54:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : git-core-doc-2.39.3-1.el9.noarch 69/73 2024-03-28T21:54:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libstdc++-devel-11.4.1-3.el9.x86_64 70/73 2024-03-28T21:54:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 71/73 2024-03-28T21:54:59.573 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : perl-Git-2.43.0-1.el9.noarch 72/73 2024-03-28T21:55:00.586 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : perl-Git-2.39.3-1.el9.noarch 73/73 2024-03-28T21:55:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:55:00.587 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-03-28T21:55:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: cpp-11.4.1-3.el9.x86_64 2024-03-28T21:55:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: device-mapper-9:1.02.197-2.el9.x86_64 2024-03-28T21:55:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: device-mapper-event-9:1.02.197-2.el9.x86_64 2024-03-28T21:55:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: device-mapper-event-libs-9:1.02.197-2.el9.x86_64 2024-03-28T21:55:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: device-mapper-libs-9:1.02.197-2.el9.x86_64 2024-03-28T21:55:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: e2fsprogs-1.46.5-5.el9.x86_64 2024-03-28T21:55:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: e2fsprogs-libs-1.46.5-5.el9.x86_64 2024-03-28T21:55:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: gcc-11.4.1-3.el9.x86_64 2024-03-28T21:55:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: gcc-c++-11.4.1-3.el9.x86_64 2024-03-28T21:55:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: gcc-plugin-annobin-11.4.1-3.el9.x86_64 2024-03-28T21:55:00.587 INFO:teuthology.orchestra.run.smithi153.stdout: git-2.43.0-1.el9.x86_64 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: git-core-2.43.0-1.el9.x86_64 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: git-core-doc-2.43.0-1.el9.noarch 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: libcom_err-1.46.5-5.el9.x86_64 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: libgcc-11.4.1-3.el9.x86_64 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: libgomp-11.4.1-3.el9.x86_64 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: libss-1.46.5-5.el9.x86_64 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: libstdc++-11.4.1-3.el9.x86_64 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: libstdc++-devel-11.4.1-3.el9.x86_64 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: lvm2-9:2.03.23-2.el9.x86_64 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: lvm2-libs-9:2.03.23-2.el9.x86_64 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: make-1:4.3-8.el9.x86_64 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: perl-Git-2.43.0-1.el9.noarch 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: python-unversioned-command-3.9.18-3.el9.noarch 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: python3-3.9.18-3.el9.x86_64 2024-03-28T21:55:00.588 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-03-28T21:55:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: python3-libs-3.9.18-3.el9.x86_64 2024-03-28T21:55:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: sqlite-libs-3.34.1-7.el9.x86_64 2024-03-28T21:55:00.589 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-03-28T21:55:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-03-28T21:55:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-03-28T21:55:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-03-28T21:55:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-03-28T21:55:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2024-03-28T21:55:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-434.el9.x86_64 2024-03-28T21:55:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-03-28T21:55:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-03-28T21:55:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: udftools-2.2-5.el9.x86_64 2024-03-28T21:55:00.589 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:55:00.589 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-03-28T21:55:01.320 DEBUG:teuthology.orchestra.run.smithi153:> sudo useradd -m fsgqa 2024-03-28T21:55:01.400 INFO:teuthology.orchestra.run.smithi153.stderr:useradd: user 'fsgqa' already exists 2024-03-28T21:55:01.404 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-28T21:55:01.405 DEBUG:teuthology.orchestra.run.smithi153:> sudo groupadd fsgqa 2024-03-28T21:55:01.471 INFO:teuthology.orchestra.run.smithi153.stderr:groupadd: group 'fsgqa' already exists 2024-03-28T21:55:01.474 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-28T21:55:01.474 DEBUG:teuthology.orchestra.run.smithi153:> sudo useradd fsgqa2 2024-03-28T21:55:02.124 DEBUG:teuthology.orchestra.run.smithi153:> sudo useradd 123456-fsgqa 2024-03-28T21:55:02.808 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-03-28T21:55:03.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.004+0000 7f25d7e00640 1 Processor -- start 2024-03-28T21:55:03.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.005+0000 7f25d7e00640 1 -- start start 2024-03-28T21:55:03.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.006+0000 7f25d7e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f25d0159a10 0x7f25d015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:55:03.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.006+0000 7f25d7e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25d00b2e60 con 0x7f25d00ad830 2024-03-28T21:55:03.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.006+0000 7f25d7e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25d00adc70 con 0x7f25d006e440 2024-03-28T21:55:03.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.006+0000 7f25d7e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f25d0159df0 con 0x7f25d0159a10 2024-03-28T21:55:03.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.006+0000 7f25d4a00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f25d00ad830 0x7f25d006dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:48024/0 (socket says 172.21.15.153:48024) 2024-03-28T21:55:03.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.006+0000 7f25d4a00640 1 -- 172.21.15.153:0/3973062464 learned_addr learned my addr 172.21.15.153:0/3973062464 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:55:03.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.007+0000 7f25d5400640 1 --2- 172.21.15.153:0/3973062464 >> v2:172.21.15.165:3300/0 conn(0x7f25d0159a10 0x7f25d015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:55:03.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.007+0000 7f25cfe00640 1 -- 172.21.15.153:0/3973062464 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248098560 0 0) 0x7f25d00b2e60 con 0x7f25d00ad830 2024-03-28T21:55:03.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.007+0000 7f25cfe00640 1 -- 172.21.15.153:0/3973062464 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25b8003520 con 0x7f25d00ad830 2024-03-28T21:55:03.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.007+0000 7f25cfe00640 1 -- 172.21.15.153:0/3973062464 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1835431688 0 0) 0x7f25b8003520 con 0x7f25d00ad830 2024-03-28T21:55:03.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.007+0000 7f25cfe00640 1 -- 172.21.15.153:0/3973062464 >> v2:172.21.15.165:3300/0 conn(0x7f25d0159a10 msgr2=0x7f25d015cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:55:03.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.007+0000 7f25cfe00640 1 --2- 172.21.15.153:0/3973062464 >> v2:172.21.15.165:3300/0 conn(0x7f25d0159a10 0x7f25d015cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.007+0000 7f25cfe00640 1 -- 172.21.15.153:0/3973062464 >> v1:172.21.15.165:6789/0 conn(0x7f25d006e440 legacy=0x7f25d00b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:55:03.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.007+0000 7f25cfe00640 1 -- 172.21.15.153:0/3973062464 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d00adf10 con 0x7f25d00ad830 2024-03-28T21:55:03.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.007+0000 7f25cfe00640 1 -- 172.21.15.153:0/3973062464 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f25bc001690 con 0x7f25d00ad830 2024-03-28T21:55:03.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.007+0000 7f25cfe00640 1 -- 172.21.15.153:0/3973062464 >> v1:172.21.15.153:6789/0 conn(0x7f25d00ad830 legacy=0x7f25d006dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:55:03.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.008+0000 7f25cfe00640 1 --2- 172.21.15.153:0/3973062464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f25b80039b0 0x7f25b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:55:03.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.008+0000 7f25cfe00640 1 --2- 172.21.15.153:0/3973062464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f25b8004800 0x7f25b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:55:03.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.008+0000 7f25cfe00640 1 --2- 172.21.15.153:0/3973062464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b80051c0 0x7f25b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:55:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.008+0000 7f25cfe00640 1 -- 172.21.15.153:0/3973062464 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f25d0159df0 con 0x7f25b80051c0 2024-03-28T21:55:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.008+0000 7f25cfe00640 1 -- 172.21.15.153:0/3973062464 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f25b800c160 con 0x7f25b80039b0 2024-03-28T21:55:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.008+0000 7f25cfe00640 1 -- 172.21.15.153:0/3973062464 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f25b800c360 con 0x7f25b8004800 2024-03-28T21:55:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.008+0000 7f25d5e00640 1 --2- 172.21.15.153:0/3973062464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b80051c0 0x7f25b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:55:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.008+0000 7f25d4a00640 1 --2- 172.21.15.153:0/3973062464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f25b8004800 0x7f25b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:55:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.008+0000 7f25d5400640 1 --2- 172.21.15.153:0/3973062464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f25b80039b0 0x7f25b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:55:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.009+0000 7f25d5e00640 1 -- 172.21.15.153:0/3973062464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f25b8004800 msgr2=0x7f25b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:55:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.009+0000 7f25d5e00640 1 --2- 172.21.15.153:0/3973062464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f25b8004800 0x7f25b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.009+0000 7f25d5e00640 1 -- 172.21.15.153:0/3973062464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f25b80039b0 msgr2=0x7f25b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:55:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.009+0000 7f25d5e00640 1 --2- 172.21.15.153:0/3973062464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f25b80039b0 0x7f25b8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.009+0000 7f25d5e00640 1 -- 172.21.15.153:0/3973062464 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b8003520 con 0x7f25b80051c0 2024-03-28T21:55:03.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.010+0000 7f25d5e00640 1 -- 172.21.15.153:0/3973062464 reap_dead start 2024-03-28T21:55:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.010+0000 7f25d5e00640 1 --2- 172.21.15.153:0/3973062464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b80051c0 0x7f25b800b9c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f25c8001e50 tx=0x7f25b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373469bcc743038f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:55:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.010+0000 7f25cfe00640 1 -- 172.21.15.153:0/3973062464 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c8001a70 con 0x7f25b80051c0 2024-03-28T21:55:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.010+0000 7f25cfe00640 1 -- 172.21.15.153:0/3973062464 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c8003bb0 con 0x7f25b80051c0 2024-03-28T21:55:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.010+0000 7f25cfe00640 1 -- 172.21.15.153:0/3973062464 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c80050d0 con 0x7f25b80051c0 2024-03-28T21:55:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.011+0000 7f25d7e00640 1 -- 172.21.15.153:0/3973062464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b80051c0 msgr2=0x7f25b800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:55:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.011+0000 7f25d7e00640 1 --2- 172.21.15.153:0/3973062464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b80051c0 0x7f25b800b9c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f25c8001e50 tx=0x7f25b8005830 comp rx=0 tx=0).stop 2024-03-28T21:55:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.011+0000 7f25d7e00640 1 -- 172.21.15.153:0/3973062464 shutdown_connections 2024-03-28T21:55:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.011+0000 7f25d7e00640 1 --2- 172.21.15.153:0/3973062464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b80051c0 0x7f25b800b9c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.011+0000 7f25d7e00640 1 -- 172.21.15.153:0/3973062464 >> 172.21.15.153:0/3973062464 conn(0x7f25d00b1a30 msgr2=0x7f25d00b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:55:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.011+0000 7f25d7e00640 1 -- 172.21.15.153:0/3973062464 shutdown_connections 2024-03-28T21:55:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.011+0000 7f25d7e00640 1 -- 172.21.15.153:0/3973062464 wait complete. 2024-03-28T21:55:03.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.013+0000 7f25d7e00640 1 Processor -- start 2024-03-28T21:55:03.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.013+0000 7f25d7e00640 1 -- start start 2024-03-28T21:55:03.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.014+0000 7f25d7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f25b80051c0 0x7f25d0156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:55:03.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.014+0000 7f25d7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f25d009d430 0x7f25d01494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:55:03.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.014+0000 7f25d7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d00cd290 0x7f25d00ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:55:03.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.014+0000 7f25d7e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f25d00ae4d0 con 0x7f25d00cd290 2024-03-28T21:55:03.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.014+0000 7f25d7e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f25d00b3100 con 0x7f25d009d430 2024-03-28T21:55:03.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.014+0000 7f25d7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f25d015cf00 con 0x7f25b80051c0 2024-03-28T21:55:03.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.014+0000 7f25d5e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d00cd290 0x7f25d00ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:55:03.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.014+0000 7f25d5e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d00cd290 0x7f25d00ce960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43290/0 (socket says 172.21.15.153:43290) 2024-03-28T21:55:03.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.014+0000 7f25d5e00640 1 -- 172.21.15.153:0/358350662 learned_addr learned my addr 172.21.15.153:0/358350662 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:55:03.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.015+0000 7f25d5400640 1 --2- 172.21.15.153:0/358350662 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f25b80051c0 0x7f25d0156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:55:03.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.015+0000 7f25d4a00640 1 --2- 172.21.15.153:0/358350662 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f25d009d430 0x7f25d01494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:55:03.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.015+0000 7f25d5e00640 1 -- 172.21.15.153:0/358350662 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f25b80051c0 msgr2=0x7f25d0156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:55:03.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.015+0000 7f25d5e00640 1 --2- 172.21.15.153:0/358350662 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f25b80051c0 0x7f25d0156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.015+0000 7f25d5e00640 1 -- 172.21.15.153:0/358350662 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f25d009d430 msgr2=0x7f25d01494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:55:03.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.015+0000 7f25d5e00640 1 --2- 172.21.15.153:0/358350662 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f25d009d430 0x7f25d01494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.015+0000 7f25d5e00640 1 -- 172.21.15.153:0/358350662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d00cddc0 con 0x7f25d00cd290 2024-03-28T21:55:03.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.015+0000 7f25d5e00640 1 --2- 172.21.15.153:0/358350662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d00cd290 0x7f25d00ce960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f25c802c060 tx=0x7f25c80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:55:03.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.016+0000 7f25cd600640 1 -- 172.21.15.153:0/358350662 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c8006d60 con 0x7f25d00cd290 2024-03-28T21:55:03.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.016+0000 7f25cd600640 1 -- 172.21.15.153:0/358350662 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c8039480 con 0x7f25d00cd290 2024-03-28T21:55:03.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.016+0000 7f25d7e00640 1 -- 172.21.15.153:0/358350662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d0149a00 con 0x7f25d00cd290 2024-03-28T21:55:03.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.016+0000 7f25cd600640 1 -- 172.21.15.153:0/358350662 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c8039830 con 0x7f25d00cd290 2024-03-28T21:55:03.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.016+0000 7f25d7e00640 1 -- 172.21.15.153:0/358350662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d009ab80 con 0x7f25d00cd290 2024-03-28T21:55:03.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.017+0000 7f25d7e00640 1 -- 172.21.15.153:0/358350662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25d0068ff0 con 0x7f25d00cd290 2024-03-28T21:55:03.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.019+0000 7f25cd600640 1 -- 172.21.15.153:0/358350662 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f25c80399d0 con 0x7f25d00cd290 2024-03-28T21:55:03.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.020+0000 7f25cd600640 1 --2- 172.21.15.153:0/358350662 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f25b006b500 0x7f25b006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:55:03.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.020+0000 7f25cd600640 1 -- 172.21.15.153:0/358350662 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f25c80abe90 con 0x7f25d00cd290 2024-03-28T21:55:03.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.020+0000 7f25d5400640 1 --2- 172.21.15.153:0/358350662 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f25b006b500 0x7f25b006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:55:03.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.021+0000 7f25d5400640 1 --2- 172.21.15.153:0/358350662 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f25b006b500 0x7f25b006d9c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f25c4010a50 tx=0x7f25c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:55:03.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.027+0000 7f25cd600640 1 -- 172.21.15.153:0/358350662 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f25c803e070 con 0x7f25d00cd290 2024-03-28T21:55:03.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.340+0000 7f25d7e00640 1 -- 172.21.15.153:0/358350662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f25d00ce740 con 0x7f25d00cd290 2024-03-28T21:55:03.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.341+0000 7f25cd600640 1 -- 172.21.15.153:0/358350662 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1289 (secure 0 0 0) 0x7f25c80ad090 con 0x7f25d00cd290 2024-03-28T21:55:03.343 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:55:03.343 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","modified":"2024-03-28T21:50:53.345903Z","created":"2024-03-28T21:50:53.345903Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:3300","nonce":0},{"type":"v1","addr":"172.21.15.165:6789","nonce":0}]},"addr":"172.21.15.165:6789/0","public_addr":"172.21.15.165:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:3301","nonce":0},{"type":"v1","addr":"172.21.15.165:6790","nonce":0}]},"addr":"172.21.15.165:6790/0","public_addr":"172.21.15.165:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-28T21:55:03.343 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-03-28T21:55:03.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.343+0000 7f25d7e00640 1 -- 172.21.15.153:0/358350662 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f25b006b500 msgr2=0x7f25b006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:55:03.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.343+0000 7f25d7e00640 1 --2- 172.21.15.153:0/358350662 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f25b006b500 0x7f25b006d9c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f25c4010a50 tx=0x7f25c4008040 comp rx=0 tx=0).stop 2024-03-28T21:55:03.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.343+0000 7f25d7e00640 1 -- 172.21.15.153:0/358350662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d00cd290 msgr2=0x7f25d00ce960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:55:03.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.343+0000 7f25d7e00640 1 --2- 172.21.15.153:0/358350662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d00cd290 0x7f25d00ce960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f25c802c060 tx=0x7f25c80014a0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.344+0000 7f25d7e00640 1 -- 172.21.15.153:0/358350662 shutdown_connections 2024-03-28T21:55:03.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.344+0000 7f25d7e00640 1 --2- 172.21.15.153:0/358350662 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f25b006b500 0x7f25b006d9c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.344+0000 7f25d7e00640 1 --2- 172.21.15.153:0/358350662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25d00cd290 0x7f25d00ce960 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.344+0000 7f25d7e00640 1 --2- 172.21.15.153:0/358350662 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f25d009d430 0x7f25d01494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.344+0000 7f25d7e00640 1 --2- 172.21.15.153:0/358350662 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f25b80051c0 0x7f25d0156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.344+0000 7f25d7e00640 1 -- 172.21.15.153:0/358350662 >> 172.21.15.153:0/358350662 conn(0x7f25d00b1a30 msgr2=0x7f25d00af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:55:03.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.344+0000 7f25d7e00640 1 -- 172.21.15.153:0/358350662 shutdown_connections 2024-03-28T21:55:03.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.344+0000 7f25d7e00640 1 -- 172.21.15.153:0/358350662 wait complete. 2024-03-28T21:55:03.370 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-03-28T21:55:03.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.552+0000 7f5b8dc00640 1 Processor -- start 2024-03-28T21:55:03.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.552+0000 7f5b8dc00640 1 -- start start 2024-03-28T21:55:03.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.554+0000 7f5b8dc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5b8815dd10 0x7f5b8815e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:55:03.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.554+0000 7f5b8dc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b8806eeb0 con 0x7f5b8815e720 2024-03-28T21:55:03.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.554+0000 7f5b8dc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b880714b0 con 0x7f5b880b3230 2024-03-28T21:55:03.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.554+0000 7f5b8dc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5b88070ef0 con 0x7f5b8815dd10 2024-03-28T21:55:03.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.555+0000 7f5b86000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5b8815e720 0x7f5b8815eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:48034/0 (socket says 172.21.15.153:48034) 2024-03-28T21:55:03.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.555+0000 7f5b86000640 1 -- 172.21.15.153:0/331721256 learned_addr learned my addr 172.21.15.153:0/331721256 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-28T21:55:03.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.555+0000 7f5b86a00640 1 --2- 172.21.15.153:0/331721256 >> v2:172.21.15.153:3300/0 conn(0x7f5b8815dd10 0x7f5b8815e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:55:03.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.555+0000 7f5b85600640 1 -- 172.21.15.153:0/331721256 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2830945714 0 0) 0x7f5b8806eeb0 con 0x7f5b8815e720 2024-03-28T21:55:03.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.555+0000 7f5b85600640 1 -- 172.21.15.153:0/331721256 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b6c003520 con 0x7f5b8815e720 2024-03-28T21:55:03.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.555+0000 7f5b86a00640 1 -- 172.21.15.153:0/331721256 >> v1:172.21.15.165:6789/0 conn(0x7f5b880b3230 legacy=0x7f5b880b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T21:55:03.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.555+0000 7f5b86a00640 1 -- 172.21.15.153:0/331721256 >> v1:172.21.15.153:6789/0 conn(0x7f5b8815e720 legacy=0x7f5b8815eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:55:03.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.555+0000 7f5b86a00640 1 -- 172.21.15.153:0/331721256 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b880711d0 con 0x7f5b8815dd10 2024-03-28T21:55:03.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.556+0000 7f5b86a00640 1 --2- 172.21.15.153:0/331721256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b8815dd10 0x7f5b8815e1e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5b780097a0 tx=0x7f5b7802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d28535c7084072 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:55:03.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.557+0000 7f5b85600640 1 -- 172.21.15.153:0/331721256 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b780315a0 con 0x7f5b8815dd10 2024-03-28T21:55:03.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.557+0000 7f5b85600640 1 -- 172.21.15.153:0/331721256 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b78037070 con 0x7f5b8815dd10 2024-03-28T21:55:03.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.557+0000 7f5b85600640 1 -- 172.21.15.153:0/331721256 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78031960 con 0x7f5b8815dd10 2024-03-28T21:55:03.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.558+0000 7f5b8dc00640 1 -- 172.21.15.153:0/331721256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b8815dd10 msgr2=0x7f5b8815e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:55:03.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.558+0000 7f5b8dc00640 1 --2- 172.21.15.153:0/331721256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b8815dd10 0x7f5b8815e1e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5b780097a0 tx=0x7f5b7802b840 comp rx=0 tx=0).stop 2024-03-28T21:55:03.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.558+0000 7f5b8dc00640 1 -- 172.21.15.153:0/331721256 shutdown_connections 2024-03-28T21:55:03.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.558+0000 7f5b8dc00640 1 --2- 172.21.15.153:0/331721256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b8815dd10 0x7f5b8815e1e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.558+0000 7f5b8dc00640 1 -- 172.21.15.153:0/331721256 >> 172.21.15.153:0/331721256 conn(0x7f5b880cfc00 msgr2=0x7f5b880cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:55:03.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.558+0000 7f5b8dc00640 1 -- 172.21.15.153:0/331721256 shutdown_connections 2024-03-28T21:55:03.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.558+0000 7f5b8dc00640 1 -- 172.21.15.153:0/331721256 wait complete. 2024-03-28T21:55:03.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.560+0000 7f5b8dc00640 1 Processor -- start 2024-03-28T21:55:03.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.561+0000 7f5b8dc00640 1 -- start start 2024-03-28T21:55:03.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.562+0000 7f5b8dc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b880b3230 0x7f5b881427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:55:03.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.562+0000 7f5b8dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b8815dd10 0x7f5b88147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:55:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.562+0000 7f5b8dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b8815e720 0x7f5b880b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:55:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.562+0000 7f5b8dc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5b880cc960 con 0x7f5b880b3230 2024-03-28T21:55:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.562+0000 7f5b8dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8806d980 con 0x7f5b8815e720 2024-03-28T21:55:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.562+0000 7f5b8dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5b880ccae0 con 0x7f5b8815dd10 2024-03-28T21:55:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.562+0000 7f5b86a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b880b3230 0x7f5b881427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:55:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.562+0000 7f5b86a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b880b3230 0x7f5b881427b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43306/0 (socket says 172.21.15.153:43306) 2024-03-28T21:55:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.563+0000 7f5b86a00640 1 -- 172.21.15.153:0/2115677626 learned_addr learned my addr 172.21.15.153:0/2115677626 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-28T21:55:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.563+0000 7f5b86000640 1 --2- 172.21.15.153:0/2115677626 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b8815dd10 0x7f5b88147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:55:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.563+0000 7f5b87400640 1 --2- 172.21.15.153:0/2115677626 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b8815e720 0x7f5b880b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:55:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.563+0000 7f5b86a00640 1 -- 172.21.15.153:0/2115677626 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b8815dd10 msgr2=0x7f5b88147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:55:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.563+0000 7f5b86a00640 1 --2- 172.21.15.153:0/2115677626 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b8815dd10 0x7f5b88147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.563+0000 7f5b86a00640 1 -- 172.21.15.153:0/2115677626 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b8815e720 msgr2=0x7f5b880b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:55:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.563+0000 7f5b86a00640 1 --2- 172.21.15.153:0/2115677626 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b8815e720 0x7f5b880b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.563+0000 7f5b86a00640 1 -- 172.21.15.153:0/2115677626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b880af6b0 con 0x7f5b880b3230 2024-03-28T21:55:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.563+0000 7f5b86a00640 1 --2- 172.21.15.153:0/2115677626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b880b3230 0x7f5b881427b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5b78034040 tx=0x7f5b780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:55:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.564+0000 7f5b7ea00640 1 -- 172.21.15.153:0/2115677626 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78032630 con 0x7f5b880b3230 2024-03-28T21:55:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.564+0000 7f5b7ea00640 1 -- 172.21.15.153:0/2115677626 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b780327d0 con 0x7f5b880b3230 2024-03-28T21:55:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.564+0000 7f5b8dc00640 1 -- 172.21.15.153:0/2115677626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b88146620 con 0x7f5b880b3230 2024-03-28T21:55:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.564+0000 7f5b7ea00640 1 -- 172.21.15.153:0/2115677626 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78032bc0 con 0x7f5b880b3230 2024-03-28T21:55:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.564+0000 7f5b8dc00640 1 -- 172.21.15.153:0/2115677626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b88146be0 con 0x7f5b880b3230 2024-03-28T21:55:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.565+0000 7f5b8dc00640 1 -- 172.21.15.153:0/2115677626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b88146de0 con 0x7f5b880b3230 2024-03-28T21:55:03.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.566+0000 7f5b7ea00640 1 -- 172.21.15.153:0/2115677626 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f5b7803b3f0 con 0x7f5b880b3230 2024-03-28T21:55:03.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.567+0000 7f5b7ea00640 1 --2- 172.21.15.153:0/2115677626 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5b6806b500 0x7f5b6806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T21:55:03.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.567+0000 7f5b7ea00640 1 -- 172.21.15.153:0/2115677626 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f5b7802f030 con 0x7f5b880b3230 2024-03-28T21:55:03.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.568+0000 7f5b86000640 1 --2- 172.21.15.153:0/2115677626 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5b6806b500 0x7f5b6806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T21:55:03.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.568+0000 7f5b86000640 1 --2- 172.21.15.153:0/2115677626 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5b6806b500 0x7f5b6806d9c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b8816b890 tx=0x7f5b74007bf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T21:55:03.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.572+0000 7f5b7ea00640 1 -- 172.21.15.153:0/2115677626 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5b88146de0 con 0x7f5b880b3230 2024-03-28T21:55:03.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.843+0000 7f5b8dc00640 1 -- 172.21.15.153:0/2115677626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) -- 0x7f5b88068ff0 con 0x7f5b880b3230 2024-03-28T21:55:03.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.843+0000 7f5b7ea00640 1 -- 172.21.15.153:0/2115677626 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) ==== 92+0+63 (secure 0 0 0) 0x7f5b78040070 con 0x7f5b880b3230 2024-03-28T21:55:03.845 INFO:teuthology.orchestra.run.smithi153.stdout:[client.admin] 2024-03-28T21:55:03.845 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== 2024-03-28T21:55:03.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.845+0000 7f5b8dc00640 1 -- 172.21.15.153:0/2115677626 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5b6806b500 msgr2=0x7f5b6806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:55:03.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.845+0000 7f5b8dc00640 1 --2- 172.21.15.153:0/2115677626 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5b6806b500 0x7f5b6806d9c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b8816b890 tx=0x7f5b74007bf0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.845+0000 7f5b8dc00640 1 -- 172.21.15.153:0/2115677626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b880b3230 msgr2=0x7f5b881427b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T21:55:03.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.845+0000 7f5b8dc00640 1 --2- 172.21.15.153:0/2115677626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b880b3230 0x7f5b881427b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5b78034040 tx=0x7f5b780046c0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.846+0000 7f5b8dc00640 1 -- 172.21.15.153:0/2115677626 shutdown_connections 2024-03-28T21:55:03.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.846+0000 7f5b8dc00640 1 --2- 172.21.15.153:0/2115677626 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5b6806b500 0x7f5b6806d9c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.846+0000 7f5b8dc00640 1 --2- 172.21.15.153:0/2115677626 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b8815e720 0x7f5b880b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.846+0000 7f5b8dc00640 1 --2- 172.21.15.153:0/2115677626 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b8815dd10 0x7f5b88147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.846+0000 7f5b8dc00640 1 --2- 172.21.15.153:0/2115677626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b880b3230 0x7f5b881427b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T21:55:03.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.846+0000 7f5b8dc00640 1 -- 172.21.15.153:0/2115677626 >> 172.21.15.153:0/2115677626 conn(0x7f5b880cfc00 msgr2=0x7f5b8815cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T21:55:03.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.846+0000 7f5b8dc00640 1 -- 172.21.15.153:0/2115677626 shutdown_connections 2024-03-28T21:55:03.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-28T21:55:03.846+0000 7f5b8dc00640 1 -- 172.21.15.153:0/2115677626 wait complete. 2024-03-28T21:55:03.875 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:55:03.875 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/tmp/tmp.0cGUU1Musyxfstests-dev/local.config 2024-03-28T21:55:03.950 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.153:6789:/test export TEST_DIR=/tmp/tmp.l0v0NkF9eFtest export SCRATCH_DEV=172.21.15.153:6789:/scratch export SCRATCH_MNT=/tmp/tmp.qtMzJmHuchscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg==" 2024-03-28T21:55:03.950 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-28T21:55:03.950 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/tmp/tmp.0cGUU1Musyxfstests-dev/ceph.exclude 2024-03-28T21:55:04.074 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo make) 2024-03-28T21:55:04.197 INFO:teuthology.orchestra.run.smithi153.stdout:libtoolize -cfi 2024-03-28T21:55:04.866 INFO:teuthology.orchestra.run.smithi153.stdout:libtoolize: putting auxiliary files in '.'. 2024-03-28T21:55:04.866 INFO:teuthology.orchestra.run.smithi153.stdout:libtoolize: copying file './config.guess' 2024-03-28T21:55:04.877 INFO:teuthology.orchestra.run.smithi153.stdout:libtoolize: copying file './config.sub' 2024-03-28T21:55:04.887 INFO:teuthology.orchestra.run.smithi153.stdout:libtoolize: copying file './install-sh' 2024-03-28T21:55:04.898 INFO:teuthology.orchestra.run.smithi153.stdout:libtoolize: copying file './ltmain.sh' 2024-03-28T21:55:04.971 INFO:teuthology.orchestra.run.smithi153.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-03-28T21:55:04.972 INFO:teuthology.orchestra.run.smithi153.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-03-28T21:55:04.987 INFO:teuthology.orchestra.run.smithi153.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-03-28T21:55:05.001 INFO:teuthology.orchestra.run.smithi153.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-03-28T21:55:05.017 INFO:teuthology.orchestra.run.smithi153.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-03-28T21:55:05.038 INFO:teuthology.orchestra.run.smithi153.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-03-28T21:55:05.059 INFO:teuthology.orchestra.run.smithi153.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-03-28T21:55:05.064 INFO:teuthology.orchestra.run.smithi153.stdout:cp include/install-sh . 2024-03-28T21:55:05.067 INFO:teuthology.orchestra.run.smithi153.stdout:aclocal -I m4 2024-03-28T21:55:06.696 INFO:teuthology.orchestra.run.smithi153.stdout:autoheader 2024-03-28T21:55:07.119 INFO:teuthology.orchestra.run.smithi153.stdout:autoconf 2024-03-28T21:55:07.363 INFO:teuthology.orchestra.run.smithi153.stdout:./configure \ 2024-03-28T21:55:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: --libexecdir=/usr/lib \ 2024-03-28T21:55:07.364 INFO:teuthology.orchestra.run.smithi153.stdout: --exec_prefix=/var/lib 2024-03-28T21:55:07.775 INFO:teuthology.orchestra.run.smithi153.stdout:checking build system type... x86_64-pc-linux-gnu 2024-03-28T21:55:07.776 INFO:teuthology.orchestra.run.smithi153.stdout:checking host system type... x86_64-pc-linux-gnu 2024-03-28T21:55:07.779 INFO:teuthology.orchestra.run.smithi153.stdout:checking how to print strings... printf 2024-03-28T21:55:07.779 INFO:teuthology.orchestra.run.smithi153.stdout:checking for gcc... gcc 2024-03-28T21:55:07.894 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether the C compiler works... yes 2024-03-28T21:55:07.894 INFO:teuthology.orchestra.run.smithi153.stdout:checking for C compiler default output file name... a.out 2024-03-28T21:55:07.957 INFO:teuthology.orchestra.run.smithi153.stdout:checking for suffix of executables... 2024-03-28T21:55:08.053 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether we are cross compiling... no 2024-03-28T21:55:08.098 INFO:teuthology.orchestra.run.smithi153.stdout:checking for suffix of object files... o 2024-03-28T21:55:08.138 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether we are using the GNU C compiler... yes 2024-03-28T21:55:08.178 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether gcc accepts -g... yes 2024-03-28T21:55:08.240 INFO:teuthology.orchestra.run.smithi153.stdout:checking for gcc option to accept ISO C89... none needed 2024-03-28T21:55:08.248 INFO:teuthology.orchestra.run.smithi153.stdout:checking for a sed that does not truncate output... /bin/sed 2024-03-28T21:55:08.256 INFO:teuthology.orchestra.run.smithi153.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-03-28T21:55:08.260 INFO:teuthology.orchestra.run.smithi153.stdout:checking for egrep... /bin/grep -E 2024-03-28T21:55:08.264 INFO:teuthology.orchestra.run.smithi153.stdout:checking for fgrep... /bin/grep -F 2024-03-28T21:55:08.275 INFO:teuthology.orchestra.run.smithi153.stdout:checking for ld used by gcc... /bin/ld 2024-03-28T21:55:08.280 INFO:teuthology.orchestra.run.smithi153.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-03-28T21:55:08.291 INFO:teuthology.orchestra.run.smithi153.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-03-28T21:55:09.320 INFO:teuthology.orchestra.run.smithi153.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-03-28T21:55:09.321 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether ln -s works... yes 2024-03-28T21:55:09.337 INFO:teuthology.orchestra.run.smithi153.stdout:checking the maximum length of command line arguments... 1572864 2024-03-28T21:55:09.348 INFO:teuthology.orchestra.run.smithi153.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-03-28T21:55:09.348 INFO:teuthology.orchestra.run.smithi153.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-03-28T21:55:09.348 INFO:teuthology.orchestra.run.smithi153.stdout:checking for /bin/ld option to reload object files... -r 2024-03-28T21:55:09.348 INFO:teuthology.orchestra.run.smithi153.stdout:checking for objdump... objdump 2024-03-28T21:55:09.349 INFO:teuthology.orchestra.run.smithi153.stdout:checking how to recognize dependent libraries... pass_all 2024-03-28T21:55:09.349 INFO:teuthology.orchestra.run.smithi153.stdout:checking for dlltool... no 2024-03-28T21:55:09.349 INFO:teuthology.orchestra.run.smithi153.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-03-28T21:55:09.350 INFO:teuthology.orchestra.run.smithi153.stdout:checking for ar... ar 2024-03-28T21:55:09.462 INFO:teuthology.orchestra.run.smithi153.stdout:checking for archiver @FILE support... @ 2024-03-28T21:55:09.463 INFO:teuthology.orchestra.run.smithi153.stdout:checking for strip... strip 2024-03-28T21:55:09.464 INFO:teuthology.orchestra.run.smithi153.stdout:checking for ranlib... ranlib 2024-03-28T21:55:09.465 INFO:teuthology.orchestra.run.smithi153.stdout:checking for gawk... gawk 2024-03-28T21:55:09.651 INFO:teuthology.orchestra.run.smithi153.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-03-28T21:55:09.656 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sysroot... no 2024-03-28T21:55:09.666 INFO:teuthology.orchestra.run.smithi153.stdout:checking for a working dd... /bin/dd 2024-03-28T21:55:09.676 INFO:teuthology.orchestra.run.smithi153.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-03-28T21:55:09.713 INFO:teuthology.orchestra.run.smithi153.stdout:checking for mt... no 2024-03-28T21:55:09.722 INFO:teuthology.orchestra.run.smithi153.stdout:checking if : is a manifest tool... no 2024-03-28T21:55:09.824 INFO:teuthology.orchestra.run.smithi153.stdout:checking how to run the C preprocessor... gcc -E 2024-03-28T21:55:10.167 INFO:teuthology.orchestra.run.smithi153.stdout:checking for ANSI C header files... yes 2024-03-28T21:55:10.228 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/types.h... yes 2024-03-28T21:55:10.297 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/stat.h... yes 2024-03-28T21:55:10.365 INFO:teuthology.orchestra.run.smithi153.stdout:checking for stdlib.h... yes 2024-03-28T21:55:10.430 INFO:teuthology.orchestra.run.smithi153.stdout:checking for string.h... yes 2024-03-28T21:55:10.504 INFO:teuthology.orchestra.run.smithi153.stdout:checking for memory.h... yes 2024-03-28T21:55:10.564 INFO:teuthology.orchestra.run.smithi153.stdout:checking for strings.h... yes 2024-03-28T21:55:10.647 INFO:teuthology.orchestra.run.smithi153.stdout:checking for inttypes.h... yes 2024-03-28T21:55:10.716 INFO:teuthology.orchestra.run.smithi153.stdout:checking for stdint.h... yes 2024-03-28T21:55:10.791 INFO:teuthology.orchestra.run.smithi153.stdout:checking for unistd.h... yes 2024-03-28T21:55:10.866 INFO:teuthology.orchestra.run.smithi153.stdout:checking for dlfcn.h... yes 2024-03-28T21:55:10.878 INFO:teuthology.orchestra.run.smithi153.stdout:checking for objdir... .libs 2024-03-28T21:55:11.051 INFO:teuthology.orchestra.run.smithi153.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-03-28T21:55:11.051 INFO:teuthology.orchestra.run.smithi153.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-03-28T21:55:11.099 INFO:teuthology.orchestra.run.smithi153.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-03-28T21:55:11.144 INFO:teuthology.orchestra.run.smithi153.stdout:checking if gcc static flag -static works... no 2024-03-28T21:55:11.220 INFO:teuthology.orchestra.run.smithi153.stdout:checking if gcc supports -c -o file.o... yes 2024-03-28T21:55:11.221 INFO:teuthology.orchestra.run.smithi153.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-03-28T21:55:11.243 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-03-28T21:55:11.303 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether -lc should be explicitly linked in... no 2024-03-28T21:55:11.430 INFO:teuthology.orchestra.run.smithi153.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-03-28T21:55:11.431 INFO:teuthology.orchestra.run.smithi153.stdout:checking how to hardcode library paths into programs... immediate 2024-03-28T21:55:11.434 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether stripping libraries is possible... yes 2024-03-28T21:55:11.434 INFO:teuthology.orchestra.run.smithi153.stdout:checking if libtool supports shared libraries... yes 2024-03-28T21:55:11.434 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether to build shared libraries... yes 2024-03-28T21:55:11.434 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether to build static libraries... yes 2024-03-28T21:55:11.450 INFO:teuthology.orchestra.run.smithi153.stdout:checking for gcc... (cached) gcc 2024-03-28T21:55:11.494 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-03-28T21:55:11.494 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-28T21:55:11.494 INFO:teuthology.orchestra.run.smithi153.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-03-28T21:55:11.495 INFO:teuthology.orchestra.run.smithi153.stdout:checking for gmake... /usr/bin/gmake 2024-03-28T21:55:11.495 INFO:teuthology.orchestra.run.smithi153.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-03-28T21:55:11.496 INFO:teuthology.orchestra.run.smithi153.stdout:checking for tar... /bin/tar 2024-03-28T21:55:11.496 INFO:teuthology.orchestra.run.smithi153.stdout:checking for gzip... /bin/gzip 2024-03-28T21:55:11.517 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether gcc -MM is supported... yes 2024-03-28T21:55:11.518 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sort... /bin/sort 2024-03-28T21:55:11.518 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether ln -s works... yes 2024-03-28T21:55:11.518 INFO:teuthology.orchestra.run.smithi153.stdout:checking for rpm... /bin/rpm 2024-03-28T21:55:11.527 INFO:teuthology.orchestra.run.smithi153.stdout:checking for rpmbuild... no 2024-03-28T21:55:11.589 INFO:teuthology.orchestra.run.smithi153.stdout:checking assert.h usability... yes 2024-03-28T21:55:11.614 INFO:teuthology.orchestra.run.smithi153.stdout:checking assert.h presence... yes 2024-03-28T21:55:11.614 INFO:teuthology.orchestra.run.smithi153.stdout:checking for assert.h... yes 2024-03-28T21:55:11.688 INFO:teuthology.orchestra.run.smithi153.stdout:checking bstring.h usability... no 2024-03-28T21:55:11.721 INFO:teuthology.orchestra.run.smithi153.stdout:checking bstring.h presence... no 2024-03-28T21:55:11.722 INFO:teuthology.orchestra.run.smithi153.stdout:checking for bstring.h... no 2024-03-28T21:55:11.778 INFO:teuthology.orchestra.run.smithi153.stdout:checking libgen.h usability... yes 2024-03-28T21:55:11.800 INFO:teuthology.orchestra.run.smithi153.stdout:checking libgen.h presence... yes 2024-03-28T21:55:11.800 INFO:teuthology.orchestra.run.smithi153.stdout:checking for libgen.h... yes 2024-03-28T21:55:11.880 INFO:teuthology.orchestra.run.smithi153.stdout:checking dirent.h usability... yes 2024-03-28T21:55:11.909 INFO:teuthology.orchestra.run.smithi153.stdout:checking dirent.h presence... yes 2024-03-28T21:55:11.909 INFO:teuthology.orchestra.run.smithi153.stdout:checking for dirent.h... yes 2024-03-28T21:55:12.012 INFO:teuthology.orchestra.run.smithi153.stdout:checking errno.h usability... yes 2024-03-28T21:55:12.037 INFO:teuthology.orchestra.run.smithi153.stdout:checking errno.h presence... yes 2024-03-28T21:55:12.037 INFO:teuthology.orchestra.run.smithi153.stdout:checking for errno.h... yes 2024-03-28T21:55:12.128 INFO:teuthology.orchestra.run.smithi153.stdout:checking malloc.h usability... yes 2024-03-28T21:55:12.154 INFO:teuthology.orchestra.run.smithi153.stdout:checking malloc.h presence... yes 2024-03-28T21:55:12.155 INFO:teuthology.orchestra.run.smithi153.stdout:checking for malloc.h... yes 2024-03-28T21:55:12.222 INFO:teuthology.orchestra.run.smithi153.stdout:checking uuid.h usability... no 2024-03-28T21:55:12.258 INFO:teuthology.orchestra.run.smithi153.stdout:checking uuid.h presence... no 2024-03-28T21:55:12.258 INFO:teuthology.orchestra.run.smithi153.stdout:checking for uuid.h... no 2024-03-28T21:55:12.338 INFO:teuthology.orchestra.run.smithi153.stdout:checking uuid/uuid.h usability... yes 2024-03-28T21:55:12.368 INFO:teuthology.orchestra.run.smithi153.stdout:checking uuid/uuid.h presence... yes 2024-03-28T21:55:12.368 INFO:teuthology.orchestra.run.smithi153.stdout:checking for uuid/uuid.h... yes 2024-03-28T21:55:12.436 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/uuid.h usability... no 2024-03-28T21:55:12.469 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/uuid.h presence... no 2024-03-28T21:55:12.469 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/uuid.h... no 2024-03-28T21:55:12.542 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/file.h usability... yes 2024-03-28T21:55:12.569 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/file.h presence... yes 2024-03-28T21:55:12.569 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/file.h... yes 2024-03-28T21:55:12.648 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/fcntl.h usability... yes 2024-03-28T21:55:12.677 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/fcntl.h presence... yes 2024-03-28T21:55:12.678 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/fcntl.h... yes 2024-03-28T21:55:12.747 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/syssgi.h usability... no 2024-03-28T21:55:12.783 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/syssgi.h presence... no 2024-03-28T21:55:12.783 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/syssgi.h... no 2024-03-28T21:55:12.870 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/param.h usability... yes 2024-03-28T21:55:12.902 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/param.h presence... yes 2024-03-28T21:55:12.902 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/param.h... yes 2024-03-28T21:55:12.920 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/stat.h... (cached) yes 2024-03-28T21:55:12.994 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/statvfs.h usability... yes 2024-03-28T21:55:13.022 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/statvfs.h presence... yes 2024-03-28T21:55:13.022 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/statvfs.h... yes 2024-03-28T21:55:13.097 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/time.h usability... yes 2024-03-28T21:55:13.126 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/time.h presence... yes 2024-03-28T21:55:13.126 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/time.h... yes 2024-03-28T21:55:13.221 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/ioctl.h usability... yes 2024-03-28T21:55:13.248 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/ioctl.h presence... yes 2024-03-28T21:55:13.248 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/ioctl.h... yes 2024-03-28T21:55:13.320 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/wait.h usability... yes 2024-03-28T21:55:13.351 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/wait.h presence... yes 2024-03-28T21:55:13.351 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/wait.h... yes 2024-03-28T21:55:13.369 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/types.h... (cached) yes 2024-03-28T21:55:13.385 INFO:teuthology.orchestra.run.smithi153.stdout:checking for strings.h... (cached) yes 2024-03-28T21:55:13.459 INFO:teuthology.orchestra.run.smithi153.stdout:checking err.h usability... yes 2024-03-28T21:55:13.484 INFO:teuthology.orchestra.run.smithi153.stdout:checking err.h presence... yes 2024-03-28T21:55:13.485 INFO:teuthology.orchestra.run.smithi153.stdout:checking for err.h... yes 2024-03-28T21:55:13.565 INFO:teuthology.orchestra.run.smithi153.stdout:checking linux/falloc.h usability... yes 2024-03-28T21:55:13.591 INFO:teuthology.orchestra.run.smithi153.stdout:checking linux/falloc.h presence... yes 2024-03-28T21:55:13.591 INFO:teuthology.orchestra.run.smithi153.stdout:checking for linux/falloc.h... yes 2024-03-28T21:55:13.661 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-03-28T21:55:13.698 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-03-28T21:55:13.698 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/fs/xfs_fsops.h... no 2024-03-28T21:55:13.759 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/fs/xfs_itable.h usability... no 2024-03-28T21:55:13.791 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/fs/xfs_itable.h presence... no 2024-03-28T21:55:13.792 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/fs/xfs_itable.h... no 2024-03-28T21:55:13.854 INFO:teuthology.orchestra.run.smithi153.stdout:checking xfs/platform_defs.h usability... no 2024-03-28T21:55:13.898 INFO:teuthology.orchestra.run.smithi153.stdout:checking xfs/platform_defs.h presence... no 2024-03-28T21:55:13.898 INFO:teuthology.orchestra.run.smithi153.stdout:checking for xfs/platform_defs.h... no 2024-03-28T21:55:13.964 INFO:teuthology.orchestra.run.smithi153.stdout:checking btrfs/ioctl.h usability... no 2024-03-28T21:55:13.999 INFO:teuthology.orchestra.run.smithi153.stdout:checking btrfs/ioctl.h presence... no 2024-03-28T21:55:13.999 INFO:teuthology.orchestra.run.smithi153.stdout:checking for btrfs/ioctl.h... no 2024-03-28T21:55:14.056 INFO:teuthology.orchestra.run.smithi153.stdout:checking cifs/ioctl.h usability... no 2024-03-28T21:55:14.089 INFO:teuthology.orchestra.run.smithi153.stdout:checking cifs/ioctl.h presence... no 2024-03-28T21:55:14.089 INFO:teuthology.orchestra.run.smithi153.stdout:checking for cifs/ioctl.h... no 2024-03-28T21:55:14.154 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/mman.h usability... yes 2024-03-28T21:55:14.183 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/mman.h presence... yes 2024-03-28T21:55:14.184 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/mman.h... yes 2024-03-28T21:55:14.234 INFO:teuthology.orchestra.run.smithi153.stdout:checking for xfs/xfs_log_format.h... no 2024-03-28T21:55:14.323 INFO:teuthology.orchestra.run.smithi153.stdout:checking for uuid_compare... no 2024-03-28T21:55:14.397 INFO:teuthology.orchestra.run.smithi153.stdout:checking for uuid_compare in -luuid... yes 2024-03-28T21:55:14.512 INFO:teuthology.orchestra.run.smithi153.stdout:checking for xfs/xfs.h... yes 2024-03-28T21:55:14.563 INFO:teuthology.orchestra.run.smithi153.stdout:checking for xfs/libxfs.h... no 2024-03-28T21:55:14.627 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether xlog_assign_lsn is declared... no 2024-03-28T21:55:14.700 INFO:teuthology.orchestra.run.smithi153.stdout:checking for xfs/xqm.h... yes 2024-03-28T21:55:14.807 INFO:teuthology.orchestra.run.smithi153.stdout:checking xfsctl from xfs/xfs.h... ok 2024-03-28T21:55:14.870 INFO:teuthology.orchestra.run.smithi153.stdout:checking xfs/handle.h usability... yes 2024-03-28T21:55:14.894 INFO:teuthology.orchestra.run.smithi153.stdout:checking xfs/handle.h presence... yes 2024-03-28T21:55:14.894 INFO:teuthology.orchestra.run.smithi153.stdout:checking for xfs/handle.h... yes 2024-03-28T21:55:14.968 INFO:teuthology.orchestra.run.smithi153.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-03-28T21:55:15.023 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/acl.h usability... yes 2024-03-28T21:55:15.051 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/acl.h presence... yes 2024-03-28T21:55:15.051 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/acl.h... yes 2024-03-28T21:55:15.109 INFO:teuthology.orchestra.run.smithi153.stdout:checking acl/libacl.h usability... yes 2024-03-28T21:55:15.138 INFO:teuthology.orchestra.run.smithi153.stdout:checking acl/libacl.h presence... yes 2024-03-28T21:55:15.138 INFO:teuthology.orchestra.run.smithi153.stdout:checking for acl/libacl.h... yes 2024-03-28T21:55:15.217 INFO:teuthology.orchestra.run.smithi153.stdout:checking for acl_init in -lacl... yes 2024-03-28T21:55:15.274 INFO:teuthology.orchestra.run.smithi153.stdout:checking gdbm-ndbm.h usability... no 2024-03-28T21:55:15.311 INFO:teuthology.orchestra.run.smithi153.stdout:checking gdbm-ndbm.h presence... no 2024-03-28T21:55:15.311 INFO:teuthology.orchestra.run.smithi153.stdout:checking for gdbm-ndbm.h... no 2024-03-28T21:55:15.371 INFO:teuthology.orchestra.run.smithi153.stdout:checking gdbm/ndbm.h usability... yes 2024-03-28T21:55:15.399 INFO:teuthology.orchestra.run.smithi153.stdout:checking gdbm/ndbm.h presence... yes 2024-03-28T21:55:15.399 INFO:teuthology.orchestra.run.smithi153.stdout:checking for gdbm/ndbm.h... yes 2024-03-28T21:55:15.488 INFO:teuthology.orchestra.run.smithi153.stdout:checking for dbm_open in -lgdbm... no 2024-03-28T21:55:15.575 INFO:teuthology.orchestra.run.smithi153.stdout:checking for dbm_fetch in -lgdbm... no 2024-03-28T21:55:15.654 INFO:teuthology.orchestra.run.smithi153.stdout:checking for dbm_store in -lgdbm... no 2024-03-28T21:55:15.740 INFO:teuthology.orchestra.run.smithi153.stdout:checking for dbm_close in -lgdbm... no 2024-03-28T21:55:15.819 INFO:teuthology.orchestra.run.smithi153.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-03-28T21:55:15.898 INFO:teuthology.orchestra.run.smithi153.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-03-28T21:55:15.976 INFO:teuthology.orchestra.run.smithi153.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-03-28T21:55:16.053 INFO:teuthology.orchestra.run.smithi153.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-03-28T21:55:16.115 INFO:teuthology.orchestra.run.smithi153.stdout:checking libaio.h usability... yes 2024-03-28T21:55:16.147 INFO:teuthology.orchestra.run.smithi153.stdout:checking libaio.h presence... yes 2024-03-28T21:55:16.147 INFO:teuthology.orchestra.run.smithi153.stdout:checking for libaio.h... yes 2024-03-28T21:55:16.211 INFO:teuthology.orchestra.run.smithi153.stdout:checking liburing.h usability... no 2024-03-28T21:55:16.250 INFO:teuthology.orchestra.run.smithi153.stdout:checking liburing.h presence... no 2024-03-28T21:55:16.250 INFO:teuthology.orchestra.run.smithi153.stdout:checking for liburing.h... no 2024-03-28T21:55:16.314 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/capability.h usability... yes 2024-03-28T21:55:16.344 INFO:teuthology.orchestra.run.smithi153.stdout:checking sys/capability.h presence... yes 2024-03-28T21:55:16.344 INFO:teuthology.orchestra.run.smithi153.stdout:checking for sys/capability.h... yes 2024-03-28T21:55:16.402 INFO:teuthology.orchestra.run.smithi153.stdout:checking linux/fiemap.h usability... yes 2024-03-28T21:55:16.427 INFO:teuthology.orchestra.run.smithi153.stdout:checking linux/fiemap.h presence... yes 2024-03-28T21:55:16.427 INFO:teuthology.orchestra.run.smithi153.stdout:checking for linux/fiemap.h... yes 2024-03-28T21:55:16.508 INFO:teuthology.orchestra.run.smithi153.stdout:checking for fallocate... yes 2024-03-28T21:55:16.591 INFO:teuthology.orchestra.run.smithi153.stdout:checking for open_by_handle_at... yes 2024-03-28T21:55:16.649 INFO:teuthology.orchestra.run.smithi153.stdout:checking linux/fs.h usability... yes 2024-03-28T21:55:16.671 INFO:teuthology.orchestra.run.smithi153.stdout:checking linux/fs.h presence... yes 2024-03-28T21:55:16.672 INFO:teuthology.orchestra.run.smithi153.stdout:checking for linux/fs.h... yes 2024-03-28T21:55:16.724 INFO:teuthology.orchestra.run.smithi153.stdout:checking btrfsutil.h usability... no 2024-03-28T21:55:16.756 INFO:teuthology.orchestra.run.smithi153.stdout:checking btrfsutil.h presence... no 2024-03-28T21:55:16.757 INFO:teuthology.orchestra.run.smithi153.stdout:checking for btrfsutil.h... no 2024-03-28T21:55:16.843 INFO:teuthology.orchestra.run.smithi153.stdout:checking for copy_file_range... yes 2024-03-28T21:55:16.928 INFO:teuthology.orchestra.run.smithi153.stdout:checking for SEEK_DATA... yes 2024-03-28T21:55:17.033 INFO:teuthology.orchestra.run.smithi153.stdout:checking for BMV_OF_SHARED... yes 2024-03-28T21:55:17.111 INFO:teuthology.orchestra.run.smithi153.stdout:checking for nftw... yes 2024-03-28T21:55:17.187 INFO:teuthology.orchestra.run.smithi153.stdout:checking for RLIMIT_NOFILE... yes 2024-03-28T21:55:17.255 INFO:teuthology.orchestra.run.smithi153.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-03-28T21:55:17.336 INFO:teuthology.orchestra.run.smithi153.stdout:checking for FICLONE... yes 2024-03-28T21:55:17.408 INFO:teuthology.orchestra.run.smithi153.stdout:checking for renameat2... yes 2024-03-28T21:55:17.480 INFO:teuthology.orchestra.run.smithi153.stdout:checking for reallocarray... yes 2024-03-28T21:55:17.577 INFO:teuthology.orchestra.run.smithi153.stdout:checking for struct mount_attr... yes 2024-03-28T21:55:17.673 INFO:teuthology.orchestra.run.smithi153.stdout:checking for struct btrfs_qgroup_limit... yes 2024-03-28T21:55:17.756 INFO:teuthology.orchestra.run.smithi153.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-03-28T21:55:17.850 INFO:teuthology.orchestra.run.smithi153.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-03-28T21:55:17.951 INFO:teuthology.orchestra.run.smithi153.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-03-28T21:55:18.051 INFO:teuthology.orchestra.run.smithi153.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-03-28T21:55:18.152 INFO:teuthology.orchestra.run.smithi153.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-03-28T21:55:18.254 INFO:teuthology.orchestra.run.smithi153.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-03-28T21:55:18.325 INFO:teuthology.orchestra.run.smithi153.stdout:checking linux/btrfs.h usability... yes 2024-03-28T21:55:18.347 INFO:teuthology.orchestra.run.smithi153.stdout:checking linux/btrfs.h presence... yes 2024-03-28T21:55:18.347 INFO:teuthology.orchestra.run.smithi153.stdout:checking for linux/btrfs.h... yes 2024-03-28T21:55:18.423 INFO:teuthology.orchestra.run.smithi153.stdout:checking linux/btrfs_tree.h usability... yes 2024-03-28T21:55:18.447 INFO:teuthology.orchestra.run.smithi153.stdout:checking linux/btrfs_tree.h presence... yes 2024-03-28T21:55:18.447 INFO:teuthology.orchestra.run.smithi153.stdout:checking for linux/btrfs_tree.h... yes 2024-03-28T21:55:18.505 INFO:teuthology.orchestra.run.smithi153.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-03-28T21:55:18.569 INFO:teuthology.orchestra.run.smithi153.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-03-28T21:55:18.605 INFO:teuthology.orchestra.run.smithi153.stdout:configure: creating ./config.status 2024-03-28T21:55:19.751 INFO:teuthology.orchestra.run.smithi153.stdout:config.status: creating include/builddefs 2024-03-28T21:55:19.783 INFO:teuthology.orchestra.run.smithi153.stdout:config.status: creating include/config.h 2024-03-28T21:55:19.809 INFO:teuthology.orchestra.run.smithi153.stdout:config.status: executing libtool commands 2024-03-28T21:55:19.906 INFO:teuthology.orchestra.run.smithi153.stdout:Building include 2024-03-28T21:55:19.915 INFO:teuthology.orchestra.run.smithi153.stdout:Building lib 2024-03-28T21:55:19.923 INFO:teuthology.orchestra.run.smithi153.stdout: [LTDEP] 2024-03-28T21:55:20.264 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] dataascii.lo 2024-03-28T21:55:20.520 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] databin.lo 2024-03-28T21:55:20.824 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] datapid.lo 2024-03-28T21:55:21.091 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] file_lock.lo 2024-03-28T21:55:21.375 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] forker.lo 2024-03-28T21:55:21.644 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] pattern.lo 2024-03-28T21:55:21.878 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] open_flags.lo 2024-03-28T21:55:22.136 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:55:22.146 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:55:22.155 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] random_range.lo 2024-03-28T21:55:22.511 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] string_to_tokens.lo 2024-03-28T21:55:22.723 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] str_to_bytes.lo 2024-03-28T21:55:22.975 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] tlibio.lo 2024-03-28T21:55:23.331 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] write_log.lo 2024-03-28T21:55:23.684 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] random.lo 2024-03-28T21:55:23.901 INFO:teuthology.orchestra.run.smithi153.stdout: [LD] 2024-03-28T21:55:24.070 INFO:teuthology.orchestra.run.smithi153.stdout:Building ltp 2024-03-28T21:55:24.077 INFO:teuthology.orchestra.run.smithi153.stdout: [DEP] 2024-03-28T21:55:24.387 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] doio 2024-03-28T21:55:25.265 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] fsstress 2024-03-28T21:55:27.094 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] fsx 2024-03-28T21:55:28.042 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] growfiles 2024-03-28T21:55:28.753 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] iogen 2024-03-28T21:55:29.320 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-stress 2024-03-28T21:55:29.895 INFO:teuthology.orchestra.run.smithi153.stdout:Building src 2024-03-28T21:55:29.910 INFO:teuthology.orchestra.run.smithi153.stdout: [DEP] 2024-03-28T21:55:33.710 INFO:teuthology.orchestra.run.smithi153.stdout: [DEP] 2024-03-28T21:55:33.779 INFO:teuthology.orchestra.run.smithi153.stdout: [DEP] 2024-03-28T21:55:33.797 INFO:teuthology.orchestra.run.smithi153.stdout: [DEP] 2024-03-28T21:55:34.270 INFO:teuthology.orchestra.run.smithi153.stdout: [DEP] 2024-03-28T21:55:34.324 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] dirstress 2024-03-28T21:55:34.750 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] fill 2024-03-28T21:55:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] fill2 2024-03-28T21:55:35.383 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] getpagesize 2024-03-28T21:55:35.672 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] holes 2024-03-28T21:55:36.102 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] lstat64 2024-03-28T21:55:36.418 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] nametest 2024-03-28T21:55:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] permname 2024-03-28T21:55:37.231 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] randholes 2024-03-28T21:55:37.652 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] runas 2024-03-28T21:55:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] truncfile 2024-03-28T21:55:38.264 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] usemem 2024-03-28T21:55:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] mmapcat 2024-03-28T21:55:38.870 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] append_reader 2024-03-28T21:55:39.185 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] append_writer 2024-03-28T21:55:39.478 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] dirperf 2024-03-28T21:55:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] metaperf 2024-03-28T21:55:40.247 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] devzero 2024-03-28T21:55:40.548 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] feature 2024-03-28T21:55:40.905 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] alloc 2024-03-28T21:55:41.250 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] fault 2024-03-28T21:55:41.550 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] fstest 2024-03-28T21:55:41.947 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_access_root 2024-03-28T21:55:42.231 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] godown 2024-03-28T21:55:42.555 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] resvtest 2024-03-28T21:55:42.882 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] writemod 2024-03-28T21:55:43.251 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] writev_on_pagefault 2024-03-28T21:55:43.562 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] makeextents 2024-03-28T21:55:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] itrash 2024-03-28T21:55:44.207 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] rename 2024-03-28T21:55:44.536 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] multi_open_unlink 2024-03-28T21:55:44.853 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] unwritten_sync 2024-03-28T21:55:45.188 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] genhashnames 2024-03-28T21:55:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_holes 2024-03-28T21:55:45.786 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_mmap_writev 2024-03-28T21:55:46.084 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_truncate_cmtime 2024-03-28T21:55:46.410 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] dirhash_collide 2024-03-28T21:55:46.730 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_rename_overwrite 2024-03-28T21:55:47.019 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] holetest 2024-03-28T21:55:47.427 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_truncate_self 2024-03-28T21:55:47.726 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] af_unix 2024-03-28T21:55:48.036 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_mmap_stale_pmd 2024-03-28T21:55:48.372 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_mmap_cow_race 2024-03-28T21:55:48.691 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_mmap_fallocate 2024-03-28T21:55:48.963 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] fsync-err 2024-03-28T21:55:49.276 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_mmap_write_ro 2024-03-28T21:55:49.556 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_ext4_dax_journal_corruption 2024-03-28T21:55:49.851 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_ext4_dax_inline_corruption 2024-03-28T21:55:50.128 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_ofd_locks 2024-03-28T21:55:50.475 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_mmap_collision 2024-03-28T21:55:50.836 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] mmap-write-concurrent 2024-03-28T21:55:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_get_file_time 2024-03-28T21:55:51.416 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_create_short_dirs 2024-03-28T21:55:51.741 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_create_long_dirs 2024-03-28T21:55:52.081 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_enospc 2024-03-28T21:55:52.282 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:55:52.287 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:55:52.396 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_mmap_writev_overlap 2024-03-28T21:55:52.687 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] checkpoint_journal 2024-03-28T21:55:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] mmap-rw-fault 2024-03-28T21:55:53.344 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] allocstale 2024-03-28T21:55:53.657 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_mmap_cow_memory_failure 2024-03-28T21:55:54.042 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] fake-dump-rootino 2024-03-28T21:55:54.382 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] dio-buf-fault 2024-03-28T21:55:54.673 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] rewinddir-test 2024-03-28T21:55:54.998 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] readdir-while-renames 2024-03-28T21:55:55.302 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] xfsctl 2024-03-28T21:55:55.628 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] bstat 2024-03-28T21:55:55.985 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_mtab 2024-03-28T21:55:56.316 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] getdevicesize 2024-03-28T21:55:56.618 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] preallo_rw_pattern_reader 2024-03-28T21:55:56.892 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] preallo_rw_pattern_writer 2024-03-28T21:55:57.180 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] ftrunc 2024-03-28T21:55:57.463 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] trunc 2024-03-28T21:55:57.781 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] fs_perms 2024-03-28T21:55:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] testx 2024-03-28T21:55:58.379 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] looptest 2024-03-28T21:55:58.754 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] locktest 2024-03-28T21:55:59.289 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] unwritten_mmap 2024-03-28T21:55:59.619 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] bulkstat_unlink_test 2024-03-28T21:55:59.988 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] deduperace 2024-03-28T21:56:00.310 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] bulkstat_unlink_test_modified 2024-03-28T21:56:00.643 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_dir_offset 2024-03-28T21:56:00.920 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_futimens 2024-03-28T21:56:01.207 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_immutable 2024-03-28T21:56:02.040 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] stale_handle 2024-03-28T21:56:02.340 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] pwrite_mmap_blocked 2024-03-28T21:56:02.622 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_dir_offset2 2024-03-28T21:56:02.947 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] seek_sanity_test 2024-03-28T21:56:03.559 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] seek_copy_test 2024-03-28T21:56:03.977 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_readdir_1 2024-03-28T21:56:04.260 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_readdir_2 2024-03-28T21:56:04.590 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] fsync-tester 2024-03-28T21:56:04.972 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] nsexec 2024-03-28T21:56:05.324 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] cloner 2024-03-28T21:56:05.667 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] renameat2 2024-03-28T21:56:05.977 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_getcwd 2024-03-28T21:56:06.278 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] e4compact 2024-03-28T21:56:06.614 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] test-nextquota 2024-03-28T21:56:06.931 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] punch-alternating 2024-03-28T21:56:07.246 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] attr-list-by-handle-cursor-test 2024-03-28T21:56:07.545 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] listxattr 2024-03-28T21:56:07.822 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] dio-interleaved 2024-03-28T21:56:08.121 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_dir_type 2024-03-28T21:56:08.423 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] dio-invalidate-cache 2024-03-28T21:56:08.766 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] stat_test 2024-03-28T21:56:09.249 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_encrypted_d_revalidate 2024-03-28T21:56:09.549 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] attr_replace_test 2024-03-28T21:56:09.842 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] swapon 2024-03-28T21:56:10.194 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] mkswap 2024-03-28T21:56:10.462 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_attr_corruption 2024-03-28T21:56:10.731 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_open_tmpfiles 2024-03-28T21:56:11.040 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] fscrypt-crypt-util 2024-03-28T21:56:11.910 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] bulkstat_null_ocount 2024-03-28T21:56:12.211 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] splice-test 2024-03-28T21:56:12.516 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] chprojid_fail 2024-03-28T21:56:12.825 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] detached_mounts_propagation 2024-03-28T21:56:13.190 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] ext4_resize 2024-03-28T21:56:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_readdir_3 2024-03-28T21:56:13.822 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] splice2pipe 2024-03-28T21:56:14.111 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] uuid_ioctl 2024-03-28T21:56:14.383 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_snapshot_deleted_subvolume 2024-03-28T21:56:14.746 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] fiemap-tester 2024-03-28T21:56:15.163 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_stripealign 2024-03-28T21:56:15.464 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] open_by_handle 2024-03-28T21:56:15.911 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] dbtest 2024-03-28T21:56:16.297 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_mmap_dio 2024-03-28T21:56:16.597 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] xfsfind 2024-03-28T21:56:16.933 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] t_reflink_read_race 2024-03-28T21:56:17.262 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] fssum 2024-03-28T21:56:17.913 INFO:teuthology.orchestra.run.smithi153.stdout:Building log-writes 2024-03-28T21:56:17.927 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] replay-log 2024-03-28T21:56:18.401 INFO:teuthology.orchestra.run.smithi153.stdout:Building perf 2024-03-28T21:56:18.412 INFO:teuthology.orchestra.run.smithi153.stdout:Building aio-dio-regress 2024-03-28T21:56:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aiocp 2024-03-28T21:56:18.811 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-dio-append-write-fallocate-race 2024-03-28T21:56:19.112 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-dio-append-write-read-race 2024-03-28T21:56:19.423 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-dio-cow-race 2024-03-28T21:56:19.748 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-dio-cycle-write 2024-03-28T21:56:20.062 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-dio-eof-race 2024-03-28T21:56:20.370 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-dio-extend-stat 2024-03-28T21:56:20.660 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-dio-fcntl-race 2024-03-28T21:56:20.962 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-dio-hole-filling-race 2024-03-28T21:56:21.235 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-dio-invalidate-failure 2024-03-28T21:56:21.543 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-dio-invalidate-readahead 2024-03-28T21:56:21.842 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aiodio_sparse2 2024-03-28T21:56:22.219 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-dio-subblock-eof-read 2024-03-28T21:56:22.427 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:56:22.433 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:56:22.551 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-dio-write-verify 2024-03-28T21:56:22.864 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-03-28T21:56:23.112 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-03-28T21:56:23.356 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] aio-last-ref-held-by-io 2024-03-28T21:56:23.667 INFO:teuthology.orchestra.run.smithi153.stdout:Building vfs 2024-03-28T21:56:23.683 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] vfstest 2024-03-28T21:56:27.711 INFO:teuthology.orchestra.run.smithi153.stdout: [CC] mount-idmapped 2024-03-28T21:56:28.262 INFO:teuthology.orchestra.run.smithi153.stdout:Building m4 2024-03-28T21:56:28.272 INFO:teuthology.orchestra.run.smithi153.stdout:Building common 2024-03-28T21:56:28.282 INFO:teuthology.orchestra.run.smithi153.stdout:Building tests 2024-03-28T21:56:28.297 INFO:teuthology.orchestra.run.smithi153.stdout:Building btrfs 2024-03-28T21:56:28.313 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/btrfs/group.list 2024-03-28T21:56:28.543 INFO:teuthology.orchestra.run.smithi153.stdout:Building ceph 2024-03-28T21:56:28.558 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/ceph/group.list 2024-03-28T21:56:28.611 INFO:teuthology.orchestra.run.smithi153.stdout:Building cifs 2024-03-28T21:56:28.624 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/cifs/group.list 2024-03-28T21:56:28.661 INFO:teuthology.orchestra.run.smithi153.stdout:Building ext4 2024-03-28T21:56:28.672 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/ext4/group.list 2024-03-28T21:56:28.795 INFO:teuthology.orchestra.run.smithi153.stdout:Building f2fs 2024-03-28T21:56:28.807 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/f2fs/group.list 2024-03-28T21:56:28.867 INFO:teuthology.orchestra.run.smithi153.stdout:Building generic 2024-03-28T21:56:28.883 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/generic/group.list 2024-03-28T21:56:29.240 INFO:teuthology.orchestra.run.smithi153.stdout:Building nfs 2024-03-28T21:56:29.254 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/nfs/group.list 2024-03-28T21:56:29.304 INFO:teuthology.orchestra.run.smithi153.stdout:Building ocfs2 2024-03-28T21:56:29.318 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/ocfs2/group.list 2024-03-28T21:56:29.361 INFO:teuthology.orchestra.run.smithi153.stdout:Building overlay 2024-03-28T21:56:29.372 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/overlay/group.list 2024-03-28T21:56:29.526 INFO:teuthology.orchestra.run.smithi153.stdout:Building perf 2024-03-28T21:56:29.541 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/perf/group.list 2024-03-28T21:56:29.582 INFO:teuthology.orchestra.run.smithi153.stdout:Building selftest 2024-03-28T21:56:29.597 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/selftest/group.list 2024-03-28T21:56:29.641 INFO:teuthology.orchestra.run.smithi153.stdout:Building shared 2024-03-28T21:56:29.653 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/shared/group.list 2024-03-28T21:56:29.709 INFO:teuthology.orchestra.run.smithi153.stdout:Building tmpfs 2024-03-28T21:56:29.722 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/tmpfs/group.list 2024-03-28T21:56:29.763 INFO:teuthology.orchestra.run.smithi153.stdout:Building udf 2024-03-28T21:56:29.776 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/udf/group.list 2024-03-28T21:56:29.812 INFO:teuthology.orchestra.run.smithi153.stdout:Building xfs 2024-03-28T21:56:29.827 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/xfs/group.list 2024-03-28T21:56:30.170 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo make install) 2024-03-28T21:56:30.272 INFO:teuthology.orchestra.run.smithi153.stdout:Building include 2024-03-28T21:56:30.279 INFO:teuthology.orchestra.run.smithi153.stdout:Building lib 2024-03-28T21:56:30.288 INFO:teuthology.orchestra.run.smithi153.stdout:Building ltp 2024-03-28T21:56:30.298 INFO:teuthology.orchestra.run.smithi153.stdout:Building src 2024-03-28T21:56:30.377 INFO:teuthology.orchestra.run.smithi153.stdout:Building log-writes 2024-03-28T21:56:30.387 INFO:teuthology.orchestra.run.smithi153.stdout:Building perf 2024-03-28T21:56:30.398 INFO:teuthology.orchestra.run.smithi153.stdout:Building aio-dio-regress 2024-03-28T21:56:30.409 INFO:teuthology.orchestra.run.smithi153.stdout:Building vfs 2024-03-28T21:56:30.420 INFO:teuthology.orchestra.run.smithi153.stdout:Building m4 2024-03-28T21:56:30.431 INFO:teuthology.orchestra.run.smithi153.stdout:Building common 2024-03-28T21:56:30.440 INFO:teuthology.orchestra.run.smithi153.stdout:Building tests 2024-03-28T21:56:30.454 INFO:teuthology.orchestra.run.smithi153.stdout:Building btrfs 2024-03-28T21:56:30.469 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/btrfs/group.list 2024-03-28T21:56:30.694 INFO:teuthology.orchestra.run.smithi153.stdout:Building ceph 2024-03-28T21:56:30.708 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/ceph/group.list 2024-03-28T21:56:30.760 INFO:teuthology.orchestra.run.smithi153.stdout:Building cifs 2024-03-28T21:56:30.773 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/cifs/group.list 2024-03-28T21:56:30.822 INFO:teuthology.orchestra.run.smithi153.stdout:Building ext4 2024-03-28T21:56:30.837 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/ext4/group.list 2024-03-28T21:56:30.966 INFO:teuthology.orchestra.run.smithi153.stdout:Building f2fs 2024-03-28T21:56:30.980 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/f2fs/group.list 2024-03-28T21:56:31.036 INFO:teuthology.orchestra.run.smithi153.stdout:Building generic 2024-03-28T21:56:31.051 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/generic/group.list 2024-03-28T21:56:31.387 INFO:teuthology.orchestra.run.smithi153.stdout:Building nfs 2024-03-28T21:56:31.401 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/nfs/group.list 2024-03-28T21:56:31.453 INFO:teuthology.orchestra.run.smithi153.stdout:Building ocfs2 2024-03-28T21:56:31.467 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/ocfs2/group.list 2024-03-28T21:56:31.515 INFO:teuthology.orchestra.run.smithi153.stdout:Building overlay 2024-03-28T21:56:31.529 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/overlay/group.list 2024-03-28T21:56:31.673 INFO:teuthology.orchestra.run.smithi153.stdout:Building perf 2024-03-28T21:56:31.685 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/perf/group.list 2024-03-28T21:56:31.722 INFO:teuthology.orchestra.run.smithi153.stdout:Building selftest 2024-03-28T21:56:31.733 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/selftest/group.list 2024-03-28T21:56:31.770 INFO:teuthology.orchestra.run.smithi153.stdout:Building shared 2024-03-28T21:56:31.782 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/shared/group.list 2024-03-28T21:56:31.836 INFO:teuthology.orchestra.run.smithi153.stdout:Building tmpfs 2024-03-28T21:56:31.848 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/tmpfs/group.list 2024-03-28T21:56:31.896 INFO:teuthology.orchestra.run.smithi153.stdout:Building udf 2024-03-28T21:56:31.909 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/udf/group.list 2024-03-28T21:56:31.946 INFO:teuthology.orchestra.run.smithi153.stdout:Building xfs 2024-03-28T21:56:31.962 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/xfs/group.list 2024-03-28T21:56:32.313 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-03-28T21:56:32.316 INFO:teuthology.orchestra.run.smithi153.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-28T21:56:32.317 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-03-28T21:56:32.322 INFO:teuthology.orchestra.run.smithi153.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-28T21:56:32.322 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-03-28T21:56:32.327 INFO:teuthology.orchestra.run.smithi153.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-03-28T21:56:32.359 INFO:teuthology.orchestra.run.smithi153.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-03-28T21:56:32.596 INFO:teuthology.orchestra.run.smithi153.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-03-28T21:56:32.627 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-03-28T21:56:32.669 INFO:teuthology.orchestra.run.smithi153.stdout:Building log-writes 2024-03-28T21:56:32.679 INFO:teuthology.orchestra.run.smithi153.stdout:Building perf 2024-03-28T21:56:32.689 INFO:teuthology.orchestra.run.smithi153.stdout:Building aio-dio-regress 2024-03-28T21:56:32.700 INFO:teuthology.orchestra.run.smithi153.stdout:Building vfs 2024-03-28T21:56:32.707 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake -C log-writes install 2024-03-28T21:56:32.711 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-03-28T21:56:32.740 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-03-28T21:56:32.770 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake -C perf install 2024-03-28T21:56:32.773 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-03-28T21:56:32.798 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-03-28T21:56:32.875 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-03-28T21:56:32.882 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-03-28T21:56:32.911 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-03-28T21:56:33.090 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake -C vfs install 2024-03-28T21:56:33.093 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-03-28T21:56:33.128 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-03-28T21:56:33.170 INFO:teuthology.orchestra.run.smithi153.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-03-28T21:56:33.201 INFO:teuthology.orchestra.run.smithi153.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-03-28T21:56:37.288 INFO:teuthology.orchestra.run.smithi153.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-03-28T21:56:37.586 INFO:teuthology.orchestra.run.smithi153.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-03-28T21:56:37.664 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-03-28T21:56:37.667 INFO:teuthology.orchestra.run.smithi153.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-28T21:56:37.667 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-03-28T21:56:37.670 INFO:teuthology.orchestra.run.smithi153.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-03-28T21:56:37.700 INFO:teuthology.orchestra.run.smithi153.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-03-28T21:56:38.191 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-03-28T21:56:38.194 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/btrfs/ install 2024-03-28T21:56:38.202 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/btrfs/group.list 2024-03-28T21:56:38.398 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-03-28T21:56:38.427 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 /var/lib/xfstests/tests/btrfs 2024-03-28T21:56:41.733 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-03-28T21:56:41.765 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out /var/lib/xfstests/tests/btrfs 2024-03-28T21:56:44.975 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/ceph/ install 2024-03-28T21:56:44.982 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/ceph/group.list 2024-03-28T21:56:45.029 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-03-28T21:56:45.056 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-03-28T21:56:45.129 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-03-28T21:56:45.162 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-03-28T21:56:45.232 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/cifs/ install 2024-03-28T21:56:45.238 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/cifs/group.list 2024-03-28T21:56:45.274 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-03-28T21:56:45.305 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-03-28T21:56:45.336 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-03-28T21:56:45.365 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-03-28T21:56:45.397 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/ext4/ install 2024-03-28T21:56:45.405 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/ext4/group.list 2024-03-28T21:56:45.549 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-03-28T21:56:45.578 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-03-28T21:56:46.227 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-03-28T21:56:46.260 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-03-28T21:56:46.943 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/f2fs/ install 2024-03-28T21:56:46.948 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/f2fs/group.list 2024-03-28T21:56:46.993 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-03-28T21:56:47.016 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-03-28T21:56:47.047 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-03-28T21:56:47.073 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-03-28T21:56:47.108 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/generic/ install 2024-03-28T21:56:47.115 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/generic/group.list 2024-03-28T21:56:47.438 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-03-28T21:56:47.464 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 /var/lib/xfstests/tests/generic 2024-03-28T21:56:52.566 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:56:52.573 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:56:54.821 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-03-28T21:56:54.849 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out /var/lib/xfstests/tests/generic 2024-03-28T21:57:01.975 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/nfs/ install 2024-03-28T21:57:01.982 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/nfs/group.list 2024-03-28T21:57:02.031 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-03-28T21:57:02.058 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-03-28T21:57:02.086 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-03-28T21:57:02.114 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-03-28T21:57:02.142 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/ocfs2/ install 2024-03-28T21:57:02.148 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/ocfs2/group.list 2024-03-28T21:57:02.189 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-03-28T21:57:02.218 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-03-28T21:57:02.246 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-03-28T21:57:02.275 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-03-28T21:57:02.305 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/overlay/ install 2024-03-28T21:57:02.312 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/overlay/group.list 2024-03-28T21:57:02.439 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-03-28T21:57:02.468 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-03-28T21:57:03.460 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-03-28T21:57:03.490 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-03-28T21:57:04.482 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/perf/ install 2024-03-28T21:57:04.487 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/perf/group.list 2024-03-28T21:57:04.521 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-03-28T21:57:04.552 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-03-28T21:57:04.584 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-03-28T21:57:04.616 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-03-28T21:57:04.647 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/selftest/ install 2024-03-28T21:57:04.653 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/selftest/group.list 2024-03-28T21:57:04.698 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-03-28T21:57:04.729 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-03-28T21:57:04.806 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-03-28T21:57:04.837 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-03-28T21:57:04.920 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/shared/ install 2024-03-28T21:57:04.927 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/shared/group.list 2024-03-28T21:57:04.989 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-03-28T21:57:05.017 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-03-28T21:57:05.057 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-03-28T21:57:05.084 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-03-28T21:57:05.132 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/tmpfs/ install 2024-03-28T21:57:05.137 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/tmpfs/group.list 2024-03-28T21:57:05.174 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-03-28T21:57:05.201 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-03-28T21:57:05.229 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-03-28T21:57:05.257 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-03-28T21:57:05.285 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/udf/ install 2024-03-28T21:57:05.291 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/udf/group.list 2024-03-28T21:57:05.323 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-03-28T21:57:05.350 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-03-28T21:57:05.375 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-03-28T21:57:05.402 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-03-28T21:57:05.434 INFO:teuthology.orchestra.run.smithi153.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.0cGUU1Musyxfstests-dev/tests/xfs/ install 2024-03-28T21:57:05.443 INFO:teuthology.orchestra.run.smithi153.stdout: [GROUP] /tmp/tmp.0cGUU1Musyxfstests-dev/tests/xfs/group.list 2024-03-28T21:57:05.789 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-03-28T21:57:05.820 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-03-28T21:57:13.274 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-03-28T21:57:13.306 INFO:teuthology.orchestra.run.smithi153.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-03-28T21:57:20.567 INFO:teuthology.orchestra.run.smithi153.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-03-28T21:57:20.599 INFO:teuthology.orchestra.run.smithi153.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-03-28T21:57:20.631 INFO:teuthology.orchestra.run.smithi153.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-03-28T21:57:20.664 INFO:teuthology.orchestra.run.smithi153.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-03-28T21:57:20.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T21:57:20.704 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec ls tests/generic) 2024-03-28T21:57:20.754 INFO:teuthology.orchestra.run.smithi153.stdout:001 2024-03-28T21:57:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:001.out 2024-03-28T21:57:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:002 2024-03-28T21:57:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:002.out 2024-03-28T21:57:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:003 2024-03-28T21:57:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:003.out 2024-03-28T21:57:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:004 2024-03-28T21:57:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:004.out 2024-03-28T21:57:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:005 2024-03-28T21:57:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:005.out 2024-03-28T21:57:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:006 2024-03-28T21:57:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:006.out 2024-03-28T21:57:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:007 2024-03-28T21:57:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:007.out 2024-03-28T21:57:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:008 2024-03-28T21:57:20.756 INFO:teuthology.orchestra.run.smithi153.stdout:008.out 2024-03-28T21:57:20.756 INFO:teuthology.orchestra.run.smithi153.stdout:009 2024-03-28T21:57:20.756 INFO:teuthology.orchestra.run.smithi153.stdout:009.out 2024-03-28T21:57:20.756 INFO:teuthology.orchestra.run.smithi153.stdout:010 2024-03-28T21:57:20.756 INFO:teuthology.orchestra.run.smithi153.stdout:010.out 2024-03-28T21:57:20.756 INFO:teuthology.orchestra.run.smithi153.stdout:011 2024-03-28T21:57:20.756 INFO:teuthology.orchestra.run.smithi153.stdout:011.out 2024-03-28T21:57:20.756 INFO:teuthology.orchestra.run.smithi153.stdout:012 2024-03-28T21:57:20.756 INFO:teuthology.orchestra.run.smithi153.stdout:012.out 2024-03-28T21:57:20.756 INFO:teuthology.orchestra.run.smithi153.stdout:013 2024-03-28T21:57:20.756 INFO:teuthology.orchestra.run.smithi153.stdout:013.out 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:014 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:014.out 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:015 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:015.out 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:016 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:016.out 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:017 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:017.out 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:018 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:018.out 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:019 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:019.out 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:020 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:020.out 2024-03-28T21:57:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:021 2024-03-28T21:57:20.758 INFO:teuthology.orchestra.run.smithi153.stdout:021.out 2024-03-28T21:57:20.758 INFO:teuthology.orchestra.run.smithi153.stdout:022 2024-03-28T21:57:20.758 INFO:teuthology.orchestra.run.smithi153.stdout:022.out 2024-03-28T21:57:20.758 INFO:teuthology.orchestra.run.smithi153.stdout:023 2024-03-28T21:57:20.758 INFO:teuthology.orchestra.run.smithi153.stdout:023.out 2024-03-28T21:57:20.758 INFO:teuthology.orchestra.run.smithi153.stdout:024 2024-03-28T21:57:20.758 INFO:teuthology.orchestra.run.smithi153.stdout:024.out 2024-03-28T21:57:20.758 INFO:teuthology.orchestra.run.smithi153.stdout:025 2024-03-28T21:57:20.758 INFO:teuthology.orchestra.run.smithi153.stdout:025.out 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:026 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:026.out 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:027 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:027.out 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:028 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:028.out 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:029 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:029.out 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:030 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:030.out 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:031 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:031.out 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:032 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:032.out 2024-03-28T21:57:20.759 INFO:teuthology.orchestra.run.smithi153.stdout:033 2024-03-28T21:57:20.760 INFO:teuthology.orchestra.run.smithi153.stdout:033.out 2024-03-28T21:57:20.760 INFO:teuthology.orchestra.run.smithi153.stdout:034 2024-03-28T21:57:20.760 INFO:teuthology.orchestra.run.smithi153.stdout:034.out 2024-03-28T21:57:20.760 INFO:teuthology.orchestra.run.smithi153.stdout:035 2024-03-28T21:57:20.760 INFO:teuthology.orchestra.run.smithi153.stdout:035.cfg 2024-03-28T21:57:20.760 INFO:teuthology.orchestra.run.smithi153.stdout:035.out.default 2024-03-28T21:57:20.760 INFO:teuthology.orchestra.run.smithi153.stdout:035.out.nfs 2024-03-28T21:57:20.760 INFO:teuthology.orchestra.run.smithi153.stdout:036 2024-03-28T21:57:20.760 INFO:teuthology.orchestra.run.smithi153.stdout:036.out 2024-03-28T21:57:20.760 INFO:teuthology.orchestra.run.smithi153.stdout:037 2024-03-28T21:57:20.760 INFO:teuthology.orchestra.run.smithi153.stdout:037.out 2024-03-28T21:57:20.760 INFO:teuthology.orchestra.run.smithi153.stdout:038 2024-03-28T21:57:20.760 INFO:teuthology.orchestra.run.smithi153.stdout:038.out 2024-03-28T21:57:20.760 INFO:teuthology.orchestra.run.smithi153.stdout:039 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:039.out 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:040 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:040.out 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:041 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:041.out 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:042 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:042.out 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:043 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:043.out 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:044 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:044.out 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:045 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:045.out 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:046 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:046.out 2024-03-28T21:57:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:047 2024-03-28T21:57:20.762 INFO:teuthology.orchestra.run.smithi153.stdout:047.out 2024-03-28T21:57:20.762 INFO:teuthology.orchestra.run.smithi153.stdout:048 2024-03-28T21:57:20.762 INFO:teuthology.orchestra.run.smithi153.stdout:048.out 2024-03-28T21:57:20.762 INFO:teuthology.orchestra.run.smithi153.stdout:049 2024-03-28T21:57:20.762 INFO:teuthology.orchestra.run.smithi153.stdout:049.out 2024-03-28T21:57:20.762 INFO:teuthology.orchestra.run.smithi153.stdout:050 2024-03-28T21:57:20.762 INFO:teuthology.orchestra.run.smithi153.stdout:050.cfg 2024-03-28T21:57:20.762 INFO:teuthology.orchestra.run.smithi153.stdout:050.out.default 2024-03-28T21:57:20.762 INFO:teuthology.orchestra.run.smithi153.stdout:050.out.nojournal 2024-03-28T21:57:20.762 INFO:teuthology.orchestra.run.smithi153.stdout:050.out.xfsquota 2024-03-28T21:57:20.762 INFO:teuthology.orchestra.run.smithi153.stdout:051 2024-03-28T21:57:20.762 INFO:teuthology.orchestra.run.smithi153.stdout:051.out 2024-03-28T21:57:20.762 INFO:teuthology.orchestra.run.smithi153.stdout:052 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:052.out 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:053 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:053.out 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:054 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:054.out 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:055 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:055.out 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:056 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:056.out 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:057 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:057.out 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:058 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:058.out 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:059 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:059.out 2024-03-28T21:57:20.763 INFO:teuthology.orchestra.run.smithi153.stdout:060 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:060.out 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:061 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:061.out 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:062 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:062.out 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:063 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:063.out 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:064 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:064.out 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:065 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:065.out 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:066 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:066.out 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:067 2024-03-28T21:57:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:067.out 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:068 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:068.out 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:069 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:069.out 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:070 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:070.out 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:071 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:071.out 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:072 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:072.out 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:073 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:073.out 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:074 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:074.out 2024-03-28T21:57:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:075 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:075.out 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:076 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:076.out 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:077 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:077.out 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:078 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:078.out 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:079 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:079.out 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:080 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:080.out 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:081 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:081.out 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:082 2024-03-28T21:57:20.766 INFO:teuthology.orchestra.run.smithi153.stdout:082.out 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:083 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:083.out 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:084 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:084.out 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:085 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:085.out 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:086 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:086.out 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:087 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:087.out 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:088 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:088.out 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:089 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:089.out 2024-03-28T21:57:20.767 INFO:teuthology.orchestra.run.smithi153.stdout:090 2024-03-28T21:57:20.768 INFO:teuthology.orchestra.run.smithi153.stdout:090.out 2024-03-28T21:57:20.768 INFO:teuthology.orchestra.run.smithi153.stdout:091 2024-03-28T21:57:20.768 INFO:teuthology.orchestra.run.smithi153.stdout:091.out 2024-03-28T21:57:20.768 INFO:teuthology.orchestra.run.smithi153.stdout:092 2024-03-28T21:57:20.768 INFO:teuthology.orchestra.run.smithi153.stdout:092.out 2024-03-28T21:57:20.768 INFO:teuthology.orchestra.run.smithi153.stdout:093 2024-03-28T21:57:20.768 INFO:teuthology.orchestra.run.smithi153.stdout:093.out 2024-03-28T21:57:20.768 INFO:teuthology.orchestra.run.smithi153.stdout:094 2024-03-28T21:57:20.768 INFO:teuthology.orchestra.run.smithi153.stdout:094.out 2024-03-28T21:57:20.768 INFO:teuthology.orchestra.run.smithi153.stdout:095 2024-03-28T21:57:20.768 INFO:teuthology.orchestra.run.smithi153.stdout:095.out 2024-03-28T21:57:20.768 INFO:teuthology.orchestra.run.smithi153.stdout:096 2024-03-28T21:57:20.768 INFO:teuthology.orchestra.run.smithi153.stdout:096.out 2024-03-28T21:57:20.768 INFO:teuthology.orchestra.run.smithi153.stdout:097 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:097.out 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:098 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:098.out 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:099 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:099.out 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:100 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:100.out 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:101 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:101.out 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:102 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:102.out 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:103 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:103.out 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:104 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:104.out 2024-03-28T21:57:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:105 2024-03-28T21:57:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:105.out 2024-03-28T21:57:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:106 2024-03-28T21:57:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:106.out 2024-03-28T21:57:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:107 2024-03-28T21:57:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:107.out 2024-03-28T21:57:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:108 2024-03-28T21:57:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:108.out 2024-03-28T21:57:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:109 2024-03-28T21:57:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:109.out 2024-03-28T21:57:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:110 2024-03-28T21:57:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:110.out 2024-03-28T21:57:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:111 2024-03-28T21:57:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:111.out 2024-03-28T21:57:20.770 INFO:teuthology.orchestra.run.smithi153.stdout:112 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:112.out 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:113 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:113.out 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:114 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:114.out 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:115 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:115.out 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:116 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:116.out 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:117 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:117.out 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:118 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:118.out 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:119 2024-03-28T21:57:20.771 INFO:teuthology.orchestra.run.smithi153.stdout:119.out 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:120 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:120.out 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:121 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:121.out 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:122 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:122.out 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:123 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:123.out 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:124 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:124.out 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:125 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:125.out 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:126 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:126.out 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:127 2024-03-28T21:57:20.772 INFO:teuthology.orchestra.run.smithi153.stdout:127.out 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:128 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:128.out 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:129 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:129.out 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:130 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:130.out 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:131 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:131.out 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:132 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:132.out 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:133 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:133.out 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:134 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:134.out 2024-03-28T21:57:20.773 INFO:teuthology.orchestra.run.smithi153.stdout:135 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:135.out 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:136 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:136.out 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:137 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:137.out 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:138 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:138.out 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:139 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:139.out 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:140 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:140.out 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:141 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:141.out 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:142 2024-03-28T21:57:20.774 INFO:teuthology.orchestra.run.smithi153.stdout:142.out 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:143 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:143.out 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:144 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:144.out 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:145 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:145.out 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:146 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:146.out 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:147 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:147.out 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:148 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:148.out 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:149 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:149.out 2024-03-28T21:57:20.775 INFO:teuthology.orchestra.run.smithi153.stdout:150 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:150.out 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:151 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:151.out 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:152 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:152.out 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:153 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:153.out 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:154 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:154.out 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:155 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:155.out 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:156 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:156.out 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:157 2024-03-28T21:57:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:157.out 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:158 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:158.out 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:159 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:159.out 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:160 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:160.out 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:161 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:161.out 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:162 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:162.out 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:163 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:163.out 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:164 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:164.out 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:165 2024-03-28T21:57:20.777 INFO:teuthology.orchestra.run.smithi153.stdout:165.out 2024-03-28T21:57:20.778 INFO:teuthology.orchestra.run.smithi153.stdout:166 2024-03-28T21:57:20.778 INFO:teuthology.orchestra.run.smithi153.stdout:166.out 2024-03-28T21:57:20.778 INFO:teuthology.orchestra.run.smithi153.stdout:167 2024-03-28T21:57:20.778 INFO:teuthology.orchestra.run.smithi153.stdout:167.out 2024-03-28T21:57:20.778 INFO:teuthology.orchestra.run.smithi153.stdout:168 2024-03-28T21:57:20.778 INFO:teuthology.orchestra.run.smithi153.stdout:168.out 2024-03-28T21:57:20.778 INFO:teuthology.orchestra.run.smithi153.stdout:169 2024-03-28T21:57:20.778 INFO:teuthology.orchestra.run.smithi153.stdout:169.out 2024-03-28T21:57:20.778 INFO:teuthology.orchestra.run.smithi153.stdout:170 2024-03-28T21:57:20.778 INFO:teuthology.orchestra.run.smithi153.stdout:170.out 2024-03-28T21:57:20.778 INFO:teuthology.orchestra.run.smithi153.stdout:171 2024-03-28T21:57:20.778 INFO:teuthology.orchestra.run.smithi153.stdout:171.out 2024-03-28T21:57:20.778 INFO:teuthology.orchestra.run.smithi153.stdout:172 2024-03-28T21:57:20.778 INFO:teuthology.orchestra.run.smithi153.stdout:172.out 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:173 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:173.out 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:174 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:174.out 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:175 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:175.out 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:176 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:176.out 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:177 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:177.out 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:178 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:178.out 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:179 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:179.out 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:180 2024-03-28T21:57:20.779 INFO:teuthology.orchestra.run.smithi153.stdout:180.out 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:181 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:181.out 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:182 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:182.out 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:183 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:183.out 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:184 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:184.out 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:185 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:185.out 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:186 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:186.out 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:187 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:187.out 2024-03-28T21:57:20.780 INFO:teuthology.orchestra.run.smithi153.stdout:188 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:188.out 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:189 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:189.out 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:190 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:190.out 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:191 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:191.out 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:192 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:192.out 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:193 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:193.out 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:194 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:194.out 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:195 2024-03-28T21:57:20.781 INFO:teuthology.orchestra.run.smithi153.stdout:195.out 2024-03-28T21:57:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:196 2024-03-28T21:57:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:196.out 2024-03-28T21:57:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:197 2024-03-28T21:57:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:197.out 2024-03-28T21:57:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:198 2024-03-28T21:57:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:198.out 2024-03-28T21:57:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:199 2024-03-28T21:57:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:199.out 2024-03-28T21:57:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:200 2024-03-28T21:57:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:200.out 2024-03-28T21:57:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:201 2024-03-28T21:57:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:201.out 2024-03-28T21:57:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:202 2024-03-28T21:57:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:202.out 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:203 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:203.out 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:204 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:204.out 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:205 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:205.out 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:206 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:206.out 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:207 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:207.out 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:208 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:208.out 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:209 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:209.out 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:210 2024-03-28T21:57:20.783 INFO:teuthology.orchestra.run.smithi153.stdout:210.out 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:211 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:211.out 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:212 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:212.out 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:213 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:213.out 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:214 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:214.out 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:215 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:215.out 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:216 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:216.out 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:217 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:217.out 2024-03-28T21:57:20.784 INFO:teuthology.orchestra.run.smithi153.stdout:218 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:218.out 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:219 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:219.out 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:220 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:220.out 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:221 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:221.out 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:222 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:222.out 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:223 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:223.out 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:224 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:224.out 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:225 2024-03-28T21:57:20.785 INFO:teuthology.orchestra.run.smithi153.stdout:225.out 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:226 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:226.out 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:227 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:227.out 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:228 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:228.out 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:229 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:229.out 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:230 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:230.out 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:231 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:231.out 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:232 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:232.out 2024-03-28T21:57:20.786 INFO:teuthology.orchestra.run.smithi153.stdout:233 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:233.out 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:234 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:234.out 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:235 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:235.out 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:236 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:236.out 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:237 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:237.out 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:238 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:238.out 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:239 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:239.out 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:240 2024-03-28T21:57:20.787 INFO:teuthology.orchestra.run.smithi153.stdout:240.out 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:241 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:241.out 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:242 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:242.out 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:243 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:243.out 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:244 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:244.out 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:245 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:245.out 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:246 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:246.out 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:247 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:247.out 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:248 2024-03-28T21:57:20.788 INFO:teuthology.orchestra.run.smithi153.stdout:248.out 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:249 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:249.out 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:250 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:250.out 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:251 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:251.out 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:252 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:252.out 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:253 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:253.out 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:254 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:254.out 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:255 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:255.out 2024-03-28T21:57:20.789 INFO:teuthology.orchestra.run.smithi153.stdout:256 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:256.out 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:257 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:257.out 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:258 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:258.out 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:259 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:259.out 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:260 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:260.out 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:261 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:261.out 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:262 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:262.out 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:263 2024-03-28T21:57:20.790 INFO:teuthology.orchestra.run.smithi153.stdout:263.out 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:264 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:264.out 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:265 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:265.out 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:266 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:266.out 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:267 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:267.out 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:268 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:268.out 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:269 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:269.out 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:270 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:270.out 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:271 2024-03-28T21:57:20.791 INFO:teuthology.orchestra.run.smithi153.stdout:271.out 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:272 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:272.out 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:273 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:273.out 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:274 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:274.out 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:275 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:275.out 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:276 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:276.out 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:277 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:277.out 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:278 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:278.out 2024-03-28T21:57:20.792 INFO:teuthology.orchestra.run.smithi153.stdout:279 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:279.out 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:280 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:280.out 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:281 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:281.out 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:282 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:282.out 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:283 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:283.out 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:284 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:284.out 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:285 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:285.out 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:286 2024-03-28T21:57:20.793 INFO:teuthology.orchestra.run.smithi153.stdout:286.out 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:287 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:287.out 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:288 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:288.out 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:289 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:289.out 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:290 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:290.out 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:291 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:291.out 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:292 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:292.out 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:293 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:293.out 2024-03-28T21:57:20.794 INFO:teuthology.orchestra.run.smithi153.stdout:294 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:294.out 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:295 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:295.out 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:296 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:296.out 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:297 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:297.out 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:298 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:298.out 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:299 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:299.out 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:300 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:300.out 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:301 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:301.out 2024-03-28T21:57:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:302 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:302.out 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:303 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:303.out 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:304 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:304.out 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:305 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:305.out 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:306 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:306.out 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:307 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:307.out 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:308 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:308.out 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:309 2024-03-28T21:57:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:309.out 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:310 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:310.out 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:311 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:311.out 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:312 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:312.out 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:313 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:313.out 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:314 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:314.out 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:315 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:315.out 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:316 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:316.out 2024-03-28T21:57:20.797 INFO:teuthology.orchestra.run.smithi153.stdout:317 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:317.out 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:318 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:318.out 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:319 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:319.out 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:320 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:320.out 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:321 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:321.out 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:322 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:322.out 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:323 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:323.out 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:324 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:324.out 2024-03-28T21:57:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:325 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:325.out 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:326 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:326.out 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:327 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:327.out 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:328 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:328.out 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:329 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:329.out 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:330 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:330.out 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:331 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:331.out 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:332 2024-03-28T21:57:20.799 INFO:teuthology.orchestra.run.smithi153.stdout:332.out 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:333 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:333.out 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:334 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:334.out 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:335 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:335.out 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:336 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:336.out 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:337 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:337.out 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:338 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:338.out 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:339 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:339.out 2024-03-28T21:57:20.800 INFO:teuthology.orchestra.run.smithi153.stdout:340 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:340.out 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:341 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:341.out 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:342 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:342.out 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:343 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:343.out 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:344 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:344.out 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:345 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:345.out 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:346 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:346.out 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:347 2024-03-28T21:57:20.801 INFO:teuthology.orchestra.run.smithi153.stdout:347.out 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:348 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:348.out 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:349 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:349.out 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:350 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:350.out 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:351 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:351.out 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:352 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:352.out 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:353 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:353.out 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:354 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:354.out 2024-03-28T21:57:20.802 INFO:teuthology.orchestra.run.smithi153.stdout:355 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:355.out 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:356 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:356.out 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:357 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:357.out 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:358 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:358.out 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:359 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:359.out 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:360 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:360.out 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:361 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:361.out 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:362 2024-03-28T21:57:20.803 INFO:teuthology.orchestra.run.smithi153.stdout:362.out 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:363 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:363.out 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:364 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:364.out 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:365 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:365.out 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:366 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:366.out 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:367 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:367.out 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:368 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:368.out 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:369 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:369.out 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:370 2024-03-28T21:57:20.804 INFO:teuthology.orchestra.run.smithi153.stdout:370.out 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:371 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:371.out 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:372 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:372.out 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:373 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:373.out 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:374 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:374.out 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:375 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:375.out 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:376 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:376.out 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:377 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:377.out 2024-03-28T21:57:20.805 INFO:teuthology.orchestra.run.smithi153.stdout:378 2024-03-28T21:57:20.806 INFO:teuthology.orchestra.run.smithi153.stdout:378.out 2024-03-28T21:57:20.806 INFO:teuthology.orchestra.run.smithi153.stdout:379 2024-03-28T21:57:20.806 INFO:teuthology.orchestra.run.smithi153.stdout:379.out 2024-03-28T21:57:20.806 INFO:teuthology.orchestra.run.smithi153.stdout:380 2024-03-28T21:57:20.806 INFO:teuthology.orchestra.run.smithi153.stdout:380.out 2024-03-28T21:57:20.806 INFO:teuthology.orchestra.run.smithi153.stdout:381 2024-03-28T21:57:20.806 INFO:teuthology.orchestra.run.smithi153.stdout:381.out 2024-03-28T21:57:20.806 INFO:teuthology.orchestra.run.smithi153.stdout:382 2024-03-28T21:57:20.806 INFO:teuthology.orchestra.run.smithi153.stdout:382.out 2024-03-28T21:57:20.806 INFO:teuthology.orchestra.run.smithi153.stdout:383 2024-03-28T21:57:20.806 INFO:teuthology.orchestra.run.smithi153.stdout:383.out 2024-03-28T21:57:20.806 INFO:teuthology.orchestra.run.smithi153.stdout:384 2024-03-28T21:57:20.806 INFO:teuthology.orchestra.run.smithi153.stdout:384.out 2024-03-28T21:57:20.806 INFO:teuthology.orchestra.run.smithi153.stdout:385 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:385.out 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:386 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:386.out 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:387 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:387.out 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:388 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:388.out 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:389 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:389.out 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:390 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:390.out 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:391 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:391.out 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:392 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:392.out 2024-03-28T21:57:20.807 INFO:teuthology.orchestra.run.smithi153.stdout:393 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:393.out 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:394 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:394.out 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:395 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:395.out 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:396 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:396.out 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:397 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:397.out 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:398 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:398.out 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:399 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:399.out 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:400 2024-03-28T21:57:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:400.out 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:401 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:401.out 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:402 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:402.out 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:403 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:403.out 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:404 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:404.out 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:405 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:405.out 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:406 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:406.out 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:407 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:407.out 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:408 2024-03-28T21:57:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:408.out 2024-03-28T21:57:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:409 2024-03-28T21:57:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:409.out 2024-03-28T21:57:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:410 2024-03-28T21:57:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:410.out 2024-03-28T21:57:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:411 2024-03-28T21:57:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:411.out 2024-03-28T21:57:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:412 2024-03-28T21:57:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:412.out 2024-03-28T21:57:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:413 2024-03-28T21:57:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:413.out 2024-03-28T21:57:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:414 2024-03-28T21:57:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:414.out 2024-03-28T21:57:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:415 2024-03-28T21:57:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:415.out 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:416 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:416.out 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:417 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:417.out 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:418 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:418.out 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:419 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:419.out 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:420 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:420.out 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:421 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:421.out 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:422 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:422.out 2024-03-28T21:57:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:423 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:423.out 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:424 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:424.out 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:425 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:425.out 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:426 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:426.out 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:427 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:427.out 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:428 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:428.out 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:429 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:429.out 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:430 2024-03-28T21:57:20.812 INFO:teuthology.orchestra.run.smithi153.stdout:430.out 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:431 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:431.out 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:432 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:432.out 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:433 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:433.out 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:434 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:434.out 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:435 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:435.out 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:436 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:436.out 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:437 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:437.out 2024-03-28T21:57:20.813 INFO:teuthology.orchestra.run.smithi153.stdout:438 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:438.out 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:439 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:439.out 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:440 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:440.out 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:441 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:441.out 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:442 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:442.out 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:443 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:443.out 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:444 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:444.out 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:445 2024-03-28T21:57:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:445.out 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:446 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:446.out 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:447 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:447.out 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:448 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:448.out 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:449 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:449.out 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:450 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:450.out 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:451 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:451.out 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:452 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:452.out 2024-03-28T21:57:20.815 INFO:teuthology.orchestra.run.smithi153.stdout:453 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:453.out 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:454 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:454.out 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:455 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:455.out 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:456 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:456.out 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:457 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:457.out 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:458 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:458.out 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:459 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:459.out 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:460 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:460.out 2024-03-28T21:57:20.816 INFO:teuthology.orchestra.run.smithi153.stdout:461 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:461.out 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:462 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:462.out 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:463 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:463.out 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:464 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:464.out 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:465 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:465.out 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:466 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:466.out 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:467 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:467.out 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:468 2024-03-28T21:57:20.817 INFO:teuthology.orchestra.run.smithi153.stdout:468.out 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:469 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:469.out 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:470 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:470.out 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:471 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:471.out 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:472 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:472.out 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:473 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:473.out 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:474 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:474.out 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:475 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:475.out 2024-03-28T21:57:20.818 INFO:teuthology.orchestra.run.smithi153.stdout:476 2024-03-28T21:57:20.819 INFO:teuthology.orchestra.run.smithi153.stdout:476.out 2024-03-28T21:57:20.819 INFO:teuthology.orchestra.run.smithi153.stdout:477 2024-03-28T21:57:20.819 INFO:teuthology.orchestra.run.smithi153.stdout:477.out 2024-03-28T21:57:20.819 INFO:teuthology.orchestra.run.smithi153.stdout:478 2024-03-28T21:57:20.819 INFO:teuthology.orchestra.run.smithi153.stdout:478.out 2024-03-28T21:57:20.819 INFO:teuthology.orchestra.run.smithi153.stdout:479 2024-03-28T21:57:20.819 INFO:teuthology.orchestra.run.smithi153.stdout:479.out 2024-03-28T21:57:20.819 INFO:teuthology.orchestra.run.smithi153.stdout:480 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:480.out 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:481 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:481.out 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:482 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:482.out 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:483 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:483.out 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:484 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:484.out 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:485 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:485.out 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:486 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:486.out 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:487 2024-03-28T21:57:20.822 INFO:teuthology.orchestra.run.smithi153.stdout:487.out 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:488 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:488.out 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:489 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:489.out 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:490 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:490.out 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:491 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:491.out 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:492 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:492.out 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:493 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:493.out 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:494 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:494.out 2024-03-28T21:57:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:495 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:495.out 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:496 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:496.out 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:497 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:497.out 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:498 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:498.out 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:499 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:499.out 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:500 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:500.out 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:501 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:501.out 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:502 2024-03-28T21:57:20.824 INFO:teuthology.orchestra.run.smithi153.stdout:502.out 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:503 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:503.out 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:504 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:504.out 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:505 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:505.out 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:506 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:506.out 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:507 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:507.out 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:508 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:508.out 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:509 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:509.out 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:510 2024-03-28T21:57:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:510.out 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:511 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:511.out 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:512 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:512.out 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:513 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:513.out 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:514 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:514.out 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:515 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:515.out 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:516 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:516.out 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:517 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:517.out 2024-03-28T21:57:20.826 INFO:teuthology.orchestra.run.smithi153.stdout:518 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:518.out 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:519 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:519.out 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:520 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:520.out 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:521 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:521.out 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:522 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:522.out 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:523 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:523.out 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:524 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:524.out 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:525 2024-03-28T21:57:20.827 INFO:teuthology.orchestra.run.smithi153.stdout:525.out 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:526 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:526.out 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:527 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:527.out 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:528 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:528.out 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:529 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:529.out 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:530 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:530.out 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:531 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:531.out 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:532 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:532.out 2024-03-28T21:57:20.828 INFO:teuthology.orchestra.run.smithi153.stdout:533 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:533.out 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:534 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:534.out 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:535 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:535.out 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:536 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:536.out 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:537 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:537.out 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:538 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:538.out 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:539 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:539.out 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:540 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:540.out 2024-03-28T21:57:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:541 2024-03-28T21:57:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:541.out 2024-03-28T21:57:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:542 2024-03-28T21:57:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:542.out 2024-03-28T21:57:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:543 2024-03-28T21:57:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:543.out 2024-03-28T21:57:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:544 2024-03-28T21:57:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:544.out 2024-03-28T21:57:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:545 2024-03-28T21:57:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:545.out 2024-03-28T21:57:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:546 2024-03-28T21:57:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:546.out 2024-03-28T21:57:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:547 2024-03-28T21:57:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:547.out 2024-03-28T21:57:20.830 INFO:teuthology.orchestra.run.smithi153.stdout:548 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:548.out 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:549 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:549.out 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:550 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:550.out 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:551 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:551.out 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:552 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:552.out 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:553 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:553.out 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:554 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:554.out 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:555 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:555.out 2024-03-28T21:57:20.831 INFO:teuthology.orchestra.run.smithi153.stdout:556 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:556.out 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:557 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:557.out 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:558 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:558.out 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:559 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:559.out 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:560 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:560.out 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:561 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:561.out 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:562 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:562.out 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:563 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:563.out 2024-03-28T21:57:20.832 INFO:teuthology.orchestra.run.smithi153.stdout:564 2024-03-28T21:57:20.833 INFO:teuthology.orchestra.run.smithi153.stdout:564.out 2024-03-28T21:57:20.833 INFO:teuthology.orchestra.run.smithi153.stdout:565 2024-03-28T21:57:20.833 INFO:teuthology.orchestra.run.smithi153.stdout:565.out 2024-03-28T21:57:20.833 INFO:teuthology.orchestra.run.smithi153.stdout:566 2024-03-28T21:57:20.833 INFO:teuthology.orchestra.run.smithi153.stdout:566.out 2024-03-28T21:57:20.833 INFO:teuthology.orchestra.run.smithi153.stdout:567 2024-03-28T21:57:20.833 INFO:teuthology.orchestra.run.smithi153.stdout:567.out 2024-03-28T21:57:20.833 INFO:teuthology.orchestra.run.smithi153.stdout:568 2024-03-28T21:57:20.833 INFO:teuthology.orchestra.run.smithi153.stdout:568.out 2024-03-28T21:57:20.833 INFO:teuthology.orchestra.run.smithi153.stdout:569 2024-03-28T21:57:20.833 INFO:teuthology.orchestra.run.smithi153.stdout:569.out 2024-03-28T21:57:20.833 INFO:teuthology.orchestra.run.smithi153.stdout:570 2024-03-28T21:57:20.834 INFO:teuthology.orchestra.run.smithi153.stdout:570.out 2024-03-28T21:57:20.834 INFO:teuthology.orchestra.run.smithi153.stdout:571 2024-03-28T21:57:20.834 INFO:teuthology.orchestra.run.smithi153.stdout:571.out 2024-03-28T21:57:20.834 INFO:teuthology.orchestra.run.smithi153.stdout:572 2024-03-28T21:57:20.834 INFO:teuthology.orchestra.run.smithi153.stdout:572.out 2024-03-28T21:57:20.834 INFO:teuthology.orchestra.run.smithi153.stdout:573 2024-03-28T21:57:20.834 INFO:teuthology.orchestra.run.smithi153.stdout:573.out 2024-03-28T21:57:20.834 INFO:teuthology.orchestra.run.smithi153.stdout:574 2024-03-28T21:57:20.834 INFO:teuthology.orchestra.run.smithi153.stdout:574.out 2024-03-28T21:57:20.834 INFO:teuthology.orchestra.run.smithi153.stdout:575 2024-03-28T21:57:20.834 INFO:teuthology.orchestra.run.smithi153.stdout:575.out 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:576 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:576.out 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:577 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:577.out 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:578 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:578.out 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:579 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:579.out 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:580 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:580.out 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:581 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:581.out 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:582 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:582.out 2024-03-28T21:57:20.835 INFO:teuthology.orchestra.run.smithi153.stdout:583 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:583.out 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:584 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:584.out 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:585 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:585.out 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:586 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:586.out 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:587 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:587.out 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:588 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:588.out 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:589 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:589.out 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:590 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:590.out 2024-03-28T21:57:20.836 INFO:teuthology.orchestra.run.smithi153.stdout:591 2024-03-28T21:57:20.837 INFO:teuthology.orchestra.run.smithi153.stdout:591.out 2024-03-28T21:57:20.837 INFO:teuthology.orchestra.run.smithi153.stdout:592 2024-03-28T21:57:20.837 INFO:teuthology.orchestra.run.smithi153.stdout:592.out 2024-03-28T21:57:20.837 INFO:teuthology.orchestra.run.smithi153.stdout:593 2024-03-28T21:57:20.837 INFO:teuthology.orchestra.run.smithi153.stdout:593.out 2024-03-28T21:57:20.837 INFO:teuthology.orchestra.run.smithi153.stdout:594 2024-03-28T21:57:20.837 INFO:teuthology.orchestra.run.smithi153.stdout:594.out 2024-03-28T21:57:20.837 INFO:teuthology.orchestra.run.smithi153.stdout:595 2024-03-28T21:57:20.837 INFO:teuthology.orchestra.run.smithi153.stdout:595.out 2024-03-28T21:57:20.837 INFO:teuthology.orchestra.run.smithi153.stdout:596 2024-03-28T21:57:20.837 INFO:teuthology.orchestra.run.smithi153.stdout:596.out 2024-03-28T21:57:20.837 INFO:teuthology.orchestra.run.smithi153.stdout:597 2024-03-28T21:57:20.837 INFO:teuthology.orchestra.run.smithi153.stdout:597.out 2024-03-28T21:57:20.837 INFO:teuthology.orchestra.run.smithi153.stdout:598 2024-03-28T21:57:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:598.out 2024-03-28T21:57:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:599 2024-03-28T21:57:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:599.out 2024-03-28T21:57:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:600 2024-03-28T21:57:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:600.out 2024-03-28T21:57:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:601 2024-03-28T21:57:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:601.out 2024-03-28T21:57:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:602 2024-03-28T21:57:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:602.out 2024-03-28T21:57:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:603 2024-03-28T21:57:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:603.out 2024-03-28T21:57:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:604 2024-03-28T21:57:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:604.out 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:605 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:605.out 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:606 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:606.out 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:607 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:607.out 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:608 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:608.out 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:609 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:609.out 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:610 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:610.out 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:611 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:611.out 2024-03-28T21:57:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:612 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:612.out 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:613 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:613.out 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:614 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:614.out 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:615 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:615.out 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:616 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:616.out 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:617 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:617.out 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:618 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:618.out 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:619 2024-03-28T21:57:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:619.out 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:620 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:620.out 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:621 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:621.out 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:622 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:622.out 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:623 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:623.out 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:624 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:624.out 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:625 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:625.out 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:626 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:626.out 2024-03-28T21:57:20.841 INFO:teuthology.orchestra.run.smithi153.stdout:627 2024-03-28T21:57:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:627.out 2024-03-28T21:57:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:628 2024-03-28T21:57:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:628.out 2024-03-28T21:57:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:629 2024-03-28T21:57:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:629.out 2024-03-28T21:57:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:630 2024-03-28T21:57:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:630.out 2024-03-28T21:57:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:631 2024-03-28T21:57:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:631.out 2024-03-28T21:57:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:632 2024-03-28T21:57:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:632.out 2024-03-28T21:57:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:633 2024-03-28T21:57:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:633.out 2024-03-28T21:57:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:634 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:634.out 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:635 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:635.out 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:636 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:636.out 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:637 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:637.out 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:638 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:638.out 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:639 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:639.out 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:640 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:640.out 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:641 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:641.out 2024-03-28T21:57:20.843 INFO:teuthology.orchestra.run.smithi153.stdout:642 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:642.out 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:643 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:643.out 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:644 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:644.out 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:645 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:645.out 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:646 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:646.out 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:647 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:647.out 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:648 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:648.out 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:649 2024-03-28T21:57:20.844 INFO:teuthology.orchestra.run.smithi153.stdout:649.out 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:650 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:650.out 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:651 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:651.out 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:652 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:652.out 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:653 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:653.out 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:654 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:654.out 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:655 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:655.out 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:656 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:656.out 2024-03-28T21:57:20.845 INFO:teuthology.orchestra.run.smithi153.stdout:657 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:657.out 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:658 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:658.out 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:659 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:659.out 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:660 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:660.out 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:661 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:661.out 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:662 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:662.out 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:663 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:663.out 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:664 2024-03-28T21:57:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:664.out 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:665 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:665.out 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:666 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:666.out 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:667 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:667.out 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:668 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:668.out 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:669 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:669.out 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:670 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:670.out 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:671 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:671.out 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:672 2024-03-28T21:57:20.847 INFO:teuthology.orchestra.run.smithi153.stdout:672.out 2024-03-28T21:57:20.848 INFO:teuthology.orchestra.run.smithi153.stdout:673 2024-03-28T21:57:20.848 INFO:teuthology.orchestra.run.smithi153.stdout:673.out 2024-03-28T21:57:20.848 INFO:teuthology.orchestra.run.smithi153.stdout:674 2024-03-28T21:57:20.848 INFO:teuthology.orchestra.run.smithi153.stdout:674.out 2024-03-28T21:57:20.848 INFO:teuthology.orchestra.run.smithi153.stdout:675 2024-03-28T21:57:20.848 INFO:teuthology.orchestra.run.smithi153.stdout:675.out 2024-03-28T21:57:20.848 INFO:teuthology.orchestra.run.smithi153.stdout:676 2024-03-28T21:57:20.848 INFO:teuthology.orchestra.run.smithi153.stdout:676.out 2024-03-28T21:57:20.848 INFO:teuthology.orchestra.run.smithi153.stdout:677 2024-03-28T21:57:20.849 INFO:teuthology.orchestra.run.smithi153.stdout:677.out 2024-03-28T21:57:20.849 INFO:teuthology.orchestra.run.smithi153.stdout:678 2024-03-28T21:57:20.849 INFO:teuthology.orchestra.run.smithi153.stdout:678.out 2024-03-28T21:57:20.849 INFO:teuthology.orchestra.run.smithi153.stdout:679 2024-03-28T21:57:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:679.out 2024-03-28T21:57:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:680 2024-03-28T21:57:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:680.out 2024-03-28T21:57:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:681 2024-03-28T21:57:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:681.out 2024-03-28T21:57:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:682 2024-03-28T21:57:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:682.out 2024-03-28T21:57:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:683 2024-03-28T21:57:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:683.out 2024-03-28T21:57:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:684 2024-03-28T21:57:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:684.out 2024-03-28T21:57:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:685 2024-03-28T21:57:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:685.out 2024-03-28T21:57:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:686 2024-03-28T21:57:20.851 INFO:teuthology.orchestra.run.smithi153.stdout:686.out 2024-03-28T21:57:20.851 INFO:teuthology.orchestra.run.smithi153.stdout:687 2024-03-28T21:57:20.851 INFO:teuthology.orchestra.run.smithi153.stdout:687.out 2024-03-28T21:57:20.851 INFO:teuthology.orchestra.run.smithi153.stdout:688 2024-03-28T21:57:20.851 INFO:teuthology.orchestra.run.smithi153.stdout:688.out 2024-03-28T21:57:20.851 INFO:teuthology.orchestra.run.smithi153.stdout:689 2024-03-28T21:57:20.851 INFO:teuthology.orchestra.run.smithi153.stdout:689.out 2024-03-28T21:57:20.851 INFO:teuthology.orchestra.run.smithi153.stdout:690 2024-03-28T21:57:20.851 INFO:teuthology.orchestra.run.smithi153.stdout:690.out 2024-03-28T21:57:20.851 INFO:teuthology.orchestra.run.smithi153.stdout:691 2024-03-28T21:57:20.851 INFO:teuthology.orchestra.run.smithi153.stdout:691.out 2024-03-28T21:57:20.851 INFO:teuthology.orchestra.run.smithi153.stdout:692 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:692.out 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:693 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:693.out 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:694 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:694.out 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:695 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:695.out 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:696 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:696.out 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:697 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:697.out 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:698 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:698.out 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:699 2024-03-28T21:57:20.852 INFO:teuthology.orchestra.run.smithi153.stdout:699.out 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:700 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:700.out 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:701 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:701.out 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:702 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:702.out 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:703 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:703.out 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:704 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:704.out 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:705 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:705.out 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:706 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:706.out 2024-03-28T21:57:20.853 INFO:teuthology.orchestra.run.smithi153.stdout:707 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:707.out 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:708 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:708.out 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:709 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:709.out 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:710 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:710.out 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:711 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:711.out 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:712 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:712.out 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:713 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:713.out 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:714 2024-03-28T21:57:20.854 INFO:teuthology.orchestra.run.smithi153.stdout:714.out 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:715 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:715.out 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:716 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:716.out 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:717 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:717.out 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:718 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:718.out 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:719 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:719.out 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:720 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:720.out 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:721 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:721.out 2024-03-28T21:57:20.855 INFO:teuthology.orchestra.run.smithi153.stdout:722 2024-03-28T21:57:20.856 INFO:teuthology.orchestra.run.smithi153.stdout:722.out 2024-03-28T21:57:20.856 INFO:teuthology.orchestra.run.smithi153.stdout:723 2024-03-28T21:57:20.856 INFO:teuthology.orchestra.run.smithi153.stdout:723.out 2024-03-28T21:57:20.856 INFO:teuthology.orchestra.run.smithi153.stdout:724 2024-03-28T21:57:20.856 INFO:teuthology.orchestra.run.smithi153.stdout:724.out 2024-03-28T21:57:20.856 INFO:teuthology.orchestra.run.smithi153.stdout:725 2024-03-28T21:57:20.856 INFO:teuthology.orchestra.run.smithi153.stdout:725.out 2024-03-28T21:57:20.856 INFO:teuthology.orchestra.run.smithi153.stdout:726 2024-03-28T21:57:20.856 INFO:teuthology.orchestra.run.smithi153.stdout:726.out 2024-03-28T21:57:20.856 INFO:teuthology.orchestra.run.smithi153.stdout:727 2024-03-28T21:57:20.856 INFO:teuthology.orchestra.run.smithi153.stdout:727.out 2024-03-28T21:57:20.856 INFO:teuthology.orchestra.run.smithi153.stdout:728 2024-03-28T21:57:20.856 INFO:teuthology.orchestra.run.smithi153.stdout:728.out 2024-03-28T21:57:20.857 INFO:teuthology.orchestra.run.smithi153.stdout:729 2024-03-28T21:57:20.857 INFO:teuthology.orchestra.run.smithi153.stdout:729.out 2024-03-28T21:57:20.857 INFO:teuthology.orchestra.run.smithi153.stdout:730 2024-03-28T21:57:20.857 INFO:teuthology.orchestra.run.smithi153.stdout:730.out 2024-03-28T21:57:20.857 INFO:teuthology.orchestra.run.smithi153.stdout:731 2024-03-28T21:57:20.857 INFO:teuthology.orchestra.run.smithi153.stdout:731.out 2024-03-28T21:57:20.857 INFO:teuthology.orchestra.run.smithi153.stdout:732 2024-03-28T21:57:20.857 INFO:teuthology.orchestra.run.smithi153.stdout:732.out 2024-03-28T21:57:20.857 INFO:teuthology.orchestra.run.smithi153.stdout:733 2024-03-28T21:57:20.857 INFO:teuthology.orchestra.run.smithi153.stdout:733.out 2024-03-28T21:57:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:734 2024-03-28T21:57:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:734.out 2024-03-28T21:57:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:735 2024-03-28T21:57:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:735.out 2024-03-28T21:57:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:736 2024-03-28T21:57:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:736.out 2024-03-28T21:57:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:737 2024-03-28T21:57:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:737.out 2024-03-28T21:57:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:738 2024-03-28T21:57:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:738.out 2024-03-28T21:57:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:739 2024-03-28T21:57:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:739.out 2024-03-28T21:57:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:group.list 2024-03-28T21:57:20.858 INFO:teuthology.orchestra.run.smithi153.stdout:Makefile 2024-03-28T21:57:20.860 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-03-28T21:57:21.426 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T21:57:21.438 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T21:57:21.439 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T21:57:21.442 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T21:57:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:57:22.730 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:57:22.738 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:57:33.571 INFO:teuthology.orchestra.run.smithi153.stdout:generic/001 12s 2024-03-28T21:57:33.588 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/001 2024-03-28T21:57:33.588 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T21:57:33.596 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:57:33.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T21:57:33.876 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-03-28T21:57:34.439 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T21:57:34.452 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T21:57:34.453 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T21:57:34.457 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T21:57:34.457 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:57:35.426 INFO:teuthology.orchestra.run.smithi153.stdout:generic/002 1s 2024-03-28T21:57:35.441 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/002 2024-03-28T21:57:35.441 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T21:57:35.448 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:57:35.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T21:57:35.513 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-03-28T21:57:35.980 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T21:57:35.992 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T21:57:35.994 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T21:57:35.996 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T21:57:35.996 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:57:36.565 INFO:teuthology.orchestra.run.smithi153.stdout:generic/003 [not run] atime not maintained by ceph 2024-03-28T21:57:36.577 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/003 2024-03-28T21:57:36.577 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/003 2024-03-28T21:57:36.577 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T21:57:36.585 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:57:36.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T21:57:36.622 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-03-28T21:57:37.241 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T21:57:37.253 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T21:57:37.255 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T21:57:37.258 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T21:57:37.258 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:57:37.844 INFO:teuthology.orchestra.run.smithi153.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-03-28T21:57:37.855 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/004 2024-03-28T21:57:37.855 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/004 2024-03-28T21:57:37.855 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T21:57:37.863 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:57:37.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T21:57:37.891 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-03-28T21:57:38.447 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T21:57:38.459 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T21:57:38.460 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T21:57:38.463 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T21:57:38.463 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:57:39.375 INFO:teuthology.orchestra.run.smithi153.stdout:generic/005 1s 2024-03-28T21:57:39.391 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/005 2024-03-28T21:57:39.391 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T21:57:39.399 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:57:39.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T21:57:39.460 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-03-28T21:57:39.943 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T21:57:39.955 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T21:57:39.956 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T21:57:39.959 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T21:57:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:57:52.883 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:57:52.889 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:58:23.029 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:58:23.035 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:58:23.631 INFO:teuthology.orchestra.run.smithi153.stdout:generic/006 43s 2024-03-28T21:58:24.156 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/006 2024-03-28T21:58:24.156 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T21:58:24.166 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:58:24.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T21:58:24.313 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-03-28T21:58:24.774 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T21:58:24.786 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T21:58:24.789 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T21:58:24.791 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T21:58:24.791 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:58:54.358 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:58:54.366 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:59:24.505 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:59:24.511 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:59:48.998 INFO:teuthology.orchestra.run.smithi153.stdout:generic/007 84s 2024-03-28T21:59:49.720 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/007 2024-03-28T21:59:49.720 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T21:59:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:59:49.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T21:59:49.855 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-03-28T21:59:50.340 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T21:59:50.351 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T21:59:50.352 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T21:59:50.355 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T21:59:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:59:51.116 INFO:teuthology.orchestra.run.smithi153.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-28T21:59:51.125 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/008 2024-03-28T21:59:51.125 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/008 2024-03-28T21:59:51.125 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T21:59:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:59:51.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T21:59:51.170 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-03-28T21:59:51.718 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T21:59:51.731 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T21:59:51.732 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T21:59:51.736 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T21:59:51.736 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:59:52.496 INFO:teuthology.orchestra.run.smithi153.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-28T21:59:52.507 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/009 2024-03-28T21:59:52.507 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/009 2024-03-28T21:59:52.507 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T21:59:52.515 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:59:52.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T21:59:52.563 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-03-28T21:59:53.112 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T21:59:53.126 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T21:59:53.128 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T21:59:53.131 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T21:59:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:59:54.312 INFO:teuthology.orchestra.run.smithi153.stdout:generic/010 1s 2024-03-28T21:59:54.328 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/010 2024-03-28T21:59:54.328 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T21:59:54.335 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T21:59:54.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T21:59:54.409 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-03-28T21:59:54.659 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:59:54.663 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T21:59:54.860 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T21:59:54.871 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T21:59:54.873 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T21:59:54.876 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T21:59:54.876 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:00:24.796 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:00:24.805 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:00:39.414 INFO:teuthology.orchestra.run.smithi153.stdout:generic/011 44s 2024-03-28T22:00:39.429 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/011 2024-03-28T22:00:39.429 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:00:39.437 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:00:39.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:00:39.523 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-03-28T22:00:40.008 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:00:40.026 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:00:40.030 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:00:40.035 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:00:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:00:40.834 INFO:teuthology.orchestra.run.smithi153.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T22:00:40.845 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/012 2024-03-28T22:00:40.845 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/012 2024-03-28T22:00:40.845 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:00:40.856 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:00:40.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:00:40.923 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-03-28T22:00:41.429 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:00:41.439 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:00:41.440 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:00:41.443 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:00:41.443 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:00:54.934 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:00:54.944 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:01:25.446 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:01:25.451 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:01:47.402 INFO:teuthology.orchestra.run.smithi153.stdout:generic/013 66s 2024-03-28T22:01:47.773 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/013 2024-03-28T22:01:47.773 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:01:47.783 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:01:47.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:01:47.865 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-03-28T22:01:48.580 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:01:48.599 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:01:48.601 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:01:48.606 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:01:48.607 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:01:51.015 INFO:teuthology.orchestra.run.smithi153.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-03-28T22:01:51.030 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/014 2024-03-28T22:01:51.030 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/014 2024-03-28T22:01:51.030 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:01:51.042 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:01:51.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:01:51.093 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-03-28T22:01:51.791 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:01:51.812 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:01:51.814 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:01:51.818 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:01:51.818 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:01:52.517 INFO:teuthology.orchestra.run.smithi153.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T22:01:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/015 2024-03-28T22:01:53.787 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/015 2024-03-28T22:01:53.788 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:01:53.797 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:01:53.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:01:53.842 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-03-28T22:01:54.507 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:01:54.524 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:01:54.525 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:01:54.528 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:01:54.528 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:01:55.469 INFO:teuthology.orchestra.run.smithi153.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T22:01:55.483 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/016 2024-03-28T22:01:55.484 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/016 2024-03-28T22:01:55.484 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:01:55.494 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:01:55.575 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:01:55.582 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:01:55.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:01:55.595 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-03-28T22:01:56.330 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:01:56.348 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:01:56.350 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:01:56.353 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:01:56.353 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:01:57.082 INFO:teuthology.orchestra.run.smithi153.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-28T22:01:57.097 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/017 2024-03-28T22:01:57.097 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/017 2024-03-28T22:01:57.098 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:01:57.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:01:57.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:01:57.150 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-03-28T22:01:57.818 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:01:57.837 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:01:57.839 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:01:57.842 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:01:57.842 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:01:58.728 INFO:teuthology.orchestra.run.smithi153.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-03-28T22:01:58.752 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/018 2024-03-28T22:01:58.752 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/018 2024-03-28T22:01:58.752 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:01:58.764 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:01:58.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:01:58.800 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-03-28T22:01:59.490 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:01:59.510 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:01:59.512 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:01:59.515 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:01:59.515 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:00.177 INFO:teuthology.orchestra.run.smithi153.stdout:generic/019 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:02:00.191 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/019 2024-03-28T22:02:00.191 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/019 2024-03-28T22:02:00.191 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:00.201 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:00.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:00.238 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-03-28T22:02:00.923 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:00.938 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:00.940 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:00.944 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:00.944 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:10.060 INFO:teuthology.orchestra.run.smithi153.stdout:generic/020 9s 2024-03-28T22:02:10.082 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/020 2024-03-28T22:02:10.082 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:10.092 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:10.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:10.181 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-03-28T22:02:10.879 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:10.897 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:10.899 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:10.905 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:10.905 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:11.861 INFO:teuthology.orchestra.run.smithi153.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T22:02:11.876 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/021 2024-03-28T22:02:11.876 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/021 2024-03-28T22:02:11.876 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:11.887 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:11.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:11.985 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-03-28T22:02:12.694 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:12.710 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:12.712 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:12.716 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:12.716 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:13.674 INFO:teuthology.orchestra.run.smithi153.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T22:02:13.688 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/022 2024-03-28T22:02:13.688 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/022 2024-03-28T22:02:13.688 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:13.697 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:13.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:13.787 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-03-28T22:02:14.489 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:14.505 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:14.507 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:14.511 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:14.511 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:17.116 INFO:teuthology.orchestra.run.smithi153.stdout:generic/023 3s 2024-03-28T22:02:17.138 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/023 2024-03-28T22:02:17.139 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:17.149 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:17.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:17.309 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-03-28T22:02:18.015 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:18.034 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:18.035 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:18.038 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:18.769 INFO:teuthology.orchestra.run.smithi153.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-03-28T22:02:18.782 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/024 2024-03-28T22:02:18.782 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/024 2024-03-28T22:02:18.782 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:18.796 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:18.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:18.903 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-03-28T22:02:19.620 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:19.640 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:19.641 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:19.646 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:19.646 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:20.547 INFO:teuthology.orchestra.run.smithi153.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-03-28T22:02:20.566 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/025 2024-03-28T22:02:20.566 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/025 2024-03-28T22:02:20.566 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:20.577 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:20.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:20.666 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-03-28T22:02:21.400 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:21.415 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:21.417 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:22.201 INFO:teuthology.orchestra.run.smithi153.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-03-28T22:02:22.216 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/026 2024-03-28T22:02:22.217 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/026 2024-03-28T22:02:22.217 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:22.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:22.285 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-03-28T22:02:22.968 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:22.985 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:22.986 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:22.990 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:22.990 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:23.706 INFO:teuthology.orchestra.run.smithi153.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T22:02:23.721 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/027 2024-03-28T22:02:23.721 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/027 2024-03-28T22:02:23.721 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:23.730 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:23.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:23.774 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-03-28T22:02:24.463 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:24.480 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:24.482 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:24.486 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:24.486 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:25.748 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:02:25.756 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:02:30.236 INFO:teuthology.orchestra.run.smithi153.stdout:generic/028 6s 2024-03-28T22:02:30.256 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/028 2024-03-28T22:02:30.256 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:30.268 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:30.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:30.321 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-03-28T22:02:31.006 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:31.021 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:31.024 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:31.029 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:31.029 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:34.589 INFO:teuthology.orchestra.run.smithi153.stdout:generic/029 3s 2024-03-28T22:02:34.613 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/029 2024-03-28T22:02:34.613 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:34.624 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:34.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:34.656 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-03-28T22:02:35.376 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:35.390 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:35.391 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:35.394 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:35.395 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:37.814 INFO:teuthology.orchestra.run.smithi153.stdout:generic/030 2s 2024-03-28T22:02:37.835 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/030 2024-03-28T22:02:37.835 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:37.848 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:37.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:37.878 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-03-28T22:02:38.535 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:38.550 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:38.552 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:38.555 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:38.556 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:39.415 INFO:teuthology.orchestra.run.smithi153.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-28T22:02:39.428 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/031 2024-03-28T22:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/031 2024-03-28T22:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:39.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:39.488 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-03-28T22:02:40.136 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:40.153 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:40.156 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:40.159 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:40.160 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:40.871 INFO:teuthology.orchestra.run.smithi153.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T22:02:40.888 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/032 2024-03-28T22:02:40.888 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/032 2024-03-28T22:02:40.888 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:40.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:40.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:40.944 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-03-28T22:02:41.613 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:41.629 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:41.631 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:41.634 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:41.634 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:42.493 INFO:teuthology.orchestra.run.smithi153.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-28T22:02:42.507 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/033 2024-03-28T22:02:42.507 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/033 2024-03-28T22:02:42.507 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:42.523 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:42.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:42.571 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-03-28T22:02:43.252 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:43.270 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:43.271 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:43.274 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:43.274 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:43.986 INFO:teuthology.orchestra.run.smithi153.stdout:generic/034 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:02:44.000 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/034 2024-03-28T22:02:44.000 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/034 2024-03-28T22:02:44.000 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:44.011 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:44.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:44.058 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-03-28T22:02:44.717 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:44.733 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:44.734 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:44.738 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:44.738 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:45.592 INFO:teuthology.orchestra.run.smithi153.stdout:generic/035 1s 2024-03-28T22:02:45.615 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/035 2024-03-28T22:02:45.616 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:45.626 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:45.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:45.737 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-03-28T22:02:46.448 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:46.466 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:46.467 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:46.470 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:46.470 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:55.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:02:55.906 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:02:57.333 INFO:teuthology.orchestra.run.smithi153.stdout:generic/036 11s 2024-03-28T22:02:57.353 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/036 2024-03-28T22:02:57.353 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:02:57.362 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:02:57.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:02:57.461 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-03-28T22:02:58.163 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:02:58.179 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:02:58.180 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:02:58.184 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:02:58.184 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:12.386 INFO:teuthology.orchestra.run.smithi153.stdout:generic/037 14s 2024-03-28T22:03:12.407 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/037 2024-03-28T22:03:12.407 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:12.417 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:12.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:12.450 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-03-28T22:03:13.122 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:13.135 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:13.136 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:13.139 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:13.139 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:13.813 INFO:teuthology.orchestra.run.smithi153.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T22:03:13.827 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/038 2024-03-28T22:03:13.828 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/038 2024-03-28T22:03:13.828 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:13.838 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:13.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:13.889 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-03-28T22:03:14.526 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:14.540 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:14.542 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:14.546 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:14.546 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:15.280 INFO:teuthology.orchestra.run.smithi153.stdout:generic/039 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:03:15.298 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/039 2024-03-28T22:03:15.298 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/039 2024-03-28T22:03:15.299 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:15.309 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:15.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:15.357 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-03-28T22:03:16.033 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:16.048 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:16.049 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:16.055 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:16.055 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:16.810 INFO:teuthology.orchestra.run.smithi153.stdout:generic/040 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:03:16.824 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/040 2024-03-28T22:03:16.824 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/040 2024-03-28T22:03:16.824 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:16.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:16.882 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-03-28T22:03:17.543 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:17.558 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:17.559 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:17.563 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:17.563 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:18.292 INFO:teuthology.orchestra.run.smithi153.stdout:generic/041 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:03:18.308 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/041 2024-03-28T22:03:18.309 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/041 2024-03-28T22:03:18.309 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:18.319 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:18.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:18.378 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-03-28T22:03:19.061 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:19.076 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:19.078 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:19.084 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:19.084 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:19.974 INFO:teuthology.orchestra.run.smithi153.stdout:generic/042 [not run] ceph does not support shutdown 2024-03-28T22:03:19.996 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/042 2024-03-28T22:03:19.996 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/042 2024-03-28T22:03:19.996 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:20.006 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:20.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:20.053 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-03-28T22:03:20.742 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:20.755 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:20.757 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:20.761 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:20.761 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:21.655 INFO:teuthology.orchestra.run.smithi153.stdout:generic/043 [not run] ceph does not support shutdown 2024-03-28T22:03:21.678 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/043 2024-03-28T22:03:21.678 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/043 2024-03-28T22:03:21.678 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:21.687 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:21.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:21.729 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-03-28T22:03:22.397 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:22.415 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:22.417 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:22.424 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:22.425 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:23.321 INFO:teuthology.orchestra.run.smithi153.stdout:generic/044 [not run] ceph does not support shutdown 2024-03-28T22:03:23.347 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/044 2024-03-28T22:03:23.348 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/044 2024-03-28T22:03:23.348 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:23.358 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:23.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:23.395 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-03-28T22:03:24.078 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:24.091 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:24.093 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:24.100 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:24.101 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:24.956 INFO:teuthology.orchestra.run.smithi153.stdout:generic/045 [not run] ceph does not support shutdown 2024-03-28T22:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/045 2024-03-28T22:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/045 2024-03-28T22:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:25.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:25.032 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-03-28T22:03:25.711 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:25.727 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:25.733 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:25.736 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:25.736 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:26.188 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:03:26.197 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:03:26.639 INFO:teuthology.orchestra.run.smithi153.stdout:generic/046 [not run] ceph does not support shutdown 2024-03-28T22:03:26.665 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/046 2024-03-28T22:03:26.665 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/046 2024-03-28T22:03:26.665 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:26.676 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:26.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:26.711 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-03-28T22:03:27.375 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:27.391 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:27.394 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:27.400 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:27.400 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:28.260 INFO:teuthology.orchestra.run.smithi153.stdout:generic/047 [not run] ceph does not support shutdown 2024-03-28T22:03:28.280 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/047 2024-03-28T22:03:28.281 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/047 2024-03-28T22:03:28.282 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:28.291 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:28.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:28.331 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-03-28T22:03:28.975 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:28.992 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:28.994 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:28.997 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:28.997 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:29.898 INFO:teuthology.orchestra.run.smithi153.stdout:generic/048 [not run] ceph does not support shutdown 2024-03-28T22:03:29.922 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/048 2024-03-28T22:03:29.922 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/048 2024-03-28T22:03:29.922 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:29.933 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:29.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:29.977 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-03-28T22:03:30.674 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:30.691 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:30.692 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:30.696 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:30.696 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:31.572 INFO:teuthology.orchestra.run.smithi153.stdout:generic/049 [not run] ceph does not support shutdown 2024-03-28T22:03:31.605 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/049 2024-03-28T22:03:31.606 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/049 2024-03-28T22:03:31.606 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:31.616 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:31.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:31.656 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-03-28T22:03:32.324 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:32.341 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:32.342 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:32.347 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:32.347 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:33.235 INFO:teuthology.orchestra.run.smithi153.stdout:generic/050 [not run] ceph does not support shutdown 2024-03-28T22:03:33.261 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/050 2024-03-28T22:03:33.262 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/050 2024-03-28T22:03:33.262 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:33.272 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:33.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:33.310 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-03-28T22:03:34.019 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:34.039 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:34.041 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:34.044 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:34.044 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:34.963 INFO:teuthology.orchestra.run.smithi153.stdout:generic/051 [not run] ceph does not support shutdown 2024-03-28T22:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/051 2024-03-28T22:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/051 2024-03-28T22:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:35.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:35.037 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-03-28T22:03:35.723 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:35.736 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:35.739 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:35.742 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:35.742 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:36.625 INFO:teuthology.orchestra.run.smithi153.stdout:generic/052 [not run] ceph does not support shutdown 2024-03-28T22:03:36.667 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/052 2024-03-28T22:03:36.667 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/052 2024-03-28T22:03:36.667 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:36.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:36.720 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-03-28T22:03:37.390 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:37.406 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:37.408 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:37.413 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:38.910 INFO:teuthology.orchestra.run.smithi153.stdout:generic/053 1s 2024-03-28T22:03:38.934 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/053 2024-03-28T22:03:38.934 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:38.946 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:38.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:38.994 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-03-28T22:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:40.632 INFO:teuthology.orchestra.run.smithi153.stdout:generic/054 [not run] ceph does not support shutdown 2024-03-28T22:03:40.651 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/054 2024-03-28T22:03:40.651 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/054 2024-03-28T22:03:40.651 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:40.662 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:40.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:40.700 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-03-28T22:03:41.364 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:41.379 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:41.380 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:41.384 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:41.385 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:42.308 INFO:teuthology.orchestra.run.smithi153.stdout:generic/055 [not run] ceph does not support shutdown 2024-03-28T22:03:42.338 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/055 2024-03-28T22:03:42.338 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/055 2024-03-28T22:03:42.339 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:42.348 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:42.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:42.391 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-03-28T22:03:43.077 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:43.091 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:43.093 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:43.096 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:43.096 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:43.843 INFO:teuthology.orchestra.run.smithi153.stdout:generic/056 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:03:43.858 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/056 2024-03-28T22:03:43.858 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/056 2024-03-28T22:03:43.858 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:43.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:43.915 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-03-28T22:03:44.585 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:44.601 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:44.603 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:44.605 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:44.606 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:45.345 INFO:teuthology.orchestra.run.smithi153.stdout:generic/057 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:03:45.358 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/057 2024-03-28T22:03:45.358 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/057 2024-03-28T22:03:45.359 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:45.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:45.412 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-03-28T22:03:46.091 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:46.107 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:46.110 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:46.115 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:46.115 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:47.033 INFO:teuthology.orchestra.run.smithi153.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T22:03:47.045 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/058 2024-03-28T22:03:47.046 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/058 2024-03-28T22:03:47.046 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:47.055 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:47.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:47.151 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-03-28T22:03:47.867 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:47.885 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:47.886 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:47.892 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:47.892 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:48.621 INFO:teuthology.orchestra.run.smithi153.stdout:generic/059 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:03:48.637 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/059 2024-03-28T22:03:48.637 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/059 2024-03-28T22:03:48.637 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:48.646 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:48.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:48.688 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-03-28T22:03:49.372 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:49.386 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:49.388 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:49.392 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:49.392 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:50.306 INFO:teuthology.orchestra.run.smithi153.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T22:03:50.321 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/060 2024-03-28T22:03:50.321 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/060 2024-03-28T22:03:50.321 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:50.331 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:50.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:50.437 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-03-28T22:03:51.157 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:51.173 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:51.175 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:51.180 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:51.985 INFO:teuthology.orchestra.run.smithi153.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T22:03:51.999 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/061 2024-03-28T22:03:51.999 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/061 2024-03-28T22:03:51.999 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:52.008 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:52.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:52.106 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-03-28T22:03:52.825 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:52.840 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:52.843 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:52.846 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:52.846 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:56.328 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:03:56.336 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:03:56.950 INFO:teuthology.orchestra.run.smithi153.stdout:generic/062 3s 2024-03-28T22:03:56.978 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/062 2024-03-28T22:03:56.979 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:56.993 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:57.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:57.031 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-03-28T22:03:57.700 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:57.716 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:57.718 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:57.723 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:57.723 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:58.760 INFO:teuthology.orchestra.run.smithi153.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T22:03:58.774 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/063 2024-03-28T22:03:58.774 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/063 2024-03-28T22:03:58.774 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:03:58.783 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:03:58.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:03:58.875 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-03-28T22:03:59.631 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:03:59.645 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:03:59.646 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:03:59.649 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:03:59.649 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:04:00.377 INFO:teuthology.orchestra.run.smithi153.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-28T22:04:00.389 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/064 2024-03-28T22:04:00.389 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/064 2024-03-28T22:04:00.390 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:04:00.399 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:04:00.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:04:00.451 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-03-28T22:04:01.131 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:04:01.147 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:04:01.148 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:04:01.151 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:04:01.151 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:04:01.933 INFO:teuthology.orchestra.run.smithi153.stdout:generic/065 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:04:01.947 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/065 2024-03-28T22:04:01.947 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/065 2024-03-28T22:04:01.947 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:04:01.956 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:04:02.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:04:02.009 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-03-28T22:04:02.710 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:04:02.727 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:04:02.729 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:04:02.738 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:04:02.738 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:04:03.464 INFO:teuthology.orchestra.run.smithi153.stdout:generic/066 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:04:03.476 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/066 2024-03-28T22:04:03.477 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/066 2024-03-28T22:04:03.477 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:04:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:04:03.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:04:03.529 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-03-28T22:04:04.208 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:04:04.226 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:04:04.227 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:04:04.231 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:04:04.231 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:04:04.987 INFO:teuthology.orchestra.run.smithi153.stdout:generic/067 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:04:05.003 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/067 2024-03-28T22:04:05.004 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/067 2024-03-28T22:04:05.004 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:04:05.017 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:04:05.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:04:05.068 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-03-28T22:04:05.720 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:04:05.734 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:04:05.736 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:04:05.740 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:04:05.740 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:04:06.465 INFO:teuthology.orchestra.run.smithi153.stdout:generic/068 [not run] ceph does not support freezing 2024-03-28T22:04:06.480 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/068 2024-03-28T22:04:06.480 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/068 2024-03-28T22:04:06.480 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:04:06.489 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:04:06.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:04:06.533 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-03-28T22:04:07.191 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:04:07.207 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:04:07.209 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:04:07.212 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:04:07.212 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:04:26.665 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:04:26.674 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:04:36.371 INFO:teuthology.orchestra.run.smithi153.stdout:generic/069 29s 2024-03-28T22:04:36.396 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/069 2024-03-28T22:04:36.396 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:04:36.408 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:04:36.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:04:36.445 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-03-28T22:04:37.130 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:04:37.148 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:04:37.149 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:04:37.153 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:04:37.154 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:04:58.920 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:04:58.927 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:05:07.345 INFO:teuthology.orchestra.run.smithi153.stdout:generic/070 30s 2024-03-28T22:05:07.368 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/070 2024-03-28T22:05:07.368 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:05:07.378 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:05:07.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:05:07.629 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-03-28T22:05:08.368 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:05:08.387 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:05:08.388 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:05:08.393 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:05:08.393 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:05:09.103 INFO:teuthology.orchestra.run.smithi153.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-28T22:05:09.117 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/071 2024-03-28T22:05:09.118 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/071 2024-03-28T22:05:09.118 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:05:09.128 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:05:09.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:05:09.173 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-03-28T22:05:09.857 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:05:09.874 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:05:09.875 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:05:09.879 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:05:09.879 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:05:10.745 INFO:teuthology.orchestra.run.smithi153.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-28T22:05:10.759 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/072 2024-03-28T22:05:10.759 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/072 2024-03-28T22:05:10.759 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:05:10.768 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:05:10.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:05:10.816 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-03-28T22:05:11.466 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:05:11.482 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:05:11.484 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:05:11.487 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:05:11.487 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:05:12.189 INFO:teuthology.orchestra.run.smithi153.stdout:generic/073 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:05:12.205 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/073 2024-03-28T22:05:12.205 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/073 2024-03-28T22:05:12.205 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:05:12.216 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:05:12.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:05:12.255 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-03-28T22:05:12.909 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:05:12.924 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:05:12.925 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:05:12.929 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:05:12.930 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:05:29.157 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:05:29.166 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:05:29.355 INFO:tasks.ceph.mds.a.smithi153.stderr:2024-03-28T22:05:29.354+0000 7f063e400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 158104) UID: 0 2024-03-28T22:05:29.360 INFO:tasks.ceph.mds.c.smithi153.stderr:2024-03-28T22:05:29.358+0000 7f40c4c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 158104) UID: 0 2024-03-28T22:06:06.534 INFO:teuthology.orchestra.run.smithi153.stdout:generic/074 53s 2024-03-28T22:06:06.560 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/074 2024-03-28T22:06:06.560 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:06:06.570 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:07.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:06:07.396 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-03-28T22:06:08.232 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:06:08.250 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:06:08.252 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:06:08.259 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:06:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:42.188 INFO:teuthology.orchestra.run.smithi153.stdout:generic/075 34s 2024-03-28T22:06:42.207 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/075 2024-03-28T22:06:42.207 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:06:42.223 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:42.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:06:42.330 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-03-28T22:06:43.177 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:06:43.193 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:06:43.194 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:06:43.197 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:06:43.197 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:43.952 INFO:teuthology.orchestra.run.smithi153.stdout:generic/076 [not run] require 172.21.15.153:6789:/scratch to be local device 2024-03-28T22:06:43.965 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/076 2024-03-28T22:06:43.965 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/076 2024-03-28T22:06:43.965 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:06:43.978 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:44.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:06:44.025 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-03-28T22:06:44.765 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:06:44.782 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:06:44.784 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:06:44.787 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:06:44.787 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:46.926 INFO:teuthology.orchestra.run.smithi153.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T22:06:46.938 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/077 2024-03-28T22:06:46.938 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/077 2024-03-28T22:06:46.938 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:06:46.949 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:47.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:06:47.069 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-03-28T22:06:47.929 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:06:47.947 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:06:47.949 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:06:47.951 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:06:47.951 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-03-28T22:06:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/078 2024-03-28T22:06:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/078 2024-03-28T22:06:48.809 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:06:48.821 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:48.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:06:48.937 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-03-28T22:06:49.788 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:06:49.803 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:06:49.804 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:06:49.808 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:06:49.808 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:50.582 INFO:teuthology.orchestra.run.smithi153.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-03-28T22:06:50.597 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/079 2024-03-28T22:06:50.597 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/079 2024-03-28T22:06:50.597 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:06:50.608 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:50.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:06:50.670 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-03-28T22:06:51.409 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:06:51.424 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:06:51.426 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:06:51.429 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:06:51.429 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:54.312 INFO:teuthology.orchestra.run.smithi153.stdout:generic/080 3s 2024-03-28T22:06:54.334 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/080 2024-03-28T22:06:54.334 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:06:54.346 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:54.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:06:54.397 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-03-28T22:06:55.144 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:06:55.161 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:06:55.167 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:06:55.172 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:06:55.172 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:58.061 INFO:teuthology.orchestra.run.smithi153.stdout:generic/081 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:06:58.077 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/081 2024-03-28T22:06:58.077 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/081 2024-03-28T22:06:58.077 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:06:58.086 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:58.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:06:58.133 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-03-28T22:06:58.842 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:06:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:06:58.862 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:06:58.869 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:06:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:59.636 INFO:teuthology.orchestra.run.smithi153.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T22:06:59.650 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/082 2024-03-28T22:06:59.650 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/082 2024-03-28T22:06:59.650 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:06:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:06:59.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:06:59.710 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-03-28T22:07:00.434 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:07:00.456 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:07:00.457 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:07:00.461 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:07:00.461 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:07:01.224 INFO:teuthology.orchestra.run.smithi153.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T22:07:01.240 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/083 2024-03-28T22:07:01.240 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/083 2024-03-28T22:07:01.241 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:07:01.252 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:07:01.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:07:01.299 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-03-28T22:07:02.025 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:07:02.041 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:07:02.043 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:07:02.049 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:07:02.050 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:07:08.323 INFO:teuthology.orchestra.run.smithi153.stdout:generic/084 6s 2024-03-28T22:07:08.370 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/084 2024-03-28T22:07:08.370 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:07:08.386 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:07:08.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:07:08.441 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-03-28T22:07:09.201 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:07:09.217 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:07:09.219 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:07:09.223 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:07:09.223 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:07:10.214 INFO:teuthology.orchestra.run.smithi153.stdout:generic/085 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:07:10.231 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/085 2024-03-28T22:07:10.231 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/085 2024-03-28T22:07:10.231 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:07:10.239 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:07:10.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:07:10.288 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-03-28T22:07:11.000 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:07:11.023 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:07:11.026 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:07:11.030 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:07:11.031 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:07:11.776 INFO:teuthology.orchestra.run.smithi153.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T22:07:11.789 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/086 2024-03-28T22:07:11.789 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/086 2024-03-28T22:07:11.789 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:07:11.803 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:07:11.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:07:11.852 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-03-28T22:07:12.559 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:07:12.579 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:07:12.580 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:07:12.585 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:07:12.585 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:07:13.653 INFO:teuthology.orchestra.run.smithi153.stdout:generic/087 1s 2024-03-28T22:07:13.684 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/087 2024-03-28T22:07:13.684 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:07:13.698 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:07:13.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:07:13.874 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-03-28T22:07:14.880 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:07:14.900 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:07:14.903 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:07:14.909 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:07:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:07:15.878 INFO:teuthology.orchestra.run.smithi153.stdout:generic/088 0s 2024-03-28T22:07:15.900 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/088 2024-03-28T22:07:15.900 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:07:15.911 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:07:16.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:07:16.016 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-03-28T22:07:16.836 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:07:16.854 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:07:16.856 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:07:16.860 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:07:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:08:50.596 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:08:50.602 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:09:21.417 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:09:21.426 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:09:51.549 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:09:51.558 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:10:21.695 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:10:21.704 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:10:51.825 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:10:51.835 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:11:22.120 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:11:22.128 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:11:52.259 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:11:52.268 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:12:23.235 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:12:23.244 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:12:53.376 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:12:53.382 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:13:23.514 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:13:23.523 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:13:23.613 INFO:tasks.ceph.mds.c.smithi153.stderr:2024-03-28T22:13:23.611+0000 7f40c4c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 167518) UID: 0 2024-03-28T22:13:23.614 INFO:tasks.ceph.mds.a.smithi153.stderr:2024-03-28T22:13:23.611+0000 7f063e400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 167518) UID: 0 2024-03-28T22:16:20.896 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:16:20.903 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:16:51.106 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:16:51.112 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:17:21.249 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:17:21.260 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:17:51.391 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:17:51.397 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:18:21.582 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:18:21.590 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:18:51.709 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:18:51.719 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:19:21.849 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:19:21.858 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:19:21.963 INFO:tasks.ceph.mds.c.smithi153.stderr:2024-03-28T22:19:21.963+0000 7f40c4c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 169664) UID: 0 2024-03-28T22:19:21.964 INFO:tasks.ceph.mds.a.smithi153.stderr:2024-03-28T22:19:21.963+0000 7f063e400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 169664) UID: 0 2024-03-28T22:22:18.455 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:22:18.464 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:22:37.062 INFO:teuthology.orchestra.run.smithi153.stdout:generic/089 920s 2024-03-28T22:22:37.079 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/089 2024-03-28T22:22:37.079 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:22:37.100 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:22:37.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:22:37.396 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-03-28T22:22:38.385 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:22:38.396 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:22:38.397 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:22:38.400 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:22:38.400 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:22:39.096 INFO:teuthology.orchestra.run.smithi153.stdout:generic/090 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:22:39.111 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/090 2024-03-28T22:22:39.111 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/090 2024-03-28T22:22:39.111 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:22:39.121 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:22:39.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:22:39.174 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-03-28T22:22:39.738 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:22:39.752 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:22:39.754 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:22:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:22:48.713 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:22:48.721 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:23:18.861 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:23:18.870 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:23:48.995 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:23:49.004 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:24:19.125 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:24:19.133 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:24:49.268 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:24:49.275 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:25:19.431 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:25:19.442 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:25:36.779 INFO:teuthology.orchestra.run.smithi153.stdout:generic/091 [failed, exit status 1]- output mismatch (see /tmp/tmp.0cGUU1Musyxfstests-dev/results//generic/091.out.bad) 2024-03-28T22:25:36.792 INFO:teuthology.orchestra.run.smithi153.stdout: --- tests/generic/091.out 2024-03-28 21:53:24.310164187 +0000 2024-03-28T22:25:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: +++ /tmp/tmp.0cGUU1Musyxfstests-dev/results//generic/091.out.bad 2024-03-28 22:25:36.772789871 +0000 2024-03-28T22:25:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: @@ -5,3 +5,527 @@ 2024-03-28T22:25:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: fsx -N 10000 -o 8192 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z -R -W 2024-03-28T22:25:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: fsx -N 10000 -o 32768 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z -R -W 2024-03-28T22:25:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: fsx -N 10000 -o 128000 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z -W 2024-03-28T22:25:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: +mapped writes DISABLED 2024-03-28T22:25:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: +Seed set to 1 2024-03-28T22:25:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support fallocate mode 0, disabling! 2024-03-28T22:25:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-03-28T22:25:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_ZERO_RANGE, disabling! 2024-03-28T22:25:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-03-28T22:25:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-03-28T22:25:36.793 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support clone range, disabling! 2024-03-28T22:25:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support dedupe range, disabling! 2024-03-28T22:25:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support exchange range, disabling! 2024-03-28T22:25:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: +skipping zero size read 2024-03-28T22:25:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: +copying to largest ever: 0x4b000 2024-03-28T22:25:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: +copying to largest ever: 0x7a000 2024-03-28T22:25:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: +READ BAD DATA: offset = 0x1f000, size = 0x111f5, fname = /tmp/tmp.l0v0NkF9eFtest/junk 2024-03-28T22:25:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: +OFFSET GOOD BAD RANGE 2024-03-28T22:25:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: +0x28000 0x94dd 0x0000 0x0 2024-03-28T22:25:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: +0x28001 0xdd94 0x0000 0x1 2024-03-28T22:25:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.794 INFO:teuthology.orchestra.run.smithi153.stdout: +0x28002 0x94f9 0x0000 0x2 2024-03-28T22:25:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: +0x28003 0xf994 0x0000 0x3 2024-03-28T22:25:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: +0x28004 0x9422 0x0000 0x4 2024-03-28T22:25:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: +0x28005 0x2294 0x0000 0x5 2024-03-28T22:25:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: +0x28006 0x9458 0x0000 0x6 2024-03-28T22:25:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: +0x28007 0x5894 0x0000 0x7 2024-03-28T22:25:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: +0x28008 0x94a3 0x0000 0x8 2024-03-28T22:25:36.795 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +0x28009 0xa394 0x0000 0x9 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +0x2800a 0x943d 0x0000 0xa 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +0x2800b 0x3d94 0x0000 0xb 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +0x2800c 0x94cd 0x0000 0xc 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +0x2800d 0xcd94 0x0000 0xd 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +0x2800e 0x941b 0x0000 0xe 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +0x2800f 0x1b94 0x0000 0xf 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T22:25:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: +LOG DUMP (473 total operations): 2024-03-28T22:25:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: +1( 1 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2( 2 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: +3( 3 mod 256): WRITE 0x69000 thru 0x78fff (0x10000 bytes) HOLE ***WWWW 2024-03-28T22:25:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: +4( 4 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: +5( 5 mod 256): READ 0x63000 thru 0x70fff (0xe000 bytes) 2024-03-28T22:25:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: +6( 6 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: +7( 7 mod 256): MAPREAD 0x29000 thru 0x40364 (0x17365 bytes) ***RRRR*** 2024-03-28T22:25:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: +8( 8 mod 256): PUNCH 0x3867a thru 0x3be42 (0x37c9 bytes) 2024-03-28T22:25:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: +9( 9 mod 256): PUNCH 0x6ea38 thru 0x78fff (0xa5c8 bytes) 2024-03-28T22:25:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: +10( 10 mod 256): COPY 0x1f000 thru 0x29fff (0xb000 bytes) to 0x40000 thru 0x4afff 2024-03-28T22:25:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: +11( 11 mod 256): READ 0x73000 thru 0x77fff (0x5000 bytes) 2024-03-28T22:25:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: +12( 12 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.797 INFO:teuthology.orchestra.run.smithi153.stdout: +13( 13 mod 256): WRITE 0x2f000 thru 0x49fff (0x1b000 bytes) ***WWWW 2024-03-28T22:25:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: +14( 14 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: +15( 15 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: +16( 16 mod 256): WRITE 0x4d000 thru 0x54fff (0x8000 bytes) 2024-03-28T22:25:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: +17( 17 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: +18( 18 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: +19( 19 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: +20( 20 mod 256): MAPREAD 0x55000 thru 0x6e2fc (0x192fd bytes) 2024-03-28T22:25:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: +21( 21 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: +22( 22 mod 256): TRUNCATE DOWN from 0x79000 to 0x1f000 ******WWWW 2024-03-28T22:25:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: +23( 23 mod 256): WRITE 0x61000 thru 0x65fff (0x5000 bytes) HOLE ***WWWW 2024-03-28T22:25:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: +24( 24 mod 256): PUNCH 0x3e5ff thru 0x3ed80 (0x782 bytes) 2024-03-28T22:25:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: +25( 25 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.798 INFO:teuthology.orchestra.run.smithi153.stdout: +26( 26 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +27( 27 mod 256): READ 0x28000 thru 0x28fff (0x1000 bytes) 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +28( 28 mod 256): COPY 0x61000 thru 0x64fff (0x4000 bytes) to 0x25000 thru 0x28fff 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +29( 29 mod 256): TRUNCATE DOWN from 0x66000 to 0x3a000 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +30( 30 mod 256): MAPREAD 0x39000 thru 0x39449 (0x44a bytes) 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +31( 31 mod 256): TRUNCATE UP from 0x3a000 to 0x40000 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +32( 32 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +33( 33 mod 256): COPY 0x1a000 thru 0x35fff (0x1c000 bytes) to 0x5e000 thru 0x79fff EEEE****** 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +34( 34 mod 256): MAPREAD 0x2000 thru 0x1ec96 (0x1cc97 bytes) 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +35( 35 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +36( 36 mod 256): WRITE 0x71000 thru 0x78fff (0x8000 bytes) 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +37( 37 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +38( 38 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +39( 39 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +40( 40 mod 256): COPY 0x49000 thru 0x5ffff (0x17000 bytes) to 0x22000 thru 0x38fff ******EEEE 2024-03-28T22:25:36.799 INFO:teuthology.orchestra.run.smithi153.stdout: +41( 41 mod 256): WRITE 0x29000 thru 0x38fff (0x10000 bytes) ***WWWW 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +42( 42 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +43( 43 mod 256): READ 0x65000 thru 0x68fff (0x4000 bytes) 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +44( 44 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +45( 45 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +46( 46 mod 256): WRITE 0x3d000 thru 0x46fff (0xa000 bytes) 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +47( 47 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +48( 48 mod 256): WRITE 0x14000 thru 0x23fff (0x10000 bytes) 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +49( 49 mod 256): READ 0x6c000 thru 0x72fff (0x7000 bytes) 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +50( 50 mod 256): TRUNCATE DOWN from 0x7a000 to 0x16000 ******WWWW 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +51( 51 mod 256): WRITE 0x15000 thru 0x1dfff (0x9000 bytes) EXTEND 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +52( 52 mod 256): PUNCH 0x6d5e thru 0x1d2c0 (0x16563 bytes) 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +53( 53 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +54( 54 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +55( 55 mod 256): WRITE 0x34000 thru 0x50fff (0x1d000 bytes) HOLE ***WWWW 2024-03-28T22:25:36.800 INFO:teuthology.orchestra.run.smithi153.stdout: +56( 56 mod 256): WRITE 0x38000 thru 0x41fff (0xa000 bytes) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +57( 57 mod 256): PUNCH 0x44b22 thru 0x479ea (0x2ec9 bytes) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +58( 58 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +59( 59 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +60( 60 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +61( 61 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +62( 62 mod 256): WRITE 0x19000 thru 0x28fff (0x10000 bytes) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +63( 63 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +64( 64 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +65( 65 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +66( 66 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +67( 67 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +68( 68 mod 256): PUNCH 0x29014 thru 0x326b2 (0x969f bytes) ******PPPP 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +69( 69 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +70( 70 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +71( 71 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.801 INFO:teuthology.orchestra.run.smithi153.stdout: +72( 72 mod 256): PUNCH 0x45e0a thru 0x4c97d (0x6b74 bytes) 2024-03-28T22:25:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: +73( 73 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: +74( 74 mod 256): PUNCH 0x204bd thru 0x26100 (0x5c44 bytes) 2024-03-28T22:25:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: +75( 75 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: +76( 76 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: +77( 77 mod 256): READ 0x38000 thru 0x49fff (0x12000 bytes) 2024-03-28T22:25:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: +78( 78 mod 256): PUNCH 0x4fdcd thru 0x50fff (0x1233 bytes) 2024-03-28T22:25:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: +79( 79 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: +80( 80 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: +81( 81 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: +82( 82 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: +83( 83 mod 256): PUNCH 0x4bbdc thru 0x50fff (0x5424 bytes) 2024-03-28T22:25:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: +84( 84 mod 256): TRUNCATE DOWN from 0x51000 to 0x16000 ******WWWW 2024-03-28T22:25:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: +85( 85 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.802 INFO:teuthology.orchestra.run.smithi153.stdout: +86( 86 mod 256): MAPREAD 0xc000 thru 0x1561e (0x961f bytes) 2024-03-28T22:25:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: +87( 87 mod 256): COPY 0x14000 thru 0x14fff (0x1000 bytes) to 0x65000 thru 0x65fff 2024-03-28T22:25:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: +88( 88 mod 256): COPY 0x4f000 thru 0x5dfff (0xf000 bytes) to 0x2000 thru 0x10fff 2024-03-28T22:25:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: +89( 89 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: +90( 90 mod 256): PUNCH 0x3f925 thru 0x50e34 (0x11510 bytes) 2024-03-28T22:25:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: +91( 91 mod 256): MAPREAD 0x21000 thru 0x25654 (0x4655 bytes) 2024-03-28T22:25:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: +92( 92 mod 256): WRITE 0x38000 thru 0x49fff (0x12000 bytes) 2024-03-28T22:25:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: +93( 93 mod 256): WRITE 0x3000 thru 0x4fff (0x2000 bytes) 2024-03-28T22:25:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: +94( 94 mod 256): PUNCH 0x22d29 thru 0x2f9e9 (0xccc1 bytes) 2024-03-28T22:25:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: +95( 95 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: +96( 96 mod 256): MAPREAD 0x37000 thru 0x4c378 (0x15379 bytes) 2024-03-28T22:25:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: +97( 97 mod 256): WRITE 0x6f000 thru 0x70fff (0x2000 bytes) HOLE 2024-03-28T22:25:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: +98( 98 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: +99( 99 mod 256): TRUNCATE DOWN from 0x71000 to 0x4f000 2024-03-28T22:25:36.803 INFO:teuthology.orchestra.run.smithi153.stdout: +100(100 mod 256): READ 0x3c000 thru 0x4dfff (0x12000 bytes) 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +101(101 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +102(102 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +103(103 mod 256): TRUNCATE UP from 0x4f000 to 0x6f000 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +104(104 mod 256): COPY 0xa000 thru 0xefff (0x5000 bytes) to 0x66000 thru 0x6afff 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +105(105 mod 256): WRITE 0x2b000 thru 0x48fff (0x1e000 bytes) ***WWWW 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +106(106 mod 256): COPY 0x5d000 thru 0x6dfff (0x11000 bytes) to 0x24000 thru 0x34fff ******EEEE 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +107(107 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +108(108 mod 256): TRUNCATE DOWN from 0x6f000 to 0x5b000 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +109(109 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +110(110 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +111(111 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +112(112 mod 256): PUNCH 0x3ad7a thru 0x4344c (0x86d3 bytes) 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +113(113 mod 256): WRITE 0xa000 thru 0x14fff (0xb000 bytes) 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +114(114 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.804 INFO:teuthology.orchestra.run.smithi153.stdout: +115(115 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +116(116 mod 256): COPY 0x4000 thru 0x14fff (0x11000 bytes) to 0x57000 thru 0x67fff 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +117(117 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +118(118 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +119(119 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +120(120 mod 256): MAPREAD 0x3a000 thru 0x4d08b (0x1308c bytes) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +121(121 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +122(122 mod 256): PUNCH 0xc17e thru 0x13d3c (0x7bbf bytes) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +123(123 mod 256): WRITE 0x3b000 thru 0x40fff (0x6000 bytes) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +124(124 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +125(125 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +126(126 mod 256): WRITE 0x21000 thru 0x23fff (0x3000 bytes) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +127(127 mod 256): PUNCH 0x55e66 thru 0x67fff (0x1219a bytes) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +128(128 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +129(129 mod 256): WRITE 0xf000 thru 0x22fff (0x14000 bytes) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +130(130 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.805 INFO:teuthology.orchestra.run.smithi153.stdout: +131(131 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +132(132 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +133(133 mod 256): COPY 0x65000 thru 0x66fff (0x2000 bytes) to 0x1e000 thru 0x1ffff 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +134(134 mod 256): READ 0x30000 thru 0x33fff (0x4000 bytes) ***RRRR*** 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +135(135 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +136(136 mod 256): COPY 0x21000 thru 0x2efff (0xe000 bytes) to 0xe000 thru 0x1bfff 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +137(137 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +138(138 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +139(139 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +140(140 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +141(141 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +142(142 mod 256): WRITE 0x0 thru 0x19fff (0x1a000 bytes) 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +143(143 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +144(144 mod 256): TRUNCATE UP from 0x68000 to 0x72000 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +145(145 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +146(146 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.806 INFO:teuthology.orchestra.run.smithi153.stdout: +147(147 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +148(148 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +149(149 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +150(150 mod 256): READ 0x19000 thru 0x29fff (0x11000 bytes) 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +151(151 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +152(152 mod 256): MAPREAD 0x4d000 thru 0x4d15d (0x15e bytes) 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +153(153 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +154(154 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +155(155 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +156(156 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +157(157 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +158(158 mod 256): PUNCH 0x7c7d thru 0x1aa9c (0x12e20 bytes) 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +159(159 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +160(160 mod 256): WRITE 0x76000 thru 0x78fff (0x3000 bytes) HOLE 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +161(161 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.807 INFO:teuthology.orchestra.run.smithi153.stdout: +162(162 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +163(163 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +164(164 mod 256): READ 0x58000 thru 0x61fff (0xa000 bytes) 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +165(165 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +166(166 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +167(167 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +168(168 mod 256): COPY 0x70000 thru 0x77fff (0x8000 bytes) to 0x57000 thru 0x5efff 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +169(169 mod 256): MAPREAD 0x65000 thru 0x78331 (0x13332 bytes) 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +170(170 mod 256): WRITE 0x6b000 thru 0x6ffff (0x5000 bytes) 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +171(171 mod 256): WRITE 0x18000 thru 0x25fff (0xe000 bytes) 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +172(172 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +173(173 mod 256): COPY 0x44000 thru 0x47fff (0x4000 bytes) to 0x13000 thru 0x16fff 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +174(174 mod 256): WRITE 0x62000 thru 0x77fff (0x16000 bytes) 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +175(175 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +176(176 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +177(177 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.808 INFO:teuthology.orchestra.run.smithi153.stdout: +178(178 mod 256): TRUNCATE DOWN from 0x79000 to 0x1d000 ******WWWW 2024-03-28T22:25:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: +179(179 mod 256): MAPREAD 0x18000 thru 0x1cc90 (0x4c91 bytes) 2024-03-28T22:25:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: +180(180 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: +181(181 mod 256): PUNCH 0x33a4 thru 0x1189f (0xe4fc bytes) 2024-03-28T22:25:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: +182(182 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: +183(183 mod 256): WRITE 0x3e000 thru 0x4cfff (0xf000 bytes) HOLE ***WWWW 2024-03-28T22:25:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: +184(184 mod 256): TRUNCATE DOWN from 0x4d000 to 0x29000 ******WWWW 2024-03-28T22:25:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: +185(185 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: +186(186 mod 256): MAPREAD 0x1d000 thru 0x28e2a (0xbe2b bytes) 2024-03-28T22:25:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: +187(187 mod 256): WRITE 0x6e000 thru 0x6efff (0x1000 bytes) HOLE ***WWWW 2024-03-28T22:25:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: +188(188 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: +189(189 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: +190(190 mod 256): COPY 0x44000 thru 0x47fff (0x4000 bytes) to 0x38000 thru 0x3bfff 2024-03-28T22:25:36.809 INFO:teuthology.orchestra.run.smithi153.stdout: +191(191 mod 256): READ 0x23000 thru 0x33fff (0x11000 bytes) ***RRRR*** 2024-03-28T22:25:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: +192(192 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: +193(193 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: +194(194 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: +195(195 mod 256): READ 0xc000 thru 0x10fff (0x5000 bytes) 2024-03-28T22:25:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: +196(196 mod 256): COPY 0x4e000 thru 0x64fff (0x17000 bytes) to 0x35000 thru 0x4bfff 2024-03-28T22:25:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: +197(197 mod 256): MAPREAD 0x54000 thru 0x634ce (0xf4cf bytes) 2024-03-28T22:25:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: +198(198 mod 256): PUNCH 0x8161 thru 0xcf7c (0x4e1c bytes) 2024-03-28T22:25:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: +199(199 mod 256): PUNCH 0x582d1 thru 0x617ef (0x951f bytes) 2024-03-28T22:25:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: +200(200 mod 256): MAPREAD 0x38000 thru 0x4da09 (0x15a0a bytes) 2024-03-28T22:25:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: +201(201 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: +202(202 mod 256): TRUNCATE DOWN from 0x6f000 to 0x15000 ******WWWW 2024-03-28T22:25:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: +203(203 mod 256): TRUNCATE UP from 0x15000 to 0x50000 ******WWWW 2024-03-28T22:25:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: +204(204 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.810 INFO:teuthology.orchestra.run.smithi153.stdout: +205(205 mod 256): WRITE 0x6a000 thru 0x76fff (0xd000 bytes) HOLE 2024-03-28T22:25:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: +206(206 mod 256): PUNCH 0x3052f thru 0x335d4 (0x30a6 bytes) 2024-03-28T22:25:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: +207(207 mod 256): WRITE 0x5b000 thru 0x60fff (0x6000 bytes) 2024-03-28T22:25:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: +208(208 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: +209(209 mod 256): READ 0x26000 thru 0x3efff (0x19000 bytes) ***RRRR*** 2024-03-28T22:25:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: +210(210 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: +211(211 mod 256): WRITE 0x5b000 thru 0x64fff (0xa000 bytes) 2024-03-28T22:25:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: +212(212 mod 256): MAPREAD 0x3f000 thru 0x4bd78 (0xcd79 bytes) 2024-03-28T22:25:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: +213(213 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: +214(214 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: +215(215 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: +216(216 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: +217(217 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.811 INFO:teuthology.orchestra.run.smithi153.stdout: +218(218 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: +219(219 mod 256): TRUNCATE DOWN from 0x77000 to 0x5e000 2024-03-28T22:25:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: +220(220 mod 256): PUNCH 0x11d69 thru 0x1753f (0x57d7 bytes) 2024-03-28T22:25:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: +221(221 mod 256): PUNCH 0x42bbc thru 0x5a0e7 (0x1752c bytes) 2024-03-28T22:25:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: +222(222 mod 256): PUNCH 0x15837 thru 0x31b0f (0x1c2d9 bytes) ******PPPP 2024-03-28T22:25:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: +223(223 mod 256): READ 0x2d000 thru 0x36fff (0xa000 bytes) ***RRRR*** 2024-03-28T22:25:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: +224(224 mod 256): MAPREAD 0x29000 thru 0x47985 (0x1e986 bytes) ***RRRR*** 2024-03-28T22:25:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: +225(225 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: +226(226 mod 256): WRITE 0x15000 thru 0x31fff (0x1d000 bytes) ***WWWW 2024-03-28T22:25:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: +227(227 mod 256): READ 0x12000 thru 0x23fff (0x12000 bytes) 2024-03-28T22:25:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: +228(228 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: +229(229 mod 256): MAPREAD 0x28000 thru 0x34970 (0xc971 bytes) ***RRRR*** 2024-03-28T22:25:36.812 INFO:teuthology.orchestra.run.smithi153.stdout: +230(230 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: +231(231 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: +232(232 mod 256): PUNCH 0x2bfe7 thru 0x33ed1 (0x7eeb bytes) ******PPPP 2024-03-28T22:25:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: +233(233 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: +234(234 mod 256): WRITE 0x72000 thru 0x78fff (0x7000 bytes) HOLE 2024-03-28T22:25:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: +235(235 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: +236(236 mod 256): COPY 0x72000 thru 0x77fff (0x6000 bytes) to 0x27000 thru 0x2cfff 2024-03-28T22:25:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: +237(237 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: +238(238 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: +239(239 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: +240(240 mod 256): PUNCH 0x74145 thru 0x78fff (0x4ebb bytes) 2024-03-28T22:25:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: +241(241 mod 256): WRITE 0x4b000 thru 0x64fff (0x1a000 bytes) 2024-03-28T22:25:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: +242(242 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.813 INFO:teuthology.orchestra.run.smithi153.stdout: +243(243 mod 256): WRITE 0x37000 thru 0x41fff (0xb000 bytes) 2024-03-28T22:25:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: +244(244 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: +245(245 mod 256): MAPREAD 0x37000 thru 0x49af1 (0x12af2 bytes) 2024-03-28T22:25:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: +246(246 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: +247(247 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: +248(248 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: +249(249 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: +250(250 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: +251(251 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: +252(252 mod 256): MAPREAD 0x2b000 thru 0x3365b (0x865c bytes) ***RRRR*** 2024-03-28T22:25:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: +253(253 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: +254(254 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: +255(255 mod 256): READ 0x40000 thru 0x42fff (0x3000 bytes) 2024-03-28T22:25:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: +256( 0 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.814 INFO:teuthology.orchestra.run.smithi153.stdout: +257( 1 mod 256): COPY 0x3f000 thru 0x46fff (0x8000 bytes) to 0x31000 thru 0x38fff 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +258( 2 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +259( 3 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +260( 4 mod 256): READ 0x23000 thru 0x3bfff (0x19000 bytes) ***RRRR*** 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +261( 5 mod 256): TRUNCATE DOWN from 0x79000 to 0x15000 ******WWWW 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +262( 6 mod 256): MAPREAD 0xa000 thru 0xe6d6 (0x46d7 bytes) 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +263( 7 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +264( 8 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +265( 9 mod 256): COPY 0xa000 thru 0x13fff (0xa000 bytes) to 0x5d000 thru 0x66fff 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +266( 10 mod 256): WRITE 0x51000 thru 0x62fff (0x12000 bytes) 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +267( 11 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +268( 12 mod 256): TRUNCATE DOWN from 0x67000 to 0x53000 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +269( 13 mod 256): PUNCH 0x4ec35 thru 0x52fff (0x43cb bytes) 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +270( 14 mod 256): TRUNCATE DOWN from 0x53000 to 0x11000 ******WWWW 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +271( 15 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.815 INFO:teuthology.orchestra.run.smithi153.stdout: +272( 16 mod 256): WRITE 0x2000 thru 0x2fff (0x1000 bytes) 2024-03-28T22:25:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: +273( 17 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: +274( 18 mod 256): TRUNCATE DOWN from 0x11000 to 0x10000 2024-03-28T22:25:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: +275( 19 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: +276( 20 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: +277( 21 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: +278( 22 mod 256): MAPREAD 0x3000 thru 0xfecf (0xced0 bytes) 2024-03-28T22:25:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: +279( 23 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: +280( 24 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: +281( 25 mod 256): COPY 0x9000 thru 0xefff (0x6000 bytes) to 0x1000 thru 0x6fff 2024-03-28T22:25:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: +282( 26 mod 256): TRUNCATE UP from 0x10000 to 0x4a000 ******WWWW 2024-03-28T22:25:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: +283( 27 mod 256): READ 0x37000 thru 0x47fff (0x11000 bytes) 2024-03-28T22:25:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: +284( 28 mod 256): TRUNCATE DOWN from 0x4a000 to 0x20000 ******WWWW 2024-03-28T22:25:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: +285( 29 mod 256): COPY 0xd000 thru 0x18fff (0xc000 bytes) to 0x6d000 thru 0x78fff 2024-03-28T22:25:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: +286( 30 mod 256): READ 0x77000 thru 0x77fff (0x1000 bytes) 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +287( 31 mod 256): TRUNCATE DOWN from 0x79000 to 0x43000 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +288( 32 mod 256): PUNCH 0x3ea29 thru 0x42fff (0x45d7 bytes) 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +289( 33 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +290( 34 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +291( 35 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +292( 36 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +293( 37 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +294( 38 mod 256): PUNCH 0x2b723 thru 0x42fff (0x178dd bytes) ******PPPP 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +295( 39 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +296( 40 mod 256): TRUNCATE DOWN from 0x43000 to 0x12000 ******WWWW 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +297( 41 mod 256): MAPREAD 0x7000 thru 0x11604 (0xa605 bytes) 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +298( 42 mod 256): MAPREAD 0x4000 thru 0x116ad (0xd6ae bytes) 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +299( 43 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +300( 44 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.817 INFO:teuthology.orchestra.run.smithi153.stdout: +301( 45 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: +302( 46 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: +303( 47 mod 256): MAPREAD 0x7000 thru 0x11f0b (0xaf0c bytes) 2024-03-28T22:25:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: +304( 48 mod 256): COPY 0x6000 thru 0xefff (0x9000 bytes) to 0x58000 thru 0x60fff 2024-03-28T22:25:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: +305( 49 mod 256): PUNCH 0x434c8 thru 0x49c93 (0x67cc bytes) 2024-03-28T22:25:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: +306( 50 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: +307( 51 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: +308( 52 mod 256): COPY 0x30000 thru 0x31fff (0x2000 bytes) to 0x6000 thru 0x7fff EEEE****** 2024-03-28T22:25:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: +309( 53 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: +310( 54 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: +311( 55 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: +312( 56 mod 256): PUNCH 0x4eab3 thru 0x60fff (0x1254d bytes) 2024-03-28T22:25:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: +313( 57 mod 256): MAPREAD 0x16000 thru 0x25c6c (0xfc6d bytes) 2024-03-28T22:25:36.818 INFO:teuthology.orchestra.run.smithi153.stdout: +314( 58 mod 256): READ 0x51000 thru 0x52fff (0x2000 bytes) 2024-03-28T22:25:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: +315( 59 mod 256): MAPREAD 0x25000 thru 0x2ba17 (0x6a18 bytes) 2024-03-28T22:25:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: +316( 60 mod 256): MAPREAD 0x15000 thru 0x29d2a (0x14d2b bytes) 2024-03-28T22:25:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: +317( 61 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: +318( 62 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: +319( 63 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: +320( 64 mod 256): WRITE 0x6b000 thru 0x78fff (0xe000 bytes) HOLE 2024-03-28T22:25:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: +321( 65 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: +322( 66 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: +323( 67 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: +324( 68 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: +325( 69 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: +326( 70 mod 256): WRITE 0x3f000 thru 0x48fff (0xa000 bytes) 2024-03-28T22:25:36.819 INFO:teuthology.orchestra.run.smithi153.stdout: +327( 71 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: +328( 72 mod 256): MAPREAD 0x3b000 thru 0x4ce48 (0x11e49 bytes) 2024-03-28T22:25:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: +329( 73 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: +330( 74 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: +331( 75 mod 256): WRITE 0x22000 thru 0x2afff (0x9000 bytes) 2024-03-28T22:25:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: +332( 76 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: +333( 77 mod 256): MAPREAD 0x3000 thru 0x20fae (0x1dfaf bytes) 2024-03-28T22:25:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: +334( 78 mod 256): READ 0x12000 thru 0x17fff (0x6000 bytes) 2024-03-28T22:25:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: +335( 79 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: +336( 80 mod 256): WRITE 0xb000 thru 0xdfff (0x3000 bytes) 2024-03-28T22:25:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: +337( 81 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: +338( 82 mod 256): TRUNCATE DOWN from 0x79000 to 0x78000 2024-03-28T22:25:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: +339( 83 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.820 INFO:teuthology.orchestra.run.smithi153.stdout: +340( 84 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: +341( 85 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: +342( 86 mod 256): COPY 0x0 thru 0x19fff (0x1a000 bytes) to 0x4b000 thru 0x64fff 2024-03-28T22:25:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: +343( 87 mod 256): COPY 0x4e000 thru 0x56fff (0x9000 bytes) to 0x60000 thru 0x68fff 2024-03-28T22:25:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: +344( 88 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: +345( 89 mod 256): PUNCH 0x2f1ac thru 0x48a46 (0x1989b bytes) ******PPPP 2024-03-28T22:25:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: +346( 90 mod 256): TRUNCATE DOWN from 0x78000 to 0x39000 2024-03-28T22:25:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: +347( 91 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: +348( 92 mod 256): PUNCH 0x2b9d5 thru 0x38fff (0xd62b bytes) ******PPPP 2024-03-28T22:25:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: +349( 93 mod 256): COPY 0x36000 thru 0x37fff (0x2000 bytes) to 0x26000 thru 0x27fff 2024-03-28T22:25:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: +350( 94 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: +351( 95 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: +352( 96 mod 256): WRITE 0x30000 thru 0x3afff (0xb000 bytes) EXTEND ***WWWW 2024-03-28T22:25:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: +353( 97 mod 256): PUNCH 0x2ff80 thru 0x3afff (0xb080 bytes) ******PPPP 2024-03-28T22:25:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: +354( 98 mod 256): PUNCH 0xe9ad thru 0x14cff (0x6353 bytes) 2024-03-28T22:25:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: +355( 99 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: +356(100 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: +357(101 mod 256): WRITE 0x53000 thru 0x61fff (0xf000 bytes) HOLE 2024-03-28T22:25:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: +358(102 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: +359(103 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: +360(104 mod 256): COPY 0x5b000 thru 0x60fff (0x6000 bytes) to 0x14000 thru 0x19fff 2024-03-28T22:25:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: +361(105 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: +362(106 mod 256): PUNCH 0x46997 thru 0x5048d (0x9af7 bytes) 2024-03-28T22:25:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: +363(107 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: +364(108 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: +365(109 mod 256): READ 0x4f000 thru 0x58fff (0xa000 bytes) 2024-03-28T22:25:36.822 INFO:teuthology.orchestra.run.smithi153.stdout: +366(110 mod 256): TRUNCATE DOWN from 0x62000 to 0x4b000 2024-03-28T22:25:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: +367(111 mod 256): PUNCH 0x16cf9 thru 0x1f09a (0x83a2 bytes) 2024-03-28T22:25:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: +368(112 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: +369(113 mod 256): WRITE 0x61000 thru 0x63fff (0x3000 bytes) HOLE 2024-03-28T22:25:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: +370(114 mod 256): PUNCH 0x7ece thru 0x15d6b (0xde9e bytes) 2024-03-28T22:25:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: +371(115 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: +372(116 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: +373(117 mod 256): MAPREAD 0x3a000 thru 0x461c0 (0xc1c1 bytes) 2024-03-28T22:25:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: +374(118 mod 256): COPY 0x4000 thru 0x7fff (0x4000 bytes) to 0x6e000 thru 0x71fff 2024-03-28T22:25:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: +375(119 mod 256): PUNCH 0xf1b6 thru 0x20325 (0x11170 bytes) 2024-03-28T22:25:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: +376(120 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: +377(121 mod 256): WRITE 0x72000 thru 0x78fff (0x7000 bytes) EXTEND 2024-03-28T22:25:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: +378(122 mod 256): PUNCH 0x33aa3 thru 0x33aba (0x18 bytes) 2024-03-28T22:25:36.823 INFO:teuthology.orchestra.run.smithi153.stdout: +379(123 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: +380(124 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: +381(125 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: +382(126 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: +383(127 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: +384(128 mod 256): WRITE 0x50000 thru 0x57fff (0x8000 bytes) 2024-03-28T22:25:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: +385(129 mod 256): WRITE 0x5c000 thru 0x78fff (0x1d000 bytes) 2024-03-28T22:25:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: +386(130 mod 256): WRITE 0x2c000 thru 0x3bfff (0x10000 bytes) ***WWWW 2024-03-28T22:25:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: +387(131 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: +388(132 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: +389(133 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: +390(134 mod 256): READ 0x14000 thru 0x15fff (0x2000 bytes) 2024-03-28T22:25:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: +391(135 mod 256): PUNCH 0x642c5 thru 0x78fff (0x14d3b bytes) 2024-03-28T22:25:36.824 INFO:teuthology.orchestra.run.smithi153.stdout: +392(136 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +393(137 mod 256): PUNCH 0x38e5e thru 0x40c2b (0x7dce bytes) 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +394(138 mod 256): WRITE 0x1a000 thru 0x30fff (0x17000 bytes) ***WWWW 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +395(139 mod 256): MAPREAD 0x25000 thru 0x3bcd4 (0x16cd5 bytes) ***RRRR*** 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +396(140 mod 256): WRITE 0x4d000 thru 0x62fff (0x16000 bytes) 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +397(141 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +398(142 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +399(143 mod 256): TRUNCATE DOWN from 0x79000 to 0x54000 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +400(144 mod 256): READ 0x34000 thru 0x47fff (0x14000 bytes) 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +401(145 mod 256): MAPREAD 0x8000 thru 0x17f9b (0xff9c bytes) 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +402(146 mod 256): WRITE 0x76000 thru 0x78fff (0x3000 bytes) HOLE 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +403(147 mod 256): WRITE 0x17000 thru 0x2bfff (0x15000 bytes) 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +404(148 mod 256): WRITE 0x1000 thru 0x15fff (0x15000 bytes) 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +405(149 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +406(150 mod 256): PUNCH 0x2e493 thru 0x47894 (0x19402 bytes) ******PPPP 2024-03-28T22:25:36.825 INFO:teuthology.orchestra.run.smithi153.stdout: +407(151 mod 256): PUNCH 0x1b7ac thru 0x330d7 (0x1792c bytes) ******PPPP 2024-03-28T22:25:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: +408(152 mod 256): TRUNCATE DOWN from 0x79000 to 0x3b000 2024-03-28T22:25:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: +409(153 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: +410(154 mod 256): WRITE 0x3f000 thru 0x41fff (0x3000 bytes) HOLE 2024-03-28T22:25:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: +411(155 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: +412(156 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: +413(157 mod 256): TRUNCATE DOWN from 0x42000 to 0x29000 ******WWWW 2024-03-28T22:25:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: +414(158 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: +415(159 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: +416(160 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: +417(161 mod 256): READ 0x27000 thru 0x27fff (0x1000 bytes) 2024-03-28T22:25:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: +418(162 mod 256): WRITE 0x61000 thru 0x61fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T22:25:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: +419(163 mod 256): TRUNCATE DOWN from 0x62000 to 0x2b000 ******WWWW 2024-03-28T22:25:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: +420(164 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.826 INFO:teuthology.orchestra.run.smithi153.stdout: +421(165 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +422(166 mod 256): COPY 0x9000 thru 0x15fff (0xd000 bytes) to 0x68000 thru 0x74fff 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +423(167 mod 256): COPY 0x49000 thru 0x4afff (0x2000 bytes) to 0x68000 thru 0x69fff 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +424(168 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +425(169 mod 256): COPY 0x25000 thru 0x41fff (0x1d000 bytes) to 0x42000 thru 0x5efff EEEE****** 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +426(170 mod 256): WRITE 0x58000 thru 0x61fff (0xa000 bytes) 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +427(171 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +428(172 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +429(173 mod 256): TRUNCATE DOWN from 0x75000 to 0x62000 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +430(174 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +431(175 mod 256): TRUNCATE DOWN from 0x62000 to 0x4e000 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +432(176 mod 256): WRITE 0x4e000 thru 0x6afff (0x1d000 bytes) EXTEND 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +433(177 mod 256): COPY 0x43000 thru 0x5dfff (0x1b000 bytes) to 0x22000 thru 0x3cfff ******EEEE 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +434(178 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +435(179 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +436(180 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.827 INFO:teuthology.orchestra.run.smithi153.stdout: +437(181 mod 256): READ 0x30000 thru 0x33fff (0x4000 bytes) ***RRRR*** 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +438(182 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +439(183 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +440(184 mod 256): READ 0x21000 thru 0x36fff (0x16000 bytes) ***RRRR*** 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +441(185 mod 256): TRUNCATE DOWN from 0x6b000 to 0x60000 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +442(186 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +443(187 mod 256): READ 0xe000 thru 0x1ffff (0x12000 bytes) 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +444(188 mod 256): READ 0x2e000 thru 0x33fff (0x6000 bytes) ***RRRR*** 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +445(189 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +446(190 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +447(191 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +448(192 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +449(193 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +450(194 mod 256): COPY 0x1d000 thru 0x1dfff (0x1000 bytes) to 0x29000 thru 0x29fff 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +451(195 mod 256): PUNCH 0x4c01a thru 0x5ffff (0x13fe6 bytes) 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +452(196 mod 256): TRUNCATE DOWN from 0x60000 to 0x2d000 ******WWWW 2024-03-28T22:25:36.828 INFO:teuthology.orchestra.run.smithi153.stdout: +453(197 mod 256): WRITE 0x68000 thru 0x68fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T22:25:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: +454(198 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: +455(199 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: +456(200 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: +457(201 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: +458(202 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: +459(203 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: +460(204 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: +461(205 mod 256): TRUNCATE DOWN from 0x69000 to 0x1c000 ******WWWW 2024-03-28T22:25:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: +462(206 mod 256): MAPREAD 0xe000 thru 0x15eaa (0x7eab bytes) 2024-03-28T22:25:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: +463(207 mod 256): WRITE 0x41000 thru 0x57fff (0x17000 bytes) HOLE ***WWWW 2024-03-28T22:25:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: +464(208 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: +465(209 mod 256): WRITE 0x4e000 thru 0x5dfff (0x10000 bytes) EXTEND 2024-03-28T22:25:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: +466(210 mod 256): TRUNCATE DOWN from 0x5e000 to 0x2e000 ******WWWW 2024-03-28T22:25:36.829 INFO:teuthology.orchestra.run.smithi153.stdout: +467(211 mod 256): TRUNCATE UP from 0x2e000 to 0x6c000 ******WWWW 2024-03-28T22:25:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: +468(212 mod 256): COPY 0x8000 thru 0x18fff (0x11000 bytes) to 0x28000 thru 0x38fff ******EEEE 2024-03-28T22:25:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: +469(213 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: +470(214 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: +471(215 mod 256): MAPREAD 0x3a000 thru 0x444af (0xa4b0 bytes) 2024-03-28T22:25:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: +472(216 mod 256): SKIPPED (no operation) 2024-03-28T22:25:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: +473(217 mod 256): MAPREAD 0x1f000 thru 0x301f4 (0x111f5 bytes) ***RRRR*** 2024-03-28T22:25:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: +Log of operations saved to "/tmp/tmp.l0v0NkF9eFtest/junk.fsxops"; replay with --replay-ops 2024-03-28T22:25:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: +Correct content saved for comparison 2024-03-28T22:25:36.830 INFO:teuthology.orchestra.run.smithi153.stdout: +(maybe hexdump "/tmp/tmp.l0v0NkF9eFtest/junk" vs "/tmp/tmp.l0v0NkF9eFtest/junk.fsxgood") 2024-03-28T22:25:36.831 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/091 2024-03-28T22:25:36.831 INFO:teuthology.orchestra.run.smithi153.stdout:Failures: generic/091 2024-03-28T22:25:36.831 INFO:teuthology.orchestra.run.smithi153.stdout:Failed 1 of 1 tests 2024-03-28T22:25:36.831 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:25:36.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T22:25:36.862 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-28T22:25:36.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-28T22:25:36.863 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-03-28T22:25:37.408 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:25:37.421 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:25:37.422 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:25:37.426 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:25:37.426 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:25:38.059 INFO:teuthology.orchestra.run.smithi153.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T22:25:38.073 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/092 2024-03-28T22:25:38.073 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/092 2024-03-28T22:25:38.073 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:25:38.081 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:25:38.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:25:38.121 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-03-28T22:25:38.687 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:25:38.701 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:25:38.702 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:25:38.706 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:25:38.706 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:25:39.989 INFO:teuthology.orchestra.run.smithi153.stdout:generic/093 1s 2024-03-28T22:25:40.004 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/093 2024-03-28T22:25:40.004 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:25:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:25:40.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:25:40.154 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-03-28T22:25:40.826 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:25:40.840 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:25:40.841 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:25:40.845 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:25:40.845 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:25:41.524 INFO:teuthology.orchestra.run.smithi153.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-28T22:25:41.536 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/094 2024-03-28T22:25:41.536 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/094 2024-03-28T22:25:41.536 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:25:41.544 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:25:41.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:25:41.655 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-03-28T22:25:42.335 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:25:42.347 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:25:42.348 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:25:42.352 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:25:42.352 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:25:49.563 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:25:49.570 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:26:02.317 INFO:teuthology.orchestra.run.smithi153.stdout:generic/095 20s 2024-03-28T22:26:02.354 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/095 2024-03-28T22:26:02.354 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:26:02.364 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:02.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:26:02.415 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-03-28T22:26:02.954 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:26:02.967 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:26:02.969 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:26:02.972 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:26:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:03.726 INFO:teuthology.orchestra.run.smithi153.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-28T22:26:03.739 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/096 2024-03-28T22:26:03.740 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/096 2024-03-28T22:26:03.740 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:26:03.749 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:03.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:26:03.807 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-03-28T22:26:04.356 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:26:04.372 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:26:04.374 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:26:04.377 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:26:04.377 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:05.566 INFO:teuthology.orchestra.run.smithi153.stdout:generic/097 1s 2024-03-28T22:26:05.579 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/097 2024-03-28T22:26:05.579 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:26:05.585 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:05.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:26:05.614 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-03-28T22:26:06.096 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:26:06.108 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:26:06.109 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:26:06.112 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:26:06.112 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:07.791 INFO:teuthology.orchestra.run.smithi153.stdout:generic/098 1s 2024-03-28T22:26:07.807 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/098 2024-03-28T22:26:07.807 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:26:07.815 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:07.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:26:07.842 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-03-28T22:26:08.369 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:26:08.381 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:26:08.382 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:26:08.385 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:26:08.385 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:10.366 INFO:teuthology.orchestra.run.smithi153.stdout:generic/099 2s 2024-03-28T22:26:10.385 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/099 2024-03-28T22:26:10.385 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:26:10.394 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:10.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:26:10.524 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-03-28T22:26:11.225 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:26:11.237 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:26:11.238 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:26:11.241 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:26:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:19.710 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:26:19.716 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:26:44.051 INFO:teuthology.orchestra.run.smithi153.stdout:generic/100 33s 2024-03-28T22:26:44.069 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/100 2024-03-28T22:26:44.069 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:26:44.077 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:45.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:26:45.432 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-03-28T22:26:45.913 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:26:45.925 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:26:45.927 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:26:45.930 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:26:45.930 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:46.506 INFO:teuthology.orchestra.run.smithi153.stdout:generic/101 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:26:46.517 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/101 2024-03-28T22:26:46.517 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/101 2024-03-28T22:26:46.517 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:26:46.526 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:46.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:26:46.561 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-03-28T22:26:47.120 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:26:47.134 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:26:47.135 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:26:47.138 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:26:47.138 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:47.707 INFO:teuthology.orchestra.run.smithi153.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T22:26:47.718 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/102 2024-03-28T22:26:47.718 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/102 2024-03-28T22:26:47.718 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:26:47.725 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:47.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:26:47.761 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-03-28T22:26:48.322 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:26:48.338 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:26:48.339 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:26:48.343 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:26:48.343 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:48.978 INFO:teuthology.orchestra.run.smithi153.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T22:26:48.993 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/103 2024-03-28T22:26:48.993 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/103 2024-03-28T22:26:48.993 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:26:49.003 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:49.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:26:49.101 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-03-28T22:26:49.822 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:26:49.958 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:26:49.959 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:26:49.960 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:26:49.960 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:26:49.960 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:49.965 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:26:50.417 INFO:teuthology.orchestra.run.smithi153.stdout:generic/104 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:26:50.429 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/104 2024-03-28T22:26:50.429 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/104 2024-03-28T22:26:50.429 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:26:50.436 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:50.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:26:50.478 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-03-28T22:26:51.029 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:26:51.040 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:26:51.042 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:26:51.045 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:26:51.045 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:52.375 INFO:teuthology.orchestra.run.smithi153.stdout:generic/105 1s 2024-03-28T22:26:52.405 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/105 2024-03-28T22:26:52.405 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:26:52.417 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:52.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:26:52.469 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-03-28T22:26:53.082 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:26:53.094 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:26:53.096 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:26:53.099 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:26:53.099 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:53.778 INFO:teuthology.orchestra.run.smithi153.stdout:generic/106 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:26:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/106 2024-03-28T22:26:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/106 2024-03-28T22:26:53.791 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:26:53.800 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:53.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:26:53.851 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-03-28T22:26:54.385 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:26:54.399 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:26:54.400 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:26:54.403 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:26:54.403 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:55.099 INFO:teuthology.orchestra.run.smithi153.stdout:generic/107 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:26:55.113 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/107 2024-03-28T22:26:55.113 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/107 2024-03-28T22:26:55.113 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:26:55.126 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:55.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:26:55.180 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-03-28T22:26:55.741 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:26:55.755 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:26:55.757 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:26:55.760 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:26:55.760 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:56.673 INFO:teuthology.orchestra.run.smithi153.stdout:generic/108 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T22:26:56.686 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/108 2024-03-28T22:26:56.686 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/108 2024-03-28T22:26:56.686 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:26:56.695 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:26:56.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:26:56.737 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-03-28T22:26:57.297 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:26:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:26:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:26:57.317 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:26:57.317 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:27:15.037 INFO:teuthology.orchestra.run.smithi153.stdout:generic/109 18s 2024-03-28T22:27:15.520 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/109 2024-03-28T22:27:15.520 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:27:15.528 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:27:15.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:27:15.555 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-03-28T22:27:16.274 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:27:16.284 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:27:16.286 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:27:16.289 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:27:16.289 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:27:20.103 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:27:20.112 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:27:43.000 INFO:teuthology.orchestra.run.smithi153.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T22:27:43.010 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/110 2024-03-28T22:27:43.010 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/110 2024-03-28T22:27:43.010 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:27:43.017 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:27:43.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:27:43.116 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-03-28T22:27:43.783 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:27:43.797 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:27:43.798 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:27:43.801 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:27:43.801 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:27:44.419 INFO:teuthology.orchestra.run.smithi153.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T22:27:44.429 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/111 2024-03-28T22:27:44.430 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/111 2024-03-28T22:27:44.430 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:27:44.438 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:27:44.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:27:44.546 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-03-28T22:27:45.211 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:27:45.222 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:27:45.223 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:27:45.226 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:27:45.226 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:27:50.249 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:27:50.256 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:28:21.283 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:28:21.291 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:28:22.375 INFO:teuthology.orchestra.run.smithi153.stdout:generic/112 37s 2024-03-28T22:28:22.391 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/112 2024-03-28T22:28:22.391 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:28:22.400 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:28:22.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:28:22.514 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-03-28T22:28:23.205 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:28:23.218 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:28:23.219 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:28:23.222 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:28:23.222 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:28:41.966 INFO:teuthology.orchestra.run.smithi153.stdout:generic/113 18s 2024-03-28T22:28:43.011 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/113 2024-03-28T22:28:43.011 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:28:43.022 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:28:43.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:28:43.146 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-03-28T22:28:43.926 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:28:43.936 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:28:43.937 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:28:43.940 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:28:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:28:44.521 INFO:teuthology.orchestra.run.smithi153.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-03-28T22:28:44.532 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/114 2024-03-28T22:28:44.532 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/114 2024-03-28T22:28:44.532 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:28:44.540 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:28:44.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:28:44.583 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-03-28T22:28:45.134 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:28:45.145 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:28:45.146 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:28:45.149 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:28:45.149 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:28:45.808 INFO:teuthology.orchestra.run.smithi153.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T22:28:45.819 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/115 2024-03-28T22:28:45.819 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/115 2024-03-28T22:28:45.819 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:28:45.828 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:28:45.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:28:45.917 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-03-28T22:28:46.647 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:28:46.660 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:28:46.661 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:28:46.665 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:28:46.665 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:28:47.334 INFO:teuthology.orchestra.run.smithi153.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T22:28:47.346 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/116 2024-03-28T22:28:47.346 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/116 2024-03-28T22:28:47.346 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:28:47.354 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:28:47.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:28:47.471 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-03-28T22:28:48.153 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:28:48.164 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:28:48.166 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:28:48.169 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:28:48.169 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:28:51.734 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:28:51.744 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:29:12.159 INFO:teuthology.orchestra.run.smithi153.stdout:generic/117 24s 2024-03-28T22:29:12.176 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/117 2024-03-28T22:29:12.176 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:29:12.185 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:12.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:29:12.214 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-03-28T22:29:12.682 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:29:12.693 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:29:12.694 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:29:12.697 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:29:12.697 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:14.177 INFO:teuthology.orchestra.run.smithi153.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T22:29:14.190 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/118 2024-03-28T22:29:14.190 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/118 2024-03-28T22:29:14.190 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:29:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:14.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:29:14.299 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-03-28T22:29:14.997 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:29:15.009 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:29:15.010 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:29:15.013 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:29:15.013 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:15.664 INFO:teuthology.orchestra.run.smithi153.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T22:29:15.680 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/119 2024-03-28T22:29:15.681 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/119 2024-03-28T22:29:15.681 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:29:15.693 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:15.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:29:15.803 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-03-28T22:29:16.492 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:29:16.502 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:29:16.504 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:29:16.506 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:29:16.506 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:17.097 INFO:teuthology.orchestra.run.smithi153.stdout:generic/120 [not run] atime not maintained by ceph 2024-03-28T22:29:17.109 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/120 2024-03-28T22:29:17.109 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/120 2024-03-28T22:29:17.109 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:29:17.118 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:17.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:29:17.155 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-03-28T22:29:17.696 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:29:17.712 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:29:17.713 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:29:17.717 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:29:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:18.372 INFO:teuthology.orchestra.run.smithi153.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-28T22:29:18.383 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/121 2024-03-28T22:29:18.383 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/121 2024-03-28T22:29:18.384 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:29:18.392 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:18.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:29:18.529 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-03-28T22:29:19.233 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:29:19.246 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:29:19.247 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:29:19.251 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:29:19.251 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:19.898 INFO:teuthology.orchestra.run.smithi153.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-28T22:29:19.911 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/122 2024-03-28T22:29:19.911 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/122 2024-03-28T22:29:19.911 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:29:19.922 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:20.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:29:20.061 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-03-28T22:29:20.726 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:29:20.738 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:29:20.739 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:29:20.742 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:29:20.742 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:21.887 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:29:21.894 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:29:22.019 INFO:teuthology.orchestra.run.smithi153.stdout:generic/123 2s 2024-03-28T22:29:22.036 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/123 2024-03-28T22:29:22.036 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:29:22.045 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:22.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:29:22.142 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-03-28T22:29:22.848 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:29:22.859 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:29:22.860 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:29:22.863 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:29:22.863 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:27.656 INFO:teuthology.orchestra.run.smithi153.stdout:generic/124 4s 2024-03-28T22:29:27.689 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/124 2024-03-28T22:29:27.689 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:29:27.698 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:28.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:29:28.364 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-03-28T22:29:29.085 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:29:29.096 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:29:29.098 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:29:29.100 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:29:29.100 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:29:52.023 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:29:52.032 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:30:22.170 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:30:22.180 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:30:31.047 INFO:teuthology.orchestra.run.smithi153.stdout:generic/125 62s 2024-03-28T22:30:31.064 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/125 2024-03-28T22:30:31.065 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:30:31.074 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:30:31.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:30:31.163 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-03-28T22:30:31.846 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:30:31.861 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:30:31.863 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:30:31.866 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:30:31.866 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:30:32.899 INFO:teuthology.orchestra.run.smithi153.stdout:generic/126 0s 2024-03-28T22:30:32.914 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/126 2024-03-28T22:30:32.914 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:30:32.922 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:30:33.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:30:33.069 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-03-28T22:30:33.741 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:30:33.754 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:30:33.755 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:30:33.760 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:30:33.760 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:30:52.317 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:30:52.322 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:31:22.445 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:31:22.454 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:31:52.592 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:31:52.600 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:32:22.755 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:32:22.761 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:32:53.316 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:32:53.322 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:33:23.455 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:33:23.463 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:33:53.601 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:33:53.611 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:34:23.756 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:34:23.767 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:34:53.886 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:34:53.896 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:35:24.032 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:35:24.041 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:35:54.193 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:35:54.202 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:36:24.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:36:24.331 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:36:54.517 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:36:54.523 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:37:24.656 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:37:24.666 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:37:54.794 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:37:54.802 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:38:25.057 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:38:25.066 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:38:55.203 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:38:55.213 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:39:25.339 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:39:25.348 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:39:55.485 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:39:55.494 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:40:25.615 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:40:25.624 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:40:55.761 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:40:55.774 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:41:25.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:41:25.909 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:41:26.016 INFO:tasks.ceph.mds.c.smithi153.stderr:2024-03-28T22:41:26.018+0000 7f40c4c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 203769) UID: 0 2024-03-28T22:41:26.016 INFO:tasks.ceph.mds.a.smithi153.stderr:2024-03-28T22:41:26.018+0000 7f063e400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 203769) UID: 0 2024-03-28T22:44:06.541 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:44:06.549 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:44:37.102 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:44:37.110 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:45:07.368 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:45:07.377 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:45:37.506 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:45:37.514 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:46:07.651 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:46:07.661 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:46:37.797 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:46:37.808 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:47:07.953 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:47:07.962 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:47:38.075 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:47:38.084 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:48:08.210 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:48:08.219 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:48:38.440 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:48:38.450 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:49:08.576 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:49:08.583 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:49:38.707 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:49:38.716 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:50:08.859 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:50:08.868 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:50:39.002 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:50:39.010 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:51:09.283 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:51:09.292 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:51:39.416 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:51:39.426 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:52:09.553 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:52:09.561 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:52:26.891 INFO:teuthology.orchestra.run.smithi153.stdout:generic/127 1313s 2024-03-28T22:52:26.908 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/127 2024-03-28T22:52:26.908 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:52:26.917 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:52:27.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:52:27.026 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-03-28T22:52:27.734 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:52:27.745 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:52:27.746 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:52:27.749 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:52:27.749 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:52:29.667 INFO:teuthology.orchestra.run.smithi153.stdout:generic/128 2s 2024-03-28T22:52:29.685 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/128 2024-03-28T22:52:29.685 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:52:29.695 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:52:29.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:52:29.724 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-03-28T22:52:30.372 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:52:30.384 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:52:30.386 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:52:30.389 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:52:30.389 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:52:31.009 INFO:teuthology.orchestra.run.smithi153.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-03-28T22:52:31.021 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/129 2024-03-28T22:52:31.021 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/129 2024-03-28T22:52:31.022 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:52:31.029 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:52:31.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:52:31.076 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-03-28T22:52:31.656 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:52:31.670 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:52:31.672 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:52:31.675 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:52:31.675 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:52:32.304 INFO:teuthology.orchestra.run.smithi153.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-03-28T22:52:32.316 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/130 2024-03-28T22:52:32.316 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/130 2024-03-28T22:52:32.316 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:52:32.324 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:52:32.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:52:32.373 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-03-28T22:52:32.933 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:52:32.945 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:52:32.947 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:52:32.950 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:52:32.950 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:52:34.834 INFO:teuthology.orchestra.run.smithi153.stdout:generic/131 1s 2024-03-28T22:52:34.852 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/131 2024-03-28T22:52:34.852 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:52:34.862 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:52:34.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:52:34.966 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-03-28T22:52:35.656 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:52:35.668 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:52:35.669 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:52:35.672 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:52:35.673 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:52:39.682 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:52:39.689 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:52:49.962 INFO:teuthology.orchestra.run.smithi153.stdout:generic/132 14s 2024-03-28T22:52:50.181 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/132 2024-03-28T22:52:50.181 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T22:52:50.192 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:52:50.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T22:52:50.227 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-03-28T22:52:50.770 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T22:52:50.783 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T22:52:50.784 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T22:52:50.787 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T22:52:50.787 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T22:53:09.848 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:53:09.854 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:53:40.063 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:53:40.070 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:54:10.197 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:54:10.205 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:54:40.334 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:54:40.343 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:55:10.466 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:55:10.474 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:55:40.619 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:55:40.628 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:56:10.998 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:56:11.009 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:56:41.127 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:56:41.137 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:57:11.314 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:57:11.323 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:57:41.455 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:57:41.464 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:58:11.593 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:58:11.604 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:58:41.738 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:58:41.747 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:59:11.888 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:59:11.896 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:59:42.020 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T22:59:42.029 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:00:12.389 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:00:12.400 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:00:42.530 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:00:42.540 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:01:12.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:01:12.679 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:01:42.871 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:01:42.882 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:02:04.500 INFO:teuthology.orchestra.run.smithi153.stdout:generic/133 553s 2024-03-28T23:02:04.514 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/133 2024-03-28T23:02:04.514 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:04.523 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:04.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:04.664 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-03-28T23:02:05.467 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:05.479 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:05.480 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:05.483 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:05.483 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:06.077 INFO:teuthology.orchestra.run.smithi153.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:06.089 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/134 2024-03-28T23:02:06.089 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/134 2024-03-28T23:02:06.089 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:06.097 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:06.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:06.221 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-03-28T23:02:06.881 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:06.895 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:06.895 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:06.896 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:06.896 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:08.449 INFO:teuthology.orchestra.run.smithi153.stdout:generic/135 1s 2024-03-28T23:02:08.462 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/135 2024-03-28T23:02:08.462 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:08.469 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:08.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:08.492 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-03-28T23:02:09.025 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:09.037 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:09.039 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:09.041 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:09.041 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:09.689 INFO:teuthology.orchestra.run.smithi153.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-28T23:02:09.702 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/136 2024-03-28T23:02:09.702 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/136 2024-03-28T23:02:09.702 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:09.713 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:09.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:09.844 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-03-28T23:02:10.500 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:10.511 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:10.512 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:10.514 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:10.514 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:11.225 INFO:teuthology.orchestra.run.smithi153.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:11.237 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/137 2024-03-28T23:02:11.237 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/137 2024-03-28T23:02:11.237 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:11.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:11.349 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-03-28T23:02:12.040 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:12.053 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:12.054 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:12.057 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:12.057 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:12.717 INFO:teuthology.orchestra.run.smithi153.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:12.730 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/138 2024-03-28T23:02:12.730 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/138 2024-03-28T23:02:12.730 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:12.740 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:12.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:12.833 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-03-28T23:02:13.028 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:02:13.038 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:02:13.516 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:13.528 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:13.529 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:13.532 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:14.191 INFO:teuthology.orchestra.run.smithi153.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/139 2024-03-28T23:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/139 2024-03-28T23:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:14.213 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:14.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:14.304 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-03-28T23:02:15.067 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:15.078 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:15.080 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:15.083 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:15.083 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:15.664 INFO:teuthology.orchestra.run.smithi153.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:15.677 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/140 2024-03-28T23:02:15.677 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/140 2024-03-28T23:02:15.678 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:15.688 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:15.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:15.785 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-03-28T23:02:16.515 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:16.530 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:16.531 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:16.534 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:17.321 INFO:teuthology.orchestra.run.smithi153.stdout:generic/141 1s 2024-03-28T23:02:17.336 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/141 2024-03-28T23:02:17.336 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:17.344 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:17.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:17.371 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-03-28T23:02:17.938 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:17.950 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:17.951 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:17.954 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:17.954 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:18.606 INFO:teuthology.orchestra.run.smithi153.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:18.619 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/142 2024-03-28T23:02:18.619 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/142 2024-03-28T23:02:18.619 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:18.629 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:18.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:18.724 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-03-28T23:02:19.411 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:19.422 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:19.424 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:19.426 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:19.426 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:20.061 INFO:teuthology.orchestra.run.smithi153.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:20.074 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/143 2024-03-28T23:02:20.075 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/143 2024-03-28T23:02:20.075 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:20.087 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:20.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:20.220 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-03-28T23:02:20.874 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:20.885 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:20.886 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:20.888 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:20.888 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:21.492 INFO:teuthology.orchestra.run.smithi153.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:21.503 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/144 2024-03-28T23:02:21.503 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/144 2024-03-28T23:02:21.503 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:21.515 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:21.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:21.611 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-03-28T23:02:22.304 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:22.317 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:22.318 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:22.321 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:22.321 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:22.959 INFO:teuthology.orchestra.run.smithi153.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:22.971 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/145 2024-03-28T23:02:22.971 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/145 2024-03-28T23:02:22.971 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:22.980 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:23.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:23.074 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-03-28T23:02:23.735 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:23.746 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:23.747 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:23.750 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:23.750 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:24.387 INFO:teuthology.orchestra.run.smithi153.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:24.400 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/146 2024-03-28T23:02:24.400 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/146 2024-03-28T23:02:24.400 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:24.409 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:24.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:24.546 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-03-28T23:02:25.204 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:25.215 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:25.217 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:25.220 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:25.220 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:25.913 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/147 2024-03-28T23:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/147 2024-03-28T23:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:26.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:26.033 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-03-28T23:02:26.749 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:26.761 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:26.762 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:26.765 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:26.765 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:27.424 INFO:teuthology.orchestra.run.smithi153.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:27.439 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/148 2024-03-28T23:02:27.439 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/148 2024-03-28T23:02:27.439 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:27.450 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:27.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:27.571 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-03-28T23:02:28.259 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:28.273 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:28.275 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:28.278 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:28.278 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:28.921 INFO:teuthology.orchestra.run.smithi153.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:28.931 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/149 2024-03-28T23:02:28.931 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/149 2024-03-28T23:02:28.932 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:28.940 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:29.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:29.077 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-03-28T23:02:29.745 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:29.757 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:29.759 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:29.762 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:29.762 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:30.401 INFO:teuthology.orchestra.run.smithi153.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:30.416 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/150 2024-03-28T23:02:30.416 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/150 2024-03-28T23:02:30.416 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:30.427 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:30.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:30.536 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-03-28T23:02:31.217 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:31.230 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:31.231 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:31.235 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:31.235 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:31.890 INFO:teuthology.orchestra.run.smithi153.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:31.904 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/151 2024-03-28T23:02:31.904 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/151 2024-03-28T23:02:31.904 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:31.914 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:32.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:32.011 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-03-28T23:02:32.712 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:32.725 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:32.727 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:32.730 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:33.362 INFO:teuthology.orchestra.run.smithi153.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:33.373 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/152 2024-03-28T23:02:33.374 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/152 2024-03-28T23:02:33.374 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:33.381 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:33.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:33.479 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-03-28T23:02:34.170 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:34.182 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:34.184 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:34.186 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:34.187 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:34.878 INFO:teuthology.orchestra.run.smithi153.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:34.890 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/153 2024-03-28T23:02:34.891 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/153 2024-03-28T23:02:34.891 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:34.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:35.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:35.035 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-03-28T23:02:35.684 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:35.697 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:35.699 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:35.702 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:35.702 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:36.322 INFO:teuthology.orchestra.run.smithi153.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:36.333 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/154 2024-03-28T23:02:36.333 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/154 2024-03-28T23:02:36.333 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:36.342 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:36.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:36.453 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-03-28T23:02:37.111 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:37.124 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:37.125 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:37.129 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:37.129 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:37.825 INFO:teuthology.orchestra.run.smithi153.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:37.836 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/155 2024-03-28T23:02:37.836 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/155 2024-03-28T23:02:37.836 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:37.843 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:37.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:37.964 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-03-28T23:02:38.620 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:38.631 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:38.632 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:38.635 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:38.635 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:39.266 INFO:teuthology.orchestra.run.smithi153.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/156 2024-03-28T23:02:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/156 2024-03-28T23:02:39.280 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:39.292 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:39.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:39.411 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-03-28T23:02:40.075 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:40.086 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:40.087 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:40.090 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:40.091 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:40.745 INFO:teuthology.orchestra.run.smithi153.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:02:40.755 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/157 2024-03-28T23:02:40.755 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/157 2024-03-28T23:02:40.756 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:40.763 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:40.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:40.870 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-03-28T23:02:41.558 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:41.569 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:41.570 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:41.573 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:41.573 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:42.227 INFO:teuthology.orchestra.run.smithi153.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-28T23:02:42.241 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/158 2024-03-28T23:02:42.241 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/158 2024-03-28T23:02:42.241 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:42.252 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:42.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:42.382 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-03-28T23:02:43.051 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:43.063 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:43.064 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:43.067 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:43.067 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:43.207 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:02:43.211 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:02:43.705 INFO:teuthology.orchestra.run.smithi153.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-03-28T23:02:43.717 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/159 2024-03-28T23:02:43.717 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/159 2024-03-28T23:02:43.717 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:43.726 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:43.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:43.776 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-03-28T23:02:44.374 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:44.387 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:44.389 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:44.393 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:44.393 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:45.022 INFO:teuthology.orchestra.run.smithi153.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-03-28T23:02:45.034 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/160 2024-03-28T23:02:45.035 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/160 2024-03-28T23:02:45.035 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:45.045 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:45.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:45.100 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-03-28T23:02:45.654 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:45.668 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:45.670 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:45.673 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:45.674 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:46.564 INFO:teuthology.orchestra.run.smithi153.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:02:46.583 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/161 2024-03-28T23:02:46.583 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/161 2024-03-28T23:02:46.584 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:46.597 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:46.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:46.836 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-03-28T23:02:47.348 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:47.360 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:47.362 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:47.364 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:47.364 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:48.176 INFO:teuthology.orchestra.run.smithi153.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-28T23:02:48.266 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/162 2024-03-28T23:02:48.266 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/162 2024-03-28T23:02:48.266 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:48.290 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:48.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:48.613 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-03-28T23:02:49.091 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:49.103 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:49.104 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:49.107 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:49.107 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:49.940 INFO:teuthology.orchestra.run.smithi153.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-28T23:02:50.012 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/163 2024-03-28T23:02:50.013 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/163 2024-03-28T23:02:50.013 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:50.026 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:50.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:50.239 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-03-28T23:02:50.801 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:50.815 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:50.817 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:50.820 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:50.821 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:51.730 INFO:teuthology.orchestra.run.smithi153.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:02:51.749 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/164 2024-03-28T23:02:51.750 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/164 2024-03-28T23:02:51.750 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:51.763 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:51.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:51.957 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-03-28T23:02:52.493 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:52.505 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:52.507 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:52.510 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:52.511 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:53.420 INFO:teuthology.orchestra.run.smithi153.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:02:53.435 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/165 2024-03-28T23:02:53.436 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/165 2024-03-28T23:02:53.436 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:53.451 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:53.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:53.693 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-03-28T23:02:54.177 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:54.189 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:54.190 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:54.193 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:54.193 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:55.095 INFO:teuthology.orchestra.run.smithi153.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:02:55.114 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/166 2024-03-28T23:02:55.114 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/166 2024-03-28T23:02:55.115 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:55.125 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:55.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:55.403 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-03-28T23:02:55.883 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:55.895 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:55.896 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:55.898 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:55.899 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:56.815 INFO:teuthology.orchestra.run.smithi153.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:02:56.838 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/167 2024-03-28T23:02:56.838 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/167 2024-03-28T23:02:56.838 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:56.850 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:57.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:57.069 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-03-28T23:02:57.624 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:57.636 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:57.637 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:57.640 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:57.640 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:58.527 INFO:teuthology.orchestra.run.smithi153.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:02:58.552 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/168 2024-03-28T23:02:58.552 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/168 2024-03-28T23:02:58.552 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:02:58.563 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:02:58.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:02:58.747 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-03-28T23:02:59.312 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:02:59.326 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:02:59.328 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:02:59.332 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:02:59.332 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:00.462 INFO:teuthology.orchestra.run.smithi153.stdout:generic/169 1s 2024-03-28T23:03:00.476 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/169 2024-03-28T23:03:00.476 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:00.483 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:00.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:00.505 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-03-28T23:03:01.103 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:01.117 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:01.119 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:01.122 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:01.122 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:02.042 INFO:teuthology.orchestra.run.smithi153.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:02.064 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/170 2024-03-28T23:03:02.064 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/170 2024-03-28T23:03:02.065 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:02.081 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:02.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:02.286 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-03-28T23:03:02.853 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:02.864 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:02.865 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:02.868 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:02.868 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:03.728 INFO:teuthology.orchestra.run.smithi153.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:03.743 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/171 2024-03-28T23:03:03.743 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/171 2024-03-28T23:03:03.744 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:03.755 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:03.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:03.939 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-03-28T23:03:04.501 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:04.514 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:04.515 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:04.518 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:04.518 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:05.438 INFO:teuthology.orchestra.run.smithi153.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:05.466 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/172 2024-03-28T23:03:05.466 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/172 2024-03-28T23:03:05.466 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:05.489 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:05.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:05.693 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-03-28T23:03:06.203 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:06.216 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:06.217 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:06.220 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:06.220 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:07.118 INFO:teuthology.orchestra.run.smithi153.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:07.138 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/173 2024-03-28T23:03:07.138 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/173 2024-03-28T23:03:07.139 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:07.150 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:07.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:07.381 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-03-28T23:03:07.899 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:07.912 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:07.913 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:07.916 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:07.916 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:08.834 INFO:teuthology.orchestra.run.smithi153.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:08.862 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/174 2024-03-28T23:03:08.862 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/174 2024-03-28T23:03:08.862 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:08.869 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:09.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:09.122 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-03-28T23:03:09.594 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:09.609 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:09.610 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:09.613 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:09.613 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:10.454 INFO:teuthology.orchestra.run.smithi153.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:10.470 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/175 2024-03-28T23:03:10.470 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/175 2024-03-28T23:03:10.471 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:10.483 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:10.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:10.734 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-03-28T23:03:11.228 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:11.240 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:11.241 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:11.245 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:12.153 INFO:teuthology.orchestra.run.smithi153.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:12.170 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/176 2024-03-28T23:03:12.170 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/176 2024-03-28T23:03:12.170 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:12.183 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:12.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:12.481 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-03-28T23:03:12.959 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:12.970 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:12.971 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:12.973 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:12.973 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:13.352 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:03:13.358 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:03:13.878 INFO:teuthology.orchestra.run.smithi153.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-28T23:03:13.894 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/177 2024-03-28T23:03:13.895 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/177 2024-03-28T23:03:13.895 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:13.909 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:14.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:14.020 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-03-28T23:03:14.725 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:14.737 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:14.738 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:14.741 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:14.741 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:15.384 INFO:teuthology.orchestra.run.smithi153.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:03:15.396 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/178 2024-03-28T23:03:15.396 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/178 2024-03-28T23:03:15.396 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:15.405 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:15.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:15.522 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-03-28T23:03:16.208 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:16.220 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:16.221 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:16.224 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:16.224 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:16.840 INFO:teuthology.orchestra.run.smithi153.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:03:16.852 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/179 2024-03-28T23:03:16.852 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/179 2024-03-28T23:03:16.852 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:16.861 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:16.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:16.966 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-03-28T23:03:17.659 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:17.671 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:17.672 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:17.675 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:18.278 INFO:teuthology.orchestra.run.smithi153.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:03:18.293 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/180 2024-03-28T23:03:18.293 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/180 2024-03-28T23:03:18.293 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:18.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:18.432 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-03-28T23:03:19.064 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:19.075 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:19.077 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:19.080 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:19.720 INFO:teuthology.orchestra.run.smithi153.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:03:19.732 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/181 2024-03-28T23:03:19.732 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/181 2024-03-28T23:03:19.732 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:19.741 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:19.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:19.863 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-03-28T23:03:20.527 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:20.538 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:20.539 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:20.541 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:20.542 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:21.158 INFO:teuthology.orchestra.run.smithi153.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-28T23:03:21.170 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/182 2024-03-28T23:03:21.170 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/182 2024-03-28T23:03:21.170 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:21.179 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:21.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:21.276 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-03-28T23:03:21.968 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:21.978 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:21.979 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:21.982 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:22.881 INFO:teuthology.orchestra.run.smithi153.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:22.897 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/183 2024-03-28T23:03:22.898 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/183 2024-03-28T23:03:22.898 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:22.909 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:23.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:23.165 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-03-28T23:03:23.670 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:23.681 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:23.682 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:23.685 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:23.685 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:24.332 INFO:teuthology.orchestra.run.smithi153.stdout:generic/184 1s 2024-03-28T23:03:24.350 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/184 2024-03-28T23:03:24.350 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:24.358 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:24.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:24.400 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-03-28T23:03:24.938 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:24.952 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:24.954 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:24.957 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:24.957 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:25.884 INFO:teuthology.orchestra.run.smithi153.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:25.907 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/185 2024-03-28T23:03:25.907 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/185 2024-03-28T23:03:25.907 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:25.924 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:26.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:26.140 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-03-28T23:03:26.668 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:26.681 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:26.683 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:26.686 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:26.686 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:27.578 INFO:teuthology.orchestra.run.smithi153.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:27.598 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/186 2024-03-28T23:03:27.598 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/186 2024-03-28T23:03:27.598 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:27.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:27.878 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-03-28T23:03:28.416 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:28.429 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:28.431 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:28.434 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:28.434 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:29.319 INFO:teuthology.orchestra.run.smithi153.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:29.341 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/187 2024-03-28T23:03:29.341 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/187 2024-03-28T23:03:29.342 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:29.361 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:29.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:29.597 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-03-28T23:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:30.127 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:30.128 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:30.131 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:30.131 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:31.049 INFO:teuthology.orchestra.run.smithi153.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:31.071 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/188 2024-03-28T23:03:31.071 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/188 2024-03-28T23:03:31.071 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:31.084 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:31.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:31.348 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-03-28T23:03:31.835 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:31.848 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:31.850 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:31.853 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:31.853 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:32.750 INFO:teuthology.orchestra.run.smithi153.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:32.768 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/189 2024-03-28T23:03:32.769 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/189 2024-03-28T23:03:32.769 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:32.780 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:32.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:32.980 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-03-28T23:03:33.541 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:33.554 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:33.555 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:33.558 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:33.558 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:34.472 INFO:teuthology.orchestra.run.smithi153.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:34.492 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/190 2024-03-28T23:03:34.492 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/190 2024-03-28T23:03:34.497 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:34.518 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:34.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:34.728 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-03-28T23:03:35.303 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:35.315 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:35.317 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:35.320 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:35.320 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:36.258 INFO:teuthology.orchestra.run.smithi153.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:36.276 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/191 2024-03-28T23:03:36.276 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/191 2024-03-28T23:03:36.276 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:36.297 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:36.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:36.554 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-03-28T23:03:37.070 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:37.083 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:37.084 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:37.087 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:37.088 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:37.666 INFO:teuthology.orchestra.run.smithi153.stdout:generic/192 [not run] atime not maintained by ceph 2024-03-28T23:03:37.678 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/192 2024-03-28T23:03:37.678 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/192 2024-03-28T23:03:37.678 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:37.687 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:37.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:37.728 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-03-28T23:03:38.300 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:38.312 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:38.314 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:38.317 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:38.317 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:40.618 INFO:teuthology.orchestra.run.smithi153.stdout:generic/193 2s 2024-03-28T23:03:40.795 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/193 2024-03-28T23:03:40.795 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:40.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:40.922 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-03-28T23:03:41.621 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:41.633 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:41.634 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:41.637 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:41.637 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:42.542 INFO:teuthology.orchestra.run.smithi153.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:42.558 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/194 2024-03-28T23:03:42.563 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/194 2024-03-28T23:03:42.563 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:42.573 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:42.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:42.804 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-03-28T23:03:43.343 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:43.357 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:43.358 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:43.361 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:43.361 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:43.482 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:03:43.487 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:03:44.233 INFO:teuthology.orchestra.run.smithi153.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:44.254 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/195 2024-03-28T23:03:44.254 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/195 2024-03-28T23:03:44.255 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:44.269 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:44.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:44.539 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-03-28T23:03:45.034 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:45.045 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:45.047 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:45.050 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:45.050 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:45.863 INFO:teuthology.orchestra.run.smithi153.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:45.881 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/196 2024-03-28T23:03:45.882 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/196 2024-03-28T23:03:45.882 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:45.894 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:46.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:46.131 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-03-28T23:03:46.646 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:46.658 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:46.659 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:46.662 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:46.662 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:47.553 INFO:teuthology.orchestra.run.smithi153.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:47.569 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/197 2024-03-28T23:03:47.569 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/197 2024-03-28T23:03:47.569 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:47.586 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:47.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:47.725 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-03-28T23:03:48.278 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:48.290 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:48.292 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:48.295 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:48.295 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:49.842 INFO:teuthology.orchestra.run.smithi153.stdout:generic/198 [failed, exit status 10]- output mismatch (see /tmp/tmp.0cGUU1Musyxfstests-dev/results//generic/198.out.bad) 2024-03-28T23:03:49.861 INFO:teuthology.orchestra.run.smithi153.stdout: --- tests/generic/198.out 2024-03-28 21:53:24.326163902 +0000 2024-03-28T23:03:49.861 INFO:teuthology.orchestra.run.smithi153.stdout: +++ /tmp/tmp.0cGUU1Musyxfstests-dev/results//generic/198.out.bad 2024-03-28 23:03:49.833978723 +0000 2024-03-28T23:03:49.861 INFO:teuthology.orchestra.run.smithi153.stdout: @@ -1,2 +1,5 @@ 2024-03-28T23:03:49.861 INFO:teuthology.orchestra.run.smithi153.stdout: QA output created by 198 2024-03-28T23:03:49.862 INFO:teuthology.orchestra.run.smithi153.stdout: Silence is golden. 2024-03-28T23:03:49.862 INFO:teuthology.orchestra.run.smithi153.stdout: +non one buffer at buf[0] => 0x00,00,00,00 2024-03-28T23:03:49.862 INFO:teuthology.orchestra.run.smithi153.stdout: +non-one read at offset 0 2024-03-28T23:03:49.862 INFO:teuthology.orchestra.run.smithi153.stdout: +*** WARNING *** /tmp/tmp.l0v0NkF9eFtest/aiodio_sparse has not been unlinked; if you don't rm it manually first, it may influence the next run 2024-03-28T23:03:49.875 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/198 2024-03-28T23:03:49.875 INFO:teuthology.orchestra.run.smithi153.stdout:Failures: generic/198 2024-03-28T23:03:49.875 INFO:teuthology.orchestra.run.smithi153.stdout:Failed 1 of 1 tests 2024-03-28T23:03:49.889 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:49.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T23:03:49.939 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-28T23:03:49.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-28T23:03:49.939 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-03-28T23:03:50.500 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:50.515 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:50.516 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:50.520 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:50.520 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:51.451 INFO:teuthology.orchestra.run.smithi153.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:51.474 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/199 2024-03-28T23:03:51.476 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/199 2024-03-28T23:03:51.476 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:51.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:51.739 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-03-28T23:03:52.224 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:52.237 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:52.238 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:52.241 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:52.241 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:53.139 INFO:teuthology.orchestra.run.smithi153.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:53.154 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/200 2024-03-28T23:03:53.154 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/200 2024-03-28T23:03:53.154 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:53.166 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:53.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:53.423 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-03-28T23:03:53.946 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:53.957 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:53.959 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:53.962 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:53.962 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:54.872 INFO:teuthology.orchestra.run.smithi153.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:54.891 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/201 2024-03-28T23:03:54.891 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/201 2024-03-28T23:03:54.891 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:54.903 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:55.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:55.197 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-03-28T23:03:55.697 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:55.708 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:55.710 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:55.713 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:55.713 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:56.658 INFO:teuthology.orchestra.run.smithi153.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:56.679 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/202 2024-03-28T23:03:56.679 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/202 2024-03-28T23:03:56.679 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:56.692 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:56.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:56.944 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-03-28T23:03:57.451 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:57.465 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:57.467 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:57.470 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:57.471 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:58.369 INFO:teuthology.orchestra.run.smithi153.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:03:58.389 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/203 2024-03-28T23:03:58.389 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/203 2024-03-28T23:03:58.389 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:03:58.402 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:03:58.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:03:58.623 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-03-28T23:03:59.159 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:03:59.172 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:03:59.173 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:03:59.176 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:03:59.176 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:04:00.633 INFO:teuthology.orchestra.run.smithi153.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T23:04:00.647 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/204 2024-03-28T23:04:00.647 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/204 2024-03-28T23:04:00.648 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:04:00.659 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:04:00.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:04:00.705 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-03-28T23:04:01.253 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:04:01.268 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:04:01.269 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:04:01.273 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:04:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:04:02.146 INFO:teuthology.orchestra.run.smithi153.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:04:02.166 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/205 2024-03-28T23:04:02.166 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/205 2024-03-28T23:04:02.166 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:04:02.181 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:04:02.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:04:02.445 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-03-28T23:04:02.944 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:04:02.955 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:04:02.956 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:04:02.959 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:04:02.959 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:04:03.827 INFO:teuthology.orchestra.run.smithi153.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:04:03.842 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/206 2024-03-28T23:04:03.842 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/206 2024-03-28T23:04:03.843 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:04:03.855 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:04:04.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:04:04.073 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-03-28T23:04:04.628 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:04:04.639 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:04:04.640 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:04:04.643 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:04:04.643 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:04:13.620 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:04:13.625 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:04:13.789 INFO:teuthology.orchestra.run.smithi153.stdout:generic/207 9s 2024-03-28T23:04:13.921 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/207 2024-03-28T23:04:13.922 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:04:13.932 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:04:14.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:04:14.002 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-03-28T23:04:14.707 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:04:14.719 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:04:14.720 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:04:14.723 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:04:14.723 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:04:43.932 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:04:43.938 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:05:14.054 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:05:14.064 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:05:44.199 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:05:44.209 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:06:14.340 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:06:14.346 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:06:44.475 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:06:44.481 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:07:14.615 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:07:14.621 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:07:35.523 INFO:teuthology.orchestra.run.smithi153.stdout:generic/208 201s 2024-03-28T23:07:35.537 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/208 2024-03-28T23:07:35.538 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:07:35.544 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:07:35.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:07:35.643 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-03-28T23:07:36.297 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:07:36.308 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:07:36.309 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:07:36.314 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:07:36.314 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:07:44.924 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:07:44.932 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:08:15.054 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:08:15.066 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:08:22.172 INFO:teuthology.orchestra.run.smithi153.stdout:generic/209 46s 2024-03-28T23:08:22.190 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/209 2024-03-28T23:08:22.190 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:22.201 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:22.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:22.316 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-03-28T23:08:22.982 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:22.993 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:22.995 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:22.998 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:22.998 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:23.796 INFO:teuthology.orchestra.run.smithi153.stdout:generic/210 0s 2024-03-28T23:08:23.812 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/210 2024-03-28T23:08:23.812 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:23.822 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:23.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:23.916 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-03-28T23:08:24.613 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:24.624 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:24.625 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:24.628 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:24.628 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:25.758 INFO:teuthology.orchestra.run.smithi153.stdout:generic/211 1s 2024-03-28T23:08:25.772 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/211 2024-03-28T23:08:25.773 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:25.780 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:25.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:25.816 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-03-28T23:08:26.333 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:26.344 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:26.345 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:26.348 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:26.348 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:27.170 INFO:teuthology.orchestra.run.smithi153.stdout:generic/212 1s 2024-03-28T23:08:27.188 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/212 2024-03-28T23:08:27.188 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:27.197 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:27.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:27.237 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-03-28T23:08:27.788 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:27.802 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:27.803 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:27.807 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:27.807 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:28.487 INFO:teuthology.orchestra.run.smithi153.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T23:08:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/213 2024-03-28T23:08:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/213 2024-03-28T23:08:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:28.511 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:28.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:28.550 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-03-28T23:08:29.087 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:29.098 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:29.100 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:29.103 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:29.103 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:29.704 INFO:teuthology.orchestra.run.smithi153.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T23:08:29.716 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/214 2024-03-28T23:08:29.716 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/214 2024-03-28T23:08:29.716 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:29.725 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:29.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:29.762 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-03-28T23:08:30.290 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:30.304 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:30.306 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:30.309 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:30.309 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:33.019 INFO:teuthology.orchestra.run.smithi153.stdout:generic/215 3s 2024-03-28T23:08:33.039 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/215 2024-03-28T23:08:33.039 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:33.050 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:33.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:33.129 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-03-28T23:08:33.692 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:33.707 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:33.708 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:33.713 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:33.713 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:34.611 INFO:teuthology.orchestra.run.smithi153.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:08:34.630 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/216 2024-03-28T23:08:34.630 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/216 2024-03-28T23:08:34.630 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:34.646 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:34.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:34.886 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-03-28T23:08:35.410 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:35.421 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:35.423 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:35.426 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:35.426 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:36.332 INFO:teuthology.orchestra.run.smithi153.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:08:36.348 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/217 2024-03-28T23:08:36.349 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/217 2024-03-28T23:08:36.349 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:36.361 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:36.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:36.629 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-03-28T23:08:37.160 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:37.173 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:37.175 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:37.178 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:37.178 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:38.110 INFO:teuthology.orchestra.run.smithi153.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:08:38.126 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/218 2024-03-28T23:08:38.126 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/218 2024-03-28T23:08:38.126 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:38.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:38.311 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-03-28T23:08:38.855 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:38.867 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:38.869 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:38.872 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:38.872 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:39.451 INFO:teuthology.orchestra.run.smithi153.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:08:39.464 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/219 2024-03-28T23:08:39.464 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/219 2024-03-28T23:08:39.464 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:39.477 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:39.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:39.518 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-03-28T23:08:40.128 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:40.141 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:40.142 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:40.145 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:40.145 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:41.027 INFO:teuthology.orchestra.run.smithi153.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:08:41.061 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/220 2024-03-28T23:08:41.062 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/220 2024-03-28T23:08:41.062 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:41.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:41.353 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-03-28T23:08:41.843 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:41.855 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:41.856 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:41.858 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:43.517 INFO:teuthology.orchestra.run.smithi153.stdout:generic/221 1s 2024-03-28T23:08:43.538 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/221 2024-03-28T23:08:43.538 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:43.550 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:43.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:43.601 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-03-28T23:08:44.145 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:44.158 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:44.160 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:44.163 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:44.163 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:45.100 INFO:teuthology.orchestra.run.smithi153.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:08:45.125 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/222 2024-03-28T23:08:45.125 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/222 2024-03-28T23:08:45.125 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:45.140 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:45.304 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:08:45.311 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:08:45.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:45.393 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-03-28T23:08:45.924 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:45.936 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:45.938 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:45.941 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:45.941 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:46.505 INFO:teuthology.orchestra.run.smithi153.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T23:08:46.518 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/223 2024-03-28T23:08:46.518 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/223 2024-03-28T23:08:46.518 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:46.526 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:46.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:46.576 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-03-28T23:08:47.159 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:47.172 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:47.173 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:47.176 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:47.750 INFO:teuthology.orchestra.run.smithi153.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T23:08:47.762 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/224 2024-03-28T23:08:47.762 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/224 2024-03-28T23:08:47.763 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:47.771 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:47.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:47.806 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-03-28T23:08:48.350 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:48.362 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:48.364 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:48.367 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:48.367 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:49.065 INFO:teuthology.orchestra.run.smithi153.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-28T23:08:49.078 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/225 2024-03-28T23:08:49.078 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/225 2024-03-28T23:08:49.078 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:49.088 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:49.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:49.170 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-03-28T23:08:49.889 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:49.901 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:49.903 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:49.906 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:49.906 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:50.569 INFO:teuthology.orchestra.run.smithi153.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T23:08:50.581 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/226 2024-03-28T23:08:50.581 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/226 2024-03-28T23:08:50.581 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:50.590 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:50.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:50.627 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-03-28T23:08:51.173 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:51.187 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:51.188 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:51.191 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:52.123 INFO:teuthology.orchestra.run.smithi153.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:08:52.139 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/227 2024-03-28T23:08:52.139 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/227 2024-03-28T23:08:52.139 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:52.157 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:52.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:52.441 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-03-28T23:08:52.950 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:52.963 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:52.964 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:52.967 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:52.967 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:53.610 INFO:teuthology.orchestra.run.smithi153.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T23:08:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/228 2024-03-28T23:08:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/228 2024-03-28T23:08:53.622 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:53.631 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:53.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:53.670 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-03-28T23:08:54.221 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:54.234 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:54.236 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:54.239 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:55.185 INFO:teuthology.orchestra.run.smithi153.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:08:55.204 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/229 2024-03-28T23:08:55.204 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/229 2024-03-28T23:08:55.209 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:55.223 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:55.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:55.489 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-03-28T23:08:55.990 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:56.003 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:56.005 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:56.008 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:56.008 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:56.643 INFO:teuthology.orchestra.run.smithi153.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:08:56.657 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/230 2024-03-28T23:08:56.658 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/230 2024-03-28T23:08:56.658 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:56.669 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:56.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:56.711 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-03-28T23:08:57.298 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:57.312 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:57.315 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:57.315 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:57.881 INFO:teuthology.orchestra.run.smithi153.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:08:57.893 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/231 2024-03-28T23:08:57.894 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/231 2024-03-28T23:08:57.894 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:57.902 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:57.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:57.940 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-03-28T23:08:58.490 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:58.502 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:58.504 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:58.507 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:58.508 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:59.130 INFO:teuthology.orchestra.run.smithi153.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:08:59.145 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/232 2024-03-28T23:08:59.145 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/232 2024-03-28T23:08:59.145 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:08:59.158 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:08:59.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:08:59.200 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-03-28T23:08:59.771 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:08:59.783 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:08:59.784 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:08:59.787 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:08:59.787 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:00.367 INFO:teuthology.orchestra.run.smithi153.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:09:00.378 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/233 2024-03-28T23:09:00.378 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/233 2024-03-28T23:09:00.378 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:09:00.387 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:00.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:09:00.423 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-03-28T23:09:00.980 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:09:00.992 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:09:00.995 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:09:00.998 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:09:00.998 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:01.585 INFO:teuthology.orchestra.run.smithi153.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:09:01.602 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/234 2024-03-28T23:09:01.602 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/234 2024-03-28T23:09:01.602 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:09:01.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:01.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:09:01.653 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-03-28T23:09:02.217 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:09:02.229 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:09:02.231 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:09:02.233 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:09:02.233 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:02.814 INFO:teuthology.orchestra.run.smithi153.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:09:02.826 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/235 2024-03-28T23:09:02.826 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/235 2024-03-28T23:09:02.826 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:09:02.836 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:02.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:09:02.871 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-03-28T23:09:03.423 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:09:03.437 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:09:03.438 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:09:03.442 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:09:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:05.183 INFO:teuthology.orchestra.run.smithi153.stdout:generic/236 2s 2024-03-28T23:09:05.201 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/236 2024-03-28T23:09:05.201 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:09:05.209 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:05.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:09:05.297 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-03-28T23:09:05.992 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:09:06.006 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:09:06.007 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:09:06.011 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:09:06.011 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:06.751 INFO:teuthology.orchestra.run.smithi153.stdout:generic/237 0s 2024-03-28T23:09:06.764 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/237 2024-03-28T23:09:06.765 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:09:06.772 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:06.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:09:06.873 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-03-28T23:09:07.544 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:09:07.555 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:09:07.557 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:09:07.559 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:09:07.559 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:08.473 INFO:teuthology.orchestra.run.smithi153.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:09:08.488 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/238 2024-03-28T23:09:08.488 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/238 2024-03-28T23:09:08.488 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:09:08.501 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:08.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:09:08.728 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-03-28T23:09:09.242 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:09:09.255 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:09:09.256 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:09:09.259 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:09:09.259 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:09.877 INFO:teuthology.orchestra.run.smithi153.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-03-28T23:09:09.889 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/239 2024-03-28T23:09:09.889 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/239 2024-03-28T23:09:09.889 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:09:09.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:09.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:09:09.947 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-03-28T23:09:10.503 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:09:10.516 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:09:10.518 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:09:10.521 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:09:10.521 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:11.226 INFO:teuthology.orchestra.run.smithi153.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-03-28T23:09:11.239 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/240 2024-03-28T23:09:11.239 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/240 2024-03-28T23:09:11.239 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:09:11.249 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:11.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:09:11.303 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-03-28T23:09:11.867 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:09:11.880 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:09:11.881 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:09:11.884 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:09:11.885 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:09:15.530 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:09:15.536 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:09:45.654 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:09:45.660 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:10:15.959 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:10:15.970 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:10:25.896 INFO:teuthology.orchestra.run.smithi153.stdout:generic/241 73s 2024-03-28T23:10:25.911 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/241 2024-03-28T23:10:25.911 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:10:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:26.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:10:26.722 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-03-28T23:10:27.652 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:10:27.662 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:10:27.664 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:10:27.666 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:28.541 INFO:teuthology.orchestra.run.smithi153.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:10:28.561 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/242 2024-03-28T23:10:28.561 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/242 2024-03-28T23:10:28.561 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:10:28.577 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:28.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:10:28.796 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-03-28T23:10:29.338 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:10:29.351 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:10:29.352 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:10:29.355 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:29.355 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:30.270 INFO:teuthology.orchestra.run.smithi153.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:10:30.290 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/243 2024-03-28T23:10:30.290 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/243 2024-03-28T23:10:30.290 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:10:30.305 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:30.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:10:30.537 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-03-28T23:10:31.059 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:10:31.072 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:10:31.073 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:10:31.076 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:31.076 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:31.661 INFO:teuthology.orchestra.run.smithi153.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:10:31.671 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/244 2024-03-28T23:10:31.672 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/244 2024-03-28T23:10:31.672 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:10:31.680 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:31.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:10:31.720 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-03-28T23:10:32.254 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:10:32.267 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:10:32.268 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:10:32.270 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:32.271 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:33.030 INFO:teuthology.orchestra.run.smithi153.stdout:generic/245 1s 2024-03-28T23:10:33.048 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/245 2024-03-28T23:10:33.048 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:10:33.058 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:33.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:10:33.183 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-03-28T23:10:33.863 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:10:33.876 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:10:33.877 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:10:33.881 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:33.881 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:34.557 INFO:teuthology.orchestra.run.smithi153.stdout:generic/246 0s 2024-03-28T23:10:34.574 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/246 2024-03-28T23:10:34.574 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:10:34.582 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:34.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:10:34.681 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-03-28T23:10:35.399 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:10:35.412 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:10:35.414 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:10:35.418 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:35.418 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:47.181 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:10:47.190 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:10:48.194 INFO:teuthology.orchestra.run.smithi153.stdout:generic/247 13s 2024-03-28T23:10:48.211 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/247 2024-03-28T23:10:48.211 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:10:48.220 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:48.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:10:48.247 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-03-28T23:10:48.793 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:10:48.805 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:10:48.807 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:10:48.810 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:48.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:49.512 INFO:teuthology.orchestra.run.smithi153.stdout:generic/248 0s 2024-03-28T23:10:49.527 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/248 2024-03-28T23:10:49.527 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:10:49.537 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:49.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:10:49.588 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-03-28T23:10:50.145 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:10:50.158 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:10:50.159 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:10:50.161 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:50.162 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:51.268 INFO:teuthology.orchestra.run.smithi153.stdout:generic/249 1s 2024-03-28T23:10:51.283 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/249 2024-03-28T23:10:51.283 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:10:51.290 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:51.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:10:51.392 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-03-28T23:10:52.102 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:10:52.124 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:10:52.125 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:10:52.129 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:52.129 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:52.771 INFO:teuthology.orchestra.run.smithi153.stdout:generic/250 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:10:52.781 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/250 2024-03-28T23:10:52.781 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/250 2024-03-28T23:10:52.781 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:10:52.790 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:52.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:10:52.829 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-03-28T23:10:53.429 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:10:53.443 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:10:53.444 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:10:53.447 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:53.447 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:54.256 INFO:teuthology.orchestra.run.smithi153.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:54.275 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/251 2024-03-28T23:10:54.275 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/251 2024-03-28T23:10:54.275 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:10:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:54.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:10:54.334 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-03-28T23:10:54.906 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:10:54.918 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:10:54.919 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:10:54.921 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:54.922 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:55.545 INFO:teuthology.orchestra.run.smithi153.stdout:generic/252 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:10:55.559 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/252 2024-03-28T23:10:55.559 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/252 2024-03-28T23:10:55.560 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:10:55.570 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:55.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:10:55.613 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-03-28T23:10:56.188 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:10:56.199 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:10:56.201 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:10:56.203 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:57.168 INFO:teuthology.orchestra.run.smithi153.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:10:57.188 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/253 2024-03-28T23:10:57.188 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/253 2024-03-28T23:10:57.188 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:10:57.206 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:57.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:10:57.415 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-03-28T23:10:57.946 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:10:57.957 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:10:57.958 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:10:57.961 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:57.961 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:58.917 INFO:teuthology.orchestra.run.smithi153.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:10:58.938 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/254 2024-03-28T23:10:58.938 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/254 2024-03-28T23:10:58.938 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:10:58.946 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:10:59.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:10:59.170 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-03-28T23:10:59.716 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:10:59.728 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:10:59.730 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:10:59.733 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:10:59.734 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:00.580 INFO:teuthology.orchestra.run.smithi153.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T23:11:00.591 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/255 2024-03-28T23:11:00.591 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/255 2024-03-28T23:11:00.591 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:00.599 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:00.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:00.704 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-03-28T23:11:01.406 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:01.418 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:01.419 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:01.422 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:01.422 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:02.719 INFO:teuthology.orchestra.run.smithi153.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T23:11:02.730 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/256 2024-03-28T23:11:02.730 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/256 2024-03-28T23:11:02.731 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:02.739 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:02.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:02.779 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-03-28T23:11:03.347 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:03.358 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:03.360 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:03.363 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:03.363 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:05.210 INFO:teuthology.orchestra.run.smithi153.stdout:generic/257 2s 2024-03-28T23:11:05.224 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/257 2024-03-28T23:11:05.224 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:05.232 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:05.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:05.341 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-03-28T23:11:06.059 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:06.070 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:06.071 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:06.074 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:06.074 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:06.713 INFO:teuthology.orchestra.run.smithi153.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-03-28T23:11:06.724 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/258 2024-03-28T23:11:06.724 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/258 2024-03-28T23:11:06.724 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:06.731 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:06.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:06.766 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-03-28T23:11:07.364 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:07.378 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:07.379 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:07.382 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:07.382 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:08.316 INFO:teuthology.orchestra.run.smithi153.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:11:08.342 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/259 2024-03-28T23:11:08.345 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/259 2024-03-28T23:11:08.345 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:08.358 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:08.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:08.515 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-03-28T23:11:09.078 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:09.091 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:09.093 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:09.096 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:09.096 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:09.891 INFO:teuthology.orchestra.run.smithi153.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:09.910 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/260 2024-03-28T23:11:09.911 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/260 2024-03-28T23:11:09.911 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:09.918 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:09.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:09.953 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-03-28T23:11:10.463 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:10.475 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:10.476 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:10.479 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:10.479 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:11.372 INFO:teuthology.orchestra.run.smithi153.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:11:11.389 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/261 2024-03-28T23:11:11.389 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/261 2024-03-28T23:11:11.389 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:11.400 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:11.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:11.499 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-03-28T23:11:12.144 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:12.155 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:12.156 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:12.159 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:12.159 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:13.101 INFO:teuthology.orchestra.run.smithi153.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:11:13.119 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/262 2024-03-28T23:11:13.119 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/262 2024-03-28T23:11:13.120 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:13.132 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:13.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:13.264 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-03-28T23:11:13.864 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:13.876 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:13.878 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:13.881 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:13.881 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:17.325 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:11:17.333 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:11:39.587 INFO:teuthology.orchestra.run.smithi153.stdout:generic/263 [failed, exit status 1]- output mismatch (see /tmp/tmp.0cGUU1Musyxfstests-dev/results//generic/263.out.bad) 2024-03-28T23:11:39.601 INFO:teuthology.orchestra.run.smithi153.stdout: --- tests/generic/263.out 2024-03-28 21:53:24.336163724 +0000 2024-03-28T23:11:39.601 INFO:teuthology.orchestra.run.smithi153.stdout: +++ /tmp/tmp.0cGUU1Musyxfstests-dev/results//generic/263.out.bad 2024-03-28 23:11:39.575760847 +0000 2024-03-28T23:11:39.601 INFO:teuthology.orchestra.run.smithi153.stdout: @@ -1,3 +1,6750 @@ 2024-03-28T23:11:39.601 INFO:teuthology.orchestra.run.smithi153.stdout: QA output created by 263 2024-03-28T23:11:39.601 INFO:teuthology.orchestra.run.smithi153.stdout: fsx -N 10000 -o 8192 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z 2024-03-28T23:11:39.601 INFO:teuthology.orchestra.run.smithi153.stdout: -fsx -N 10000 -o 128000 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z 2024-03-28T23:11:39.602 INFO:teuthology.orchestra.run.smithi153.stdout: +Seed set to 1 2024-03-28T23:11:39.602 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support fallocate mode 0, disabling! 2024-03-28T23:11:39.602 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-03-28T23:11:39.602 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_ZERO_RANGE, disabling! 2024-03-28T23:11:39.602 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-03-28T23:11:39.602 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-03-28T23:11:39.602 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support clone range, disabling! 2024-03-28T23:11:39.602 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support dedupe range, disabling! 2024-03-28T23:11:39.602 INFO:teuthology.orchestra.run.smithi153.stdout: +main: filesystem does not support exchange range, disabling! 2024-03-28T23:11:39.602 INFO:teuthology.orchestra.run.smithi153.stdout: +skipping zero size read 2024-03-28T23:11:39.602 INFO:teuthology.orchestra.run.smithi153.stdout: +truncating to largest ever: 0x1f000 2024-03-28T23:11:39.602 INFO:teuthology.orchestra.run.smithi153.stdout: +truncating to largest ever: 0x3a000 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +truncating to largest ever: 0x40000 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +truncating to largest ever: 0x4f000 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +truncating to largest ever: 0x6f000 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +truncating to largest ever: 0x72000 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +copying to largest ever: 0x7a000 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +skipping zero length punch hole 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +READ BAD DATA: offset = 0x37000, size = 0x12a6, fname = /tmp/tmp.l0v0NkF9eFtest/junk 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +OFFSET GOOD BAD RANGE 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +0x37000 0xc65f 0x0000 0x0 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +0x37001 0x5fc6 0x0000 0x1 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +0x37002 0xc65c 0x0000 0x2 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: +0x37003 0x5cc6 0x0000 0x3 2024-03-28T23:11:39.604 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.604 INFO:teuthology.orchestra.run.smithi153.stdout: +0x37004 0xc67d 0x0000 0x4 2024-03-28T23:11:39.604 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.604 INFO:teuthology.orchestra.run.smithi153.stdout: +0x37005 0x7dc6 0x0000 0x5 2024-03-28T23:11:39.604 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.604 INFO:teuthology.orchestra.run.smithi153.stdout: +0x37006 0xc6cf 0x0000 0x6 2024-03-28T23:11:39.604 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.604 INFO:teuthology.orchestra.run.smithi153.stdout: +0x37007 0xcfc6 0x0000 0x7 2024-03-28T23:11:39.604 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.604 INFO:teuthology.orchestra.run.smithi153.stdout: +0x37008 0xc6e5 0x0000 0x8 2024-03-28T23:11:39.604 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.604 INFO:teuthology.orchestra.run.smithi153.stdout: +0x37009 0xe5c6 0x0000 0x9 2024-03-28T23:11:39.604 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.605 INFO:teuthology.orchestra.run.smithi153.stdout: +0x3700a 0xc658 0x0000 0xa 2024-03-28T23:11:39.605 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.605 INFO:teuthology.orchestra.run.smithi153.stdout: +0x3700b 0x58c6 0x0000 0xb 2024-03-28T23:11:39.605 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.605 INFO:teuthology.orchestra.run.smithi153.stdout: +0x3700c 0xc67d 0x0000 0xc 2024-03-28T23:11:39.605 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.605 INFO:teuthology.orchestra.run.smithi153.stdout: +0x3700d 0x7dc6 0x0000 0xd 2024-03-28T23:11:39.605 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.605 INFO:teuthology.orchestra.run.smithi153.stdout: +0x3700e 0xc6d0 0x0000 0xe 2024-03-28T23:11:39.605 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.605 INFO:teuthology.orchestra.run.smithi153.stdout: +0x3700f 0xd0c6 0x0000 0xf 2024-03-28T23:11:39.605 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-28T23:11:39.605 INFO:teuthology.orchestra.run.smithi153.stdout: +LOG DUMP (6692 total operations): 2024-03-28T23:11:39.605 INFO:teuthology.orchestra.run.smithi153.stdout: +1( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.606 INFO:teuthology.orchestra.run.smithi153.stdout: +2( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.606 INFO:teuthology.orchestra.run.smithi153.stdout: +3( 3 mod 256): MAPWRITE 0x69000 thru 0x6948f (0x490 bytes) 2024-03-28T23:11:39.606 INFO:teuthology.orchestra.run.smithi153.stdout: +4( 4 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.606 INFO:teuthology.orchestra.run.smithi153.stdout: +5( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.606 INFO:teuthology.orchestra.run.smithi153.stdout: +6( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.606 INFO:teuthology.orchestra.run.smithi153.stdout: +7( 7 mod 256): MAPREAD 0x24000 thru 0x252b7 (0x12b8 bytes) 2024-03-28T23:11:39.606 INFO:teuthology.orchestra.run.smithi153.stdout: +8( 8 mod 256): PUNCH 0x2f0aa thru 0x30bc8 (0x1b1f bytes) 2024-03-28T23:11:39.606 INFO:teuthology.orchestra.run.smithi153.stdout: +9( 9 mod 256): PUNCH 0x6338 thru 0x8078 (0x1d41 bytes) 2024-03-28T23:11:39.606 INFO:teuthology.orchestra.run.smithi153.stdout: +10( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.606 INFO:teuthology.orchestra.run.smithi153.stdout: +11( 11 mod 256): PUNCH 0x33326 thru 0x33877 (0x552 bytes) 2024-03-28T23:11:39.606 INFO:teuthology.orchestra.run.smithi153.stdout: +12( 12 mod 256): READ 0x65000 thru 0x65fff (0x1000 bytes) 2024-03-28T23:11:39.606 INFO:teuthology.orchestra.run.smithi153.stdout: +13( 13 mod 256): MAPREAD 0x2a000 thru 0x2b84b (0x184c bytes) 2024-03-28T23:11:39.606 INFO:teuthology.orchestra.run.smithi153.stdout: +14( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.606 INFO:teuthology.orchestra.run.smithi153.stdout: +15( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.607 INFO:teuthology.orchestra.run.smithi153.stdout: +16( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.607 INFO:teuthology.orchestra.run.smithi153.stdout: +17( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.607 INFO:teuthology.orchestra.run.smithi153.stdout: +18( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.607 INFO:teuthology.orchestra.run.smithi153.stdout: +19( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.607 INFO:teuthology.orchestra.run.smithi153.stdout: +20( 20 mod 256): MAPREAD 0x13000 thru 0x13b3a (0xb3b bytes) 2024-03-28T23:11:39.607 INFO:teuthology.orchestra.run.smithi153.stdout: +21( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.607 INFO:teuthology.orchestra.run.smithi153.stdout: +22( 22 mod 256): TRUNCATE DOWN from 0x69490 to 0x1f000 ******WWWW 2024-03-28T23:11:39.607 INFO:teuthology.orchestra.run.smithi153.stdout: +23( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.607 INFO:teuthology.orchestra.run.smithi153.stdout: +24( 24 mod 256): PUNCH 0x1c5ff thru 0x1e2e9 (0x1ceb bytes) 2024-03-28T23:11:39.607 INFO:teuthology.orchestra.run.smithi153.stdout: +25( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +26( 26 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +27( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +28( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +29( 29 mod 256): TRUNCATE UP from 0x1f000 to 0x3a000 ******WWWW 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +30( 30 mod 256): MAPREAD 0x39000 thru 0x390cd (0xce bytes) 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +31( 31 mod 256): TRUNCATE UP from 0x3a000 to 0x40000 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +32( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +33( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +34( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +35( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +36( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +37( 37 mod 256): MAPREAD 0x23000 thru 0x24420 (0x1421 bytes) 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +38( 38 mod 256): READ 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +39( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.608 INFO:teuthology.orchestra.run.smithi153.stdout: +40( 40 mod 256): PUNCH 0x1d8f1 thru 0x1f1a2 (0x18b2 bytes) 2024-03-28T23:11:39.609 INFO:teuthology.orchestra.run.smithi153.stdout: +41( 41 mod 256): PUNCH 0x1bcf8 thru 0x1c24c (0x555 bytes) 2024-03-28T23:11:39.609 INFO:teuthology.orchestra.run.smithi153.stdout: +42( 42 mod 256): MAPREAD 0x1d000 thru 0x1d2ab (0x2ac bytes) 2024-03-28T23:11:39.609 INFO:teuthology.orchestra.run.smithi153.stdout: +43( 43 mod 256): COPY 0x9000 thru 0x9fff (0x1000 bytes) to 0x22000 thru 0x22fff 2024-03-28T23:11:39.609 INFO:teuthology.orchestra.run.smithi153.stdout: +44( 44 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.609 INFO:teuthology.orchestra.run.smithi153.stdout: +45( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.609 INFO:teuthology.orchestra.run.smithi153.stdout: +46( 46 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.609 INFO:teuthology.orchestra.run.smithi153.stdout: +47( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.609 INFO:teuthology.orchestra.run.smithi153.stdout: +48( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.609 INFO:teuthology.orchestra.run.smithi153.stdout: +49( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.609 INFO:teuthology.orchestra.run.smithi153.stdout: +50( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.609 INFO:teuthology.orchestra.run.smithi153.stdout: +51( 51 mod 256): MAPWRITE 0x14000 thru 0x14c81 (0xc82 bytes) 2024-03-28T23:11:39.609 INFO:teuthology.orchestra.run.smithi153.stdout: +52( 52 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.609 INFO:teuthology.orchestra.run.smithi153.stdout: +53( 53 mod 256): TRUNCATE DOWN from 0x40000 to 0x16000 ******WWWW 2024-03-28T23:11:39.610 INFO:teuthology.orchestra.run.smithi153.stdout: +54( 54 mod 256): MAPWRITE 0x15000 thru 0x15628 (0x629 bytes) 2024-03-28T23:11:39.610 INFO:teuthology.orchestra.run.smithi153.stdout: +55( 55 mod 256): PUNCH 0xad5e thru 0xae53 (0xf6 bytes) 2024-03-28T23:11:39.610 INFO:teuthology.orchestra.run.smithi153.stdout: +56( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.610 INFO:teuthology.orchestra.run.smithi153.stdout: +57( 57 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.610 INFO:teuthology.orchestra.run.smithi153.stdout: +58( 58 mod 256): MAPWRITE 0x34000 thru 0x34c6f (0xc70 bytes) 2024-03-28T23:11:39.610 INFO:teuthology.orchestra.run.smithi153.stdout: +59( 59 mod 256): WRITE 0x38000 thru 0x38fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.610 INFO:teuthology.orchestra.run.smithi153.stdout: +60( 60 mod 256): PUNCH 0x20b22 thru 0x20f00 (0x3df bytes) 2024-03-28T23:11:39.610 INFO:teuthology.orchestra.run.smithi153.stdout: +61( 61 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.610 INFO:teuthology.orchestra.run.smithi153.stdout: +62( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.610 INFO:teuthology.orchestra.run.smithi153.stdout: +63( 63 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.610 INFO:teuthology.orchestra.run.smithi153.stdout: +64( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.610 INFO:teuthology.orchestra.run.smithi153.stdout: +65( 65 mod 256): MAPWRITE 0x19000 thru 0x193b6 (0x3b7 bytes) 2024-03-28T23:11:39.610 INFO:teuthology.orchestra.run.smithi153.stdout: +66( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.611 INFO:teuthology.orchestra.run.smithi153.stdout: +67( 67 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.611 INFO:teuthology.orchestra.run.smithi153.stdout: +68( 68 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.611 INFO:teuthology.orchestra.run.smithi153.stdout: +69( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.611 INFO:teuthology.orchestra.run.smithi153.stdout: +70( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.611 INFO:teuthology.orchestra.run.smithi153.stdout: +71( 71 mod 256): PUNCH 0x11014 thru 0x1282b (0x1818 bytes) 2024-03-28T23:11:39.611 INFO:teuthology.orchestra.run.smithi153.stdout: +72( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.611 INFO:teuthology.orchestra.run.smithi153.stdout: +73( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.611 INFO:teuthology.orchestra.run.smithi153.stdout: +74( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.611 INFO:teuthology.orchestra.run.smithi153.stdout: +75( 75 mod 256): PUNCH 0x18e0a thru 0x1a043 (0x123a bytes) 2024-03-28T23:11:39.611 INFO:teuthology.orchestra.run.smithi153.stdout: +76( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.611 INFO:teuthology.orchestra.run.smithi153.stdout: +77( 77 mod 256): PUNCH 0x2c4bd thru 0x2c688 (0x1cc bytes) 2024-03-28T23:11:39.611 INFO:teuthology.orchestra.run.smithi153.stdout: +78( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.611 INFO:teuthology.orchestra.run.smithi153.stdout: +79( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.611 INFO:teuthology.orchestra.run.smithi153.stdout: +80( 80 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.612 INFO:teuthology.orchestra.run.smithi153.stdout: +81( 81 mod 256): PUNCH 0x1cdcd thru 0x1dce2 (0xf16 bytes) 2024-03-28T23:11:39.612 INFO:teuthology.orchestra.run.smithi153.stdout: +82( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.612 INFO:teuthology.orchestra.run.smithi153.stdout: +83( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.612 INFO:teuthology.orchestra.run.smithi153.stdout: +84( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.612 INFO:teuthology.orchestra.run.smithi153.stdout: +85( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.612 INFO:teuthology.orchestra.run.smithi153.stdout: +86( 86 mod 256): PUNCH 0xbdc thru 0x27cc (0x1bf1 bytes) 2024-03-28T23:11:39.612 INFO:teuthology.orchestra.run.smithi153.stdout: +87( 87 mod 256): TRUNCATE DOWN from 0x39000 to 0x16000 ******WWWW 2024-03-28T23:11:39.612 INFO:teuthology.orchestra.run.smithi153.stdout: +88( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.612 INFO:teuthology.orchestra.run.smithi153.stdout: +89( 89 mod 256): MAPREAD 0xc000 thru 0xd35c (0x135d bytes) 2024-03-28T23:11:39.612 INFO:teuthology.orchestra.run.smithi153.stdout: +90( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.612 INFO:teuthology.orchestra.run.smithi153.stdout: +91( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.612 INFO:teuthology.orchestra.run.smithi153.stdout: +92( 92 mod 256): PUNCH 0x10170 thru 0x12055 (0x1ee6 bytes) 2024-03-28T23:11:39.612 INFO:teuthology.orchestra.run.smithi153.stdout: +93( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +94( 94 mod 256): PUNCH 0x1925 thru 0x348f (0x1b6b bytes) 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +95( 95 mod 256): MAPREAD 0xb000 thru 0xc8f7 (0x18f8 bytes) 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +96( 96 mod 256): MAPWRITE 0x38000 thru 0x3909b (0x109c bytes) 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +97( 97 mod 256): MAPWRITE 0x3000 thru 0x48f2 (0x18f3 bytes) 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +98( 98 mod 256): PUNCH 0x32b99 thru 0x3442f (0x1897 bytes) 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +99( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +100(100 mod 256): MAPREAD 0x37000 thru 0x377ef (0x7f0 bytes) 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +101(101 mod 256): WRITE 0x6f000 thru 0x6ffff (0x1000 bytes) HOLE 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +102(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +103(103 mod 256): TRUNCATE DOWN from 0x70000 to 0x4f000 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +104(104 mod 256): READ 0x3c000 thru 0x3cfff (0x1000 bytes) 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +105(105 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +106(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +107(107 mod 256): TRUNCATE UP from 0x4f000 to 0x6f000 2024-03-28T23:11:39.613 INFO:teuthology.orchestra.run.smithi153.stdout: +108(108 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x66000 thru 0x66fff 2024-03-28T23:11:39.614 INFO:teuthology.orchestra.run.smithi153.stdout: +109(109 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.614 INFO:teuthology.orchestra.run.smithi153.stdout: +110(110 mod 256): COPY 0x5d000 thru 0x5dfff (0x1000 bytes) to 0x24000 thru 0x24fff 2024-03-28T23:11:39.614 INFO:teuthology.orchestra.run.smithi153.stdout: +111(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.614 INFO:teuthology.orchestra.run.smithi153.stdout: +112(112 mod 256): TRUNCATE DOWN from 0x6f000 to 0x5b000 2024-03-28T23:11:39.614 INFO:teuthology.orchestra.run.smithi153.stdout: +113(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.614 INFO:teuthology.orchestra.run.smithi153.stdout: +114(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.614 INFO:teuthology.orchestra.run.smithi153.stdout: +115(115 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.614 INFO:teuthology.orchestra.run.smithi153.stdout: +116(116 mod 256): PUNCH 0x3ad7a thru 0x3c8ca (0x1b51 bytes) 2024-03-28T23:11:39.614 INFO:teuthology.orchestra.run.smithi153.stdout: +117(117 mod 256): WRITE 0xa000 thru 0xafff (0x1000 bytes) 2024-03-28T23:11:39.614 INFO:teuthology.orchestra.run.smithi153.stdout: +118(118 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.614 INFO:teuthology.orchestra.run.smithi153.stdout: +119(119 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.614 INFO:teuthology.orchestra.run.smithi153.stdout: +120(120 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.614 INFO:teuthology.orchestra.run.smithi153.stdout: +121(121 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.614 INFO:teuthology.orchestra.run.smithi153.stdout: +122(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.615 INFO:teuthology.orchestra.run.smithi153.stdout: +123(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.615 INFO:teuthology.orchestra.run.smithi153.stdout: +124(124 mod 256): MAPREAD 0x54000 thru 0x55754 (0x1755 bytes) 2024-03-28T23:11:39.615 INFO:teuthology.orchestra.run.smithi153.stdout: +125(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.615 INFO:teuthology.orchestra.run.smithi153.stdout: +126(126 mod 256): PUNCH 0x5a17e thru 0x5afff (0xe82 bytes) 2024-03-28T23:11:39.615 INFO:teuthology.orchestra.run.smithi153.stdout: +127(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.615 INFO:teuthology.orchestra.run.smithi153.stdout: +128(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.615 INFO:teuthology.orchestra.run.smithi153.stdout: +129(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.615 INFO:teuthology.orchestra.run.smithi153.stdout: +130(130 mod 256): WRITE 0x21000 thru 0x21fff (0x1000 bytes) 2024-03-28T23:11:39.615 INFO:teuthology.orchestra.run.smithi153.stdout: +131(131 mod 256): PUNCH 0x14e66 thru 0x16d92 (0x1f2d bytes) 2024-03-28T23:11:39.615 INFO:teuthology.orchestra.run.smithi153.stdout: +132(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.615 INFO:teuthology.orchestra.run.smithi153.stdout: +133(133 mod 256): MAPWRITE 0xf000 thru 0x1004e (0x104f bytes) 2024-03-28T23:11:39.615 INFO:teuthology.orchestra.run.smithi153.stdout: +134(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.615 INFO:teuthology.orchestra.run.smithi153.stdout: +135(135 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.615 INFO:teuthology.orchestra.run.smithi153.stdout: +136(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.616 INFO:teuthology.orchestra.run.smithi153.stdout: +137(137 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x1e000 thru 0x1efff 2024-03-28T23:11:39.616 INFO:teuthology.orchestra.run.smithi153.stdout: +138(138 mod 256): READ 0x57000 thru 0x57fff (0x1000 bytes) 2024-03-28T23:11:39.616 INFO:teuthology.orchestra.run.smithi153.stdout: +139(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.616 INFO:teuthology.orchestra.run.smithi153.stdout: +140(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.616 INFO:teuthology.orchestra.run.smithi153.stdout: +141(141 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.616 INFO:teuthology.orchestra.run.smithi153.stdout: +142(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.616 INFO:teuthology.orchestra.run.smithi153.stdout: +143(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.616 INFO:teuthology.orchestra.run.smithi153.stdout: +144(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.616 INFO:teuthology.orchestra.run.smithi153.stdout: +145(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.616 INFO:teuthology.orchestra.run.smithi153.stdout: +146(146 mod 256): MAPWRITE 0x0 thru 0x1cc3 (0x1cc4 bytes) 2024-03-28T23:11:39.616 INFO:teuthology.orchestra.run.smithi153.stdout: +147(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.616 INFO:teuthology.orchestra.run.smithi153.stdout: +148(148 mod 256): TRUNCATE UP from 0x5b000 to 0x72000 2024-03-28T23:11:39.616 INFO:teuthology.orchestra.run.smithi153.stdout: +149(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.616 INFO:teuthology.orchestra.run.smithi153.stdout: +150(150 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.617 INFO:teuthology.orchestra.run.smithi153.stdout: +151(151 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.617 INFO:teuthology.orchestra.run.smithi153.stdout: +152(152 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.617 INFO:teuthology.orchestra.run.smithi153.stdout: +153(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.617 INFO:teuthology.orchestra.run.smithi153.stdout: +154(154 mod 256): READ 0x19000 thru 0x19fff (0x1000 bytes) 2024-03-28T23:11:39.617 INFO:teuthology.orchestra.run.smithi153.stdout: +155(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.617 INFO:teuthology.orchestra.run.smithi153.stdout: +156(156 mod 256): MAPREAD 0x4d000 thru 0x4ecd8 (0x1cd9 bytes) 2024-03-28T23:11:39.617 INFO:teuthology.orchestra.run.smithi153.stdout: +157(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.617 INFO:teuthology.orchestra.run.smithi153.stdout: +158(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.617 INFO:teuthology.orchestra.run.smithi153.stdout: +159(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.617 INFO:teuthology.orchestra.run.smithi153.stdout: +160(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.617 INFO:teuthology.orchestra.run.smithi153.stdout: +161(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.617 INFO:teuthology.orchestra.run.smithi153.stdout: +162(162 mod 256): PUNCH 0x7c7d thru 0x8bfe (0xf82 bytes) 2024-03-28T23:11:39.618 INFO:teuthology.orchestra.run.smithi153.stdout: +163(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.618 INFO:teuthology.orchestra.run.smithi153.stdout: +164(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.618 INFO:teuthology.orchestra.run.smithi153.stdout: +165(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.618 INFO:teuthology.orchestra.run.smithi153.stdout: +166(166 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.618 INFO:teuthology.orchestra.run.smithi153.stdout: +167(167 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.618 INFO:teuthology.orchestra.run.smithi153.stdout: +168(168 mod 256): READ 0x3e000 thru 0x3efff (0x1000 bytes) 2024-03-28T23:11:39.618 INFO:teuthology.orchestra.run.smithi153.stdout: +169(169 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.618 INFO:teuthology.orchestra.run.smithi153.stdout: +170(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.618 INFO:teuthology.orchestra.run.smithi153.stdout: +171(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.618 INFO:teuthology.orchestra.run.smithi153.stdout: +172(172 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.618 INFO:teuthology.orchestra.run.smithi153.stdout: +173(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.618 INFO:teuthology.orchestra.run.smithi153.stdout: +174(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.618 INFO:teuthology.orchestra.run.smithi153.stdout: +175(175 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-28T23:11:39.618 INFO:teuthology.orchestra.run.smithi153.stdout: +176(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.619 INFO:teuthology.orchestra.run.smithi153.stdout: +177(177 mod 256): COPY 0x10000 thru 0x10fff (0x1000 bytes) to 0x13000 thru 0x13fff 2024-03-28T23:11:39.619 INFO:teuthology.orchestra.run.smithi153.stdout: +178(178 mod 256): WRITE 0x62000 thru 0x62fff (0x1000 bytes) 2024-03-28T23:11:39.619 INFO:teuthology.orchestra.run.smithi153.stdout: +179(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.619 INFO:teuthology.orchestra.run.smithi153.stdout: +180(180 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.619 INFO:teuthology.orchestra.run.smithi153.stdout: +181(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.619 INFO:teuthology.orchestra.run.smithi153.stdout: +182(182 mod 256): TRUNCATE DOWN from 0x72000 to 0x1d000 ******WWWW 2024-03-28T23:11:39.619 INFO:teuthology.orchestra.run.smithi153.stdout: +183(183 mod 256): MAPREAD 0x18000 thru 0x18c69 (0xc6a bytes) 2024-03-28T23:11:39.619 INFO:teuthology.orchestra.run.smithi153.stdout: +184(184 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.619 INFO:teuthology.orchestra.run.smithi153.stdout: +185(185 mod 256): PUNCH 0x33a4 thru 0x414a (0xda7 bytes) 2024-03-28T23:11:39.619 INFO:teuthology.orchestra.run.smithi153.stdout: +186(186 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.619 INFO:teuthology.orchestra.run.smithi153.stdout: +187(187 mod 256): WRITE 0x3e000 thru 0x3efff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.619 INFO:teuthology.orchestra.run.smithi153.stdout: +188(188 mod 256): TRUNCATE DOWN from 0x3f000 to 0x29000 ******WWWW 2024-03-28T23:11:39.619 INFO:teuthology.orchestra.run.smithi153.stdout: +189(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.620 INFO:teuthology.orchestra.run.smithi153.stdout: +190(190 mod 256): MAPREAD 0x1d000 thru 0x1ec41 (0x1c42 bytes) 2024-03-28T23:11:39.620 INFO:teuthology.orchestra.run.smithi153.stdout: +191(191 mod 256): WRITE 0x6e000 thru 0x6efff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.620 INFO:teuthology.orchestra.run.smithi153.stdout: +192(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.620 INFO:teuthology.orchestra.run.smithi153.stdout: +193(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.620 INFO:teuthology.orchestra.run.smithi153.stdout: +194(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.620 INFO:teuthology.orchestra.run.smithi153.stdout: +195(195 mod 256): READ 0x23000 thru 0x23fff (0x1000 bytes) 2024-03-28T23:11:39.620 INFO:teuthology.orchestra.run.smithi153.stdout: +196(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.620 INFO:teuthology.orchestra.run.smithi153.stdout: +197(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.620 INFO:teuthology.orchestra.run.smithi153.stdout: +198(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.620 INFO:teuthology.orchestra.run.smithi153.stdout: +199(199 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.620 INFO:teuthology.orchestra.run.smithi153.stdout: +200(200 mod 256): COPY 0x4e000 thru 0x4efff (0x1000 bytes) to 0x51000 thru 0x51fff 2024-03-28T23:11:39.620 INFO:teuthology.orchestra.run.smithi153.stdout: +201(201 mod 256): PUNCH 0xee00 thru 0xef5c (0x15d bytes) 2024-03-28T23:11:39.620 INFO:teuthology.orchestra.run.smithi153.stdout: +202(202 mod 256): TRUNCATE UP from 0x6f000 to 0x72000 2024-03-28T23:11:39.620 INFO:teuthology.orchestra.run.smithi153.stdout: +203(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.621 INFO:teuthology.orchestra.run.smithi153.stdout: +204(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.621 INFO:teuthology.orchestra.run.smithi153.stdout: +205(205 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.621 INFO:teuthology.orchestra.run.smithi153.stdout: +206(206 mod 256): TRUNCATE DOWN from 0x72000 to 0x15000 ******WWWW 2024-03-28T23:11:39.621 INFO:teuthology.orchestra.run.smithi153.stdout: +207(207 mod 256): TRUNCATE UP from 0x15000 to 0x50000 ******WWWW 2024-03-28T23:11:39.621 INFO:teuthology.orchestra.run.smithi153.stdout: +208(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.621 INFO:teuthology.orchestra.run.smithi153.stdout: +209(209 mod 256): WRITE 0x6a000 thru 0x6afff (0x1000 bytes) HOLE 2024-03-28T23:11:39.621 INFO:teuthology.orchestra.run.smithi153.stdout: +210(210 mod 256): PUNCH 0x3052f thru 0x31b9d (0x166f bytes) 2024-03-28T23:11:39.621 INFO:teuthology.orchestra.run.smithi153.stdout: +211(211 mod 256): MAPWRITE 0x5b000 thru 0x5c311 (0x1312 bytes) 2024-03-28T23:11:39.621 INFO:teuthology.orchestra.run.smithi153.stdout: +212(212 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.621 INFO:teuthology.orchestra.run.smithi153.stdout: +213(213 mod 256): READ 0x50000 thru 0x50fff (0x1000 bytes) 2024-03-28T23:11:39.621 INFO:teuthology.orchestra.run.smithi153.stdout: +214(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.621 INFO:teuthology.orchestra.run.smithi153.stdout: +215(215 mod 256): MAPWRITE 0x5b000 thru 0x5b56d (0x56e bytes) 2024-03-28T23:11:39.621 INFO:teuthology.orchestra.run.smithi153.stdout: +216(216 mod 256): MAPREAD 0x5e000 thru 0x5f351 (0x1352 bytes) 2024-03-28T23:11:39.622 INFO:teuthology.orchestra.run.smithi153.stdout: +217(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.622 INFO:teuthology.orchestra.run.smithi153.stdout: +218(218 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.622 INFO:teuthology.orchestra.run.smithi153.stdout: +219(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.622 INFO:teuthology.orchestra.run.smithi153.stdout: +220(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.622 INFO:teuthology.orchestra.run.smithi153.stdout: +221(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.622 INFO:teuthology.orchestra.run.smithi153.stdout: +222(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.622 INFO:teuthology.orchestra.run.smithi153.stdout: +223(223 mod 256): TRUNCATE DOWN from 0x6b000 to 0x5e000 2024-03-28T23:11:39.622 INFO:teuthology.orchestra.run.smithi153.stdout: +224(224 mod 256): PUNCH 0x11d69 thru 0x12ac6 (0xd5e bytes) 2024-03-28T23:11:39.622 INFO:teuthology.orchestra.run.smithi153.stdout: +225(225 mod 256): PUNCH 0x42bbc thru 0x43275 (0x6ba bytes) 2024-03-28T23:11:39.622 INFO:teuthology.orchestra.run.smithi153.stdout: +226(226 mod 256): PUNCH 0x15837 thru 0x15f7b (0x745 bytes) 2024-03-28T23:11:39.622 INFO:teuthology.orchestra.run.smithi153.stdout: +227(227 mod 256): READ 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-28T23:11:39.622 INFO:teuthology.orchestra.run.smithi153.stdout: +228(228 mod 256): MAPREAD 0x29000 thru 0x2a04b (0x104c bytes) 2024-03-28T23:11:39.622 INFO:teuthology.orchestra.run.smithi153.stdout: +229(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.622 INFO:teuthology.orchestra.run.smithi153.stdout: +230(230 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.623 INFO:teuthology.orchestra.run.smithi153.stdout: +231(231 mod 256): READ 0x12000 thru 0x12fff (0x1000 bytes) 2024-03-28T23:11:39.623 INFO:teuthology.orchestra.run.smithi153.stdout: +232(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.623 INFO:teuthology.orchestra.run.smithi153.stdout: +233(233 mod 256): MAPREAD 0x28000 thru 0x29df8 (0x1df9 bytes) 2024-03-28T23:11:39.623 INFO:teuthology.orchestra.run.smithi153.stdout: +234(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.623 INFO:teuthology.orchestra.run.smithi153.stdout: +235(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.623 INFO:teuthology.orchestra.run.smithi153.stdout: +236(236 mod 256): PUNCH 0x2bfe7 thru 0x2c8a2 (0x8bc bytes) 2024-03-28T23:11:39.623 INFO:teuthology.orchestra.run.smithi153.stdout: +237(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.623 INFO:teuthology.orchestra.run.smithi153.stdout: +238(238 mod 256): MAPWRITE 0x72000 thru 0x72b58 (0xb59 bytes) 2024-03-28T23:11:39.623 INFO:teuthology.orchestra.run.smithi153.stdout: +239(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.623 INFO:teuthology.orchestra.run.smithi153.stdout: +240(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.623 INFO:teuthology.orchestra.run.smithi153.stdout: +241(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.623 INFO:teuthology.orchestra.run.smithi153.stdout: +242(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.623 INFO:teuthology.orchestra.run.smithi153.stdout: +243(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.624 INFO:teuthology.orchestra.run.smithi153.stdout: +244(244 mod 256): PUNCH 0x991d thru 0x9cf2 (0x3d6 bytes) 2024-03-28T23:11:39.624 INFO:teuthology.orchestra.run.smithi153.stdout: +245(245 mod 256): WRITE 0x4b000 thru 0x4bfff (0x1000 bytes) 2024-03-28T23:11:39.624 INFO:teuthology.orchestra.run.smithi153.stdout: +246(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.624 INFO:teuthology.orchestra.run.smithi153.stdout: +247(247 mod 256): MAPWRITE 0x37000 thru 0x372a4 (0x2a5 bytes) 2024-03-28T23:11:39.624 INFO:teuthology.orchestra.run.smithi153.stdout: +248(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.624 INFO:teuthology.orchestra.run.smithi153.stdout: +249(249 mod 256): MAPREAD 0x0 thru 0x131f (0x1320 bytes) 2024-03-28T23:11:39.624 INFO:teuthology.orchestra.run.smithi153.stdout: +250(250 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.624 INFO:teuthology.orchestra.run.smithi153.stdout: +251(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.624 INFO:teuthology.orchestra.run.smithi153.stdout: +252(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.624 INFO:teuthology.orchestra.run.smithi153.stdout: +253(253 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.624 INFO:teuthology.orchestra.run.smithi153.stdout: +254(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.624 INFO:teuthology.orchestra.run.smithi153.stdout: +255(255 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.624 INFO:teuthology.orchestra.run.smithi153.stdout: +256( 0 mod 256): MAPREAD 0x38000 thru 0x39e9c (0x1e9d bytes) 2024-03-28T23:11:39.624 INFO:teuthology.orchestra.run.smithi153.stdout: +257( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +258( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +259( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +260( 4 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +261( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +262( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +263( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +264( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +265( 9 mod 256): TRUNCATE DOWN from 0x72b59 to 0x15000 ******WWWW 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +266( 10 mod 256): MAPREAD 0xa000 thru 0xaad3 (0xad4 bytes) 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +267( 11 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +268( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +269( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +270( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +271( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.625 INFO:teuthology.orchestra.run.smithi153.stdout: +272( 16 mod 256): TRUNCATE UP from 0x15000 to 0x53000 ******WWWW 2024-03-28T23:11:39.626 INFO:teuthology.orchestra.run.smithi153.stdout: +273( 17 mod 256): PUNCH 0x4ec35 thru 0x507f9 (0x1bc5 bytes) 2024-03-28T23:11:39.626 INFO:teuthology.orchestra.run.smithi153.stdout: +274( 18 mod 256): TRUNCATE DOWN from 0x53000 to 0x11000 ******WWWW 2024-03-28T23:11:39.626 INFO:teuthology.orchestra.run.smithi153.stdout: +275( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.626 INFO:teuthology.orchestra.run.smithi153.stdout: +276( 20 mod 256): WRITE 0x2000 thru 0x2fff (0x1000 bytes) 2024-03-28T23:11:39.626 INFO:teuthology.orchestra.run.smithi153.stdout: +277( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.626 INFO:teuthology.orchestra.run.smithi153.stdout: +278( 22 mod 256): TRUNCATE DOWN from 0x11000 to 0x10000 2024-03-28T23:11:39.626 INFO:teuthology.orchestra.run.smithi153.stdout: +279( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.626 INFO:teuthology.orchestra.run.smithi153.stdout: +280( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.626 INFO:teuthology.orchestra.run.smithi153.stdout: +281( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.626 INFO:teuthology.orchestra.run.smithi153.stdout: +282( 26 mod 256): MAPREAD 0x3000 thru 0x4d4b (0x1d4c bytes) 2024-03-28T23:11:39.626 INFO:teuthology.orchestra.run.smithi153.stdout: +283( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.626 INFO:teuthology.orchestra.run.smithi153.stdout: +284( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.626 INFO:teuthology.orchestra.run.smithi153.stdout: +285( 29 mod 256): COPY 0x9000 thru 0x9fff (0x1000 bytes) to 0x79000 thru 0x79fff 2024-03-28T23:11:39.627 INFO:teuthology.orchestra.run.smithi153.stdout: +286( 30 mod 256): PUNCH 0x33fda thru 0x34cca (0xcf1 bytes) 2024-03-28T23:11:39.627 INFO:teuthology.orchestra.run.smithi153.stdout: +287( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.627 INFO:teuthology.orchestra.run.smithi153.stdout: +288( 32 mod 256): MAPWRITE 0x1d000 thru 0x1e4e5 (0x14e6 bytes) 2024-03-28T23:11:39.627 INFO:teuthology.orchestra.run.smithi153.stdout: +289( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.627 INFO:teuthology.orchestra.run.smithi153.stdout: +290( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.627 INFO:teuthology.orchestra.run.smithi153.stdout: +291( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.627 INFO:teuthology.orchestra.run.smithi153.stdout: +292( 36 mod 256): TRUNCATE DOWN from 0x7a000 to 0x43000 2024-03-28T23:11:39.627 INFO:teuthology.orchestra.run.smithi153.stdout: +293( 37 mod 256): PUNCH 0x3ea29 thru 0x3f56f (0xb47 bytes) 2024-03-28T23:11:39.627 INFO:teuthology.orchestra.run.smithi153.stdout: +294( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.627 INFO:teuthology.orchestra.run.smithi153.stdout: +295( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.627 INFO:teuthology.orchestra.run.smithi153.stdout: +296( 40 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.627 INFO:teuthology.orchestra.run.smithi153.stdout: +297( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.627 INFO:teuthology.orchestra.run.smithi153.stdout: +298( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.627 INFO:teuthology.orchestra.run.smithi153.stdout: +299( 43 mod 256): PUNCH 0x2b723 thru 0x2c70c (0xfea bytes) 2024-03-28T23:11:39.628 INFO:teuthology.orchestra.run.smithi153.stdout: +300( 44 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.628 INFO:teuthology.orchestra.run.smithi153.stdout: +301( 45 mod 256): TRUNCATE DOWN from 0x43000 to 0x12000 ******WWWW 2024-03-28T23:11:39.628 INFO:teuthology.orchestra.run.smithi153.stdout: +302( 46 mod 256): MAPREAD 0x7000 thru 0x8a30 (0x1a31 bytes) 2024-03-28T23:11:39.628 INFO:teuthology.orchestra.run.smithi153.stdout: +303( 47 mod 256): MAPREAD 0x4000 thru 0x4b51 (0xb52 bytes) 2024-03-28T23:11:39.628 INFO:teuthology.orchestra.run.smithi153.stdout: +304( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.628 INFO:teuthology.orchestra.run.smithi153.stdout: +305( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.628 INFO:teuthology.orchestra.run.smithi153.stdout: +306( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.628 INFO:teuthology.orchestra.run.smithi153.stdout: +307( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.628 INFO:teuthology.orchestra.run.smithi153.stdout: +308( 52 mod 256): MAPREAD 0x7000 thru 0x7b04 (0xb05 bytes) 2024-03-28T23:11:39.628 INFO:teuthology.orchestra.run.smithi153.stdout: +309( 53 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x58000 thru 0x58fff 2024-03-28T23:11:39.628 INFO:teuthology.orchestra.run.smithi153.stdout: +310( 54 mod 256): PUNCH 0x4e4c8 thru 0x4f398 (0xed1 bytes) 2024-03-28T23:11:39.628 INFO:teuthology.orchestra.run.smithi153.stdout: +311( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.628 INFO:teuthology.orchestra.run.smithi153.stdout: +312( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.628 INFO:teuthology.orchestra.run.smithi153.stdout: +313( 57 mod 256): COPY 0x3e000 thru 0x3efff (0x1000 bytes) to 0x6000 thru 0x6fff 2024-03-28T23:11:39.629 INFO:teuthology.orchestra.run.smithi153.stdout: +314( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.629 INFO:teuthology.orchestra.run.smithi153.stdout: +315( 59 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.629 INFO:teuthology.orchestra.run.smithi153.stdout: +316( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.629 INFO:teuthology.orchestra.run.smithi153.stdout: +317( 61 mod 256): PUNCH 0x57ab3 thru 0x57e5c (0x3aa bytes) 2024-03-28T23:11:39.629 INFO:teuthology.orchestra.run.smithi153.stdout: +318( 62 mod 256): MAPREAD 0x2a000 thru 0x2adda (0xddb bytes) 2024-03-28T23:11:39.629 INFO:teuthology.orchestra.run.smithi153.stdout: +319( 63 mod 256): READ 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-28T23:11:39.629 INFO:teuthology.orchestra.run.smithi153.stdout: +320( 64 mod 256): MAPREAD 0x2a000 thru 0x2ab0a (0xb0b bytes) 2024-03-28T23:11:39.629 INFO:teuthology.orchestra.run.smithi153.stdout: +321( 65 mod 256): MAPREAD 0x3c000 thru 0x3c0de (0xdf bytes) 2024-03-28T23:11:39.629 INFO:teuthology.orchestra.run.smithi153.stdout: +322( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.629 INFO:teuthology.orchestra.run.smithi153.stdout: +323( 67 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.629 INFO:teuthology.orchestra.run.smithi153.stdout: +324( 68 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.629 INFO:teuthology.orchestra.run.smithi153.stdout: +325( 69 mod 256): MAPWRITE 0x6b000 thru 0x6cbc4 (0x1bc5 bytes) 2024-03-28T23:11:39.629 INFO:teuthology.orchestra.run.smithi153.stdout: +326( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.629 INFO:teuthology.orchestra.run.smithi153.stdout: +327( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.630 INFO:teuthology.orchestra.run.smithi153.stdout: +328( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.630 INFO:teuthology.orchestra.run.smithi153.stdout: +329( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.630 INFO:teuthology.orchestra.run.smithi153.stdout: +330( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.630 INFO:teuthology.orchestra.run.smithi153.stdout: +331( 75 mod 256): MAPWRITE 0x3f000 thru 0x40d69 (0x1d6a bytes) 2024-03-28T23:11:39.630 INFO:teuthology.orchestra.run.smithi153.stdout: +332( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.630 INFO:teuthology.orchestra.run.smithi153.stdout: +333( 77 mod 256): MAPREAD 0x55000 thru 0x56f7b (0x1f7c bytes) 2024-03-28T23:11:39.630 INFO:teuthology.orchestra.run.smithi153.stdout: +334( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.630 INFO:teuthology.orchestra.run.smithi153.stdout: +335( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.630 INFO:teuthology.orchestra.run.smithi153.stdout: +336( 80 mod 256): MAPWRITE 0x22000 thru 0x23633 (0x1634 bytes) 2024-03-28T23:11:39.630 INFO:teuthology.orchestra.run.smithi153.stdout: +337( 81 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.630 INFO:teuthology.orchestra.run.smithi153.stdout: +338( 82 mod 256): MAPREAD 0xa000 thru 0xa4e8 (0x4e9 bytes) 2024-03-28T23:11:39.630 INFO:teuthology.orchestra.run.smithi153.stdout: +339( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.630 INFO:teuthology.orchestra.run.smithi153.stdout: +340( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: +341( 85 mod 256): MAPWRITE 0xb000 thru 0xbbae (0xbaf bytes) 2024-03-28T23:11:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: +342( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: +343( 87 mod 256): TRUNCATE UP from 0x6cbc5 to 0x78000 2024-03-28T23:11:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: +344( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: +345( 89 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: +346( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: +347( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: +348( 92 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: +349( 93 mod 256): PUNCH 0x2a2c8 thru 0x2ac33 (0x96c bytes) 2024-03-28T23:11:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: +350( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: +351( 95 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: +352( 96 mod 256): TRUNCATE DOWN from 0x78000 to 0x39000 2024-03-28T23:11:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: +353( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: +354( 98 mod 256): PUNCH 0x2b9d5 thru 0x2c864 (0xe90 bytes) 2024-03-28T23:11:39.632 INFO:teuthology.orchestra.run.smithi153.stdout: +355( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.632 INFO:teuthology.orchestra.run.smithi153.stdout: +356(100 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.632 INFO:teuthology.orchestra.run.smithi153.stdout: +357(101 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.632 INFO:teuthology.orchestra.run.smithi153.stdout: +358(102 mod 256): MAPWRITE 0x30000 thru 0x31d6a (0x1d6b bytes) 2024-03-28T23:11:39.632 INFO:teuthology.orchestra.run.smithi153.stdout: +359(103 mod 256): PUNCH 0x24f80 thru 0x25fd2 (0x1053 bytes) 2024-03-28T23:11:39.632 INFO:teuthology.orchestra.run.smithi153.stdout: +360(104 mod 256): PUNCH 0xf9ad thru 0x110b8 (0x170c bytes) 2024-03-28T23:11:39.632 INFO:teuthology.orchestra.run.smithi153.stdout: +361(105 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.632 INFO:teuthology.orchestra.run.smithi153.stdout: +362(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.632 INFO:teuthology.orchestra.run.smithi153.stdout: +363(107 mod 256): WRITE 0x53000 thru 0x53fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.632 INFO:teuthology.orchestra.run.smithi153.stdout: +364(108 mod 256): READ 0x35000 thru 0x35fff (0x1000 bytes) 2024-03-28T23:11:39.632 INFO:teuthology.orchestra.run.smithi153.stdout: +365(109 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.632 INFO:teuthology.orchestra.run.smithi153.stdout: +366(110 mod 256): COPY 0x15000 thru 0x15fff (0x1000 bytes) to 0x14000 thru 0x14fff 2024-03-28T23:11:39.632 INFO:teuthology.orchestra.run.smithi153.stdout: +367(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.632 INFO:teuthology.orchestra.run.smithi153.stdout: +368(112 mod 256): PUNCH 0x1c997 thru 0x1e0db (0x1745 bytes) 2024-03-28T23:11:39.633 INFO:teuthology.orchestra.run.smithi153.stdout: +369(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.633 INFO:teuthology.orchestra.run.smithi153.stdout: +370(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.633 INFO:teuthology.orchestra.run.smithi153.stdout: +371(115 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.633 INFO:teuthology.orchestra.run.smithi153.stdout: +372(116 mod 256): TRUNCATE DOWN from 0x54000 to 0x4b000 2024-03-28T23:11:39.633 INFO:teuthology.orchestra.run.smithi153.stdout: +373(117 mod 256): PUNCH 0x16cf9 thru 0x16df6 (0xfe bytes) 2024-03-28T23:11:39.633 INFO:teuthology.orchestra.run.smithi153.stdout: +374(118 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.633 INFO:teuthology.orchestra.run.smithi153.stdout: +375(119 mod 256): MAPWRITE 0x61000 thru 0x61618 (0x619 bytes) 2024-03-28T23:11:39.633 INFO:teuthology.orchestra.run.smithi153.stdout: +376(120 mod 256): PUNCH 0x5ac25 thru 0x5bc97 (0x1073 bytes) 2024-03-28T23:11:39.633 INFO:teuthology.orchestra.run.smithi153.stdout: +377(121 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.633 INFO:teuthology.orchestra.run.smithi153.stdout: +378(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.633 INFO:teuthology.orchestra.run.smithi153.stdout: +379(123 mod 256): MAPREAD 0x5000 thru 0x61d1 (0x11d2 bytes) 2024-03-28T23:11:39.633 INFO:teuthology.orchestra.run.smithi153.stdout: +380(124 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.633 INFO:teuthology.orchestra.run.smithi153.stdout: +381(125 mod 256): PUNCH 0x1e67a thru 0x1f967 (0x12ee bytes) 2024-03-28T23:11:39.633 INFO:teuthology.orchestra.run.smithi153.stdout: +382(126 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.634 INFO:teuthology.orchestra.run.smithi153.stdout: +383(127 mod 256): MAPWRITE 0x72000 thru 0x72abb (0xabc bytes) 2024-03-28T23:11:39.634 INFO:teuthology.orchestra.run.smithi153.stdout: +384(128 mod 256): PUNCH 0x2909b thru 0x2a306 (0x126c bytes) 2024-03-28T23:11:39.634 INFO:teuthology.orchestra.run.smithi153.stdout: +385(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.634 INFO:teuthology.orchestra.run.smithi153.stdout: +386(130 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.634 INFO:teuthology.orchestra.run.smithi153.stdout: +387(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.634 INFO:teuthology.orchestra.run.smithi153.stdout: +388(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.634 INFO:teuthology.orchestra.run.smithi153.stdout: +389(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.634 INFO:teuthology.orchestra.run.smithi153.stdout: +390(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.634 INFO:teuthology.orchestra.run.smithi153.stdout: +391(135 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.634 INFO:teuthology.orchestra.run.smithi153.stdout: +392(136 mod 256): MAPWRITE 0x2c000 thru 0x2da76 (0x1a77 bytes) 2024-03-28T23:11:39.634 INFO:teuthology.orchestra.run.smithi153.stdout: +393(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.634 INFO:teuthology.orchestra.run.smithi153.stdout: +394(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.634 INFO:teuthology.orchestra.run.smithi153.stdout: +395(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +396(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +397(141 mod 256): PUNCH 0x1bd99 thru 0x1bf4b (0x1b3 bytes) 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +398(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +399(143 mod 256): PUNCH 0x1f74a thru 0x20abb (0x1372 bytes) 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +400(144 mod 256): MAPWRITE 0x1a000 thru 0x1b696 (0x1697 bytes) 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +401(145 mod 256): MAPREAD 0x8000 thru 0x94d9 (0x14da bytes) 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +402(146 mod 256): MAPWRITE 0x4d000 thru 0x4da38 (0xa39 bytes) 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +403(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +404(148 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +405(149 mod 256): TRUNCATE DOWN from 0x72abc to 0x54000 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +406(150 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +407(151 mod 256): MAPREAD 0x8000 thru 0x9817 (0x1818 bytes) 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +408(152 mod 256): WRITE 0x76000 thru 0x76fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +409(153 mod 256): MAPWRITE 0x17000 thru 0x18827 (0x1828 bytes) 2024-03-28T23:11:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: +410(154 mod 256): MAPWRITE 0x1000 thru 0x1024 (0x25 bytes) 2024-03-28T23:11:39.636 INFO:teuthology.orchestra.run.smithi153.stdout: +411(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.636 INFO:teuthology.orchestra.run.smithi153.stdout: +412(156 mod 256): PUNCH 0x3a493 thru 0x3af64 (0xad2 bytes) 2024-03-28T23:11:39.636 INFO:teuthology.orchestra.run.smithi153.stdout: +413(157 mod 256): PUNCH 0x37ac thru 0x38ab (0x100 bytes) 2024-03-28T23:11:39.636 INFO:teuthology.orchestra.run.smithi153.stdout: +414(158 mod 256): TRUNCATE DOWN from 0x77000 to 0x3b000 2024-03-28T23:11:39.636 INFO:teuthology.orchestra.run.smithi153.stdout: +415(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.636 INFO:teuthology.orchestra.run.smithi153.stdout: +416(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.636 INFO:teuthology.orchestra.run.smithi153.stdout: +417(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.636 INFO:teuthology.orchestra.run.smithi153.stdout: +418(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.636 INFO:teuthology.orchestra.run.smithi153.stdout: +419(163 mod 256): TRUNCATE DOWN from 0x3b000 to 0x29000 ******WWWW 2024-03-28T23:11:39.636 INFO:teuthology.orchestra.run.smithi153.stdout: +420(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.636 INFO:teuthology.orchestra.run.smithi153.stdout: +421(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.636 INFO:teuthology.orchestra.run.smithi153.stdout: +422(166 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x67000 thru 0x67fff 2024-03-28T23:11:39.636 INFO:teuthology.orchestra.run.smithi153.stdout: +423(167 mod 256): READ 0x58000 thru 0x58fff (0x1000 bytes) 2024-03-28T23:11:39.636 INFO:teuthology.orchestra.run.smithi153.stdout: +424(168 mod 256): MAPWRITE 0x61000 thru 0x62b12 (0x1b13 bytes) 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +425(169 mod 256): TRUNCATE DOWN from 0x68000 to 0x2b000 ******WWWW 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +426(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +427(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +428(172 mod 256): COPY 0x9000 thru 0x9fff (0x1000 bytes) to 0x68000 thru 0x68fff 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +429(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +430(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +431(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +432(176 mod 256): MAPWRITE 0x58000 thru 0x597f8 (0x17f9 bytes) 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +433(177 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +434(178 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +435(179 mod 256): TRUNCATE DOWN from 0x69000 to 0x62000 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +436(180 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +437(181 mod 256): TRUNCATE DOWN from 0x62000 to 0x4e000 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +438(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.637 INFO:teuthology.orchestra.run.smithi153.stdout: +439(183 mod 256): COPY 0x20000 thru 0x20fff (0x1000 bytes) to 0x72000 thru 0x72fff 2024-03-28T23:11:39.638 INFO:teuthology.orchestra.run.smithi153.stdout: +440(184 mod 256): PUNCH 0x60bba thru 0x62953 (0x1d9a bytes) 2024-03-28T23:11:39.638 INFO:teuthology.orchestra.run.smithi153.stdout: +441(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.638 INFO:teuthology.orchestra.run.smithi153.stdout: +442(186 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.638 INFO:teuthology.orchestra.run.smithi153.stdout: +443(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.638 INFO:teuthology.orchestra.run.smithi153.stdout: +444(188 mod 256): READ 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-28T23:11:39.638 INFO:teuthology.orchestra.run.smithi153.stdout: +445(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.638 INFO:teuthology.orchestra.run.smithi153.stdout: +446(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.638 INFO:teuthology.orchestra.run.smithi153.stdout: +447(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.638 INFO:teuthology.orchestra.run.smithi153.stdout: +448(192 mod 256): TRUNCATE DOWN from 0x73000 to 0x60000 2024-03-28T23:11:39.638 INFO:teuthology.orchestra.run.smithi153.stdout: +449(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.638 INFO:teuthology.orchestra.run.smithi153.stdout: +450(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.638 INFO:teuthology.orchestra.run.smithi153.stdout: +451(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.638 INFO:teuthology.orchestra.run.smithi153.stdout: +452(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.638 INFO:teuthology.orchestra.run.smithi153.stdout: +453(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.639 INFO:teuthology.orchestra.run.smithi153.stdout: +454(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.639 INFO:teuthology.orchestra.run.smithi153.stdout: +455(199 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.639 INFO:teuthology.orchestra.run.smithi153.stdout: +456(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.639 INFO:teuthology.orchestra.run.smithi153.stdout: +457(201 mod 256): COPY 0x1d000 thru 0x1dfff (0x1000 bytes) to 0x29000 thru 0x29fff 2024-03-28T23:11:39.639 INFO:teuthology.orchestra.run.smithi153.stdout: +458(202 mod 256): PUNCH 0x4c01a thru 0x4d716 (0x16fd bytes) 2024-03-28T23:11:39.639 INFO:teuthology.orchestra.run.smithi153.stdout: +459(203 mod 256): TRUNCATE DOWN from 0x60000 to 0x2d000 ******WWWW 2024-03-28T23:11:39.639 INFO:teuthology.orchestra.run.smithi153.stdout: +460(204 mod 256): MAPWRITE 0x68000 thru 0x68bd9 (0xbda bytes) 2024-03-28T23:11:39.639 INFO:teuthology.orchestra.run.smithi153.stdout: +461(205 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.639 INFO:teuthology.orchestra.run.smithi153.stdout: +462(206 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.639 INFO:teuthology.orchestra.run.smithi153.stdout: +463(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.639 INFO:teuthology.orchestra.run.smithi153.stdout: +464(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.639 INFO:teuthology.orchestra.run.smithi153.stdout: +465(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.639 INFO:teuthology.orchestra.run.smithi153.stdout: +466(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.639 INFO:teuthology.orchestra.run.smithi153.stdout: +467(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.640 INFO:teuthology.orchestra.run.smithi153.stdout: +468(212 mod 256): TRUNCATE DOWN from 0x68bda to 0x1c000 ******WWWW 2024-03-28T23:11:39.640 INFO:teuthology.orchestra.run.smithi153.stdout: +469(213 mod 256): MAPREAD 0xe000 thru 0xecef (0xcf0 bytes) 2024-03-28T23:11:39.640 INFO:teuthology.orchestra.run.smithi153.stdout: +470(214 mod 256): MAPWRITE 0x41000 thru 0x41342 (0x343 bytes) 2024-03-28T23:11:39.640 INFO:teuthology.orchestra.run.smithi153.stdout: +471(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.640 INFO:teuthology.orchestra.run.smithi153.stdout: +472(216 mod 256): MAPWRITE 0x4e000 thru 0x4e7c6 (0x7c7 bytes) 2024-03-28T23:11:39.640 INFO:teuthology.orchestra.run.smithi153.stdout: +473(217 mod 256): TRUNCATE DOWN from 0x4e7c7 to 0x2e000 ******WWWW 2024-03-28T23:11:39.640 INFO:teuthology.orchestra.run.smithi153.stdout: +474(218 mod 256): TRUNCATE UP from 0x2e000 to 0x6c000 ******WWWW 2024-03-28T23:11:39.640 INFO:teuthology.orchestra.run.smithi153.stdout: +475(219 mod 256): COPY 0x8000 thru 0x8fff (0x1000 bytes) to 0x6b000 thru 0x6bfff 2024-03-28T23:11:39.640 INFO:teuthology.orchestra.run.smithi153.stdout: +476(220 mod 256): WRITE 0xb000 thru 0xbfff (0x1000 bytes) 2024-03-28T23:11:39.640 INFO:teuthology.orchestra.run.smithi153.stdout: +477(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.640 INFO:teuthology.orchestra.run.smithi153.stdout: +478(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: +479(223 mod 256): READ 0x30000 thru 0x30fff (0x1000 bytes) 2024-03-28T23:11:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: +480(224 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: +481(225 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: +482(226 mod 256): PUNCH 0xa403 thru 0xb8ae (0x14ac bytes) 2024-03-28T23:11:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: +483(227 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: +484(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: +485(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: +486(230 mod 256): MAPWRITE 0x13000 thru 0x13fc4 (0xfc5 bytes) 2024-03-28T23:11:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: +487(231 mod 256): PUNCH 0x5630 thru 0x5ec6 (0x897 bytes) 2024-03-28T23:11:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: +488(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: +489(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: +490(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: +491(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: +492(236 mod 256): WRITE 0x24000 thru 0x24fff (0x1000 bytes) 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +493(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +494(238 mod 256): WRITE 0x73000 thru 0x73fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +495(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +496(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +497(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +498(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +499(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +500(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +501(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +502(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +503(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +504(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +505(249 mod 256): TRUNCATE DOWN from 0x74000 to 0x1b000 ******WWWW 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +506(250 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.642 INFO:teuthology.orchestra.run.smithi153.stdout: +507(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.643 INFO:teuthology.orchestra.run.smithi153.stdout: +508(252 mod 256): MAPREAD 0x5000 thru 0x6c2e (0x1c2f bytes) 2024-03-28T23:11:39.643 INFO:teuthology.orchestra.run.smithi153.stdout: +509(253 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.643 INFO:teuthology.orchestra.run.smithi153.stdout: +510(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.643 INFO:teuthology.orchestra.run.smithi153.stdout: +511(255 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.643 INFO:teuthology.orchestra.run.smithi153.stdout: +512( 0 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.643 INFO:teuthology.orchestra.run.smithi153.stdout: +513( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.643 INFO:teuthology.orchestra.run.smithi153.stdout: +514( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.643 INFO:teuthology.orchestra.run.smithi153.stdout: +515( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.643 INFO:teuthology.orchestra.run.smithi153.stdout: +516( 4 mod 256): COPY 0x15000 thru 0x15fff (0x1000 bytes) to 0x50000 thru 0x50fff 2024-03-28T23:11:39.643 INFO:teuthology.orchestra.run.smithi153.stdout: +517( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.643 INFO:teuthology.orchestra.run.smithi153.stdout: +518( 6 mod 256): MAPWRITE 0xa000 thru 0xa6c8 (0x6c9 bytes) 2024-03-28T23:11:39.643 INFO:teuthology.orchestra.run.smithi153.stdout: +519( 7 mod 256): MAPREAD 0x4e000 thru 0x4eede (0xedf bytes) 2024-03-28T23:11:39.643 INFO:teuthology.orchestra.run.smithi153.stdout: +520( 8 mod 256): PUNCH 0x4a7a thru 0x5da7 (0x132e bytes) 2024-03-28T23:11:39.643 INFO:teuthology.orchestra.run.smithi153.stdout: +521( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.644 INFO:teuthology.orchestra.run.smithi153.stdout: +522( 10 mod 256): WRITE 0x13000 thru 0x13fff (0x1000 bytes) 2024-03-28T23:11:39.644 INFO:teuthology.orchestra.run.smithi153.stdout: +523( 11 mod 256): MAPWRITE 0x6000 thru 0x7f4b (0x1f4c bytes) 2024-03-28T23:11:39.644 INFO:teuthology.orchestra.run.smithi153.stdout: +524( 12 mod 256): MAPWRITE 0x62000 thru 0x63a1f (0x1a20 bytes) 2024-03-28T23:11:39.644 INFO:teuthology.orchestra.run.smithi153.stdout: +525( 13 mod 256): TRUNCATE DOWN from 0x63a20 to 0x5a000 2024-03-28T23:11:39.644 INFO:teuthology.orchestra.run.smithi153.stdout: +526( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.644 INFO:teuthology.orchestra.run.smithi153.stdout: +527( 15 mod 256): WRITE 0x74000 thru 0x74fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.644 INFO:teuthology.orchestra.run.smithi153.stdout: +528( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.644 INFO:teuthology.orchestra.run.smithi153.stdout: +529( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.644 INFO:teuthology.orchestra.run.smithi153.stdout: +530( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.644 INFO:teuthology.orchestra.run.smithi153.stdout: +531( 19 mod 256): TRUNCATE DOWN from 0x75000 to 0x5000 ******WWWW 2024-03-28T23:11:39.644 INFO:teuthology.orchestra.run.smithi153.stdout: +532( 20 mod 256): PUNCH 0xde4 thru 0x1f88 (0x11a5 bytes) 2024-03-28T23:11:39.644 INFO:teuthology.orchestra.run.smithi153.stdout: +533( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.644 INFO:teuthology.orchestra.run.smithi153.stdout: +534( 22 mod 256): READ 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-28T23:11:39.644 INFO:teuthology.orchestra.run.smithi153.stdout: +535( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.645 INFO:teuthology.orchestra.run.smithi153.stdout: +536( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.645 INFO:teuthology.orchestra.run.smithi153.stdout: +537( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.645 INFO:teuthology.orchestra.run.smithi153.stdout: +538( 26 mod 256): WRITE 0x53000 thru 0x53fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.645 INFO:teuthology.orchestra.run.smithi153.stdout: +539( 27 mod 256): PUNCH 0x18fd7 thru 0x192f7 (0x321 bytes) 2024-03-28T23:11:39.645 INFO:teuthology.orchestra.run.smithi153.stdout: +540( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.645 INFO:teuthology.orchestra.run.smithi153.stdout: +541( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.645 INFO:teuthology.orchestra.run.smithi153.stdout: +542( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.645 INFO:teuthology.orchestra.run.smithi153.stdout: +543( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.645 INFO:teuthology.orchestra.run.smithi153.stdout: +544( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.645 INFO:teuthology.orchestra.run.smithi153.stdout: +545( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.645 INFO:teuthology.orchestra.run.smithi153.stdout: +546( 34 mod 256): MAPWRITE 0x27000 thru 0x28867 (0x1868 bytes) 2024-03-28T23:11:39.645 INFO:teuthology.orchestra.run.smithi153.stdout: +547( 35 mod 256): COPY 0x51000 thru 0x51fff (0x1000 bytes) to 0x47000 thru 0x47fff 2024-03-28T23:11:39.645 INFO:teuthology.orchestra.run.smithi153.stdout: +548( 36 mod 256): MAPREAD 0xb000 thru 0xb942 (0x943 bytes) 2024-03-28T23:11:39.645 INFO:teuthology.orchestra.run.smithi153.stdout: +549( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +550( 38 mod 256): MAPWRITE 0x5b000 thru 0x5b671 (0x672 bytes) 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +551( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +552( 40 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +553( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +554( 42 mod 256): MAPWRITE 0x19000 thru 0x19548 (0x549 bytes) 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +555( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +556( 44 mod 256): READ 0x1a000 thru 0x1afff (0x1000 bytes) 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +557( 45 mod 256): WRITE 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +558( 46 mod 256): WRITE 0x64000 thru 0x64fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +559( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +560( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +561( 49 mod 256): COPY 0x13000 thru 0x13fff (0x1000 bytes) to 0x57000 thru 0x57fff 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +562( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +563( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: +564( 52 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.647 INFO:teuthology.orchestra.run.smithi153.stdout: +565( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.647 INFO:teuthology.orchestra.run.smithi153.stdout: +566( 54 mod 256): MAPREAD 0x58000 thru 0x59f77 (0x1f78 bytes) 2024-03-28T23:11:39.647 INFO:teuthology.orchestra.run.smithi153.stdout: +567( 55 mod 256): WRITE 0x14000 thru 0x14fff (0x1000 bytes) 2024-03-28T23:11:39.647 INFO:teuthology.orchestra.run.smithi153.stdout: +568( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.647 INFO:teuthology.orchestra.run.smithi153.stdout: +569( 57 mod 256): MAPWRITE 0x53000 thru 0x53ff3 (0xff4 bytes) 2024-03-28T23:11:39.647 INFO:teuthology.orchestra.run.smithi153.stdout: +570( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.647 INFO:teuthology.orchestra.run.smithi153.stdout: +571( 59 mod 256): MAPREAD 0x4b000 thru 0x4b4c3 (0x4c4 bytes) 2024-03-28T23:11:39.647 INFO:teuthology.orchestra.run.smithi153.stdout: +572( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.647 INFO:teuthology.orchestra.run.smithi153.stdout: +573( 61 mod 256): COPY 0x5a000 thru 0x5afff (0x1000 bytes) to 0x5b000 thru 0x5bfff 2024-03-28T23:11:39.647 INFO:teuthology.orchestra.run.smithi153.stdout: +574( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.647 INFO:teuthology.orchestra.run.smithi153.stdout: +575( 63 mod 256): MAPWRITE 0x3e000 thru 0x3f7cc (0x17cd bytes) 2024-03-28T23:11:39.647 INFO:teuthology.orchestra.run.smithi153.stdout: +576( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.647 INFO:teuthology.orchestra.run.smithi153.stdout: +577( 65 mod 256): COPY 0x30000 thru 0x30fff (0x1000 bytes) to 0xf000 thru 0xffff 2024-03-28T23:11:39.647 INFO:teuthology.orchestra.run.smithi153.stdout: +578( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +579( 67 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +580( 68 mod 256): PUNCH 0x152eb thru 0x15f1c (0xc32 bytes) 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +581( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +582( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +583( 71 mod 256): COPY 0x0 thru 0xfff (0x1000 bytes) to 0x55000 thru 0x55fff 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +584( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +585( 73 mod 256): PUNCH 0x29fbd thru 0x2b131 (0x1175 bytes) 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +586( 74 mod 256): PUNCH 0x1b0be thru 0x1c195 (0x10d8 bytes) 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +587( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +588( 76 mod 256): PUNCH 0x29e10 thru 0x29f3c (0x12d bytes) 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +589( 77 mod 256): TRUNCATE DOWN from 0x65000 to 0x35000 ******WWWW 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +590( 78 mod 256): TRUNCATE UP from 0x35000 to 0x4d000 ******WWWW 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +591( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +592( 80 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.648 INFO:teuthology.orchestra.run.smithi153.stdout: +593( 81 mod 256): READ 0x4b000 thru 0x4bfff (0x1000 bytes) 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +594( 82 mod 256): PUNCH 0x34594 thru 0x3548d (0xefa bytes) 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +595( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +596( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +597( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +598( 86 mod 256): WRITE 0x74000 thru 0x74fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +599( 87 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +600( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +601( 89 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +602( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +603( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +604( 92 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +605( 93 mod 256): WRITE 0x53000 thru 0x53fff (0x1000 bytes) 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +606( 94 mod 256): MAPWRITE 0x45000 thru 0x468e2 (0x18e3 bytes) 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +607( 95 mod 256): MAPWRITE 0x23000 thru 0x239c4 (0x9c5 bytes) 2024-03-28T23:11:39.649 INFO:teuthology.orchestra.run.smithi153.stdout: +608( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.650 INFO:teuthology.orchestra.run.smithi153.stdout: +609( 97 mod 256): MAPWRITE 0x2c000 thru 0x2c865 (0x866 bytes) 2024-03-28T23:11:39.650 INFO:teuthology.orchestra.run.smithi153.stdout: +610( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.650 INFO:teuthology.orchestra.run.smithi153.stdout: +611( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.650 INFO:teuthology.orchestra.run.smithi153.stdout: +612(100 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.650 INFO:teuthology.orchestra.run.smithi153.stdout: +613(101 mod 256): MAPREAD 0x5c000 thru 0x5ce4d (0xe4e bytes) 2024-03-28T23:11:39.650 INFO:teuthology.orchestra.run.smithi153.stdout: +614(102 mod 256): MAPREAD 0x6f000 thru 0x6fd24 (0xd25 bytes) 2024-03-28T23:11:39.650 INFO:teuthology.orchestra.run.smithi153.stdout: +615(103 mod 256): MAPREAD 0x33000 thru 0x34ca2 (0x1ca3 bytes) 2024-03-28T23:11:39.650 INFO:teuthology.orchestra.run.smithi153.stdout: +616(104 mod 256): WRITE 0x23000 thru 0x23fff (0x1000 bytes) 2024-03-28T23:11:39.650 INFO:teuthology.orchestra.run.smithi153.stdout: +617(105 mod 256): PUNCH 0x1070f thru 0x11117 (0xa09 bytes) 2024-03-28T23:11:39.650 INFO:teuthology.orchestra.run.smithi153.stdout: +618(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.650 INFO:teuthology.orchestra.run.smithi153.stdout: +619(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.650 INFO:teuthology.orchestra.run.smithi153.stdout: +620(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.650 INFO:teuthology.orchestra.run.smithi153.stdout: +621(109 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.650 INFO:teuthology.orchestra.run.smithi153.stdout: +622(110 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +623(111 mod 256): PUNCH 0x3c3cf thru 0x3cfa7 (0xbd9 bytes) 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +624(112 mod 256): TRUNCATE DOWN from 0x75000 to 0xc000 ******WWWW 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +625(113 mod 256): MAPWRITE 0x6a000 thru 0x6b75f (0x1760 bytes) 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +626(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +627(115 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +628(116 mod 256): TRUNCATE DOWN from 0x6b760 to 0x40000 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +629(117 mod 256): MAPREAD 0x12000 thru 0x13703 (0x1704 bytes) 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +630(118 mod 256): TRUNCATE UP from 0x40000 to 0x47000 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +631(119 mod 256): PUNCH 0x37190 thru 0x386c8 (0x1539 bytes) ******PPPP 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +632(120 mod 256): MAPREAD 0x30000 thru 0x3108e (0x108f bytes) 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +633(121 mod 256): WRITE 0x72000 thru 0x72fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +634(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +635(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +636(124 mod 256): PUNCH 0x6abe0 thru 0x6c3f2 (0x1813 bytes) 2024-03-28T23:11:39.651 INFO:teuthology.orchestra.run.smithi153.stdout: +637(125 mod 256): READ 0x68000 thru 0x68fff (0x1000 bytes) 2024-03-28T23:11:39.652 INFO:teuthology.orchestra.run.smithi153.stdout: +638(126 mod 256): READ 0x28000 thru 0x28fff (0x1000 bytes) 2024-03-28T23:11:39.652 INFO:teuthology.orchestra.run.smithi153.stdout: +639(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.652 INFO:teuthology.orchestra.run.smithi153.stdout: +640(128 mod 256): MAPREAD 0x32000 thru 0x33f39 (0x1f3a bytes) 2024-03-28T23:11:39.652 INFO:teuthology.orchestra.run.smithi153.stdout: +641(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.652 INFO:teuthology.orchestra.run.smithi153.stdout: +642(130 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.652 INFO:teuthology.orchestra.run.smithi153.stdout: +643(131 mod 256): MAPWRITE 0x61000 thru 0x614b9 (0x4ba bytes) 2024-03-28T23:11:39.652 INFO:teuthology.orchestra.run.smithi153.stdout: +644(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.652 INFO:teuthology.orchestra.run.smithi153.stdout: +645(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.652 INFO:teuthology.orchestra.run.smithi153.stdout: +646(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.652 INFO:teuthology.orchestra.run.smithi153.stdout: +647(135 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.652 INFO:teuthology.orchestra.run.smithi153.stdout: +648(136 mod 256): MAPWRITE 0x4e000 thru 0x4f002 (0x1003 bytes) 2024-03-28T23:11:39.652 INFO:teuthology.orchestra.run.smithi153.stdout: +649(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.652 INFO:teuthology.orchestra.run.smithi153.stdout: +650(138 mod 256): READ 0x25000 thru 0x25fff (0x1000 bytes) 2024-03-28T23:11:39.652 INFO:teuthology.orchestra.run.smithi153.stdout: +651(139 mod 256): PUNCH 0x3ebeb thru 0x3fdf4 (0x120a bytes) 2024-03-28T23:11:39.653 INFO:teuthology.orchestra.run.smithi153.stdout: +652(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.653 INFO:teuthology.orchestra.run.smithi153.stdout: +653(141 mod 256): MAPREAD 0x2000 thru 0x2a1a (0xa1b bytes) 2024-03-28T23:11:39.653 INFO:teuthology.orchestra.run.smithi153.stdout: +654(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.653 INFO:teuthology.orchestra.run.smithi153.stdout: +655(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.653 INFO:teuthology.orchestra.run.smithi153.stdout: +656(144 mod 256): COPY 0xd000 thru 0xdfff (0x1000 bytes) to 0x42000 thru 0x42fff 2024-03-28T23:11:39.653 INFO:teuthology.orchestra.run.smithi153.stdout: +657(145 mod 256): PUNCH 0x3abcf thru 0x3b7f1 (0xc23 bytes) 2024-03-28T23:11:39.653 INFO:teuthology.orchestra.run.smithi153.stdout: +658(146 mod 256): MAPREAD 0x13000 thru 0x14d2a (0x1d2b bytes) 2024-03-28T23:11:39.653 INFO:teuthology.orchestra.run.smithi153.stdout: +659(147 mod 256): COPY 0x23000 thru 0x23fff (0x1000 bytes) to 0x4d000 thru 0x4dfff 2024-03-28T23:11:39.653 INFO:teuthology.orchestra.run.smithi153.stdout: +660(148 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.653 INFO:teuthology.orchestra.run.smithi153.stdout: +661(149 mod 256): MAPREAD 0x21000 thru 0x216f4 (0x6f5 bytes) 2024-03-28T23:11:39.653 INFO:teuthology.orchestra.run.smithi153.stdout: +662(150 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.653 INFO:teuthology.orchestra.run.smithi153.stdout: +663(151 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.653 INFO:teuthology.orchestra.run.smithi153.stdout: +664(152 mod 256): READ 0x2a000 thru 0x2afff (0x1000 bytes) 2024-03-28T23:11:39.653 INFO:teuthology.orchestra.run.smithi153.stdout: +665(153 mod 256): MAPREAD 0x56000 thru 0x56f92 (0xf93 bytes) 2024-03-28T23:11:39.654 INFO:teuthology.orchestra.run.smithi153.stdout: +666(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.654 INFO:teuthology.orchestra.run.smithi153.stdout: +667(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.654 INFO:teuthology.orchestra.run.smithi153.stdout: +668(156 mod 256): MAPWRITE 0x50000 thru 0x516ca (0x16cb bytes) 2024-03-28T23:11:39.654 INFO:teuthology.orchestra.run.smithi153.stdout: +669(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.654 INFO:teuthology.orchestra.run.smithi153.stdout: +670(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.654 INFO:teuthology.orchestra.run.smithi153.stdout: +671(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.654 INFO:teuthology.orchestra.run.smithi153.stdout: +672(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.654 INFO:teuthology.orchestra.run.smithi153.stdout: +673(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.654 INFO:teuthology.orchestra.run.smithi153.stdout: +674(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.654 INFO:teuthology.orchestra.run.smithi153.stdout: +675(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.654 INFO:teuthology.orchestra.run.smithi153.stdout: +676(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.654 INFO:teuthology.orchestra.run.smithi153.stdout: +677(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.654 INFO:teuthology.orchestra.run.smithi153.stdout: +678(166 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.655 INFO:teuthology.orchestra.run.smithi153.stdout: +679(167 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.655 INFO:teuthology.orchestra.run.smithi153.stdout: +680(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.655 INFO:teuthology.orchestra.run.smithi153.stdout: +681(169 mod 256): PUNCH 0x492a4 thru 0x4a6cd (0x142a bytes) 2024-03-28T23:11:39.655 INFO:teuthology.orchestra.run.smithi153.stdout: +682(170 mod 256): READ 0x59000 thru 0x59fff (0x1000 bytes) 2024-03-28T23:11:39.660 INFO:teuthology.orchestra.run.smithi153.stdout: +683(171 mod 256): MAPREAD 0x65000 thru 0x66022 (0x1023 bytes) 2024-03-28T23:11:39.660 INFO:teuthology.orchestra.run.smithi153.stdout: +684(172 mod 256): READ 0x38000 thru 0x38fff (0x1000 bytes) 2024-03-28T23:11:39.660 INFO:teuthology.orchestra.run.smithi153.stdout: +685(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.661 INFO:teuthology.orchestra.run.smithi153.stdout: +686(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.661 INFO:teuthology.orchestra.run.smithi153.stdout: +687(175 mod 256): PUNCH 0xc4a0 thru 0xd099 (0xbfa bytes) 2024-03-28T23:11:39.661 INFO:teuthology.orchestra.run.smithi153.stdout: +688(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.661 INFO:teuthology.orchestra.run.smithi153.stdout: +689(177 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.661 INFO:teuthology.orchestra.run.smithi153.stdout: +690(178 mod 256): WRITE 0x13000 thru 0x13fff (0x1000 bytes) 2024-03-28T23:11:39.661 INFO:teuthology.orchestra.run.smithi153.stdout: +691(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.661 INFO:teuthology.orchestra.run.smithi153.stdout: +692(180 mod 256): PUNCH 0x49dff thru 0x4b7bb (0x19bd bytes) 2024-03-28T23:11:39.661 INFO:teuthology.orchestra.run.smithi153.stdout: +693(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.661 INFO:teuthology.orchestra.run.smithi153.stdout: +694(182 mod 256): MAPREAD 0x28000 thru 0x29ea1 (0x1ea2 bytes) 2024-03-28T23:11:39.661 INFO:teuthology.orchestra.run.smithi153.stdout: +695(183 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.661 INFO:teuthology.orchestra.run.smithi153.stdout: +696(184 mod 256): TRUNCATE DOWN from 0x73000 to 0x1c000 ******WWWW 2024-03-28T23:11:39.661 INFO:teuthology.orchestra.run.smithi153.stdout: +697(185 mod 256): TRUNCATE UP from 0x1c000 to 0x2e000 2024-03-28T23:11:39.661 INFO:teuthology.orchestra.run.smithi153.stdout: +698(186 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.661 INFO:teuthology.orchestra.run.smithi153.stdout: +699(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.662 INFO:teuthology.orchestra.run.smithi153.stdout: +700(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.662 INFO:teuthology.orchestra.run.smithi153.stdout: +701(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.662 INFO:teuthology.orchestra.run.smithi153.stdout: +702(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.662 INFO:teuthology.orchestra.run.smithi153.stdout: +703(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.662 INFO:teuthology.orchestra.run.smithi153.stdout: +704(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.662 INFO:teuthology.orchestra.run.smithi153.stdout: +705(193 mod 256): TRUNCATE UP from 0x2e000 to 0x3d000 ******WWWW 2024-03-28T23:11:39.662 INFO:teuthology.orchestra.run.smithi153.stdout: +706(194 mod 256): PUNCH 0x10003 thru 0x11c1c (0x1c1a bytes) 2024-03-28T23:11:39.662 INFO:teuthology.orchestra.run.smithi153.stdout: +707(195 mod 256): COPY 0x1d000 thru 0x1dfff (0x1000 bytes) to 0x31000 thru 0x31fff 2024-03-28T23:11:39.662 INFO:teuthology.orchestra.run.smithi153.stdout: +708(196 mod 256): WRITE 0x60000 thru 0x60fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.662 INFO:teuthology.orchestra.run.smithi153.stdout: +709(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.662 INFO:teuthology.orchestra.run.smithi153.stdout: +710(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.662 INFO:teuthology.orchestra.run.smithi153.stdout: +711(199 mod 256): WRITE 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-28T23:11:39.662 INFO:teuthology.orchestra.run.smithi153.stdout: +712(200 mod 256): MAPREAD 0x19000 thru 0x1a043 (0x1044 bytes) 2024-03-28T23:11:39.663 INFO:teuthology.orchestra.run.smithi153.stdout: +713(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.663 INFO:teuthology.orchestra.run.smithi153.stdout: +714(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.663 INFO:teuthology.orchestra.run.smithi153.stdout: +715(203 mod 256): WRITE 0x35000 thru 0x35fff (0x1000 bytes) 2024-03-28T23:11:39.663 INFO:teuthology.orchestra.run.smithi153.stdout: +716(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.663 INFO:teuthology.orchestra.run.smithi153.stdout: +717(205 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.663 INFO:teuthology.orchestra.run.smithi153.stdout: +718(206 mod 256): MAPREAD 0x5d000 thru 0x5d0e1 (0xe2 bytes) 2024-03-28T23:11:39.663 INFO:teuthology.orchestra.run.smithi153.stdout: +719(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.663 INFO:teuthology.orchestra.run.smithi153.stdout: +720(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.663 INFO:teuthology.orchestra.run.smithi153.stdout: +721(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.663 INFO:teuthology.orchestra.run.smithi153.stdout: +722(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.663 INFO:teuthology.orchestra.run.smithi153.stdout: +723(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.663 INFO:teuthology.orchestra.run.smithi153.stdout: +724(212 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.663 INFO:teuthology.orchestra.run.smithi153.stdout: +725(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.663 INFO:teuthology.orchestra.run.smithi153.stdout: +726(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +727(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +728(216 mod 256): MAPREAD 0x36000 thru 0x36280 (0x281 bytes) 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +729(217 mod 256): READ 0x4b000 thru 0x4bfff (0x1000 bytes) 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +730(218 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +731(219 mod 256): MAPREAD 0xe000 thru 0xf96b (0x196c bytes) 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +732(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +733(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +734(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +735(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +736(224 mod 256): PUNCH 0xb9e4 thru 0xd140 (0x175d bytes) 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +737(225 mod 256): PUNCH 0x2681c thru 0x286fe (0x1ee3 bytes) 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +738(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +739(227 mod 256): TRUNCATE DOWN from 0x61000 to 0x34000 ******WWWW 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +740(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.664 INFO:teuthology.orchestra.run.smithi153.stdout: +741(229 mod 256): MAPREAD 0x16000 thru 0x17c4d (0x1c4e bytes) 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +742(230 mod 256): COPY 0x30000 thru 0x30fff (0x1000 bytes) to 0x5a000 thru 0x5afff 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +743(231 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +744(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +745(233 mod 256): TRUNCATE DOWN from 0x5b000 to 0x1d000 ******WWWW 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +746(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +747(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +748(236 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +749(237 mod 256): PUNCH 0x19f9a thru 0x1b698 (0x16ff bytes) 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +750(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +751(239 mod 256): COPY 0xe000 thru 0xefff (0x1000 bytes) to 0x55000 thru 0x55fff 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +752(240 mod 256): TRUNCATE DOWN from 0x56000 to 0x3d000 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +753(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +754(242 mod 256): MAPWRITE 0x19000 thru 0x1a0d2 (0x10d3 bytes) 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +755(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.665 INFO:teuthology.orchestra.run.smithi153.stdout: +756(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.666 INFO:teuthology.orchestra.run.smithi153.stdout: +757(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.666 INFO:teuthology.orchestra.run.smithi153.stdout: +758(246 mod 256): WRITE 0x3e000 thru 0x3efff (0x1000 bytes) HOLE 2024-03-28T23:11:39.666 INFO:teuthology.orchestra.run.smithi153.stdout: +759(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.666 INFO:teuthology.orchestra.run.smithi153.stdout: +760(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.666 INFO:teuthology.orchestra.run.smithi153.stdout: +761(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.666 INFO:teuthology.orchestra.run.smithi153.stdout: +762(250 mod 256): MAPREAD 0xd000 thru 0xde7b (0xe7c bytes) 2024-03-28T23:11:39.666 INFO:teuthology.orchestra.run.smithi153.stdout: +763(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.666 INFO:teuthology.orchestra.run.smithi153.stdout: +764(252 mod 256): TRUNCATE UP from 0x3f000 to 0x73000 2024-03-28T23:11:39.666 INFO:teuthology.orchestra.run.smithi153.stdout: +765(253 mod 256): TRUNCATE DOWN from 0x73000 to 0x42000 2024-03-28T23:11:39.666 INFO:teuthology.orchestra.run.smithi153.stdout: +766(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.666 INFO:teuthology.orchestra.run.smithi153.stdout: +767(255 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.666 INFO:teuthology.orchestra.run.smithi153.stdout: +768( 0 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.666 INFO:teuthology.orchestra.run.smithi153.stdout: +769( 1 mod 256): MAPREAD 0x2d000 thru 0x2dd51 (0xd52 bytes) 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +770( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +771( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +772( 4 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +773( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +774( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +775( 7 mod 256): TRUNCATE DOWN from 0x42000 to 0x41000 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +776( 8 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +777( 9 mod 256): PUNCH 0x2d84a thru 0x2f830 (0x1fe7 bytes) 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +778( 10 mod 256): MAPWRITE 0x68000 thru 0x694cf (0x14d0 bytes) 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +779( 11 mod 256): PUNCH 0x1c91 thru 0x2085 (0x3f5 bytes) 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +780( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +781( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +782( 14 mod 256): MAPWRITE 0x62000 thru 0x63353 (0x1354 bytes) 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +783( 15 mod 256): TRUNCATE UP from 0x694d0 to 0x73000 2024-03-28T23:11:39.667 INFO:teuthology.orchestra.run.smithi153.stdout: +784( 16 mod 256): COPY 0x1c000 thru 0x1cfff (0x1000 bytes) to 0x4a000 thru 0x4afff 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +785( 17 mod 256): TRUNCATE DOWN from 0x73000 to 0x55000 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +786( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +787( 19 mod 256): MAPWRITE 0x5a000 thru 0x5bf85 (0x1f86 bytes) 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +788( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +789( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +790( 22 mod 256): COPY 0x54000 thru 0x54fff (0x1000 bytes) to 0x5c000 thru 0x5cfff 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +791( 23 mod 256): PUNCH 0x50fb7 thru 0x526d6 (0x1720 bytes) 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +792( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +793( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +794( 26 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +795( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +796( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +797( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +798( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.668 INFO:teuthology.orchestra.run.smithi153.stdout: +799( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +800( 32 mod 256): READ 0x11000 thru 0x11fff (0x1000 bytes) 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +801( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +802( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +803( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +804( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +805( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +806( 38 mod 256): TRUNCATE UP from 0x5d000 to 0x6c000 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +807( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +808( 40 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +809( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +810( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +811( 43 mod 256): TRUNCATE DOWN from 0x6c000 to 0x2a000 ******WWWW 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +812( 44 mod 256): MAPWRITE 0x40000 thru 0x40cdf (0xce0 bytes) 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +813( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +814( 46 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.669 INFO:teuthology.orchestra.run.smithi153.stdout: +815( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.670 INFO:teuthology.orchestra.run.smithi153.stdout: +816( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.670 INFO:teuthology.orchestra.run.smithi153.stdout: +817( 49 mod 256): READ 0x2f000 thru 0x2ffff (0x1000 bytes) 2024-03-28T23:11:39.670 INFO:teuthology.orchestra.run.smithi153.stdout: +818( 50 mod 256): MAPREAD 0x4000 thru 0x41d4 (0x1d5 bytes) 2024-03-28T23:11:39.670 INFO:teuthology.orchestra.run.smithi153.stdout: +819( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.670 INFO:teuthology.orchestra.run.smithi153.stdout: +820( 52 mod 256): MAPWRITE 0x13000 thru 0x14f54 (0x1f55 bytes) 2024-03-28T23:11:39.670 INFO:teuthology.orchestra.run.smithi153.stdout: +821( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.670 INFO:teuthology.orchestra.run.smithi153.stdout: +822( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.670 INFO:teuthology.orchestra.run.smithi153.stdout: +823( 55 mod 256): MAPWRITE 0x79000 thru 0x7a09c (0x109d bytes) 2024-03-28T23:11:39.670 INFO:teuthology.orchestra.run.smithi153.stdout: +824( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.670 INFO:teuthology.orchestra.run.smithi153.stdout: +825( 57 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.670 INFO:teuthology.orchestra.run.smithi153.stdout: +826( 58 mod 256): MAPREAD 0x37000 thru 0x37bf9 (0xbfa bytes) 2024-03-28T23:11:39.670 INFO:teuthology.orchestra.run.smithi153.stdout: +827( 59 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.670 INFO:teuthology.orchestra.run.smithi153.stdout: +828( 60 mod 256): MAPREAD 0x67000 thru 0x67951 (0x952 bytes) 2024-03-28T23:11:39.670 INFO:teuthology.orchestra.run.smithi153.stdout: +829( 61 mod 256): TRUNCATE DOWN from 0x7a09d to 0x26000 ******WWWW 2024-03-28T23:11:39.671 INFO:teuthology.orchestra.run.smithi153.stdout: +830( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.671 INFO:teuthology.orchestra.run.smithi153.stdout: +831( 63 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.671 INFO:teuthology.orchestra.run.smithi153.stdout: +832( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.671 INFO:teuthology.orchestra.run.smithi153.stdout: +833( 65 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.671 INFO:teuthology.orchestra.run.smithi153.stdout: +834( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.671 INFO:teuthology.orchestra.run.smithi153.stdout: +835( 67 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.671 INFO:teuthology.orchestra.run.smithi153.stdout: +836( 68 mod 256): COPY 0x7000 thru 0x7fff (0x1000 bytes) to 0x37000 thru 0x37fff ******EEEE 2024-03-28T23:11:39.671 INFO:teuthology.orchestra.run.smithi153.stdout: +837( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.671 INFO:teuthology.orchestra.run.smithi153.stdout: +838( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.671 INFO:teuthology.orchestra.run.smithi153.stdout: +839( 71 mod 256): PUNCH 0x1c46c thru 0x1d125 (0xcba bytes) 2024-03-28T23:11:39.671 INFO:teuthology.orchestra.run.smithi153.stdout: +840( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.671 INFO:teuthology.orchestra.run.smithi153.stdout: +841( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.671 INFO:teuthology.orchestra.run.smithi153.stdout: +842( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.671 INFO:teuthology.orchestra.run.smithi153.stdout: +843( 75 mod 256): TRUNCATE UP from 0x38000 to 0x55000 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +844( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +845( 77 mod 256): READ 0x3b000 thru 0x3bfff (0x1000 bytes) 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +846( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +847( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +848( 80 mod 256): READ 0x49000 thru 0x49fff (0x1000 bytes) 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +849( 81 mod 256): TRUNCATE UP from 0x55000 to 0x6c000 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +850( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +851( 83 mod 256): PUNCH 0x3c0aa thru 0x3d62b (0x1582 bytes) 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +852( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +853( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +854( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +855( 87 mod 256): COPY 0x3d000 thru 0x3dfff (0x1000 bytes) to 0x66000 thru 0x66fff 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +856( 88 mod 256): TRUNCATE DOWN from 0x6c000 to 0x48000 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +857( 89 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.672 INFO:teuthology.orchestra.run.smithi153.stdout: +858( 90 mod 256): MAPREAD 0x7000 thru 0x8761 (0x1762 bytes) 2024-03-28T23:11:39.673 INFO:teuthology.orchestra.run.smithi153.stdout: +859( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.673 INFO:teuthology.orchestra.run.smithi153.stdout: +860( 92 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.673 INFO:teuthology.orchestra.run.smithi153.stdout: +861( 93 mod 256): COPY 0xb000 thru 0xbfff (0x1000 bytes) to 0x1a000 thru 0x1afff 2024-03-28T23:11:39.673 INFO:teuthology.orchestra.run.smithi153.stdout: +862( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.673 INFO:teuthology.orchestra.run.smithi153.stdout: +863( 95 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.673 INFO:teuthology.orchestra.run.smithi153.stdout: +864( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.673 INFO:teuthology.orchestra.run.smithi153.stdout: +865( 97 mod 256): MAPWRITE 0x72000 thru 0x726de (0x6df bytes) 2024-03-28T23:11:39.673 INFO:teuthology.orchestra.run.smithi153.stdout: +866( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.673 INFO:teuthology.orchestra.run.smithi153.stdout: +867( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.673 INFO:teuthology.orchestra.run.smithi153.stdout: +868(100 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.673 INFO:teuthology.orchestra.run.smithi153.stdout: +869(101 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.673 INFO:teuthology.orchestra.run.smithi153.stdout: +870(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.673 INFO:teuthology.orchestra.run.smithi153.stdout: +871(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.673 INFO:teuthology.orchestra.run.smithi153.stdout: +872(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +873(105 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +874(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +875(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +876(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +877(109 mod 256): READ 0x53000 thru 0x53fff (0x1000 bytes) 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +878(110 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +879(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +880(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +881(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +882(114 mod 256): WRITE 0x5f000 thru 0x5ffff (0x1000 bytes) 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +883(115 mod 256): WRITE 0xf000 thru 0xffff (0x1000 bytes) 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +884(116 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +885(117 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +886(118 mod 256): TRUNCATE DOWN from 0x726df to 0x48000 2024-03-28T23:11:39.674 INFO:teuthology.orchestra.run.smithi153.stdout: +887(119 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +888(120 mod 256): TRUNCATE DOWN from 0x48000 to 0x34000 ******WWWW 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +889(121 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +890(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +891(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +892(124 mod 256): MAPREAD 0x31000 thru 0x31614 (0x615 bytes) 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +893(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +894(126 mod 256): MAPREAD 0x6000 thru 0x62c1 (0x2c2 bytes) 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +895(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +896(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +897(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +898(130 mod 256): MAPREAD 0x5000 thru 0x54ca (0x4cb bytes) 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +899(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +900(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +901(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.675 INFO:teuthology.orchestra.run.smithi153.stdout: +902(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +903(135 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +904(136 mod 256): TRUNCATE UP from 0x34000 to 0x70000 ******WWWW 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +905(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +906(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +907(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +908(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +909(141 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +910(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +911(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +912(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +913(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +914(146 mod 256): COPY 0x35000 thru 0x35fff (0x1000 bytes) to 0x5d000 thru 0x5dfff 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +915(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +916(148 mod 256): PUNCH 0x55393 thru 0x5716c (0x1dda bytes) 2024-03-28T23:11:39.676 INFO:teuthology.orchestra.run.smithi153.stdout: +917(149 mod 256): WRITE 0x78000 thru 0x78fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.677 INFO:teuthology.orchestra.run.smithi153.stdout: +918(150 mod 256): MAPREAD 0x53000 thru 0x5310c (0x10d bytes) 2024-03-28T23:11:39.677 INFO:teuthology.orchestra.run.smithi153.stdout: +919(151 mod 256): TRUNCATE DOWN from 0x79000 to 0x1f000 ******WWWW 2024-03-28T23:11:39.677 INFO:teuthology.orchestra.run.smithi153.stdout: +920(152 mod 256): READ 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-28T23:11:39.677 INFO:teuthology.orchestra.run.smithi153.stdout: +921(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.677 INFO:teuthology.orchestra.run.smithi153.stdout: +922(154 mod 256): COPY 0x4000 thru 0x4fff (0x1000 bytes) to 0x79000 thru 0x79fff 2024-03-28T23:11:39.677 INFO:teuthology.orchestra.run.smithi153.stdout: +923(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.677 INFO:teuthology.orchestra.run.smithi153.stdout: +924(156 mod 256): COPY 0x3d000 thru 0x3dfff (0x1000 bytes) to 0x33000 thru 0x33fff 2024-03-28T23:11:39.677 INFO:teuthology.orchestra.run.smithi153.stdout: +925(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.677 INFO:teuthology.orchestra.run.smithi153.stdout: +926(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.677 INFO:teuthology.orchestra.run.smithi153.stdout: +927(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.677 INFO:teuthology.orchestra.run.smithi153.stdout: +928(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.677 INFO:teuthology.orchestra.run.smithi153.stdout: +929(161 mod 256): PUNCH 0x2b7fe thru 0x2c31e (0xb21 bytes) 2024-03-28T23:11:39.677 INFO:teuthology.orchestra.run.smithi153.stdout: +930(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.677 INFO:teuthology.orchestra.run.smithi153.stdout: +931(163 mod 256): WRITE 0x3c000 thru 0x3cfff (0x1000 bytes) 2024-03-28T23:11:39.678 INFO:teuthology.orchestra.run.smithi153.stdout: +932(164 mod 256): COPY 0x5b000 thru 0x5bfff (0x1000 bytes) to 0xc000 thru 0xcfff 2024-03-28T23:11:39.678 INFO:teuthology.orchestra.run.smithi153.stdout: +933(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.678 INFO:teuthology.orchestra.run.smithi153.stdout: +934(166 mod 256): PUNCH 0x6fef0 thru 0x7021e (0x32f bytes) 2024-03-28T23:11:39.678 INFO:teuthology.orchestra.run.smithi153.stdout: +935(167 mod 256): MAPREAD 0x55000 thru 0x55d20 (0xd21 bytes) 2024-03-28T23:11:39.678 INFO:teuthology.orchestra.run.smithi153.stdout: +936(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.678 INFO:teuthology.orchestra.run.smithi153.stdout: +937(169 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.678 INFO:teuthology.orchestra.run.smithi153.stdout: +938(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.678 INFO:teuthology.orchestra.run.smithi153.stdout: +939(171 mod 256): PUNCH 0x8c56 thru 0xa327 (0x16d2 bytes) 2024-03-28T23:11:39.678 INFO:teuthology.orchestra.run.smithi153.stdout: +940(172 mod 256): MAPREAD 0x29000 thru 0x2ac8b (0x1c8c bytes) 2024-03-28T23:11:39.678 INFO:teuthology.orchestra.run.smithi153.stdout: +941(173 mod 256): TRUNCATE DOWN from 0x7a000 to 0x73000 2024-03-28T23:11:39.678 INFO:teuthology.orchestra.run.smithi153.stdout: +942(174 mod 256): PUNCH 0x49cee thru 0x4a2b0 (0x5c3 bytes) 2024-03-28T23:11:39.678 INFO:teuthology.orchestra.run.smithi153.stdout: +943(175 mod 256): COPY 0x3a000 thru 0x3afff (0x1000 bytes) to 0x2d000 thru 0x2dfff 2024-03-28T23:11:39.678 INFO:teuthology.orchestra.run.smithi153.stdout: +944(176 mod 256): TRUNCATE DOWN from 0x73000 to 0x45000 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +945(177 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +946(178 mod 256): COPY 0x43000 thru 0x43fff (0x1000 bytes) to 0x3b000 thru 0x3bfff 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +947(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +948(180 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +949(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +950(182 mod 256): WRITE 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +951(183 mod 256): MAPWRITE 0x49000 thru 0x49900 (0x901 bytes) 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +952(184 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x3b000 thru 0x3bfff 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +953(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +954(186 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +955(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +956(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +957(189 mod 256): MAPWRITE 0x72000 thru 0x7266f (0x670 bytes) 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +958(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.679 INFO:teuthology.orchestra.run.smithi153.stdout: +959(191 mod 256): TRUNCATE DOWN from 0x72670 to 0x6a000 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +960(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +961(193 mod 256): MAPREAD 0x4e000 thru 0x4e4b7 (0x4b8 bytes) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +962(194 mod 256): PUNCH 0x5552d thru 0x5574a (0x21e bytes) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +963(195 mod 256): MAPREAD 0x48000 thru 0x4966f (0x1670 bytes) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +964(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +965(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +966(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +967(199 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +968(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +969(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +970(202 mod 256): PUNCH 0x3fe93 thru 0x41567 (0x16d5 bytes) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +971(203 mod 256): MAPWRITE 0x1e000 thru 0x1fcf7 (0x1cf8 bytes) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +972(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +973(205 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +974(206 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.680 INFO:teuthology.orchestra.run.smithi153.stdout: +975(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.681 INFO:teuthology.orchestra.run.smithi153.stdout: +976(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.681 INFO:teuthology.orchestra.run.smithi153.stdout: +977(209 mod 256): MAPWRITE 0x57000 thru 0x58af2 (0x1af3 bytes) 2024-03-28T23:11:39.681 INFO:teuthology.orchestra.run.smithi153.stdout: +978(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.681 INFO:teuthology.orchestra.run.smithi153.stdout: +979(211 mod 256): MAPREAD 0x0 thru 0xc7b (0xc7c bytes) 2024-03-28T23:11:39.681 INFO:teuthology.orchestra.run.smithi153.stdout: +980(212 mod 256): PUNCH 0x554bf thru 0x572f7 (0x1e39 bytes) 2024-03-28T23:11:39.681 INFO:teuthology.orchestra.run.smithi153.stdout: +981(213 mod 256): PUNCH 0x3f0ac thru 0x3f49a (0x3ef bytes) 2024-03-28T23:11:39.681 INFO:teuthology.orchestra.run.smithi153.stdout: +982(214 mod 256): COPY 0x68000 thru 0x68fff (0x1000 bytes) to 0x9000 thru 0x9fff 2024-03-28T23:11:39.681 INFO:teuthology.orchestra.run.smithi153.stdout: +983(215 mod 256): MAPWRITE 0x4c000 thru 0x4d591 (0x1592 bytes) 2024-03-28T23:11:39.681 INFO:teuthology.orchestra.run.smithi153.stdout: +984(216 mod 256): MAPWRITE 0x3b000 thru 0x3cbd9 (0x1bda bytes) 2024-03-28T23:11:39.681 INFO:teuthology.orchestra.run.smithi153.stdout: +985(217 mod 256): MAPWRITE 0x62000 thru 0x63190 (0x1191 bytes) 2024-03-28T23:11:39.681 INFO:teuthology.orchestra.run.smithi153.stdout: +986(218 mod 256): MAPREAD 0x0 thru 0x1505 (0x1506 bytes) 2024-03-28T23:11:39.681 INFO:teuthology.orchestra.run.smithi153.stdout: +987(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.681 INFO:teuthology.orchestra.run.smithi153.stdout: +988(220 mod 256): MAPREAD 0x22000 thru 0x22113 (0x114 bytes) 2024-03-28T23:11:39.682 INFO:teuthology.orchestra.run.smithi153.stdout: +989(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.682 INFO:teuthology.orchestra.run.smithi153.stdout: +990(222 mod 256): COPY 0x66000 thru 0x66fff (0x1000 bytes) to 0x1d000 thru 0x1dfff 2024-03-28T23:11:39.682 INFO:teuthology.orchestra.run.smithi153.stdout: +991(223 mod 256): PUNCH 0x466c0 thru 0x47bc3 (0x1504 bytes) 2024-03-28T23:11:39.682 INFO:teuthology.orchestra.run.smithi153.stdout: +992(224 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.682 INFO:teuthology.orchestra.run.smithi153.stdout: +993(225 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.682 INFO:teuthology.orchestra.run.smithi153.stdout: +994(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.682 INFO:teuthology.orchestra.run.smithi153.stdout: +995(227 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.682 INFO:teuthology.orchestra.run.smithi153.stdout: +996(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.682 INFO:teuthology.orchestra.run.smithi153.stdout: +997(229 mod 256): PUNCH 0x34fbe thru 0x36ecf (0x1f12 bytes) 2024-03-28T23:11:39.682 INFO:teuthology.orchestra.run.smithi153.stdout: +998(230 mod 256): TRUNCATE DOWN from 0x6a000 to 0x7000 ******WWWW 2024-03-28T23:11:39.682 INFO:teuthology.orchestra.run.smithi153.stdout: +999(231 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.682 INFO:teuthology.orchestra.run.smithi153.stdout: +1000(232 mod 256): MAPWRITE 0x7000 thru 0x76d8 (0x6d9 bytes) 2024-03-28T23:11:39.682 INFO:teuthology.orchestra.run.smithi153.stdout: +1001(233 mod 256): MAPREAD 0x6000 thru 0x6795 (0x796 bytes) 2024-03-28T23:11:39.682 INFO:teuthology.orchestra.run.smithi153.stdout: +1002(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.683 INFO:teuthology.orchestra.run.smithi153.stdout: +1003(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.683 INFO:teuthology.orchestra.run.smithi153.stdout: +1004(236 mod 256): MAPWRITE 0x24000 thru 0x25359 (0x135a bytes) 2024-03-28T23:11:39.683 INFO:teuthology.orchestra.run.smithi153.stdout: +1005(237 mod 256): COPY 0x22000 thru 0x22fff (0x1000 bytes) to 0x18000 thru 0x18fff 2024-03-28T23:11:39.683 INFO:teuthology.orchestra.run.smithi153.stdout: +1006(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.683 INFO:teuthology.orchestra.run.smithi153.stdout: +1007(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.683 INFO:teuthology.orchestra.run.smithi153.stdout: +1008(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.683 INFO:teuthology.orchestra.run.smithi153.stdout: +1009(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.683 INFO:teuthology.orchestra.run.smithi153.stdout: +1010(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.683 INFO:teuthology.orchestra.run.smithi153.stdout: +1011(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.683 INFO:teuthology.orchestra.run.smithi153.stdout: +1012(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.683 INFO:teuthology.orchestra.run.smithi153.stdout: +1013(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.683 INFO:teuthology.orchestra.run.smithi153.stdout: +1014(246 mod 256): MAPWRITE 0x2d000 thru 0x2ec55 (0x1c56 bytes) 2024-03-28T23:11:39.683 INFO:teuthology.orchestra.run.smithi153.stdout: +1015(247 mod 256): TRUNCATE DOWN from 0x2ec56 to 0x2a000 2024-03-28T23:11:39.683 INFO:teuthology.orchestra.run.smithi153.stdout: +1016(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1017(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1018(250 mod 256): PUNCH 0xf84b thru 0x11486 (0x1c3c bytes) 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1019(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1020(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1021(253 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1022(254 mod 256): WRITE 0x37000 thru 0x37fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1023(255 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1024( 0 mod 256): COPY 0x34000 thru 0x34fff (0x1000 bytes) to 0x21000 thru 0x21fff 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1025( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1026( 2 mod 256): MAPREAD 0x5000 thru 0x55f6 (0x5f7 bytes) 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1027( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1028( 4 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1029( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1030( 6 mod 256): MAPWRITE 0x49000 thru 0x4a0a8 (0x10a9 bytes) 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1031( 7 mod 256): MAPWRITE 0x64000 thru 0x64195 (0x196 bytes) 2024-03-28T23:11:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: +1032( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: +1033( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: +1034( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: +1035( 11 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: +1036( 12 mod 256): TRUNCATE DOWN from 0x64196 to 0x62000 2024-03-28T23:11:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: +1037( 13 mod 256): MAPWRITE 0x57000 thru 0x587ce (0x17cf bytes) 2024-03-28T23:11:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: +1038( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: +1039( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: +1040( 16 mod 256): COPY 0x17000 thru 0x17fff (0x1000 bytes) to 0x3a000 thru 0x3afff 2024-03-28T23:11:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: +1041( 17 mod 256): COPY 0x1000 thru 0x1fff (0x1000 bytes) to 0x4d000 thru 0x4dfff 2024-03-28T23:11:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: +1042( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: +1043( 19 mod 256): COPY 0x2000 thru 0x2fff (0x1000 bytes) to 0x4a000 thru 0x4afff 2024-03-28T23:11:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: +1044( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: +1045( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: +1046( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: +1047( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: +1048( 24 mod 256): PUNCH 0xdb9d thru 0xecbd (0x1121 bytes) 2024-03-28T23:11:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: +1049( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: +1050( 26 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: +1051( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: +1052( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: +1053( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: +1054( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: +1055( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: +1056( 32 mod 256): READ 0x29000 thru 0x29fff (0x1000 bytes) 2024-03-28T23:11:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: +1057( 33 mod 256): MAPWRITE 0x6c000 thru 0x6da94 (0x1a95 bytes) 2024-03-28T23:11:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: +1058( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: +1059( 35 mod 256): MAPWRITE 0x28000 thru 0x2963d (0x163e bytes) 2024-03-28T23:11:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: +1060( 36 mod 256): MAPWRITE 0x27000 thru 0x27a6c (0xa6d bytes) 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1061( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1062( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1063( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1064( 40 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1065( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1066( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1067( 43 mod 256): MAPWRITE 0x13000 thru 0x138af (0x8b0 bytes) 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1068( 44 mod 256): MAPWRITE 0x44000 thru 0x45265 (0x1266 bytes) 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1069( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1070( 46 mod 256): TRUNCATE DOWN from 0x6da95 to 0x66000 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1071( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1072( 48 mod 256): MAPWRITE 0x2b000 thru 0x2bda1 (0xda2 bytes) 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1073( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1074( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: +1075( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1076( 52 mod 256): MAPWRITE 0x2f000 thru 0x30cb6 (0x1cb7 bytes) 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1077( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1078( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1079( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1080( 56 mod 256): COPY 0x54000 thru 0x54fff (0x1000 bytes) to 0x18000 thru 0x18fff 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1081( 57 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1082( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1083( 59 mod 256): WRITE 0x5d000 thru 0x5dfff (0x1000 bytes) 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1084( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1085( 61 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1086( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1087( 63 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1088( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1089( 65 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: +1090( 66 mod 256): READ 0x3000 thru 0x3fff (0x1000 bytes) 2024-03-28T23:11:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: +1091( 67 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: +1092( 68 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: +1093( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: +1094( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: +1095( 71 mod 256): PUNCH 0x12764 thru 0x13795 (0x1032 bytes) 2024-03-28T23:11:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: +1096( 72 mod 256): PUNCH 0x53883 thru 0x5492e (0x10ac bytes) 2024-03-28T23:11:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: +1097( 73 mod 256): COPY 0x2f000 thru 0x2ffff (0x1000 bytes) to 0x2e000 thru 0x2efff 2024-03-28T23:11:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: +1098( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: +1099( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: +1100( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: +1101( 77 mod 256): MAPWRITE 0x74000 thru 0x75a17 (0x1a18 bytes) 2024-03-28T23:11:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: +1102( 78 mod 256): PUNCH 0x1f39f thru 0x20cf3 (0x1955 bytes) 2024-03-28T23:11:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: +1103( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: +1104( 80 mod 256): MAPREAD 0x74000 thru 0x74188 (0x189 bytes) 2024-03-28T23:11:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: +1105( 81 mod 256): TRUNCATE DOWN from 0x75a18 to 0x64000 2024-03-28T23:11:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: +1106( 82 mod 256): MAPREAD 0x5000 thru 0x6821 (0x1822 bytes) 2024-03-28T23:11:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: +1107( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: +1108( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: +1109( 85 mod 256): MAPREAD 0x28000 thru 0x28226 (0x227 bytes) 2024-03-28T23:11:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: +1110( 86 mod 256): PUNCH 0x3609a thru 0x37889 (0x17f0 bytes) 2024-03-28T23:11:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: +1111( 87 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: +1112( 88 mod 256): TRUNCATE UP from 0x64000 to 0x76000 2024-03-28T23:11:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: +1113( 89 mod 256): READ 0x5c000 thru 0x5cfff (0x1000 bytes) 2024-03-28T23:11:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: +1114( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: +1115( 91 mod 256): MAPREAD 0x52000 thru 0x53ec3 (0x1ec4 bytes) 2024-03-28T23:11:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: +1116( 92 mod 256): MAPREAD 0x72000 thru 0x73240 (0x1241 bytes) 2024-03-28T23:11:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: +1117( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: +1118( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: +1119( 95 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: +1120( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: +1121( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: +1122( 98 mod 256): MAPREAD 0x26000 thru 0x27e3b (0x1e3c bytes) 2024-03-28T23:11:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: +1123( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: +1124(100 mod 256): PUNCH 0x5e9a9 thru 0x5fa4e (0x10a6 bytes) 2024-03-28T23:11:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: +1125(101 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: +1126(102 mod 256): MAPREAD 0x6c000 thru 0x6c0ef (0xf0 bytes) 2024-03-28T23:11:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: +1127(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: +1128(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: +1129(105 mod 256): MAPWRITE 0x1e000 thru 0x1f044 (0x1045 bytes) 2024-03-28T23:11:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: +1130(106 mod 256): PUNCH 0x4e25c thru 0x4ebde (0x983 bytes) 2024-03-28T23:11:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: +1131(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: +1132(108 mod 256): PUNCH 0x5f962 thru 0x61134 (0x17d3 bytes) 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1133(109 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1134(110 mod 256): MAPWRITE 0x2a000 thru 0x2ae1f (0xe20 bytes) 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1135(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1136(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1137(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1138(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1139(115 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1140(116 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1141(117 mod 256): TRUNCATE DOWN from 0x76000 to 0x37000 ******WWWW 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1142(118 mod 256): READ 0x29000 thru 0x29fff (0x1000 bytes) 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1143(119 mod 256): PUNCH 0x2a45d thru 0x2b4be (0x1062 bytes) 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1144(120 mod 256): READ 0x15000 thru 0x15fff (0x1000 bytes) 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1145(121 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1146(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: +1147(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: +1148(124 mod 256): TRUNCATE DOWN from 0x37000 to 0xe000 2024-03-28T23:11:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: +1149(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: +1150(126 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: +1151(127 mod 256): COPY 0x8000 thru 0x8fff (0x1000 bytes) to 0x1a000 thru 0x1afff 2024-03-28T23:11:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: +1152(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: +1153(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: +1154(130 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: +1155(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: +1156(132 mod 256): TRUNCATE UP from 0x1b000 to 0x3b000 ******WWWW 2024-03-28T23:11:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: +1157(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: +1158(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: +1159(135 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: +1160(136 mod 256): TRUNCATE DOWN from 0x3b000 to 0x2d000 ******WWWW 2024-03-28T23:11:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: +1161(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: +1162(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: +1163(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: +1164(140 mod 256): COPY 0x9000 thru 0x9fff (0x1000 bytes) to 0x4b000 thru 0x4bfff 2024-03-28T23:11:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: +1165(141 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: +1166(142 mod 256): TRUNCATE UP from 0x4c000 to 0x51000 2024-03-28T23:11:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: +1167(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: +1168(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: +1169(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: +1170(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: +1171(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: +1172(148 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: +1173(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: +1174(150 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1175(151 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1176(152 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1177(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1178(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1179(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1180(156 mod 256): MAPWRITE 0x35000 thru 0x36a55 (0x1a56 bytes) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1181(157 mod 256): READ 0x2b000 thru 0x2bfff (0x1000 bytes) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1182(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1183(159 mod 256): MAPWRITE 0x62000 thru 0x631e0 (0x11e1 bytes) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1184(160 mod 256): MAPWRITE 0x1b000 thru 0x1b7a5 (0x7a6 bytes) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1185(161 mod 256): MAPREAD 0x5b000 thru 0x5b114 (0x115 bytes) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1186(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1187(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1188(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: +1189(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1190(166 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1191(167 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1192(168 mod 256): PUNCH 0x34b62 thru 0x361e8 (0x1687 bytes) 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1193(169 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1194(170 mod 256): MAPREAD 0x62000 thru 0x623d4 (0x3d5 bytes) 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1195(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1196(172 mod 256): MAPWRITE 0x4d000 thru 0x4e90e (0x190f bytes) 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1197(173 mod 256): MAPWRITE 0xd000 thru 0xd288 (0x289 bytes) 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1198(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1199(175 mod 256): READ 0x1c000 thru 0x1cfff (0x1000 bytes) 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1200(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1201(177 mod 256): TRUNCATE DOWN from 0x631e1 to 0x16000 ******WWWW 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1202(178 mod 256): MAPWRITE 0x77000 thru 0x770f3 (0xf4 bytes) 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1203(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: +1204(180 mod 256): MAPWRITE 0x50000 thru 0x50e6f (0xe70 bytes) 2024-03-28T23:11:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: +1205(181 mod 256): PUNCH 0x23c3 thru 0x2aac (0x6ea bytes) 2024-03-28T23:11:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: +1206(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: +1207(183 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: +1208(184 mod 256): COPY 0x5d000 thru 0x5dfff (0x1000 bytes) to 0x32000 thru 0x32fff 2024-03-28T23:11:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: +1209(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: +1210(186 mod 256): WRITE 0x7000 thru 0x7fff (0x1000 bytes) 2024-03-28T23:11:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: +1211(187 mod 256): PUNCH 0x2f4c2 thru 0x2f99b (0x4da bytes) 2024-03-28T23:11:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: +1212(188 mod 256): TRUNCATE DOWN from 0x770f4 to 0x3f000 2024-03-28T23:11:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: +1213(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: +1214(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: +1215(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: +1216(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: +1217(193 mod 256): MAPWRITE 0x76000 thru 0x77088 (0x1089 bytes) 2024-03-28T23:11:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: +1218(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: +1219(195 mod 256): MAPREAD 0x6f000 thru 0x6f91b (0x91c bytes) 2024-03-28T23:11:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: +1220(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: +1221(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: +1222(198 mod 256): TRUNCATE DOWN from 0x77089 to 0x72000 2024-03-28T23:11:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: +1223(199 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: +1224(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: +1225(201 mod 256): READ 0x1d000 thru 0x1dfff (0x1000 bytes) 2024-03-28T23:11:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: +1226(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: +1227(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: +1228(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: +1229(205 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: +1230(206 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: +1231(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: +1232(208 mod 256): READ 0x5e000 thru 0x5efff (0x1000 bytes) 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1233(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1234(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1235(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1236(212 mod 256): MAPREAD 0x1b000 thru 0x1c8d5 (0x18d6 bytes) 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1237(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1238(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1239(215 mod 256): COPY 0x31000 thru 0x31fff (0x1000 bytes) to 0x10000 thru 0x10fff 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1240(216 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1241(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1242(218 mod 256): MAPWRITE 0x40000 thru 0x41bab (0x1bac bytes) 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1243(219 mod 256): WRITE 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1244(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1245(221 mod 256): PUNCH 0x1e59 thru 0x318f (0x1337 bytes) 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1246(222 mod 256): MAPWRITE 0x53000 thru 0x546b1 (0x16b2 bytes) 2024-03-28T23:11:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: +1247(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: +1248(224 mod 256): WRITE 0x6b000 thru 0x6bfff (0x1000 bytes) 2024-03-28T23:11:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: +1249(225 mod 256): PUNCH 0x4f187 thru 0x50260 (0x10da bytes) 2024-03-28T23:11:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: +1250(226 mod 256): MAPWRITE 0x62000 thru 0x6348a (0x148b bytes) 2024-03-28T23:11:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: +1251(227 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: +1252(228 mod 256): TRUNCATE DOWN from 0x72000 to 0x27000 ******WWWW 2024-03-28T23:11:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: +1253(229 mod 256): MAPREAD 0x3000 thru 0x3374 (0x375 bytes) 2024-03-28T23:11:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: +1254(230 mod 256): COPY 0xc000 thru 0xcfff (0x1000 bytes) to 0x36000 thru 0x36fff 2024-03-28T23:11:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: +1255(231 mod 256): TRUNCATE UP from 0x37000 to 0x38000 ******WWWW 2024-03-28T23:11:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: +1256(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: +1257(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: +1258(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: +1259(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: +1260(236 mod 256): MAPWRITE 0x3e000 thru 0x3f8e0 (0x18e1 bytes) 2024-03-28T23:11:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: +1261(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: +1262(238 mod 256): TRUNCATE UP from 0x3f8e1 to 0x44000 2024-03-28T23:11:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: +1263(239 mod 256): MAPREAD 0x32000 thru 0x33756 (0x1757 bytes) 2024-03-28T23:11:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: +1264(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: +1265(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: +1266(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: +1267(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: +1268(244 mod 256): MAPWRITE 0x1f000 thru 0x20002 (0x1003 bytes) 2024-03-28T23:11:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: +1269(245 mod 256): MAPWRITE 0x45000 thru 0x46dcf (0x1dd0 bytes) 2024-03-28T23:11:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: +1270(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: +1271(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: +1272(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: +1273(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: +1274(250 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: +1275(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: +1276(252 mod 256): READ 0x45000 thru 0x45fff (0x1000 bytes) 2024-03-28T23:11:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: +1277(253 mod 256): MAPWRITE 0x38000 thru 0x39954 (0x1955 bytes) 2024-03-28T23:11:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: +1278(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: +1279(255 mod 256): READ 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-28T23:11:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: +1280( 0 mod 256): MAPWRITE 0x32000 thru 0x3202d (0x2e bytes) 2024-03-28T23:11:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: +1281( 1 mod 256): MAPREAD 0x21000 thru 0x22645 (0x1646 bytes) 2024-03-28T23:11:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: +1282( 2 mod 256): READ 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-28T23:11:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: +1283( 3 mod 256): MAPREAD 0x13000 thru 0x13268 (0x269 bytes) 2024-03-28T23:11:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: +1284( 4 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: +1285( 5 mod 256): COPY 0x2f000 thru 0x2ffff (0x1000 bytes) to 0x4000 thru 0x4fff 2024-03-28T23:11:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: +1286( 6 mod 256): COPY 0x0 thru 0xfff (0x1000 bytes) to 0x5a000 thru 0x5afff 2024-03-28T23:11:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: +1287( 7 mod 256): COPY 0x44000 thru 0x44fff (0x1000 bytes) to 0x5d000 thru 0x5dfff 2024-03-28T23:11:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: +1288( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: +1289( 9 mod 256): TRUNCATE DOWN from 0x5e000 to 0xa000 ******WWWW 2024-03-28T23:11:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: +1290( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: +1291( 11 mod 256): MAPWRITE 0x4a000 thru 0x4b036 (0x1037 bytes) 2024-03-28T23:11:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: +1292( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: +1293( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: +1294( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: +1295( 15 mod 256): PUNCH 0xa91e thru 0xb165 (0x848 bytes) 2024-03-28T23:11:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: +1296( 16 mod 256): MAPWRITE 0x5e000 thru 0x5eb14 (0xb15 bytes) 2024-03-28T23:11:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: +1297( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: +1298( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: +1299( 19 mod 256): MAPREAD 0x20000 thru 0x2181b (0x181c bytes) 2024-03-28T23:11:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: +1300( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: +1301( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1302( 22 mod 256): WRITE 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1303( 23 mod 256): TRUNCATE DOWN from 0x5eb15 to 0x1b000 ******WWWW 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1304( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1305( 25 mod 256): MAPREAD 0xc000 thru 0xd18f (0x1190 bytes) 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1306( 26 mod 256): TRUNCATE UP from 0x1b000 to 0x67000 ******WWWW 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1307( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1308( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1309( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1310( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1311( 31 mod 256): MAPREAD 0x2e000 thru 0x2eb84 (0xb85 bytes) 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1312( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1313( 33 mod 256): PUNCH 0x17463 thru 0x17e50 (0x9ee bytes) 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1314( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1315( 35 mod 256): MAPREAD 0xf000 thru 0x1020b (0x120c bytes) 2024-03-28T23:11:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: +1316( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1317( 37 mod 256): MAPREAD 0x5b000 thru 0x5ca97 (0x1a98 bytes) 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1318( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1319( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1320( 40 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1321( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1322( 42 mod 256): MAPREAD 0x28000 thru 0x28b60 (0xb61 bytes) 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1323( 43 mod 256): MAPREAD 0x3a000 thru 0x3b294 (0x1295 bytes) 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1324( 44 mod 256): COPY 0x2b000 thru 0x2bfff (0x1000 bytes) to 0x4000 thru 0x4fff 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1325( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1326( 46 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1327( 47 mod 256): PUNCH 0x8f4a thru 0x9399 (0x450 bytes) 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1328( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1329( 49 mod 256): MAPREAD 0x35000 thru 0x3634d (0x134e bytes) 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1330( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: +1331( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: +1332( 52 mod 256): WRITE 0x1b000 thru 0x1bfff (0x1000 bytes) 2024-03-28T23:11:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: +1333( 53 mod 256): MAPWRITE 0x34000 thru 0x3459c (0x59d bytes) 2024-03-28T23:11:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: +1334( 54 mod 256): MAPREAD 0x42000 thru 0x431ea (0x11eb bytes) 2024-03-28T23:11:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: +1335( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: +1336( 56 mod 256): COPY 0x3e000 thru 0x3efff (0x1000 bytes) to 0x49000 thru 0x49fff 2024-03-28T23:11:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: +1337( 57 mod 256): MAPWRITE 0x41000 thru 0x42cf5 (0x1cf6 bytes) 2024-03-28T23:11:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: +1338( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: +1339( 59 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: +1340( 60 mod 256): TRUNCATE DOWN from 0x67000 to 0xb000 ******WWWW 2024-03-28T23:11:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: +1341( 61 mod 256): TRUNCATE UP from 0xb000 to 0x36000 2024-03-28T23:11:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: +1342( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: +1343( 63 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: +1344( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1345( 65 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1346( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1347( 67 mod 256): WRITE 0x41000 thru 0x41fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1348( 68 mod 256): READ 0x3b000 thru 0x3bfff (0x1000 bytes) 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1349( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1350( 70 mod 256): TRUNCATE DOWN from 0x42000 to 0x11000 ******WWWW 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1351( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1352( 72 mod 256): MAPWRITE 0x35000 thru 0x36058 (0x1059 bytes) 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1353( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1354( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1355( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1356( 76 mod 256): WRITE 0x2b000 thru 0x2bfff (0x1000 bytes) 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1357( 77 mod 256): MAPWRITE 0x59000 thru 0x5ae87 (0x1e88 bytes) 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1358( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: +1359( 79 mod 256): PUNCH 0x2a9bd thru 0x2c6ab (0x1cef bytes) 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1360( 80 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1361( 81 mod 256): MAPWRITE 0x16000 thru 0x160cc (0xcd bytes) 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1362( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1363( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1364( 84 mod 256): PUNCH 0x81a7 thru 0x9ce1 (0x1b3b bytes) 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1365( 85 mod 256): PUNCH 0x5a0dd thru 0x5ae1a (0xd3e bytes) 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1366( 86 mod 256): TRUNCATE DOWN from 0x5ae88 to 0x2000 ******WWWW 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1367( 87 mod 256): MAPREAD 0x1000 thru 0x1def (0xdf0 bytes) 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1368( 88 mod 256): PUNCH 0x2e9 thru 0x1220 (0xf38 bytes) 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1369( 89 mod 256): TRUNCATE UP from 0x2000 to 0x46000 ******WWWW 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1370( 90 mod 256): MAPWRITE 0x53000 thru 0x54e01 (0x1e02 bytes) 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1371( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1372( 92 mod 256): WRITE 0x4d000 thru 0x4dfff (0x1000 bytes) 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1373( 93 mod 256): WRITE 0x5d000 thru 0x5dfff (0x1000 bytes) HOLE 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1374( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: +1375( 95 mod 256): PUNCH 0x34920 thru 0x35aed (0x11ce bytes) 2024-03-28T23:11:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: +1376( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: +1377( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: +1378( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: +1379( 99 mod 256): PUNCH 0x1d4e5 thru 0x1e58b (0x10a7 bytes) 2024-03-28T23:11:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: +1380(100 mod 256): COPY 0x37000 thru 0x37fff (0x1000 bytes) to 0x2f000 thru 0x2ffff EEEE****** 2024-03-28T23:11:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: +1381(101 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: +1382(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: +1383(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: +1384(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: +1385(105 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: +1386(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: +1387(107 mod 256): MAPREAD 0x40000 thru 0x41281 (0x1282 bytes) 2024-03-28T23:11:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: +1388(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: +1389(109 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: +1390(110 mod 256): WRITE 0x3c000 thru 0x3cfff (0x1000 bytes) 2024-03-28T23:11:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: +1391(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: +1392(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: +1393(113 mod 256): WRITE 0x28000 thru 0x28fff (0x1000 bytes) 2024-03-28T23:11:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: +1394(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: +1395(115 mod 256): PUNCH 0x419b thru 0x4e51 (0xcb7 bytes) 2024-03-28T23:11:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: +1396(116 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: +1397(117 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: +1398(118 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: +1399(119 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: +1400(120 mod 256): TRUNCATE DOWN from 0x5e000 to 0x4f000 2024-03-28T23:11:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: +1401(121 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: +1402(122 mod 256): READ 0x1c000 thru 0x1cfff (0x1000 bytes) 2024-03-28T23:11:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: +1403(123 mod 256): MAPWRITE 0x67000 thru 0x6774b (0x74c bytes) 2024-03-28T23:11:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: +1404(124 mod 256): TRUNCATE DOWN from 0x6774c to 0x4b000 2024-03-28T23:11:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: +1405(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: +1406(126 mod 256): WRITE 0x2a000 thru 0x2afff (0x1000 bytes) 2024-03-28T23:11:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: +1407(127 mod 256): TRUNCATE UP from 0x4b000 to 0x68000 2024-03-28T23:11:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: +1408(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: +1409(129 mod 256): PUNCH 0x1ab4b thru 0x1ca47 (0x1efd bytes) 2024-03-28T23:11:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: +1410(130 mod 256): MAPWRITE 0x25000 thru 0x258ab (0x8ac bytes) 2024-03-28T23:11:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: +1411(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: +1412(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: +1413(133 mod 256): TRUNCATE DOWN from 0x68000 to 0xa000 ******WWWW 2024-03-28T23:11:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: +1414(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: +1415(135 mod 256): MAPWRITE 0x35000 thru 0x35221 (0x222 bytes) 2024-03-28T23:11:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: +1416(136 mod 256): TRUNCATE DOWN from 0x35222 to 0x6000 2024-03-28T23:11:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: +1417(137 mod 256): TRUNCATE UP from 0x6000 to 0x6b000 ******WWWW 2024-03-28T23:11:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: +1418(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: +1419(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: +1420(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: +1421(141 mod 256): WRITE 0x1b000 thru 0x1bfff (0x1000 bytes) 2024-03-28T23:11:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: +1422(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: +1423(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: +1424(144 mod 256): PUNCH 0x5499c thru 0x54c2e (0x293 bytes) 2024-03-28T23:11:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: +1425(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: +1426(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: +1427(147 mod 256): WRITE 0x0 thru 0xfff (0x1000 bytes) 2024-03-28T23:11:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: +1428(148 mod 256): PUNCH 0x2f503 thru 0x30685 (0x1183 bytes) 2024-03-28T23:11:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: +1429(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1430(150 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1431(151 mod 256): PUNCH 0x44db9 thru 0x4685a (0x1aa2 bytes) 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1432(152 mod 256): TRUNCATE UP from 0x6b000 to 0x73000 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1433(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1434(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1435(155 mod 256): TRUNCATE DOWN from 0x73000 to 0x42000 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1436(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1437(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1438(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1439(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1440(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1441(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1442(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1443(163 mod 256): WRITE 0x21000 thru 0x21fff (0x1000 bytes) 2024-03-28T23:11:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: +1444(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: +1445(165 mod 256): COPY 0x9000 thru 0x9fff (0x1000 bytes) to 0x1d000 thru 0x1dfff 2024-03-28T23:11:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: +1446(166 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: +1447(167 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: +1448(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: +1449(169 mod 256): COPY 0x30000 thru 0x30fff (0x1000 bytes) to 0x5c000 thru 0x5cfff 2024-03-28T23:11:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: +1450(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: +1451(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: +1452(172 mod 256): TRUNCATE UP from 0x5d000 to 0x61000 2024-03-28T23:11:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: +1453(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: +1454(174 mod 256): MAPREAD 0x6000 thru 0x6166 (0x167 bytes) 2024-03-28T23:11:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: +1455(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: +1456(176 mod 256): READ 0x2a000 thru 0x2afff (0x1000 bytes) 2024-03-28T23:11:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: +1457(177 mod 256): PUNCH 0x34c6 thru 0x379d (0x2d8 bytes) 2024-03-28T23:11:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: +1458(178 mod 256): MAPWRITE 0x6f000 thru 0x6f418 (0x419 bytes) 2024-03-28T23:11:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: +1459(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: +1460(180 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: +1461(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: +1462(182 mod 256): WRITE 0x2c000 thru 0x2cfff (0x1000 bytes) 2024-03-28T23:11:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: +1463(183 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: +1464(184 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: +1465(185 mod 256): WRITE 0x22000 thru 0x22fff (0x1000 bytes) 2024-03-28T23:11:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: +1466(186 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: +1467(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: +1468(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: +1469(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: +1470(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: +1471(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: +1472(192 mod 256): MAPWRITE 0x4d000 thru 0x4dde4 (0xde5 bytes) 2024-03-28T23:11:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: +1473(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: +1474(194 mod 256): READ 0x33000 thru 0x33fff (0x1000 bytes) 2024-03-28T23:11:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: +1475(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: +1476(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: +1477(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: +1478(198 mod 256): WRITE 0x68000 thru 0x68fff (0x1000 bytes) 2024-03-28T23:11:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: +1479(199 mod 256): PUNCH 0xa88f thru 0xb334 (0xaa6 bytes) 2024-03-28T23:11:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: +1480(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: +1481(201 mod 256): MAPREAD 0x3a000 thru 0x3a389 (0x38a bytes) 2024-03-28T23:11:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: +1482(202 mod 256): COPY 0x17000 thru 0x17fff (0x1000 bytes) to 0x69000 thru 0x69fff 2024-03-28T23:11:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: +1483(203 mod 256): TRUNCATE DOWN from 0x6f419 to 0x4f000 2024-03-28T23:11:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: +1484(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: +1485(205 mod 256): COPY 0x37000 thru 0x37fff (0x1000 bytes) to 0x79000 thru 0x79fff EEEE****** 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1486(206 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1487(207 mod 256): MAPREAD 0x17000 thru 0x18b55 (0x1b56 bytes) 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1488(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1489(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1490(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1491(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1492(212 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1493(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1494(214 mod 256): MAPREAD 0x7000 thru 0x8800 (0x1801 bytes) 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1495(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1496(216 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1497(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1498(218 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1499(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: +1500(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: +1501(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: +1502(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: +1503(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: +1504(224 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: +1505(225 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: +1506(226 mod 256): MAPWRITE 0x59000 thru 0x5a572 (0x1573 bytes) 2024-03-28T23:11:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: +1507(227 mod 256): MAPREAD 0xb000 thru 0xc455 (0x1456 bytes) 2024-03-28T23:11:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: +1508(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: +1509(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: +1510(230 mod 256): TRUNCATE DOWN from 0x7a000 to 0x1a000 ******WWWW 2024-03-28T23:11:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: +1511(231 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: +1512(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: +1513(233 mod 256): MAPREAD 0x9000 thru 0x9e43 (0xe44 bytes) 2024-03-28T23:11:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: +1514(234 mod 256): WRITE 0x4c000 thru 0x4cfff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: +1515(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: +1516(236 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: +1517(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: +1518(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: +1519(239 mod 256): MAPWRITE 0x6000 thru 0x61c8 (0x1c9 bytes) 2024-03-28T23:11:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: +1520(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: +1521(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: +1522(242 mod 256): MAPREAD 0x45000 thru 0x451a0 (0x1a1 bytes) 2024-03-28T23:11:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: +1523(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: +1524(244 mod 256): READ 0x40000 thru 0x40fff (0x1000 bytes) 2024-03-28T23:11:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: +1525(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: +1526(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: +1527(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: +1528(248 mod 256): MAPREAD 0x41000 thru 0x42e89 (0x1e8a bytes) 2024-03-28T23:11:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: +1529(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: +1530(250 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: +1531(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: +1532(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: +1533(253 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: +1534(254 mod 256): MAPWRITE 0xc000 thru 0xcd6b (0xd6c bytes) 2024-03-28T23:11:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: +1535(255 mod 256): COPY 0x45000 thru 0x45fff (0x1000 bytes) to 0x76000 thru 0x76fff 2024-03-28T23:11:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: +1536( 0 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: +1537( 1 mod 256): COPY 0x2b000 thru 0x2bfff (0x1000 bytes) to 0x21000 thru 0x21fff 2024-03-28T23:11:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: +1538( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: +1539( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: +1540( 4 mod 256): MAPWRITE 0x35000 thru 0x3510e (0x10f bytes) 2024-03-28T23:11:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: +1541( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: +1542( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: +1543( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: +1544( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: +1545( 9 mod 256): MAPREAD 0x51000 thru 0x524cd (0x14ce bytes) 2024-03-28T23:11:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: +1546( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: +1547( 11 mod 256): MAPREAD 0x71000 thru 0x71426 (0x427 bytes) 2024-03-28T23:11:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: +1548( 12 mod 256): PUNCH 0x31db3 thru 0x329ae (0xbfc bytes) 2024-03-28T23:11:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: +1549( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: +1550( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: +1551( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: +1552( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: +1553( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: +1554( 18 mod 256): MAPWRITE 0x73000 thru 0x74203 (0x1204 bytes) 2024-03-28T23:11:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: +1555( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: +1556( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: +1557( 21 mod 256): MAPWRITE 0x61000 thru 0x61481 (0x482 bytes) 2024-03-28T23:11:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: +1558( 22 mod 256): PUNCH 0x656f0 thru 0x66d34 (0x1645 bytes) 2024-03-28T23:11:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: +1559( 23 mod 256): TRUNCATE DOWN from 0x77000 to 0x24000 ******WWWW 2024-03-28T23:11:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: +1560( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: +1561( 25 mod 256): PUNCH 0xee9c thru 0xf9b9 (0xb1e bytes) 2024-03-28T23:11:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: +1562( 26 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: +1563( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: +1564( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: +1565( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: +1566( 30 mod 256): MAPWRITE 0x30000 thru 0x30cb9 (0xcba bytes) 2024-03-28T23:11:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: +1567( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: +1568( 32 mod 256): PUNCH 0x2bd34 thru 0x2c6b4 (0x981 bytes) 2024-03-28T23:11:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: +1569( 33 mod 256): TRUNCATE UP from 0x30cba to 0x4e000 ******WWWW 2024-03-28T23:11:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: +1570( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: +1571( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: +1572( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: +1573( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: +1574( 38 mod 256): PUNCH 0x2942a thru 0x29baf (0x786 bytes) 2024-03-28T23:11:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: +1575( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: +1576( 40 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: +1577( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: +1578( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: +1579( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: +1580( 44 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: +1581( 45 mod 256): PUNCH 0x2f21d thru 0x3011d (0xf01 bytes) 2024-03-28T23:11:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: +1582( 46 mod 256): TRUNCATE DOWN from 0x4e000 to 0x7000 ******WWWW 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1583( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1584( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1585( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1586( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1587( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1588( 52 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1589( 53 mod 256): PUNCH 0x3429 thru 0x436f (0xf47 bytes) 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1590( 54 mod 256): MAPWRITE 0x3e000 thru 0x3e036 (0x37 bytes) 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1591( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1592( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1593( 57 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1594( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1595( 59 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1596( 60 mod 256): TRUNCATE DOWN from 0x3e037 to 0x10000 ******WWWW 2024-03-28T23:11:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: +1597( 61 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1598( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1599( 63 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1600( 64 mod 256): MAPWRITE 0x26000 thru 0x276d3 (0x16d4 bytes) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1601( 65 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1602( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1603( 67 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1604( 68 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1605( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1606( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1607( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1608( 72 mod 256): MAPREAD 0xc000 thru 0xce00 (0xe01 bytes) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1609( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1610( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1611( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1612( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: +1613( 77 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: +1614( 78 mod 256): WRITE 0x68000 thru 0x68fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: +1615( 79 mod 256): COPY 0xb000 thru 0xbfff (0x1000 bytes) to 0x79000 thru 0x79fff 2024-03-28T23:11:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: +1616( 80 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: +1617( 81 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: +1618( 82 mod 256): MAPWRITE 0x76000 thru 0x77cbf (0x1cc0 bytes) 2024-03-28T23:11:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: +1619( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: +1620( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: +1621( 85 mod 256): MAPWRITE 0x5c000 thru 0x5c23d (0x23e bytes) 2024-03-28T23:11:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: +1622( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: +1623( 87 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: +1624( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: +1625( 89 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: +1626( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1627( 91 mod 256): TRUNCATE DOWN from 0x7a000 to 0x4c000 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1628( 92 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1629( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1630( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1631( 95 mod 256): WRITE 0x22000 thru 0x22fff (0x1000 bytes) 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1632( 96 mod 256): READ 0x43000 thru 0x43fff (0x1000 bytes) 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1633( 97 mod 256): PUNCH 0x47ae1 thru 0x48530 (0xa50 bytes) 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1634( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1635( 99 mod 256): TRUNCATE DOWN from 0x4c000 to 0x25000 ******WWWW 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1636(100 mod 256): PUNCH 0x154d8 thru 0x16fb0 (0x1ad9 bytes) 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1637(101 mod 256): WRITE 0x56000 thru 0x56fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1638(102 mod 256): MAPWRITE 0x63000 thru 0x6472b (0x172c bytes) 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1639(103 mod 256): MAPWRITE 0x24000 thru 0x2419b (0x19c bytes) 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1640(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: +1641(105 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1642(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1643(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1644(108 mod 256): MAPREAD 0x3000 thru 0x36d6 (0x6d7 bytes) 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1645(109 mod 256): COPY 0x5f000 thru 0x5ffff (0x1000 bytes) to 0x77000 thru 0x77fff 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1646(110 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1647(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1648(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1649(113 mod 256): TRUNCATE DOWN from 0x78000 to 0x71000 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1650(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1651(115 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1652(116 mod 256): WRITE 0x3f000 thru 0x3ffff (0x1000 bytes) 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1653(117 mod 256): PUNCH 0x4804e thru 0x484cb (0x47e bytes) 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1654(118 mod 256): MAPWRITE 0x4c000 thru 0x4d7bd (0x17be bytes) 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1655(119 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: +1656(120 mod 256): MAPREAD 0x2d000 thru 0x2d9e4 (0x9e5 bytes) 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1657(121 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1658(122 mod 256): TRUNCATE DOWN from 0x71000 to 0x41000 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1659(123 mod 256): MAPWRITE 0x29000 thru 0x294d1 (0x4d2 bytes) 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1660(124 mod 256): COPY 0xb000 thru 0xbfff (0x1000 bytes) to 0x4f000 thru 0x4ffff 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1661(125 mod 256): MAPWRITE 0x25000 thru 0x25511 (0x512 bytes) 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1662(126 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1663(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1664(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1665(129 mod 256): MAPREAD 0x45000 thru 0x45c50 (0xc51 bytes) 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1666(130 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1667(131 mod 256): MAPWRITE 0x37000 thru 0x37bfe (0xbff bytes) 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1668(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1669(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1670(134 mod 256): MAPWRITE 0x5000 thru 0x5624 (0x625 bytes) 2024-03-28T23:11:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: +1671(135 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1672(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1673(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1674(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1675(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1676(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1677(141 mod 256): MAPWRITE 0x74000 thru 0x74200 (0x201 bytes) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1678(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1679(143 mod 256): WRITE 0x55000 thru 0x55fff (0x1000 bytes) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1680(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1681(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1682(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1683(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1684(148 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1685(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: +1686(150 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: +1687(151 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: +1688(152 mod 256): MAPWRITE 0x35000 thru 0x36b24 (0x1b25 bytes) 2024-03-28T23:11:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: +1689(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: +1690(154 mod 256): MAPWRITE 0x1a000 thru 0x1a440 (0x441 bytes) 2024-03-28T23:11:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: +1691(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: +1692(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: +1693(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: +1694(158 mod 256): MAPWRITE 0x2f000 thru 0x30284 (0x1285 bytes) 2024-03-28T23:11:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: +1695(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: +1696(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: +1697(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: +1698(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: +1699(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: +1700(164 mod 256): TRUNCATE DOWN from 0x74201 to 0x2c000 ******WWWW 2024-03-28T23:11:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: +1701(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: +1702(166 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: +1703(167 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: +1704(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: +1705(169 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: +1706(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: +1707(171 mod 256): READ 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-28T23:11:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: +1708(172 mod 256): MAPWRITE 0x1a000 thru 0x1a29b (0x29c bytes) 2024-03-28T23:11:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: +1709(173 mod 256): PUNCH 0x15c5d thru 0x16756 (0xafa bytes) 2024-03-28T23:11:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: +1710(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: +1711(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: +1712(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: +1713(177 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: +1714(178 mod 256): MAPREAD 0x1d000 thru 0x1d60a (0x60b bytes) 2024-03-28T23:11:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: +1715(179 mod 256): MAPREAD 0x11000 thru 0x1177b (0x77c bytes) 2024-03-28T23:11:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: +1716(180 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: +1717(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: +1718(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: +1719(183 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: +1720(184 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: +1721(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: +1722(186 mod 256): MAPREAD 0x1c000 thru 0x1c821 (0x822 bytes) 2024-03-28T23:11:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: +1723(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: +1724(188 mod 256): PUNCH 0x2bb59 thru 0x2bfff (0x4a7 bytes) 2024-03-28T23:11:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: +1725(189 mod 256): TRUNCATE UP from 0x2c000 to 0x67000 ******WWWW 2024-03-28T23:11:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: +1726(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: +1727(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: +1728(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: +1729(193 mod 256): TRUNCATE DOWN from 0x67000 to 0xc000 ******WWWW 2024-03-28T23:11:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: +1730(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: +1731(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: +1732(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: +1733(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: +1734(198 mod 256): MAPREAD 0xb000 thru 0xb477 (0x478 bytes) 2024-03-28T23:11:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: +1735(199 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: +1736(200 mod 256): MAPWRITE 0x27000 thru 0x28005 (0x1006 bytes) 2024-03-28T23:11:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: +1737(201 mod 256): MAPWRITE 0x6f000 thru 0x6f3cb (0x3cc bytes) 2024-03-28T23:11:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: +1738(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: +1739(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: +1740(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: +1741(205 mod 256): COPY 0x34000 thru 0x34fff (0x1000 bytes) to 0x49000 thru 0x49fff 2024-03-28T23:11:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: +1742(206 mod 256): READ 0x58000 thru 0x58fff (0x1000 bytes) 2024-03-28T23:11:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: +1743(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1744(208 mod 256): READ 0x17000 thru 0x17fff (0x1000 bytes) 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1745(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1746(210 mod 256): TRUNCATE DOWN from 0x6f3cc to 0x42000 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1747(211 mod 256): TRUNCATE DOWN from 0x42000 to 0x3000 ******WWWW 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1748(212 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1749(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1750(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1751(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1752(216 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1753(217 mod 256): PUNCH 0x264d thru 0x2fff (0x9b3 bytes) 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1754(218 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1755(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1756(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1757(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: +1758(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: +1759(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: +1760(224 mod 256): MAPWRITE 0x4c000 thru 0x4c79a (0x79b bytes) 2024-03-28T23:11:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: +1761(225 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: +1762(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: +1763(227 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: +1764(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: +1765(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: +1766(230 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: +1767(231 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: +1768(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: +1769(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: +1770(234 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-28T23:11:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: +1771(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: +1772(236 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: +1773(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: +1774(238 mod 256): PUNCH 0xeb0f thru 0xf289 (0x77b bytes) 2024-03-28T23:11:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: +1775(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: +1776(240 mod 256): MAPWRITE 0x55000 thru 0x56522 (0x1523 bytes) 2024-03-28T23:11:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: +1777(241 mod 256): MAPWRITE 0x35000 thru 0x353b3 (0x3b4 bytes) 2024-03-28T23:11:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: +1778(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: +1779(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: +1780(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: +1781(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: +1782(246 mod 256): MAPREAD 0x3d000 thru 0x3e931 (0x1932 bytes) 2024-03-28T23:11:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: +1783(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: +1784(248 mod 256): PUNCH 0x17f89 thru 0x19b53 (0x1bcb bytes) 2024-03-28T23:11:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: +1785(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: +1786(250 mod 256): READ 0x30000 thru 0x30fff (0x1000 bytes) 2024-03-28T23:11:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: +1787(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: +1788(252 mod 256): MAPREAD 0xc000 thru 0xd222 (0x1223 bytes) 2024-03-28T23:11:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: +1789(253 mod 256): MAPWRITE 0x73000 thru 0x74b92 (0x1b93 bytes) 2024-03-28T23:11:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: +1790(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: +1791(255 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: +1792( 0 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: +1793( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: +1794( 2 mod 256): TRUNCATE DOWN from 0x74b93 to 0x6f000 2024-03-28T23:11:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: +1795( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: +1796( 4 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: +1797( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: +1798( 6 mod 256): PUNCH 0x23b48 thru 0x23ccc (0x185 bytes) 2024-03-28T23:11:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: +1799( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: +1800( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: +1801( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: +1802( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: +1803( 11 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: +1804( 12 mod 256): MAPWRITE 0x19000 thru 0x19177 (0x178 bytes) 2024-03-28T23:11:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: +1805( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: +1806( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1807( 15 mod 256): READ 0x3e000 thru 0x3efff (0x1000 bytes) 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1808( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1809( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1810( 18 mod 256): PUNCH 0x43902 thru 0x4532c (0x1a2b bytes) 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1811( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1812( 20 mod 256): TRUNCATE DOWN from 0x6f000 to 0x5e000 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1813( 21 mod 256): WRITE 0x76000 thru 0x76fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1814( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1815( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1816( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1817( 25 mod 256): TRUNCATE DOWN from 0x77000 to 0x76000 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1818( 26 mod 256): PUNCH 0x240f6 thru 0x25661 (0x156c bytes) 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1819( 27 mod 256): TRUNCATE DOWN from 0x76000 to 0x5e000 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1820( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1821( 29 mod 256): WRITE 0x57000 thru 0x57fff (0x1000 bytes) 2024-03-28T23:11:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: +1822( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: +1823( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: +1824( 32 mod 256): TRUNCATE DOWN from 0x5e000 to 0x2c000 ******WWWW 2024-03-28T23:11:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: +1825( 33 mod 256): COPY 0x11000 thru 0x11fff (0x1000 bytes) to 0x7000 thru 0x7fff 2024-03-28T23:11:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: +1826( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: +1827( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: +1828( 36 mod 256): MAPWRITE 0x58000 thru 0x59f13 (0x1f14 bytes) 2024-03-28T23:11:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: +1829( 37 mod 256): WRITE 0x1b000 thru 0x1bfff (0x1000 bytes) 2024-03-28T23:11:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: +1830( 38 mod 256): TRUNCATE UP from 0x59f14 to 0x77000 2024-03-28T23:11:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: +1831( 39 mod 256): MAPWRITE 0x75000 thru 0x75761 (0x762 bytes) 2024-03-28T23:11:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: +1832( 40 mod 256): PUNCH 0x341ff thru 0x35b98 (0x199a bytes) 2024-03-28T23:11:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: +1833( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: +1834( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: +1835( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: +1836( 44 mod 256): MAPREAD 0x46000 thru 0x473e2 (0x13e3 bytes) 2024-03-28T23:11:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: +1837( 45 mod 256): PUNCH 0x3d073 thru 0x3dfac (0xf3a bytes) 2024-03-28T23:11:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: +1838( 46 mod 256): PUNCH 0x44935 thru 0x4590f (0xfdb bytes) 2024-03-28T23:11:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: +1839( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: +1840( 48 mod 256): MAPWRITE 0x5c000 thru 0x5c887 (0x888 bytes) 2024-03-28T23:11:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: +1841( 49 mod 256): TRUNCATE DOWN from 0x77000 to 0x14000 ******WWWW 2024-03-28T23:11:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: +1842( 50 mod 256): MAPREAD 0x12000 thru 0x1216b (0x16c bytes) 2024-03-28T23:11:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: +1843( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: +1844( 52 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: +1845( 53 mod 256): READ 0xa000 thru 0xafff (0x1000 bytes) 2024-03-28T23:11:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: +1846( 54 mod 256): MAPREAD 0xc000 thru 0xd2d0 (0x12d1 bytes) 2024-03-28T23:11:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: +1847( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: +1848( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: +1849( 57 mod 256): MAPWRITE 0x3d000 thru 0x3d9e2 (0x9e3 bytes) 2024-03-28T23:11:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: +1850( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: +1851( 59 mod 256): PUNCH 0x39d78 thru 0x3a6c6 (0x94f bytes) 2024-03-28T23:11:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: +1852( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: +1853( 61 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: +1854( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: +1855( 63 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: +1856( 64 mod 256): COPY 0xe000 thru 0xefff (0x1000 bytes) to 0x40000 thru 0x40fff 2024-03-28T23:11:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: +1857( 65 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: +1858( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: +1859( 67 mod 256): WRITE 0x50000 thru 0x50fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: +1860( 68 mod 256): MAPWRITE 0x3d000 thru 0x3e9b7 (0x19b8 bytes) 2024-03-28T23:11:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: +1861( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: +1862( 70 mod 256): MAPWRITE 0x5000 thru 0x5ff8 (0xff9 bytes) 2024-03-28T23:11:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: +1863( 71 mod 256): MAPWRITE 0x69000 thru 0x6a08f (0x1090 bytes) 2024-03-28T23:11:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: +1864( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: +1865( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: +1866( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: +1867( 75 mod 256): PUNCH 0x1cbb thru 0x2898 (0xbde bytes) 2024-03-28T23:11:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: +1868( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: +1869( 77 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: +1870( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: +1871( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: +1872( 80 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: +1873( 81 mod 256): COPY 0x68000 thru 0x68fff (0x1000 bytes) to 0x1b000 thru 0x1bfff 2024-03-28T23:11:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: +1874( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: +1875( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: +1876( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: +1877( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: +1878( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: +1879( 87 mod 256): PUNCH 0x2f7b8 thru 0x2fe87 (0x6d0 bytes) 2024-03-28T23:11:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: +1880( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: +1881( 89 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: +1882( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: +1883( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: +1884( 92 mod 256): MAPREAD 0x3c000 thru 0x3c27a (0x27b bytes) 2024-03-28T23:11:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: +1885( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: +1886( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: +1887( 95 mod 256): MAPREAD 0x51000 thru 0x52178 (0x1179 bytes) 2024-03-28T23:11:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: +1888( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: +1889( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: +1890( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: +1891( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: +1892(100 mod 256): MAPWRITE 0x2b000 thru 0x2b608 (0x609 bytes) 2024-03-28T23:11:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: +1893(101 mod 256): TRUNCATE DOWN from 0x6a090 to 0x2a000 ******WWWW 2024-03-28T23:11:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: +1894(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: +1895(103 mod 256): READ 0x12000 thru 0x12fff (0x1000 bytes) 2024-03-28T23:11:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: +1896(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: +1897(105 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: +1898(106 mod 256): WRITE 0x26000 thru 0x26fff (0x1000 bytes) 2024-03-28T23:11:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: +1899(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: +1900(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: +1901(109 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: +1902(110 mod 256): PUNCH 0x1a628 thru 0x1a9d3 (0x3ac bytes) 2024-03-28T23:11:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: +1903(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: +1904(112 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-28T23:11:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: +1905(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: +1906(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: +1907(115 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: +1908(116 mod 256): WRITE 0x2d000 thru 0x2dfff (0x1000 bytes) HOLE 2024-03-28T23:11:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: +1909(117 mod 256): PUNCH 0x9ac7 thru 0xb368 (0x18a2 bytes) 2024-03-28T23:11:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: +1910(118 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: +1911(119 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: +1912(120 mod 256): MAPREAD 0x11000 thru 0x11a85 (0xa86 bytes) 2024-03-28T23:11:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: +1913(121 mod 256): TRUNCATE DOWN from 0x2e000 to 0x1f000 2024-03-28T23:11:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: +1914(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: +1915(123 mod 256): TRUNCATE DOWN from 0x1f000 to 0xc000 2024-03-28T23:11:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: +1916(124 mod 256): MAPWRITE 0x5000 thru 0x66ec (0x16ed bytes) 2024-03-28T23:11:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: +1917(125 mod 256): COPY 0x4000 thru 0x4fff (0x1000 bytes) to 0x3f000 thru 0x3ffff 2024-03-28T23:11:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: +1918(126 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1919(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1920(128 mod 256): TRUNCATE DOWN from 0x40000 to 0x1c000 ******WWWW 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1921(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1922(130 mod 256): MAPREAD 0x10000 thru 0x10462 (0x463 bytes) 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1923(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1924(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1925(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1926(134 mod 256): MAPREAD 0x0 thru 0xa72 (0xa73 bytes) 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1927(135 mod 256): MAPWRITE 0x70000 thru 0x71ac9 (0x1aca bytes) 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1928(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1929(137 mod 256): READ 0x46000 thru 0x46fff (0x1000 bytes) 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1930(138 mod 256): MAPREAD 0x69000 thru 0x6aade (0x1adf bytes) 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1931(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1932(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: +1933(141 mod 256): READ 0xb000 thru 0xbfff (0x1000 bytes) 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1934(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1935(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1936(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1937(145 mod 256): MAPREAD 0x66000 thru 0x677a5 (0x17a6 bytes) 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1938(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1939(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1940(148 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1941(149 mod 256): WRITE 0x3b000 thru 0x3bfff (0x1000 bytes) 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1942(150 mod 256): WRITE 0x78000 thru 0x78fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1943(151 mod 256): TRUNCATE DOWN from 0x79000 to 0x3c000 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1944(152 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1945(153 mod 256): MAPREAD 0x9000 thru 0x9c56 (0xc57 bytes) 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1946(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1947(155 mod 256): TRUNCATE UP from 0x3c000 to 0x5c000 2024-03-28T23:11:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: +1948(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: +1949(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: +1950(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: +1951(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: +1952(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: +1953(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: +1954(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: +1955(163 mod 256): PUNCH 0x20a5f thru 0x22084 (0x1626 bytes) 2024-03-28T23:11:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: +1956(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: +1957(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: +1958(166 mod 256): PUNCH 0x3a06e thru 0x3ba11 (0x19a4 bytes) 2024-03-28T23:11:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: +1959(167 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: +1960(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: +1961(169 mod 256): TRUNCATE DOWN from 0x5c000 to 0x8000 ******WWWW 2024-03-28T23:11:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: +1962(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: +1963(171 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x65000 thru 0x65fff 2024-03-28T23:11:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: +1964(172 mod 256): TRUNCATE DOWN from 0x66000 to 0x4000 ******WWWW 2024-03-28T23:11:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: +1965(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: +1966(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: +1967(175 mod 256): MAPREAD 0x3000 thru 0x3b87 (0xb88 bytes) 2024-03-28T23:11:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: +1968(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: +1969(177 mod 256): TRUNCATE UP from 0x4000 to 0x63000 ******WWWW 2024-03-28T23:11:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: +1970(178 mod 256): MAPREAD 0x53000 thru 0x53193 (0x194 bytes) 2024-03-28T23:11:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: +1971(179 mod 256): COPY 0x4e000 thru 0x4efff (0x1000 bytes) to 0x3a000 thru 0x3afff 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1972(180 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1973(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1974(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1975(183 mod 256): MAPREAD 0x44000 thru 0x449ac (0x9ad bytes) 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1976(184 mod 256): MAPWRITE 0x28000 thru 0x28540 (0x541 bytes) 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1977(185 mod 256): TRUNCATE UP from 0x63000 to 0x76000 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1978(186 mod 256): TRUNCATE DOWN from 0x76000 to 0x3000 ******WWWW 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1979(187 mod 256): PUNCH 0xcd8 thru 0x179b (0xac4 bytes) 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1980(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1981(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1982(190 mod 256): MAPREAD 0x0 thru 0x6d2 (0x6d3 bytes) 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1983(191 mod 256): TRUNCATE UP from 0x3000 to 0x5d000 ******WWWW 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1984(192 mod 256): MAPWRITE 0x1d000 thru 0x1e06c (0x106d bytes) 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1985(193 mod 256): MAPREAD 0xc000 thru 0xd669 (0x166a bytes) 2024-03-28T23:11:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: +1986(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: +1987(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: +1988(196 mod 256): MAPWRITE 0x1f000 thru 0x20284 (0x1285 bytes) 2024-03-28T23:11:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: +1989(197 mod 256): WRITE 0xb000 thru 0xbfff (0x1000 bytes) 2024-03-28T23:11:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: +1990(198 mod 256): MAPWRITE 0x1d000 thru 0x1e64f (0x1650 bytes) 2024-03-28T23:11:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: +1991(199 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: +1992(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: +1993(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: +1994(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: +1995(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: +1996(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: +1997(205 mod 256): MAPREAD 0x3000 thru 0x38a7 (0x8a8 bytes) 2024-03-28T23:11:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: +1998(206 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: +1999(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: +2000(208 mod 256): TRUNCATE UP from 0x5d000 to 0x78000 2024-03-28T23:11:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: +2001(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: +2002(210 mod 256): PUNCH 0x1663d thru 0x16caf (0x673 bytes) 2024-03-28T23:11:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: +2003(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: +2004(212 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: +2005(213 mod 256): READ 0x5b000 thru 0x5bfff (0x1000 bytes) 2024-03-28T23:11:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: +2006(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: +2007(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: +2008(216 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: +2009(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: +2010(218 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: +2011(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: +2012(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: +2013(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: +2014(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2015(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2016(224 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2017(225 mod 256): MAPWRITE 0x29000 thru 0x2a9a4 (0x19a5 bytes) 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2018(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2019(227 mod 256): MAPREAD 0x51000 thru 0x518a7 (0x8a8 bytes) 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2020(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2021(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2022(230 mod 256): MAPWRITE 0x1d000 thru 0x1d773 (0x774 bytes) 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2023(231 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2024(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2025(233 mod 256): MAPWRITE 0x2a000 thru 0x2b7c9 (0x17ca bytes) 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2026(234 mod 256): TRUNCATE DOWN from 0x78000 to 0x5b000 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2027(235 mod 256): MAPWRITE 0x5e000 thru 0x5efc9 (0xfca bytes) 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2028(236 mod 256): READ 0x19000 thru 0x19fff (0x1000 bytes) 2024-03-28T23:11:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: +2029(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: +2030(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: +2031(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: +2032(240 mod 256): COPY 0x28000 thru 0x28fff (0x1000 bytes) to 0x34000 thru 0x34fff 2024-03-28T23:11:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: +2033(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: +2034(242 mod 256): MAPREAD 0x10000 thru 0x104af (0x4b0 bytes) 2024-03-28T23:11:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: +2035(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: +2036(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: +2037(245 mod 256): COPY 0x3c000 thru 0x3cfff (0x1000 bytes) to 0x18000 thru 0x18fff 2024-03-28T23:11:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: +2038(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: +2039(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: +2040(248 mod 256): PUNCH 0x4c9db thru 0x4dda3 (0x13c9 bytes) 2024-03-28T23:11:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: +2041(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: +2042(250 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: +2043(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: +2044(252 mod 256): READ 0x44000 thru 0x44fff (0x1000 bytes) 2024-03-28T23:11:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: +2045(253 mod 256): PUNCH 0x447d3 thru 0x4557a (0xda8 bytes) 2024-03-28T23:11:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: +2046(254 mod 256): TRUNCATE DOWN from 0x5efca to 0x1e000 ******WWWW 2024-03-28T23:11:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: +2047(255 mod 256): MAPREAD 0x0 thru 0x694 (0x695 bytes) 2024-03-28T23:11:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: +2048( 0 mod 256): TRUNCATE DOWN from 0x1e000 to 0x8000 2024-03-28T23:11:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: +2049( 1 mod 256): MAPREAD 0x4000 thru 0x4031 (0x32 bytes) 2024-03-28T23:11:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: +2050( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: +2051( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: +2052( 4 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: +2053( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: +2054( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: +2055( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: +2056( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: +2057( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: +2058( 10 mod 256): MAPREAD 0x2000 thru 0x264e (0x64f bytes) 2024-03-28T23:11:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: +2059( 11 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: +2060( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: +2061( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: +2062( 14 mod 256): MAPWRITE 0x56000 thru 0x561e6 (0x1e7 bytes) 2024-03-28T23:11:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: +2063( 15 mod 256): TRUNCATE DOWN from 0x561e7 to 0x1c000 ******WWWW 2024-03-28T23:11:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: +2064( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: +2065( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: +2066( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: +2067( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: +2068( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: +2069( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: +2070( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: +2071( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2072( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2073( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2074( 26 mod 256): MAPREAD 0xd000 thru 0xd610 (0x611 bytes) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2075( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2076( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2077( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2078( 30 mod 256): MAPWRITE 0x36000 thru 0x37238 (0x1239 bytes) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2079( 31 mod 256): READ 0x22000 thru 0x22fff (0x1000 bytes) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2080( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2081( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2082( 34 mod 256): MAPWRITE 0xd000 thru 0xde90 (0xe91 bytes) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2083( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2084( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2085( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2086( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: +2087( 39 mod 256): MAPWRITE 0x5f000 thru 0x606d5 (0x16d6 bytes) 2024-03-28T23:11:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: +2088( 40 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: +2089( 41 mod 256): MAPREAD 0x1c000 thru 0x1d4c5 (0x14c6 bytes) 2024-03-28T23:11:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: +2090( 42 mod 256): MAPREAD 0xc000 thru 0xca92 (0xa93 bytes) 2024-03-28T23:11:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: +2091( 43 mod 256): PUNCH 0x8687 thru 0x8dfb (0x775 bytes) 2024-03-28T23:11:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: +2092( 44 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: +2093( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: +2094( 46 mod 256): WRITE 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-28T23:11:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: +2095( 47 mod 256): READ 0x4a000 thru 0x4afff (0x1000 bytes) 2024-03-28T23:11:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: +2096( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: +2097( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: +2098( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: +2099( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: +2100( 52 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: +2101( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: +2102( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: +2103( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: +2104( 56 mod 256): PUNCH 0x2a2d6 thru 0x2acef (0xa1a bytes) 2024-03-28T23:11:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: +2105( 57 mod 256): WRITE 0x3c000 thru 0x3cfff (0x1000 bytes) 2024-03-28T23:11:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: +2106( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: +2107( 59 mod 256): TRUNCATE DOWN from 0x606d6 to 0x1e000 ******WWWW 2024-03-28T23:11:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: +2108( 60 mod 256): WRITE 0x52000 thru 0x52fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: +2109( 61 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: +2110( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: +2111( 63 mod 256): MAPREAD 0x50000 thru 0x51b82 (0x1b83 bytes) 2024-03-28T23:11:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: +2112( 64 mod 256): COPY 0x3c000 thru 0x3cfff (0x1000 bytes) to 0x78000 thru 0x78fff 2024-03-28T23:11:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: +2113( 65 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: +2114( 66 mod 256): MAPREAD 0x23000 thru 0x232fb (0x2fc bytes) 2024-03-28T23:11:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: +2115( 67 mod 256): MAPREAD 0x78000 thru 0x7816f (0x170 bytes) 2024-03-28T23:11:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: +2116( 68 mod 256): WRITE 0x5a000 thru 0x5afff (0x1000 bytes) 2024-03-28T23:11:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: +2117( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: +2118( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: +2119( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: +2120( 72 mod 256): READ 0x16000 thru 0x16fff (0x1000 bytes) 2024-03-28T23:11:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: +2121( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: +2122( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: +2123( 75 mod 256): PUNCH 0x5dd81 thru 0x5e8b3 (0xb33 bytes) 2024-03-28T23:11:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: +2124( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: +2125( 77 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: +2126( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: +2127( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: +2128( 80 mod 256): MAPREAD 0x2b000 thru 0x2b572 (0x573 bytes) 2024-03-28T23:11:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: +2129( 81 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: +2130( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: +2131( 83 mod 256): WRITE 0x51000 thru 0x51fff (0x1000 bytes) 2024-03-28T23:11:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: +2132( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: +2133( 85 mod 256): WRITE 0x6e000 thru 0x6efff (0x1000 bytes) 2024-03-28T23:11:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: +2134( 86 mod 256): COPY 0x77000 thru 0x77fff (0x1000 bytes) to 0x64000 thru 0x64fff 2024-03-28T23:11:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: +2135( 87 mod 256): MAPREAD 0x72000 thru 0x72afd (0xafe bytes) 2024-03-28T23:11:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: +2136( 88 mod 256): MAPREAD 0x1b000 thru 0x1b66a (0x66b bytes) 2024-03-28T23:11:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: +2137( 89 mod 256): TRUNCATE DOWN from 0x79000 to 0x5000 ******WWWW 2024-03-28T23:11:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: +2138( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: +2139( 91 mod 256): PUNCH 0x4318 thru 0x4fff (0xce8 bytes) 2024-03-28T23:11:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: +2140( 92 mod 256): WRITE 0x2a000 thru 0x2afff (0x1000 bytes) HOLE 2024-03-28T23:11:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: +2141( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: +2142( 94 mod 256): MAPWRITE 0x16000 thru 0x16b95 (0xb96 bytes) 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2143( 95 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2144( 96 mod 256): WRITE 0x4a000 thru 0x4afff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2145( 97 mod 256): MAPREAD 0x4000 thru 0x422f (0x230 bytes) 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2146( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2147( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2148(100 mod 256): TRUNCATE UP from 0x4b000 to 0x53000 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2149(101 mod 256): MAPWRITE 0x35000 thru 0x352a5 (0x2a6 bytes) 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2150(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2151(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2152(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2153(105 mod 256): PUNCH 0x23e44 thru 0x25246 (0x1403 bytes) 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2154(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2155(107 mod 256): PUNCH 0x11e64 thru 0x13346 (0x14e3 bytes) 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2156(108 mod 256): MAPREAD 0x24000 thru 0x25341 (0x1342 bytes) 2024-03-28T23:11:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: +2157(109 mod 256): TRUNCATE DOWN from 0x53000 to 0x34000 ******WWWW 2024-03-28T23:11:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: +2158(110 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: +2159(111 mod 256): PUNCH 0x67db thru 0x7e6f (0x1695 bytes) 2024-03-28T23:11:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: +2160(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: +2161(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: +2162(114 mod 256): MAPWRITE 0x54000 thru 0x5538e (0x138f bytes) 2024-03-28T23:11:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: +2163(115 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: +2164(116 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: +2165(117 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: +2166(118 mod 256): PUNCH 0x14ba2 thru 0x153b6 (0x815 bytes) 2024-03-28T23:11:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: +2167(119 mod 256): WRITE 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-28T23:11:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: +2168(120 mod 256): READ 0x38000 thru 0x38fff (0x1000 bytes) 2024-03-28T23:11:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: +2169(121 mod 256): MAPREAD 0xc000 thru 0xd2cf (0x12d0 bytes) 2024-03-28T23:11:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: +2170(122 mod 256): PUNCH 0x40696 thru 0x4090a (0x275 bytes) 2024-03-28T23:11:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: +2171(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2172(124 mod 256): WRITE 0x38000 thru 0x38fff (0x1000 bytes) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2173(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2174(126 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2175(127 mod 256): READ 0xa000 thru 0xafff (0x1000 bytes) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2176(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2177(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2178(130 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2179(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2180(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2181(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2182(134 mod 256): MAPWRITE 0x22000 thru 0x234f5 (0x14f6 bytes) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2183(135 mod 256): PUNCH 0xda08 thru 0xf96d (0x1f66 bytes) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2184(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2185(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: +2186(138 mod 256): MAPWRITE 0x39000 thru 0x3ad04 (0x1d05 bytes) 2024-03-28T23:11:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: +2187(139 mod 256): TRUNCATE DOWN from 0x5538f to 0x3c000 2024-03-28T23:11:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: +2188(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: +2189(141 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: +2190(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: +2191(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: +2192(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: +2193(145 mod 256): WRITE 0x50000 thru 0x50fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: +2194(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: +2195(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: +2196(148 mod 256): TRUNCATE DOWN from 0x51000 to 0x7000 ******WWWW 2024-03-28T23:11:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: +2197(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: +2198(150 mod 256): TRUNCATE UP from 0x7000 to 0x12000 2024-03-28T23:11:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: +2199(151 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: +2200(152 mod 256): TRUNCATE UP from 0x12000 to 0x13000 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2201(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2202(154 mod 256): PUNCH 0xb7fb thru 0xb864 (0x6a bytes) 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2203(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2204(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2205(157 mod 256): TRUNCATE DOWN from 0x13000 to 0x5000 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2206(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2207(159 mod 256): MAPREAD 0x1000 thru 0x2492 (0x1493 bytes) 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2208(160 mod 256): READ 0x2000 thru 0x2fff (0x1000 bytes) 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2209(161 mod 256): MAPWRITE 0x5000 thru 0x501e (0x1f bytes) 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2210(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2211(163 mod 256): MAPWRITE 0x27000 thru 0x279f1 (0x9f2 bytes) 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2212(164 mod 256): READ 0x1e000 thru 0x1efff (0x1000 bytes) 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2213(165 mod 256): WRITE 0x62000 thru 0x62fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2214(166 mod 256): WRITE 0xf000 thru 0xffff (0x1000 bytes) 2024-03-28T23:11:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: +2215(167 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: +2216(168 mod 256): TRUNCATE DOWN from 0x63000 to 0xa000 ******WWWW 2024-03-28T23:11:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: +2217(169 mod 256): MAPREAD 0x4000 thru 0x4c1e (0xc1f bytes) 2024-03-28T23:11:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: +2218(170 mod 256): READ 0x2000 thru 0x2fff (0x1000 bytes) 2024-03-28T23:11:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: +2219(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: +2220(172 mod 256): TRUNCATE UP from 0xa000 to 0x1e000 2024-03-28T23:11:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: +2221(173 mod 256): MAPREAD 0x1c000 thru 0x1c59d (0x59e bytes) 2024-03-28T23:11:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: +2222(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: +2223(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: +2224(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: +2225(177 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: +2226(178 mod 256): MAPWRITE 0x6b000 thru 0x6c20d (0x120e bytes) 2024-03-28T23:11:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: +2227(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: +2228(180 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: +2229(181 mod 256): TRUNCATE UP from 0x6c20e to 0x73000 2024-03-28T23:11:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: +2230(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: +2231(183 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: +2232(184 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: +2233(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: +2234(186 mod 256): COPY 0x1c000 thru 0x1cfff (0x1000 bytes) to 0x42000 thru 0x42fff 2024-03-28T23:11:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: +2235(187 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-28T23:11:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: +2236(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: +2237(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: +2238(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: +2239(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: +2240(192 mod 256): PUNCH 0x138e4 thru 0x149ba (0x10d7 bytes) 2024-03-28T23:11:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: +2241(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: +2242(194 mod 256): WRITE 0x4f000 thru 0x4ffff (0x1000 bytes) 2024-03-28T23:11:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: +2243(195 mod 256): MAPWRITE 0x13000 thru 0x14874 (0x1875 bytes) 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2244(196 mod 256): READ 0x1a000 thru 0x1afff (0x1000 bytes) 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2245(197 mod 256): MAPREAD 0x31000 thru 0x32320 (0x1321 bytes) 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2246(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2247(199 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2248(200 mod 256): READ 0x6d000 thru 0x6dfff (0x1000 bytes) 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2249(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2250(202 mod 256): WRITE 0x14000 thru 0x14fff (0x1000 bytes) 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2251(203 mod 256): TRUNCATE DOWN from 0x73000 to 0x22000 ******WWWW 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2252(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2253(205 mod 256): TRUNCATE UP from 0x22000 to 0x64000 ******WWWW 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2254(206 mod 256): READ 0x4c000 thru 0x4cfff (0x1000 bytes) 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2255(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2256(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2257(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: +2258(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: +2259(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: +2260(212 mod 256): MAPWRITE 0x6c000 thru 0x6ced4 (0xed5 bytes) 2024-03-28T23:11:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: +2261(213 mod 256): MAPWRITE 0x29000 thru 0x290e1 (0xe2 bytes) 2024-03-28T23:11:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: +2262(214 mod 256): MAPREAD 0x6000 thru 0x61ec (0x1ed bytes) 2024-03-28T23:11:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: +2263(215 mod 256): PUNCH 0x5d6a0 thru 0x5f1e6 (0x1b47 bytes) 2024-03-28T23:11:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: +2264(216 mod 256): MAPREAD 0xd000 thru 0xea95 (0x1a96 bytes) 2024-03-28T23:11:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: +2265(217 mod 256): TRUNCATE DOWN from 0x6ced5 to 0x6000 ******WWWW 2024-03-28T23:11:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: +2266(218 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: +2267(219 mod 256): MAPWRITE 0x21000 thru 0x2246a (0x146b bytes) 2024-03-28T23:11:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: +2268(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: +2269(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: +2270(222 mod 256): MAPWRITE 0x58000 thru 0x58fab (0xfac bytes) 2024-03-28T23:11:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: +2271(223 mod 256): COPY 0x29000 thru 0x29fff (0x1000 bytes) to 0xa000 thru 0xafff 2024-03-28T23:11:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: +2272(224 mod 256): MAPREAD 0x4b000 thru 0x4c178 (0x1179 bytes) 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2273(225 mod 256): READ 0x40000 thru 0x40fff (0x1000 bytes) 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2274(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2275(227 mod 256): READ 0x25000 thru 0x25fff (0x1000 bytes) 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2276(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2277(229 mod 256): MAPREAD 0x1b000 thru 0x1c17a (0x117b bytes) 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2278(230 mod 256): WRITE 0xc000 thru 0xcfff (0x1000 bytes) 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2279(231 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2280(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2281(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2282(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2283(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2284(236 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2285(237 mod 256): MAPREAD 0x20000 thru 0x2004a (0x4b bytes) 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2286(238 mod 256): TRUNCATE UP from 0x58fac to 0x78000 2024-03-28T23:11:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: +2287(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: +2288(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: +2289(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: +2290(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: +2291(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: +2292(244 mod 256): PUNCH 0x3ac27 thru 0x3c310 (0x16ea bytes) 2024-03-28T23:11:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: +2293(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: +2294(246 mod 256): TRUNCATE DOWN from 0x78000 to 0x43000 2024-03-28T23:11:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: +2295(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: +2296(248 mod 256): TRUNCATE DOWN from 0x43000 to 0x21000 ******WWWW 2024-03-28T23:11:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: +2297(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: +2298(250 mod 256): MAPREAD 0xb000 thru 0xbc10 (0xc11 bytes) 2024-03-28T23:11:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: +2299(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: +2300(252 mod 256): MAPREAD 0x1000 thru 0x25ae (0x15af bytes) 2024-03-28T23:11:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: +2301(253 mod 256): TRUNCATE UP from 0x21000 to 0x63000 ******WWWW 2024-03-28T23:11:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: +2302(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: +2303(255 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-28T23:11:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: +2304( 0 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: +2305( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: +2306( 2 mod 256): MAPREAD 0x1d000 thru 0x1e558 (0x1559 bytes) 2024-03-28T23:11:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: +2307( 3 mod 256): WRITE 0x6b000 thru 0x6bfff (0x1000 bytes) HOLE 2024-03-28T23:11:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: +2308( 4 mod 256): MAPWRITE 0x3000 thru 0x4876 (0x1877 bytes) 2024-03-28T23:11:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: +2309( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: +2310( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: +2311( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: +2312( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: +2313( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2314( 10 mod 256): MAPWRITE 0x48000 thru 0x49b81 (0x1b82 bytes) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2315( 11 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2316( 12 mod 256): PUNCH 0x50c71 thru 0x50db7 (0x147 bytes) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2317( 13 mod 256): PUNCH 0x3e759 thru 0x3f117 (0x9bf bytes) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2318( 14 mod 256): WRITE 0x41000 thru 0x41fff (0x1000 bytes) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2319( 15 mod 256): MAPWRITE 0x38000 thru 0x39a5f (0x1a60 bytes) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2320( 16 mod 256): MAPREAD 0x35000 thru 0x36a24 (0x1a25 bytes) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2321( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2322( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2323( 19 mod 256): MAPWRITE 0x45000 thru 0x45c1a (0xc1b bytes) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2324( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2325( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2326( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2327( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: +2328( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2329( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2330( 26 mod 256): READ 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2331( 27 mod 256): TRUNCATE DOWN from 0x6c000 to 0x21000 ******WWWW 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2332( 28 mod 256): TRUNCATE UP from 0x21000 to 0x66000 ******WWWW 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2333( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2334( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2335( 31 mod 256): MAPREAD 0x13000 thru 0x141d4 (0x11d5 bytes) 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2336( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2337( 33 mod 256): COPY 0xb000 thru 0xbfff (0x1000 bytes) to 0x1000 thru 0x1fff 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2338( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2339( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2340( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2341( 37 mod 256): COPY 0x56000 thru 0x56fff (0x1000 bytes) to 0x4e000 thru 0x4efff 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2342( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: +2343( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: +2344( 40 mod 256): READ 0x62000 thru 0x62fff (0x1000 bytes) 2024-03-28T23:11:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: +2345( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: +2346( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: +2347( 43 mod 256): MAPREAD 0x29000 thru 0x29a55 (0xa56 bytes) 2024-03-28T23:11:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: +2348( 44 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: +2349( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: +2350( 46 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: +2351( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: +2352( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: +2353( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: +2354( 50 mod 256): MAPWRITE 0x4c000 thru 0x4d052 (0x1053 bytes) 2024-03-28T23:11:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: +2355( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: +2356( 52 mod 256): MAPWRITE 0x2c000 thru 0x2c2dd (0x2de bytes) 2024-03-28T23:11:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: +2357( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: +2358( 54 mod 256): READ 0x4f000 thru 0x4ffff (0x1000 bytes) 2024-03-28T23:11:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: +2359( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: +2360( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: +2361( 57 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: +2362( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: +2363( 59 mod 256): PUNCH 0x353ba thru 0x3594d (0x594 bytes) 2024-03-28T23:11:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: +2364( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: +2365( 61 mod 256): MAPREAD 0x41000 thru 0x41f4a (0xf4b bytes) 2024-03-28T23:11:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: +2366( 62 mod 256): MAPREAD 0x50000 thru 0x51d1b (0x1d1c bytes) 2024-03-28T23:11:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: +2367( 63 mod 256): PUNCH 0x1e36c thru 0x1ea48 (0x6dd bytes) 2024-03-28T23:11:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: +2368( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: +2369( 65 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: +2370( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: +2371( 67 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2372( 68 mod 256): TRUNCATE DOWN from 0x66000 to 0x13000 ******WWWW 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2373( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2374( 70 mod 256): MAPREAD 0xd000 thru 0xdaa7 (0xaa8 bytes) 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2375( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2376( 72 mod 256): MAPWRITE 0x69000 thru 0x69cba (0xcbb bytes) 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2377( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2378( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2379( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2380( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2381( 77 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2382( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2383( 79 mod 256): MAPWRITE 0x37000 thru 0x37ef8 (0xef9 bytes) 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2384( 80 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2385( 81 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: +2386( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: +2387( 83 mod 256): MAPREAD 0x6000 thru 0x7dff (0x1e00 bytes) 2024-03-28T23:11:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: +2388( 84 mod 256): MAPREAD 0x15000 thru 0x15bef (0xbf0 bytes) 2024-03-28T23:11:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: +2389( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: +2390( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: +2391( 87 mod 256): PUNCH 0x36719 thru 0x37cd7 (0x15bf bytes) 2024-03-28T23:11:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: +2392( 88 mod 256): READ 0xd000 thru 0xdfff (0x1000 bytes) 2024-03-28T23:11:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: +2393( 89 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: +2394( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: +2395( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: +2396( 92 mod 256): COPY 0x16000 thru 0x16fff (0x1000 bytes) to 0x50000 thru 0x50fff 2024-03-28T23:11:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: +2397( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: +2398( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: +2399( 95 mod 256): MAPWRITE 0xc000 thru 0xcce2 (0xce3 bytes) 2024-03-28T23:11:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: +2400( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2401( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2402( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2403( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2404(100 mod 256): READ 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2405(101 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2406(102 mod 256): MAPREAD 0x11000 thru 0x1288b (0x188c bytes) 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2407(103 mod 256): TRUNCATE DOWN from 0x69cbb to 0x63000 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2408(104 mod 256): TRUNCATE UP from 0x63000 to 0x70000 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2409(105 mod 256): MAPWRITE 0x5d000 thru 0x5d1f0 (0x1f1 bytes) 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2410(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2411(107 mod 256): TRUNCATE UP from 0x70000 to 0x74000 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2412(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2413(109 mod 256): READ 0x48000 thru 0x48fff (0x1000 bytes) 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2414(110 mod 256): WRITE 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-28T23:11:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: +2415(111 mod 256): WRITE 0x59000 thru 0x59fff (0x1000 bytes) 2024-03-28T23:11:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: +2416(112 mod 256): MAPWRITE 0x51000 thru 0x52c6d (0x1c6e bytes) 2024-03-28T23:11:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: +2417(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: +2418(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: +2419(115 mod 256): MAPWRITE 0x66000 thru 0x67801 (0x1802 bytes) 2024-03-28T23:11:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: +2420(116 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: +2421(117 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: +2422(118 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: +2423(119 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: +2424(120 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: +2425(121 mod 256): MAPWRITE 0x3b000 thru 0x3c2db (0x12dc bytes) 2024-03-28T23:11:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: +2426(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: +2427(123 mod 256): MAPWRITE 0x72000 thru 0x73637 (0x1638 bytes) 2024-03-28T23:11:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: +2428(124 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: +2429(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2430(126 mod 256): COPY 0x64000 thru 0x64fff (0x1000 bytes) to 0x73000 thru 0x73fff 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2431(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2432(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2433(129 mod 256): MAPREAD 0x4f000 thru 0x50d7a (0x1d7b bytes) 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2434(130 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2435(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2436(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2437(133 mod 256): PUNCH 0x571bd thru 0x588d8 (0x171c bytes) 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2438(134 mod 256): WRITE 0x2f000 thru 0x2ffff (0x1000 bytes) 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2439(135 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2440(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2441(137 mod 256): TRUNCATE DOWN from 0x74000 to 0x6a000 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2442(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2443(139 mod 256): COPY 0x28000 thru 0x28fff (0x1000 bytes) to 0x3d000 thru 0x3dfff 2024-03-28T23:11:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: +2444(140 mod 256): MAPREAD 0x50000 thru 0x51f56 (0x1f57 bytes) 2024-03-28T23:11:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: +2445(141 mod 256): MAPREAD 0x24000 thru 0x24898 (0x899 bytes) 2024-03-28T23:11:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: +2446(142 mod 256): PUNCH 0x358e0 thru 0x36d36 (0x1457 bytes) 2024-03-28T23:11:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: +2447(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: +2448(144 mod 256): COPY 0x37000 thru 0x37fff (0x1000 bytes) to 0x23000 thru 0x23fff EEEE****** 2024-03-28T23:11:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: +2449(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: +2450(146 mod 256): TRUNCATE UP from 0x6a000 to 0x6b000 2024-03-28T23:11:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: +2451(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: +2452(148 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: +2453(149 mod 256): PUNCH 0x3e14e thru 0x3eb46 (0x9f9 bytes) 2024-03-28T23:11:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: +2454(150 mod 256): PUNCH 0x490c0 thru 0x4af59 (0x1e9a bytes) 2024-03-28T23:11:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: +2455(151 mod 256): MAPWRITE 0x6a000 thru 0x6b1d7 (0x11d8 bytes) 2024-03-28T23:11:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: +2456(152 mod 256): MAPREAD 0x68000 thru 0x69024 (0x1025 bytes) 2024-03-28T23:11:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: +2457(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: +2458(154 mod 256): COPY 0x5c000 thru 0x5cfff (0x1000 bytes) to 0x41000 thru 0x41fff 2024-03-28T23:11:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: +2459(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: +2460(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: +2461(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: +2462(158 mod 256): READ 0x2f000 thru 0x2ffff (0x1000 bytes) 2024-03-28T23:11:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: +2463(159 mod 256): PUNCH 0x40348 thru 0x4182b (0x14e4 bytes) 2024-03-28T23:11:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: +2464(160 mod 256): TRUNCATE DOWN from 0x6b1d8 to 0x5f000 2024-03-28T23:11:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: +2465(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: +2466(162 mod 256): MAPREAD 0x1d000 thru 0x1ec9d (0x1c9e bytes) 2024-03-28T23:11:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: +2467(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: +2468(164 mod 256): MAPREAD 0x26000 thru 0x278a4 (0x18a5 bytes) 2024-03-28T23:11:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: +2469(165 mod 256): MAPREAD 0x53000 thru 0x53850 (0x851 bytes) 2024-03-28T23:11:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: +2470(166 mod 256): TRUNCATE DOWN from 0x5f000 to 0x17000 ******WWWW 2024-03-28T23:11:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: +2471(167 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2472(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2473(169 mod 256): WRITE 0x74000 thru 0x74fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2474(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2475(171 mod 256): COPY 0x2e000 thru 0x2efff (0x1000 bytes) to 0x2000 thru 0x2fff 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2476(172 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2477(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2478(174 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x6f000 thru 0x6ffff 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2479(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2480(176 mod 256): MAPREAD 0x11000 thru 0x12a61 (0x1a62 bytes) 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2481(177 mod 256): READ 0x6c000 thru 0x6cfff (0x1000 bytes) 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2482(178 mod 256): COPY 0x26000 thru 0x26fff (0x1000 bytes) to 0x48000 thru 0x48fff 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2483(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2484(180 mod 256): PUNCH 0x5c600 thru 0x5e1fc (0x1bfd bytes) 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2485(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: +2486(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2487(183 mod 256): READ 0x34000 thru 0x34fff (0x1000 bytes) 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2488(184 mod 256): COPY 0x7000 thru 0x7fff (0x1000 bytes) to 0x67000 thru 0x67fff 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2489(185 mod 256): MAPWRITE 0x71000 thru 0x723a2 (0x13a3 bytes) 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2490(186 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2491(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2492(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2493(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2494(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2495(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2496(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2497(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2498(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2499(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2500(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: +2501(197 mod 256): TRUNCATE DOWN from 0x75000 to 0x10000 ******WWWW 2024-03-28T23:11:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: +2502(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: +2503(199 mod 256): MAPWRITE 0x2b000 thru 0x2cdca (0x1dcb bytes) 2024-03-28T23:11:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: +2504(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: +2505(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: +2506(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: +2507(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: +2508(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: +2509(205 mod 256): COPY 0x12000 thru 0x12fff (0x1000 bytes) to 0x1c000 thru 0x1cfff 2024-03-28T23:11:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: +2510(206 mod 256): READ 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-28T23:11:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: +2511(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: +2512(208 mod 256): TRUNCATE UP from 0x2cdcb to 0x62000 ******WWWW 2024-03-28T23:11:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: +2513(209 mod 256): READ 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-28T23:11:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: +2514(210 mod 256): TRUNCATE UP from 0x62000 to 0x71000 2024-03-28T23:11:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: +2515(211 mod 256): MAPWRITE 0x25000 thru 0x25c97 (0xc98 bytes) 2024-03-28T23:11:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: +2516(212 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: +2517(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: +2518(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: +2519(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: +2520(216 mod 256): COPY 0x44000 thru 0x44fff (0x1000 bytes) to 0x59000 thru 0x59fff 2024-03-28T23:11:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: +2521(217 mod 256): WRITE 0x57000 thru 0x57fff (0x1000 bytes) 2024-03-28T23:11:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: +2522(218 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: +2523(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: +2524(220 mod 256): PUNCH 0x1a69d thru 0x1b3e7 (0xd4b bytes) 2024-03-28T23:11:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: +2525(221 mod 256): TRUNCATE DOWN from 0x71000 to 0x4a000 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2526(222 mod 256): WRITE 0x4c000 thru 0x4cfff (0x1000 bytes) HOLE 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2527(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2528(224 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2529(225 mod 256): PUNCH 0x14ee7 thru 0x15f86 (0x10a0 bytes) 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2530(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2531(227 mod 256): MAPREAD 0x16000 thru 0x160d4 (0xd5 bytes) 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2532(228 mod 256): TRUNCATE UP from 0x4d000 to 0x5e000 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2533(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2534(230 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2535(231 mod 256): MAPWRITE 0x56000 thru 0x57845 (0x1846 bytes) 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2536(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2537(233 mod 256): MAPWRITE 0x33000 thru 0x34b82 (0x1b83 bytes) 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2538(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2539(235 mod 256): PUNCH 0x156cd thru 0x15f5b (0x88f bytes) 2024-03-28T23:11:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: +2540(236 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2541(237 mod 256): PUNCH 0x1aed1 thru 0x1b63f (0x76f bytes) 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2542(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2543(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2544(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2545(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2546(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2547(243 mod 256): MAPWRITE 0x59000 thru 0x5929e (0x29f bytes) 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2548(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2549(245 mod 256): TRUNCATE DOWN from 0x5e000 to 0x0 ******WWWW 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2550(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2551(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2552(248 mod 256): TRUNCATE UP from 0x0 to 0x66000 ******WWWW 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2553(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2554(250 mod 256): MAPREAD 0x20000 thru 0x20a17 (0xa18 bytes) 2024-03-28T23:11:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: +2555(251 mod 256): READ 0x39000 thru 0x39fff (0x1000 bytes) 2024-03-28T23:11:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2556(252 mod 256): TRUNCATE DOWN from 0x66000 to 0x40000 2024-03-28T23:11:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2557(253 mod 256): TRUNCATE DOWN from 0x40000 to 0x7000 ******WWWW 2024-03-28T23:11:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2558(254 mod 256): MAPREAD 0x6000 thru 0x66a0 (0x6a1 bytes) 2024-03-28T23:11:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2559(255 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2560( 0 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2561( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2562( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2563( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2564( 4 mod 256): PUNCH 0x21c thru 0x1204 (0xfe9 bytes) 2024-03-28T23:11:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2565( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2566( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2567( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2568( 8 mod 256): PUNCH 0xa37 thru 0x184e (0xe18 bytes) 2024-03-28T23:11:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: +2569( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: +2570( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: +2571( 11 mod 256): MAPREAD 0x4000 thru 0x4d4b (0xd4c bytes) 2024-03-28T23:11:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: +2572( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: +2573( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: +2574( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: +2575( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: +2576( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: +2577( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: +2578( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: +2579( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: +2580( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: +2581( 21 mod 256): PUNCH 0x1954 thru 0x1d26 (0x3d3 bytes) 2024-03-28T23:11:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: +2582( 22 mod 256): TRUNCATE UP from 0x7000 to 0x6d000 ******WWWW 2024-03-28T23:11:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: +2583( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2584( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2585( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2586( 26 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2587( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2588( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2589( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2590( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2591( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2592( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2593( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2594( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2595( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2596( 36 mod 256): MAPREAD 0xc000 thru 0xdaaf (0x1ab0 bytes) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2597( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: +2598( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2599( 39 mod 256): PUNCH 0x4de7e thru 0x4fc7c (0x1dff bytes) 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2600( 40 mod 256): TRUNCATE DOWN from 0x6d000 to 0x2f000 ******WWWW 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2601( 41 mod 256): PUNCH 0x288f7 thru 0x2908d (0x797 bytes) 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2602( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2603( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2604( 44 mod 256): PUNCH 0x28a25 thru 0x2a38d (0x1969 bytes) 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2605( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2606( 46 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2607( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2608( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2609( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2610( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2611( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2612( 52 mod 256): MAPWRITE 0x63000 thru 0x63cae (0xcaf bytes) 2024-03-28T23:11:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: +2613( 53 mod 256): PUNCH 0x3be44 thru 0x3d1ee (0x13ab bytes) 2024-03-28T23:11:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: +2614( 54 mod 256): TRUNCATE DOWN from 0x63caf to 0x22000 ******WWWW 2024-03-28T23:11:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: +2615( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: +2616( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: +2617( 57 mod 256): MAPREAD 0xb000 thru 0xce06 (0x1e07 bytes) 2024-03-28T23:11:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: +2618( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: +2619( 59 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: +2620( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: +2621( 61 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: +2622( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: +2623( 63 mod 256): PUNCH 0x1e36b thru 0x1e89e (0x534 bytes) 2024-03-28T23:11:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: +2624( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: +2625( 65 mod 256): TRUNCATE UP from 0x22000 to 0x77000 ******WWWW 2024-03-28T23:11:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: +2626( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: +2627( 67 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: +2628( 68 mod 256): COPY 0x23000 thru 0x23fff (0x1000 bytes) to 0x4b000 thru 0x4bfff 2024-03-28T23:11:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: +2629( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: +2630( 70 mod 256): MAPWRITE 0x2000 thru 0x3c8e (0x1c8f bytes) 2024-03-28T23:11:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: +2631( 71 mod 256): WRITE 0x5c000 thru 0x5cfff (0x1000 bytes) 2024-03-28T23:11:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: +2632( 72 mod 256): MAPWRITE 0x4c000 thru 0x4c874 (0x875 bytes) 2024-03-28T23:11:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: +2633( 73 mod 256): READ 0x67000 thru 0x67fff (0x1000 bytes) 2024-03-28T23:11:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: +2634( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: +2635( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: +2636( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: +2637( 77 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: +2638( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: +2639( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: +2640( 80 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: +2641( 81 mod 256): TRUNCATE DOWN from 0x77000 to 0x1e000 ******WWWW 2024-03-28T23:11:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: +2642( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: +2643( 83 mod 256): TRUNCATE DOWN from 0x1e000 to 0x15000 2024-03-28T23:11:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: +2644( 84 mod 256): TRUNCATE UP from 0x15000 to 0x44000 ******WWWW 2024-03-28T23:11:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: +2645( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: +2646( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: +2647( 87 mod 256): MAPREAD 0x3a000 thru 0x3b322 (0x1323 bytes) 2024-03-28T23:11:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: +2648( 88 mod 256): PUNCH 0x391a1 thru 0x3982b (0x68b bytes) 2024-03-28T23:11:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: +2649( 89 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: +2650( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: +2651( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: +2652( 92 mod 256): MAPWRITE 0x1000 thru 0x2d6b (0x1d6c bytes) 2024-03-28T23:11:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: +2653( 93 mod 256): MAPWRITE 0x17000 thru 0x18e46 (0x1e47 bytes) 2024-03-28T23:11:39.803 INFO:teuthology.orchestra.run.smithi153.stdout: +2654( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.804 INFO:teuthology.orchestra.run.smithi153.stdout: +2655( 95 mod 256): MAPWRITE 0x17000 thru 0x18727 (0x1728 bytes) 2024-03-28T23:11:39.804 INFO:teuthology.orchestra.run.smithi153.stdout: +2656( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.804 INFO:teuthology.orchestra.run.smithi153.stdout: +2657( 97 mod 256): MAPREAD 0x14000 thru 0x14357 (0x358 bytes) 2024-03-28T23:11:39.804 INFO:teuthology.orchestra.run.smithi153.stdout: +2658( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.804 INFO:teuthology.orchestra.run.smithi153.stdout: +2659( 99 mod 256): COPY 0x10000 thru 0x10fff (0x1000 bytes) to 0x1b000 thru 0x1bfff 2024-03-28T23:11:39.804 INFO:teuthology.orchestra.run.smithi153.stdout: +2660(100 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.804 INFO:teuthology.orchestra.run.smithi153.stdout: +2661(101 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.804 INFO:teuthology.orchestra.run.smithi153.stdout: +2662(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.804 INFO:teuthology.orchestra.run.smithi153.stdout: +2663(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.804 INFO:teuthology.orchestra.run.smithi153.stdout: +2664(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.804 INFO:teuthology.orchestra.run.smithi153.stdout: +2665(105 mod 256): MAPWRITE 0x54000 thru 0x55953 (0x1954 bytes) 2024-03-28T23:11:39.804 INFO:teuthology.orchestra.run.smithi153.stdout: +2666(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.804 INFO:teuthology.orchestra.run.smithi153.stdout: +2667(107 mod 256): PUNCH 0x52a thru 0x2369 (0x1e40 bytes) 2024-03-28T23:11:39.804 INFO:teuthology.orchestra.run.smithi153.stdout: +2668(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2669(109 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2670(110 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2671(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2672(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2673(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2674(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2675(115 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2676(116 mod 256): COPY 0x32000 thru 0x32fff (0x1000 bytes) to 0xb000 thru 0xbfff 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2677(117 mod 256): MAPREAD 0x48000 thru 0x49614 (0x1615 bytes) 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2678(118 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2679(119 mod 256): READ 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2680(120 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2681(121 mod 256): COPY 0x3a000 thru 0x3afff (0x1000 bytes) to 0x50000 thru 0x50fff 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2682(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.805 INFO:teuthology.orchestra.run.smithi153.stdout: +2683(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.806 INFO:teuthology.orchestra.run.smithi153.stdout: +2684(124 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.806 INFO:teuthology.orchestra.run.smithi153.stdout: +2685(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.806 INFO:teuthology.orchestra.run.smithi153.stdout: +2686(126 mod 256): TRUNCATE DOWN from 0x55954 to 0x29000 ******WWWW 2024-03-28T23:11:39.806 INFO:teuthology.orchestra.run.smithi153.stdout: +2687(127 mod 256): READ 0x16000 thru 0x16fff (0x1000 bytes) 2024-03-28T23:11:39.806 INFO:teuthology.orchestra.run.smithi153.stdout: +2688(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.806 INFO:teuthology.orchestra.run.smithi153.stdout: +2689(129 mod 256): TRUNCATE UP from 0x29000 to 0x55000 ******WWWW 2024-03-28T23:11:39.806 INFO:teuthology.orchestra.run.smithi153.stdout: +2690(130 mod 256): MAPREAD 0x5000 thru 0x6306 (0x1307 bytes) 2024-03-28T23:11:39.806 INFO:teuthology.orchestra.run.smithi153.stdout: +2691(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.806 INFO:teuthology.orchestra.run.smithi153.stdout: +2692(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.806 INFO:teuthology.orchestra.run.smithi153.stdout: +2693(133 mod 256): MAPWRITE 0x1e000 thru 0x1f3c6 (0x13c7 bytes) 2024-03-28T23:11:39.806 INFO:teuthology.orchestra.run.smithi153.stdout: +2694(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.806 INFO:teuthology.orchestra.run.smithi153.stdout: +2695(135 mod 256): MAPWRITE 0x3000 thru 0x30b6 (0xb7 bytes) 2024-03-28T23:11:39.806 INFO:teuthology.orchestra.run.smithi153.stdout: +2696(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.806 INFO:teuthology.orchestra.run.smithi153.stdout: +2697(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2698(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2699(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2700(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2701(141 mod 256): PUNCH 0x10a32 thru 0x128bb (0x1e8a bytes) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2702(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2703(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2704(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2705(145 mod 256): MAPWRITE 0x6e000 thru 0x6f3fc (0x13fd bytes) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2706(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2707(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2708(148 mod 256): WRITE 0x69000 thru 0x69fff (0x1000 bytes) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2709(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2710(150 mod 256): READ 0x28000 thru 0x28fff (0x1000 bytes) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2711(151 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2712(152 mod 256): MAPWRITE 0x50000 thru 0x5197a (0x197b bytes) 2024-03-28T23:11:39.807 INFO:teuthology.orchestra.run.smithi153.stdout: +2713(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2714(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2715(155 mod 256): MAPREAD 0x4000 thru 0x4e84 (0xe85 bytes) 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2716(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2717(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2718(158 mod 256): MAPWRITE 0x6000 thru 0x65c3 (0x5c4 bytes) 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2719(159 mod 256): PUNCH 0x158f thru 0x2bb8 (0x162a bytes) 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2720(160 mod 256): TRUNCATE DOWN from 0x6f3fd to 0x22000 ******WWWW 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2721(161 mod 256): PUNCH 0x1f259 thru 0x1f949 (0x6f1 bytes) 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2722(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2723(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2724(164 mod 256): TRUNCATE DOWN from 0x22000 to 0x21000 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2725(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2726(166 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2727(167 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.808 INFO:teuthology.orchestra.run.smithi153.stdout: +2728(168 mod 256): MAPWRITE 0x67000 thru 0x688b9 (0x18ba bytes) 2024-03-28T23:11:39.809 INFO:teuthology.orchestra.run.smithi153.stdout: +2729(169 mod 256): MAPWRITE 0x20000 thru 0x20355 (0x356 bytes) 2024-03-28T23:11:39.809 INFO:teuthology.orchestra.run.smithi153.stdout: +2730(170 mod 256): MAPWRITE 0xb000 thru 0xc917 (0x1918 bytes) 2024-03-28T23:11:39.809 INFO:teuthology.orchestra.run.smithi153.stdout: +2731(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.809 INFO:teuthology.orchestra.run.smithi153.stdout: +2732(172 mod 256): PUNCH 0x45849 thru 0x46e95 (0x164d bytes) 2024-03-28T23:11:39.809 INFO:teuthology.orchestra.run.smithi153.stdout: +2733(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.809 INFO:teuthology.orchestra.run.smithi153.stdout: +2734(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.809 INFO:teuthology.orchestra.run.smithi153.stdout: +2735(175 mod 256): COPY 0x29000 thru 0x29fff (0x1000 bytes) to 0x1e000 thru 0x1efff 2024-03-28T23:11:39.809 INFO:teuthology.orchestra.run.smithi153.stdout: +2736(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.809 INFO:teuthology.orchestra.run.smithi153.stdout: +2737(177 mod 256): PUNCH 0x3ecad thru 0x403ea (0x173e bytes) 2024-03-28T23:11:39.809 INFO:teuthology.orchestra.run.smithi153.stdout: +2738(178 mod 256): MAPREAD 0x15000 thru 0x15318 (0x319 bytes) 2024-03-28T23:11:39.809 INFO:teuthology.orchestra.run.smithi153.stdout: +2739(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.809 INFO:teuthology.orchestra.run.smithi153.stdout: +2740(180 mod 256): MAPREAD 0x3f000 thru 0x3fa6d (0xa6e bytes) 2024-03-28T23:11:39.809 INFO:teuthology.orchestra.run.smithi153.stdout: +2741(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.810 INFO:teuthology.orchestra.run.smithi153.stdout: +2742(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.810 INFO:teuthology.orchestra.run.smithi153.stdout: +2743(183 mod 256): PUNCH 0x18333 thru 0x19134 (0xe02 bytes) 2024-03-28T23:11:39.810 INFO:teuthology.orchestra.run.smithi153.stdout: +2744(184 mod 256): MAPREAD 0x12000 thru 0x123dd (0x3de bytes) 2024-03-28T23:11:39.810 INFO:teuthology.orchestra.run.smithi153.stdout: +2745(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.810 INFO:teuthology.orchestra.run.smithi153.stdout: +2746(186 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.810 INFO:teuthology.orchestra.run.smithi153.stdout: +2747(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.810 INFO:teuthology.orchestra.run.smithi153.stdout: +2748(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.810 INFO:teuthology.orchestra.run.smithi153.stdout: +2749(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.810 INFO:teuthology.orchestra.run.smithi153.stdout: +2750(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.810 INFO:teuthology.orchestra.run.smithi153.stdout: +2751(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.810 INFO:teuthology.orchestra.run.smithi153.stdout: +2752(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.810 INFO:teuthology.orchestra.run.smithi153.stdout: +2753(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.810 INFO:teuthology.orchestra.run.smithi153.stdout: +2754(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.810 INFO:teuthology.orchestra.run.smithi153.stdout: +2755(195 mod 256): PUNCH 0x2b80 thru 0x42b5 (0x1736 bytes) 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2756(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2757(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2758(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2759(199 mod 256): PUNCH 0x372b8 thru 0x37cd5 (0xa1e bytes) 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2760(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2761(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2762(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2763(203 mod 256): COPY 0x26000 thru 0x26fff (0x1000 bytes) to 0x10000 thru 0x10fff 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2764(204 mod 256): READ 0x4d000 thru 0x4dfff (0x1000 bytes) 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2765(205 mod 256): MAPREAD 0x27000 thru 0x273e3 (0x3e4 bytes) 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2766(206 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2767(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2768(208 mod 256): MAPWRITE 0x4e000 thru 0x4e7be (0x7bf bytes) 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2769(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.811 INFO:teuthology.orchestra.run.smithi153.stdout: +2770(210 mod 256): PUNCH 0x5614c thru 0x5624e (0x103 bytes) 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2771(211 mod 256): COPY 0x1c000 thru 0x1cfff (0x1000 bytes) to 0x58000 thru 0x58fff 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2772(212 mod 256): TRUNCATE DOWN from 0x688ba to 0x13000 ******WWWW 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2773(213 mod 256): READ 0x11000 thru 0x11fff (0x1000 bytes) 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2774(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2775(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2776(216 mod 256): MAPWRITE 0x32000 thru 0x323aa (0x3ab bytes) 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2777(217 mod 256): MAPWRITE 0x6a000 thru 0x6a80b (0x80c bytes) 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2778(218 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2779(219 mod 256): TRUNCATE DOWN from 0x6a80c to 0x9000 ******WWWW 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2780(220 mod 256): MAPWRITE 0x2c000 thru 0x2dfae (0x1faf bytes) 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2781(221 mod 256): TRUNCATE UP from 0x2dfaf to 0x76000 ******WWWW 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2782(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2783(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2784(224 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.812 INFO:teuthology.orchestra.run.smithi153.stdout: +2785(225 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2786(226 mod 256): TRUNCATE DOWN from 0x76000 to 0x2b000 ******WWWW 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2787(227 mod 256): PUNCH 0x2f96 thru 0x4c98 (0x1d03 bytes) 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2788(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2789(229 mod 256): TRUNCATE UP from 0x2b000 to 0x79000 ******WWWW 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2790(230 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2791(231 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2792(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2793(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2794(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2795(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2796(236 mod 256): READ 0xe000 thru 0xefff (0x1000 bytes) 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2797(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2798(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2799(239 mod 256): PUNCH 0x2b4e thru 0x47f3 (0x1ca6 bytes) 2024-03-28T23:11:39.813 INFO:teuthology.orchestra.run.smithi153.stdout: +2800(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.814 INFO:teuthology.orchestra.run.smithi153.stdout: +2801(241 mod 256): TRUNCATE DOWN from 0x79000 to 0x3a000 2024-03-28T23:11:39.814 INFO:teuthology.orchestra.run.smithi153.stdout: +2802(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.814 INFO:teuthology.orchestra.run.smithi153.stdout: +2803(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.814 INFO:teuthology.orchestra.run.smithi153.stdout: +2804(244 mod 256): PUNCH 0x1f9e5 thru 0x1fc12 (0x22e bytes) 2024-03-28T23:11:39.814 INFO:teuthology.orchestra.run.smithi153.stdout: +2805(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.814 INFO:teuthology.orchestra.run.smithi153.stdout: +2806(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.814 INFO:teuthology.orchestra.run.smithi153.stdout: +2807(247 mod 256): MAPREAD 0x35000 thru 0x361db (0x11dc bytes) 2024-03-28T23:11:39.814 INFO:teuthology.orchestra.run.smithi153.stdout: +2808(248 mod 256): MAPWRITE 0x10000 thru 0x105a9 (0x5aa bytes) 2024-03-28T23:11:39.814 INFO:teuthology.orchestra.run.smithi153.stdout: +2809(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.814 INFO:teuthology.orchestra.run.smithi153.stdout: +2810(250 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.814 INFO:teuthology.orchestra.run.smithi153.stdout: +2811(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.814 INFO:teuthology.orchestra.run.smithi153.stdout: +2812(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.814 INFO:teuthology.orchestra.run.smithi153.stdout: +2813(253 mod 256): MAPREAD 0x31000 thru 0x32c42 (0x1c43 bytes) 2024-03-28T23:11:39.814 INFO:teuthology.orchestra.run.smithi153.stdout: +2814(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2815(255 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2816( 0 mod 256): MAPWRITE 0x16000 thru 0x1623d (0x23e bytes) 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2817( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2818( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2819( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2820( 4 mod 256): PUNCH 0x1a7a3 thru 0x1bf1d (0x177b bytes) 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2821( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2822( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2823( 7 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2824( 8 mod 256): COPY 0x35000 thru 0x35fff (0x1000 bytes) to 0x69000 thru 0x69fff 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2825( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2826( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2827( 11 mod 256): MAPREAD 0x69000 thru 0x69811 (0x812 bytes) 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2828( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.815 INFO:teuthology.orchestra.run.smithi153.stdout: +2829( 13 mod 256): MAPWRITE 0x78000 thru 0x78557 (0x558 bytes) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2830( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2831( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2832( 16 mod 256): MAPWRITE 0x71000 thru 0x7249b (0x149c bytes) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2833( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2834( 18 mod 256): TRUNCATE DOWN from 0x78558 to 0x66000 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2835( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2836( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2837( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2838( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2839( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2840( 24 mod 256): PUNCH 0x109f3 thru 0x115c1 (0xbcf bytes) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2841( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2842( 26 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2843( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2844( 28 mod 256): MAPREAD 0x4a000 thru 0x4a245 (0x246 bytes) 2024-03-28T23:11:39.816 INFO:teuthology.orchestra.run.smithi153.stdout: +2845( 29 mod 256): MAPREAD 0x3000 thru 0x340a (0x40b bytes) 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2846( 30 mod 256): WRITE 0x36000 thru 0x36fff (0x1000 bytes) 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2847( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2848( 32 mod 256): TRUNCATE DOWN from 0x66000 to 0x8000 ******WWWW 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2849( 33 mod 256): TRUNCATE UP from 0x8000 to 0x5a000 ******WWWW 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2850( 34 mod 256): MAPWRITE 0x63000 thru 0x64403 (0x1404 bytes) 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2851( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2852( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2853( 37 mod 256): TRUNCATE DOWN from 0x64404 to 0x2c000 ******WWWW 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2854( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2855( 39 mod 256): COPY 0x29000 thru 0x29fff (0x1000 bytes) to 0x27000 thru 0x27fff 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2856( 40 mod 256): MAPWRITE 0x59000 thru 0x5a24f (0x1250 bytes) 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2857( 41 mod 256): MAPREAD 0x14000 thru 0x15fd8 (0x1fd9 bytes) 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2858( 42 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2859( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.817 INFO:teuthology.orchestra.run.smithi153.stdout: +2860( 44 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.818 INFO:teuthology.orchestra.run.smithi153.stdout: +2861( 45 mod 256): COPY 0x3c000 thru 0x3cfff (0x1000 bytes) to 0x54000 thru 0x54fff 2024-03-28T23:11:39.818 INFO:teuthology.orchestra.run.smithi153.stdout: +2862( 46 mod 256): MAPWRITE 0x26000 thru 0x273aa (0x13ab bytes) 2024-03-28T23:11:39.818 INFO:teuthology.orchestra.run.smithi153.stdout: +2863( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.818 INFO:teuthology.orchestra.run.smithi153.stdout: +2864( 48 mod 256): MAPREAD 0x47000 thru 0x47dc7 (0xdc8 bytes) 2024-03-28T23:11:39.818 INFO:teuthology.orchestra.run.smithi153.stdout: +2865( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.818 INFO:teuthology.orchestra.run.smithi153.stdout: +2866( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.818 INFO:teuthology.orchestra.run.smithi153.stdout: +2867( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.818 INFO:teuthology.orchestra.run.smithi153.stdout: +2868( 52 mod 256): PUNCH 0x41cea thru 0x43124 (0x143b bytes) 2024-03-28T23:11:39.818 INFO:teuthology.orchestra.run.smithi153.stdout: +2869( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.818 INFO:teuthology.orchestra.run.smithi153.stdout: +2870( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.818 INFO:teuthology.orchestra.run.smithi153.stdout: +2871( 55 mod 256): MAPWRITE 0x3f000 thru 0x3f95e (0x95f bytes) 2024-03-28T23:11:39.818 INFO:teuthology.orchestra.run.smithi153.stdout: +2872( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.818 INFO:teuthology.orchestra.run.smithi153.stdout: +2873( 57 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.818 INFO:teuthology.orchestra.run.smithi153.stdout: +2874( 58 mod 256): MAPWRITE 0xd000 thru 0xe062 (0x1063 bytes) 2024-03-28T23:11:39.819 INFO:teuthology.orchestra.run.smithi153.stdout: +2875( 59 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.819 INFO:teuthology.orchestra.run.smithi153.stdout: +2876( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.819 INFO:teuthology.orchestra.run.smithi153.stdout: +2877( 61 mod 256): MAPWRITE 0x52000 thru 0x5375d (0x175e bytes) 2024-03-28T23:11:39.819 INFO:teuthology.orchestra.run.smithi153.stdout: +2878( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.819 INFO:teuthology.orchestra.run.smithi153.stdout: +2879( 63 mod 256): TRUNCATE DOWN from 0x5a250 to 0x44000 2024-03-28T23:11:39.819 INFO:teuthology.orchestra.run.smithi153.stdout: +2880( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.819 INFO:teuthology.orchestra.run.smithi153.stdout: +2881( 65 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.819 INFO:teuthology.orchestra.run.smithi153.stdout: +2882( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.819 INFO:teuthology.orchestra.run.smithi153.stdout: +2883( 67 mod 256): TRUNCATE UP from 0x44000 to 0x5d000 2024-03-28T23:11:39.819 INFO:teuthology.orchestra.run.smithi153.stdout: +2884( 68 mod 256): MAPREAD 0x2c000 thru 0x2ddce (0x1dcf bytes) 2024-03-28T23:11:39.819 INFO:teuthology.orchestra.run.smithi153.stdout: +2885( 69 mod 256): COPY 0x30000 thru 0x30fff (0x1000 bytes) to 0x3c000 thru 0x3cfff 2024-03-28T23:11:39.819 INFO:teuthology.orchestra.run.smithi153.stdout: +2886( 70 mod 256): PUNCH 0x23b27 thru 0x2440d (0x8e7 bytes) 2024-03-28T23:11:39.819 INFO:teuthology.orchestra.run.smithi153.stdout: +2887( 71 mod 256): TRUNCATE DOWN from 0x5d000 to 0x54000 2024-03-28T23:11:39.819 INFO:teuthology.orchestra.run.smithi153.stdout: +2888( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.820 INFO:teuthology.orchestra.run.smithi153.stdout: +2889( 73 mod 256): TRUNCATE UP from 0x54000 to 0x69000 2024-03-28T23:11:39.820 INFO:teuthology.orchestra.run.smithi153.stdout: +2890( 74 mod 256): TRUNCATE DOWN from 0x69000 to 0x3f000 2024-03-28T23:11:39.820 INFO:teuthology.orchestra.run.smithi153.stdout: +2891( 75 mod 256): PUNCH 0x15553 thru 0x1603f (0xaed bytes) 2024-03-28T23:11:39.820 INFO:teuthology.orchestra.run.smithi153.stdout: +2892( 76 mod 256): MAPWRITE 0x1b000 thru 0x1c54a (0x154b bytes) 2024-03-28T23:11:39.820 INFO:teuthology.orchestra.run.smithi153.stdout: +2893( 77 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.820 INFO:teuthology.orchestra.run.smithi153.stdout: +2894( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.820 INFO:teuthology.orchestra.run.smithi153.stdout: +2895( 79 mod 256): TRUNCATE UP from 0x3f000 to 0x45000 2024-03-28T23:11:39.820 INFO:teuthology.orchestra.run.smithi153.stdout: +2896( 80 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.820 INFO:teuthology.orchestra.run.smithi153.stdout: +2897( 81 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.820 INFO:teuthology.orchestra.run.smithi153.stdout: +2898( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.820 INFO:teuthology.orchestra.run.smithi153.stdout: +2899( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.820 INFO:teuthology.orchestra.run.smithi153.stdout: +2900( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.820 INFO:teuthology.orchestra.run.smithi153.stdout: +2901( 85 mod 256): TRUNCATE DOWN from 0x45000 to 0x15000 ******WWWW 2024-03-28T23:11:39.820 INFO:teuthology.orchestra.run.smithi153.stdout: +2902( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2903( 87 mod 256): TRUNCATE DOWN from 0x15000 to 0x0 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2904( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2905( 89 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2906( 90 mod 256): MAPWRITE 0x23000 thru 0x23d7d (0xd7e bytes) 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2907( 91 mod 256): TRUNCATE UP from 0x23d7e to 0x73000 ******WWWW 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2908( 92 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2909( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2910( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2911( 95 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2912( 96 mod 256): READ 0x4f000 thru 0x4ffff (0x1000 bytes) 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2913( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2914( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2915( 99 mod 256): MAPWRITE 0x6e000 thru 0x6efe8 (0xfe9 bytes) 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2916(100 mod 256): TRUNCATE DOWN from 0x73000 to 0x6c000 2024-03-28T23:11:39.821 INFO:teuthology.orchestra.run.smithi153.stdout: +2917(101 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2918(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2919(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2920(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2921(105 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2922(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2923(107 mod 256): TRUNCATE DOWN from 0x6c000 to 0x62000 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2924(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2925(109 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2926(110 mod 256): TRUNCATE DOWN from 0x62000 to 0x13000 ******WWWW 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2927(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2928(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2929(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2930(114 mod 256): TRUNCATE UP from 0x13000 to 0x5e000 ******WWWW 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2931(115 mod 256): TRUNCATE DOWN from 0x5e000 to 0x19000 ******WWWW 2024-03-28T23:11:39.822 INFO:teuthology.orchestra.run.smithi153.stdout: +2932(116 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.823 INFO:teuthology.orchestra.run.smithi153.stdout: +2933(117 mod 256): MAPREAD 0x6000 thru 0x6d46 (0xd47 bytes) 2024-03-28T23:11:39.823 INFO:teuthology.orchestra.run.smithi153.stdout: +2934(118 mod 256): MAPREAD 0xa000 thru 0xba37 (0x1a38 bytes) 2024-03-28T23:11:39.823 INFO:teuthology.orchestra.run.smithi153.stdout: +2935(119 mod 256): PUNCH 0xd10e thru 0xea0a (0x18fd bytes) 2024-03-28T23:11:39.823 INFO:teuthology.orchestra.run.smithi153.stdout: +2936(120 mod 256): MAPREAD 0x11000 thru 0x12b5c (0x1b5d bytes) 2024-03-28T23:11:39.823 INFO:teuthology.orchestra.run.smithi153.stdout: +2937(121 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.823 INFO:teuthology.orchestra.run.smithi153.stdout: +2938(122 mod 256): PUNCH 0x136a6 thru 0x145f3 (0xf4e bytes) 2024-03-28T23:11:39.823 INFO:teuthology.orchestra.run.smithi153.stdout: +2939(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.823 INFO:teuthology.orchestra.run.smithi153.stdout: +2940(124 mod 256): MAPWRITE 0x6c000 thru 0x6cbef (0xbf0 bytes) 2024-03-28T23:11:39.823 INFO:teuthology.orchestra.run.smithi153.stdout: +2941(125 mod 256): TRUNCATE DOWN from 0x6cbf0 to 0x3a000 2024-03-28T23:11:39.823 INFO:teuthology.orchestra.run.smithi153.stdout: +2942(126 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.823 INFO:teuthology.orchestra.run.smithi153.stdout: +2943(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.823 INFO:teuthology.orchestra.run.smithi153.stdout: +2944(128 mod 256): MAPREAD 0x7000 thru 0x83f4 (0x13f5 bytes) 2024-03-28T23:11:39.823 INFO:teuthology.orchestra.run.smithi153.stdout: +2945(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.823 INFO:teuthology.orchestra.run.smithi153.stdout: +2946(130 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2947(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2948(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2949(133 mod 256): TRUNCATE DOWN from 0x3a000 to 0x38000 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2950(134 mod 256): WRITE 0x5d000 thru 0x5dfff (0x1000 bytes) HOLE 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2951(135 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2952(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2953(137 mod 256): MAPREAD 0x59000 thru 0x5a0e0 (0x10e1 bytes) 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2954(138 mod 256): TRUNCATE DOWN from 0x5e000 to 0x4f000 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2955(139 mod 256): PUNCH 0x33388 thru 0x349f3 (0x166c bytes) 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2956(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2957(141 mod 256): TRUNCATE DOWN from 0x4f000 to 0x45000 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2958(142 mod 256): COPY 0x35000 thru 0x36fff (0x2000 bytes) to 0x6b000 thru 0x6cfff 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2959(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2960(144 mod 256): READ 0x4a000 thru 0x4afff (0x1000 bytes) 2024-03-28T23:11:39.824 INFO:teuthology.orchestra.run.smithi153.stdout: +2961(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.825 INFO:teuthology.orchestra.run.smithi153.stdout: +2962(146 mod 256): MAPWRITE 0x5b000 thru 0x5bbe2 (0xbe3 bytes) 2024-03-28T23:11:39.825 INFO:teuthology.orchestra.run.smithi153.stdout: +2963(147 mod 256): PUNCH 0x4f59e thru 0x513c9 (0x1e2c bytes) 2024-03-28T23:11:39.825 INFO:teuthology.orchestra.run.smithi153.stdout: +2964(148 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.825 INFO:teuthology.orchestra.run.smithi153.stdout: +2965(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.825 INFO:teuthology.orchestra.run.smithi153.stdout: +2966(150 mod 256): MAPREAD 0x10000 thru 0x10d1a (0xd1b bytes) 2024-03-28T23:11:39.825 INFO:teuthology.orchestra.run.smithi153.stdout: +2967(151 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.825 INFO:teuthology.orchestra.run.smithi153.stdout: +2968(152 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.825 INFO:teuthology.orchestra.run.smithi153.stdout: +2969(153 mod 256): READ 0x65000 thru 0x65fff (0x1000 bytes) 2024-03-28T23:11:39.825 INFO:teuthology.orchestra.run.smithi153.stdout: +2970(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.825 INFO:teuthology.orchestra.run.smithi153.stdout: +2971(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.825 INFO:teuthology.orchestra.run.smithi153.stdout: +2972(156 mod 256): WRITE 0x6b000 thru 0x6bfff (0x1000 bytes) 2024-03-28T23:11:39.825 INFO:teuthology.orchestra.run.smithi153.stdout: +2973(157 mod 256): TRUNCATE DOWN from 0x6d000 to 0x24000 ******WWWW 2024-03-28T23:11:39.825 INFO:teuthology.orchestra.run.smithi153.stdout: +2974(158 mod 256): WRITE 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-28T23:11:39.825 INFO:teuthology.orchestra.run.smithi153.stdout: +2975(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.826 INFO:teuthology.orchestra.run.smithi153.stdout: +2976(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.826 INFO:teuthology.orchestra.run.smithi153.stdout: +2977(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.826 INFO:teuthology.orchestra.run.smithi153.stdout: +2978(162 mod 256): TRUNCATE UP from 0x24000 to 0x6b000 ******WWWW 2024-03-28T23:11:39.826 INFO:teuthology.orchestra.run.smithi153.stdout: +2979(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.826 INFO:teuthology.orchestra.run.smithi153.stdout: +2980(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.826 INFO:teuthology.orchestra.run.smithi153.stdout: +2981(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.826 INFO:teuthology.orchestra.run.smithi153.stdout: +2982(166 mod 256): PUNCH 0x1feab thru 0x20f4c (0x10a2 bytes) 2024-03-28T23:11:39.826 INFO:teuthology.orchestra.run.smithi153.stdout: +2983(167 mod 256): WRITE 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-28T23:11:39.826 INFO:teuthology.orchestra.run.smithi153.stdout: +2984(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.826 INFO:teuthology.orchestra.run.smithi153.stdout: +2985(169 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.826 INFO:teuthology.orchestra.run.smithi153.stdout: +2986(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.826 INFO:teuthology.orchestra.run.smithi153.stdout: +2987(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.826 INFO:teuthology.orchestra.run.smithi153.stdout: +2988(172 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.826 INFO:teuthology.orchestra.run.smithi153.stdout: +2989(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.827 INFO:teuthology.orchestra.run.smithi153.stdout: +2990(174 mod 256): TRUNCATE DOWN from 0x6b000 to 0x6000 ******WWWW 2024-03-28T23:11:39.827 INFO:teuthology.orchestra.run.smithi153.stdout: +2991(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.827 INFO:teuthology.orchestra.run.smithi153.stdout: +2992(176 mod 256): MAPREAD 0x4000 thru 0x50cb (0x10cc bytes) 2024-03-28T23:11:39.827 INFO:teuthology.orchestra.run.smithi153.stdout: +2993(177 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.827 INFO:teuthology.orchestra.run.smithi153.stdout: +2994(178 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.827 INFO:teuthology.orchestra.run.smithi153.stdout: +2995(179 mod 256): MAPWRITE 0x15000 thru 0x16712 (0x1713 bytes) 2024-03-28T23:11:39.827 INFO:teuthology.orchestra.run.smithi153.stdout: +2996(180 mod 256): PUNCH 0x11a5e thru 0x129bf (0xf62 bytes) 2024-03-28T23:11:39.827 INFO:teuthology.orchestra.run.smithi153.stdout: +2997(181 mod 256): MAPREAD 0x5000 thru 0x56f3 (0x6f4 bytes) 2024-03-28T23:11:39.827 INFO:teuthology.orchestra.run.smithi153.stdout: +2998(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.827 INFO:teuthology.orchestra.run.smithi153.stdout: +2999(183 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.827 INFO:teuthology.orchestra.run.smithi153.stdout: +3000(184 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.827 INFO:teuthology.orchestra.run.smithi153.stdout: +3001(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.827 INFO:teuthology.orchestra.run.smithi153.stdout: +3002(186 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3003(187 mod 256): PUNCH 0x161f7 thru 0x16712 (0x51c bytes) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3004(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3005(189 mod 256): MAPWRITE 0x2f000 thru 0x2fdb5 (0xdb6 bytes) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3006(190 mod 256): PUNCH 0x13733 thru 0x14111 (0x9df bytes) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3007(191 mod 256): MAPREAD 0x13000 thru 0x13048 (0x49 bytes) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3008(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3009(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3010(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3011(195 mod 256): MAPREAD 0x6000 thru 0x6a4d (0xa4e bytes) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3012(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3013(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3014(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3015(199 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3016(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.828 INFO:teuthology.orchestra.run.smithi153.stdout: +3017(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout: +3018(202 mod 256): WRITE 0x70000 thru 0x70fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout: +3019(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout: +3020(204 mod 256): READ 0xa000 thru 0xafff (0x1000 bytes) 2024-03-28T23:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout: +3021(205 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout: +3022(206 mod 256): PUNCH 0x39fb5 thru 0x3aea0 (0xeec bytes) 2024-03-28T23:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout: +3023(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout: +3024(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout: +3025(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout: +3026(210 mod 256): COPY 0x51000 thru 0x51fff (0x1000 bytes) to 0x6a000 thru 0x6afff 2024-03-28T23:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout: +3027(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout: +3028(212 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout: +3029(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout: +3030(214 mod 256): MAPWRITE 0x67000 thru 0x68190 (0x1191 bytes) 2024-03-28T23:11:39.830 INFO:teuthology.orchestra.run.smithi153.stdout: +3031(215 mod 256): MAPWRITE 0x47000 thru 0x4767d (0x67e bytes) 2024-03-28T23:11:39.830 INFO:teuthology.orchestra.run.smithi153.stdout: +3032(216 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.830 INFO:teuthology.orchestra.run.smithi153.stdout: +3033(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.830 INFO:teuthology.orchestra.run.smithi153.stdout: +3034(218 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.830 INFO:teuthology.orchestra.run.smithi153.stdout: +3035(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.830 INFO:teuthology.orchestra.run.smithi153.stdout: +3036(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.830 INFO:teuthology.orchestra.run.smithi153.stdout: +3037(221 mod 256): MAPWRITE 0x40000 thru 0x40921 (0x922 bytes) 2024-03-28T23:11:39.830 INFO:teuthology.orchestra.run.smithi153.stdout: +3038(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.830 INFO:teuthology.orchestra.run.smithi153.stdout: +3039(223 mod 256): MAPWRITE 0x74000 thru 0x754a3 (0x14a4 bytes) 2024-03-28T23:11:39.830 INFO:teuthology.orchestra.run.smithi153.stdout: +3040(224 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.830 INFO:teuthology.orchestra.run.smithi153.stdout: +3041(225 mod 256): PUNCH 0xa50f thru 0xbbad (0x169f bytes) 2024-03-28T23:11:39.830 INFO:teuthology.orchestra.run.smithi153.stdout: +3042(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.830 INFO:teuthology.orchestra.run.smithi153.stdout: +3043(227 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.830 INFO:teuthology.orchestra.run.smithi153.stdout: +3044(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.831 INFO:teuthology.orchestra.run.smithi153.stdout: +3045(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.831 INFO:teuthology.orchestra.run.smithi153.stdout: +3046(230 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.831 INFO:teuthology.orchestra.run.smithi153.stdout: +3047(231 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.831 INFO:teuthology.orchestra.run.smithi153.stdout: +3048(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.831 INFO:teuthology.orchestra.run.smithi153.stdout: +3049(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.831 INFO:teuthology.orchestra.run.smithi153.stdout: +3050(234 mod 256): MAPWRITE 0x49000 thru 0x4aa55 (0x1a56 bytes) 2024-03-28T23:11:39.831 INFO:teuthology.orchestra.run.smithi153.stdout: +3051(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.831 INFO:teuthology.orchestra.run.smithi153.stdout: +3052(236 mod 256): MAPWRITE 0x5000 thru 0x6681 (0x1682 bytes) 2024-03-28T23:11:39.831 INFO:teuthology.orchestra.run.smithi153.stdout: +3053(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.831 INFO:teuthology.orchestra.run.smithi153.stdout: +3054(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.831 INFO:teuthology.orchestra.run.smithi153.stdout: +3055(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.831 INFO:teuthology.orchestra.run.smithi153.stdout: +3056(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.831 INFO:teuthology.orchestra.run.smithi153.stdout: +3057(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.831 INFO:teuthology.orchestra.run.smithi153.stdout: +3058(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.832 INFO:teuthology.orchestra.run.smithi153.stdout: +3059(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.832 INFO:teuthology.orchestra.run.smithi153.stdout: +3060(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.832 INFO:teuthology.orchestra.run.smithi153.stdout: +3061(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.832 INFO:teuthology.orchestra.run.smithi153.stdout: +3062(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.832 INFO:teuthology.orchestra.run.smithi153.stdout: +3063(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.832 INFO:teuthology.orchestra.run.smithi153.stdout: +3064(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.832 INFO:teuthology.orchestra.run.smithi153.stdout: +3065(249 mod 256): TRUNCATE DOWN from 0x754a4 to 0x5b000 2024-03-28T23:11:39.832 INFO:teuthology.orchestra.run.smithi153.stdout: +3066(250 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.832 INFO:teuthology.orchestra.run.smithi153.stdout: +3067(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.832 INFO:teuthology.orchestra.run.smithi153.stdout: +3068(252 mod 256): MAPWRITE 0x5b000 thru 0x5c8ab (0x18ac bytes) 2024-03-28T23:11:39.832 INFO:teuthology.orchestra.run.smithi153.stdout: +3069(253 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.832 INFO:teuthology.orchestra.run.smithi153.stdout: +3070(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.832 INFO:teuthology.orchestra.run.smithi153.stdout: +3071(255 mod 256): COPY 0xf000 thru 0xffff (0x1000 bytes) to 0x9000 thru 0x9fff 2024-03-28T23:11:39.832 INFO:teuthology.orchestra.run.smithi153.stdout: +3072( 0 mod 256): PUNCH 0x3c56b thru 0x3c87e (0x314 bytes) 2024-03-28T23:11:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: +3073( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: +3074( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: +3075( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: +3076( 4 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: +3077( 5 mod 256): MAPWRITE 0x71000 thru 0x728de (0x18df bytes) 2024-03-28T23:11:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: +3078( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: +3079( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: +3080( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: +3081( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: +3082( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: +3083( 11 mod 256): MAPREAD 0x3b000 thru 0x3c5bb (0x15bc bytes) 2024-03-28T23:11:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: +3084( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: +3085( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.833 INFO:teuthology.orchestra.run.smithi153.stdout: +3086( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.834 INFO:teuthology.orchestra.run.smithi153.stdout: +3087( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.834 INFO:teuthology.orchestra.run.smithi153.stdout: +3088( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.834 INFO:teuthology.orchestra.run.smithi153.stdout: +3089( 17 mod 256): MAPREAD 0x35000 thru 0x355e5 (0x5e6 bytes) 2024-03-28T23:11:39.834 INFO:teuthology.orchestra.run.smithi153.stdout: +3090( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.834 INFO:teuthology.orchestra.run.smithi153.stdout: +3091( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.834 INFO:teuthology.orchestra.run.smithi153.stdout: +3092( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.834 INFO:teuthology.orchestra.run.smithi153.stdout: +3093( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.834 INFO:teuthology.orchestra.run.smithi153.stdout: +3094( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.834 INFO:teuthology.orchestra.run.smithi153.stdout: +3095( 23 mod 256): PUNCH 0x5dc32 thru 0x5e389 (0x758 bytes) 2024-03-28T23:11:39.834 INFO:teuthology.orchestra.run.smithi153.stdout: +3096( 24 mod 256): TRUNCATE DOWN from 0x728df to 0x1f000 ******WWWW 2024-03-28T23:11:39.834 INFO:teuthology.orchestra.run.smithi153.stdout: +3097( 25 mod 256): WRITE 0x50000 thru 0x50fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.834 INFO:teuthology.orchestra.run.smithi153.stdout: +3098( 26 mod 256): COPY 0xe000 thru 0xefff (0x1000 bytes) to 0x9000 thru 0x9fff 2024-03-28T23:11:39.834 INFO:teuthology.orchestra.run.smithi153.stdout: +3099( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.834 INFO:teuthology.orchestra.run.smithi153.stdout: +3100( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3101( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3102( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3103( 31 mod 256): TRUNCATE UP from 0x51000 to 0x54000 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3104( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3105( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3106( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3107( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3108( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3109( 37 mod 256): PUNCH 0x50ca2 thru 0x52af3 (0x1e52 bytes) 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3110( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3111( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3112( 40 mod 256): COPY 0x1e000 thru 0x1efff (0x1000 bytes) to 0x22000 thru 0x22fff 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3113( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3114( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.835 INFO:teuthology.orchestra.run.smithi153.stdout: +3115( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3116( 44 mod 256): PUNCH 0x34376 thru 0x3520a (0xe95 bytes) 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3117( 45 mod 256): MAPREAD 0x3d000 thru 0x3ebc6 (0x1bc7 bytes) 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3118( 46 mod 256): TRUNCATE UP from 0x54000 to 0x66000 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3119( 47 mod 256): PUNCH 0xef70 thru 0x10835 (0x18c6 bytes) 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3120( 48 mod 256): COPY 0x50000 thru 0x50fff (0x1000 bytes) to 0x55000 thru 0x55fff 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3121( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3122( 50 mod 256): COPY 0x54000 thru 0x54fff (0x1000 bytes) to 0x26000 thru 0x26fff 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3123( 51 mod 256): MAPWRITE 0x49000 thru 0x4a76a (0x176b bytes) 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3124( 52 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3125( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3126( 54 mod 256): TRUNCATE DOWN from 0x66000 to 0x2b000 ******WWWW 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3127( 55 mod 256): MAPWRITE 0x6f000 thru 0x6fb74 (0xb75 bytes) 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3128( 56 mod 256): MAPWRITE 0x3a000 thru 0x3a251 (0x252 bytes) 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3129( 57 mod 256): TRUNCATE DOWN from 0x6fb75 to 0x54000 2024-03-28T23:11:39.836 INFO:teuthology.orchestra.run.smithi153.stdout: +3130( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3131( 59 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3132( 60 mod 256): READ 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3133( 61 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3134( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3135( 63 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3136( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3137( 65 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3138( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3139( 67 mod 256): READ 0x2b000 thru 0x2bfff (0x1000 bytes) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3140( 68 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3141( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3142( 70 mod 256): READ 0x31000 thru 0x31fff (0x1000 bytes) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3143( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3144( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.837 INFO:teuthology.orchestra.run.smithi153.stdout: +3145( 73 mod 256): WRITE 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-28T23:11:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: +3146( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: +3147( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: +3148( 76 mod 256): MAPREAD 0x1000 thru 0x1983 (0x984 bytes) 2024-03-28T23:11:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: +3149( 77 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: +3150( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: +3151( 79 mod 256): COPY 0x27000 thru 0x27fff (0x1000 bytes) to 0x3e000 thru 0x3efff 2024-03-28T23:11:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: +3152( 80 mod 256): PUNCH 0x28453 thru 0x290ed (0xc9b bytes) 2024-03-28T23:11:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: +3153( 81 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: +3154( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: +3155( 83 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x78000 thru 0x78fff 2024-03-28T23:11:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: +3156( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: +3157( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: +3158( 86 mod 256): PUNCH 0xd74a thru 0xead3 (0x138a bytes) 2024-03-28T23:11:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: +3159( 87 mod 256): TRUNCATE DOWN from 0x79000 to 0x31000 ******WWWW 2024-03-28T23:11:39.839 INFO:teuthology.orchestra.run.smithi153.stdout: +3160( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.839 INFO:teuthology.orchestra.run.smithi153.stdout: +3161( 89 mod 256): WRITE 0x12000 thru 0x12fff (0x1000 bytes) 2024-03-28T23:11:39.839 INFO:teuthology.orchestra.run.smithi153.stdout: +3162( 90 mod 256): PUNCH 0x2e2c5 thru 0x2f488 (0x11c4 bytes) 2024-03-28T23:11:39.839 INFO:teuthology.orchestra.run.smithi153.stdout: +3163( 91 mod 256): READ 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-28T23:11:39.839 INFO:teuthology.orchestra.run.smithi153.stdout: +3164( 92 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.839 INFO:teuthology.orchestra.run.smithi153.stdout: +3165( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.839 INFO:teuthology.orchestra.run.smithi153.stdout: +3166( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.839 INFO:teuthology.orchestra.run.smithi153.stdout: +3167( 95 mod 256): TRUNCATE UP from 0x31000 to 0x51000 ******WWWW 2024-03-28T23:11:39.839 INFO:teuthology.orchestra.run.smithi153.stdout: +3168( 96 mod 256): TRUNCATE DOWN from 0x51000 to 0x29000 ******WWWW 2024-03-28T23:11:39.839 INFO:teuthology.orchestra.run.smithi153.stdout: +3169( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.839 INFO:teuthology.orchestra.run.smithi153.stdout: +3170( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.839 INFO:teuthology.orchestra.run.smithi153.stdout: +3171( 99 mod 256): COPY 0xe000 thru 0xefff (0x1000 bytes) to 0x36000 thru 0x36fff 2024-03-28T23:11:39.839 INFO:teuthology.orchestra.run.smithi153.stdout: +3172(100 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.839 INFO:teuthology.orchestra.run.smithi153.stdout: +3173(101 mod 256): TRUNCATE UP from 0x37000 to 0x75000 ******WWWW 2024-03-28T23:11:39.840 INFO:teuthology.orchestra.run.smithi153.stdout: +3174(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.840 INFO:teuthology.orchestra.run.smithi153.stdout: +3175(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.840 INFO:teuthology.orchestra.run.smithi153.stdout: +3176(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.840 INFO:teuthology.orchestra.run.smithi153.stdout: +3177(105 mod 256): WRITE 0xf000 thru 0xffff (0x1000 bytes) 2024-03-28T23:11:39.840 INFO:teuthology.orchestra.run.smithi153.stdout: +3178(106 mod 256): PUNCH 0x412f9 thru 0x42a59 (0x1761 bytes) 2024-03-28T23:11:39.840 INFO:teuthology.orchestra.run.smithi153.stdout: +3179(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.840 INFO:teuthology.orchestra.run.smithi153.stdout: +3180(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.840 INFO:teuthology.orchestra.run.smithi153.stdout: +3181(109 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.840 INFO:teuthology.orchestra.run.smithi153.stdout: +3182(110 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.840 INFO:teuthology.orchestra.run.smithi153.stdout: +3183(111 mod 256): READ 0x6a000 thru 0x6afff (0x1000 bytes) 2024-03-28T23:11:39.840 INFO:teuthology.orchestra.run.smithi153.stdout: +3184(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.840 INFO:teuthology.orchestra.run.smithi153.stdout: +3185(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.840 INFO:teuthology.orchestra.run.smithi153.stdout: +3186(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.841 INFO:teuthology.orchestra.run.smithi153.stdout: +3187(115 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.841 INFO:teuthology.orchestra.run.smithi153.stdout: +3188(116 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.841 INFO:teuthology.orchestra.run.smithi153.stdout: +3189(117 mod 256): TRUNCATE DOWN from 0x75000 to 0x6000 ******WWWW 2024-03-28T23:11:39.841 INFO:teuthology.orchestra.run.smithi153.stdout: +3190(118 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.841 INFO:teuthology.orchestra.run.smithi153.stdout: +3191(119 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.841 INFO:teuthology.orchestra.run.smithi153.stdout: +3192(120 mod 256): WRITE 0x53000 thru 0x53fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.841 INFO:teuthology.orchestra.run.smithi153.stdout: +3193(121 mod 256): MAPWRITE 0x48000 thru 0x49b8a (0x1b8b bytes) 2024-03-28T23:11:39.841 INFO:teuthology.orchestra.run.smithi153.stdout: +3194(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.841 INFO:teuthology.orchestra.run.smithi153.stdout: +3195(123 mod 256): MAPWRITE 0x52000 thru 0x52a33 (0xa34 bytes) 2024-03-28T23:11:39.841 INFO:teuthology.orchestra.run.smithi153.stdout: +3196(124 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.841 INFO:teuthology.orchestra.run.smithi153.stdout: +3197(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.841 INFO:teuthology.orchestra.run.smithi153.stdout: +3198(126 mod 256): TRUNCATE DOWN from 0x54000 to 0x0 ******WWWW 2024-03-28T23:11:39.841 INFO:teuthology.orchestra.run.smithi153.stdout: +3199(127 mod 256): MAPWRITE 0x78000 thru 0x7961c (0x161d bytes) 2024-03-28T23:11:39.842 INFO:teuthology.orchestra.run.smithi153.stdout: +3200(128 mod 256): COPY 0x44000 thru 0x44fff (0x1000 bytes) to 0x59000 thru 0x59fff 2024-03-28T23:11:39.842 INFO:teuthology.orchestra.run.smithi153.stdout: +3201(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.842 INFO:teuthology.orchestra.run.smithi153.stdout: +3202(130 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.842 INFO:teuthology.orchestra.run.smithi153.stdout: +3203(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.842 INFO:teuthology.orchestra.run.smithi153.stdout: +3204(132 mod 256): TRUNCATE DOWN from 0x7961d to 0x52000 2024-03-28T23:11:39.842 INFO:teuthology.orchestra.run.smithi153.stdout: +3205(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.842 INFO:teuthology.orchestra.run.smithi153.stdout: +3206(134 mod 256): MAPREAD 0x35000 thru 0x353e6 (0x3e7 bytes) 2024-03-28T23:11:39.842 INFO:teuthology.orchestra.run.smithi153.stdout: +3207(135 mod 256): WRITE 0x4a000 thru 0x4afff (0x1000 bytes) 2024-03-28T23:11:39.842 INFO:teuthology.orchestra.run.smithi153.stdout: +3208(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.842 INFO:teuthology.orchestra.run.smithi153.stdout: +3209(137 mod 256): TRUNCATE DOWN from 0x52000 to 0x23000 ******WWWW 2024-03-28T23:11:39.842 INFO:teuthology.orchestra.run.smithi153.stdout: +3210(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.842 INFO:teuthology.orchestra.run.smithi153.stdout: +3211(139 mod 256): PUNCH 0x1c69b thru 0x1dc7f (0x15e5 bytes) 2024-03-28T23:11:39.842 INFO:teuthology.orchestra.run.smithi153.stdout: +3212(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.842 INFO:teuthology.orchestra.run.smithi153.stdout: +3213(141 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.843 INFO:teuthology.orchestra.run.smithi153.stdout: +3214(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.843 INFO:teuthology.orchestra.run.smithi153.stdout: +3215(143 mod 256): PUNCH 0xebd4 thru 0x10b17 (0x1f44 bytes) 2024-03-28T23:11:39.843 INFO:teuthology.orchestra.run.smithi153.stdout: +3216(144 mod 256): READ 0x17000 thru 0x17fff (0x1000 bytes) 2024-03-28T23:11:39.843 INFO:teuthology.orchestra.run.smithi153.stdout: +3217(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.843 INFO:teuthology.orchestra.run.smithi153.stdout: +3218(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.843 INFO:teuthology.orchestra.run.smithi153.stdout: +3219(147 mod 256): MAPWRITE 0x47000 thru 0x473ab (0x3ac bytes) 2024-03-28T23:11:39.843 INFO:teuthology.orchestra.run.smithi153.stdout: +3220(148 mod 256): TRUNCATE DOWN from 0x473ac to 0x3000 ******WWWW 2024-03-28T23:11:39.843 INFO:teuthology.orchestra.run.smithi153.stdout: +3221(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.843 INFO:teuthology.orchestra.run.smithi153.stdout: +3222(150 mod 256): WRITE 0x57000 thru 0x57fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.843 INFO:teuthology.orchestra.run.smithi153.stdout: +3223(151 mod 256): TRUNCATE UP from 0x58000 to 0x59000 2024-03-28T23:11:39.843 INFO:teuthology.orchestra.run.smithi153.stdout: +3224(152 mod 256): WRITE 0x6e000 thru 0x6efff (0x1000 bytes) HOLE 2024-03-28T23:11:39.843 INFO:teuthology.orchestra.run.smithi153.stdout: +3225(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.843 INFO:teuthology.orchestra.run.smithi153.stdout: +3226(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.844 INFO:teuthology.orchestra.run.smithi153.stdout: +3227(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.844 INFO:teuthology.orchestra.run.smithi153.stdout: +3228(156 mod 256): READ 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-28T23:11:39.844 INFO:teuthology.orchestra.run.smithi153.stdout: +3229(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.844 INFO:teuthology.orchestra.run.smithi153.stdout: +3230(158 mod 256): MAPREAD 0x54000 thru 0x54297 (0x298 bytes) 2024-03-28T23:11:39.844 INFO:teuthology.orchestra.run.smithi153.stdout: +3231(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.844 INFO:teuthology.orchestra.run.smithi153.stdout: +3232(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.844 INFO:teuthology.orchestra.run.smithi153.stdout: +3233(161 mod 256): MAPWRITE 0x43000 thru 0x4425a (0x125b bytes) 2024-03-28T23:11:39.844 INFO:teuthology.orchestra.run.smithi153.stdout: +3234(162 mod 256): COPY 0x30000 thru 0x30fff (0x1000 bytes) to 0x26000 thru 0x26fff 2024-03-28T23:11:39.844 INFO:teuthology.orchestra.run.smithi153.stdout: +3235(163 mod 256): READ 0x4e000 thru 0x4efff (0x1000 bytes) 2024-03-28T23:11:39.844 INFO:teuthology.orchestra.run.smithi153.stdout: +3236(164 mod 256): PUNCH 0x57f90 thru 0x5997b (0x19ec bytes) 2024-03-28T23:11:39.844 INFO:teuthology.orchestra.run.smithi153.stdout: +3237(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.844 INFO:teuthology.orchestra.run.smithi153.stdout: +3238(166 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.844 INFO:teuthology.orchestra.run.smithi153.stdout: +3239(167 mod 256): COPY 0x26000 thru 0x26fff (0x1000 bytes) to 0x1000 thru 0x1fff 2024-03-28T23:11:39.845 INFO:teuthology.orchestra.run.smithi153.stdout: +3240(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.845 INFO:teuthology.orchestra.run.smithi153.stdout: +3241(169 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.845 INFO:teuthology.orchestra.run.smithi153.stdout: +3242(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.845 INFO:teuthology.orchestra.run.smithi153.stdout: +3243(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.845 INFO:teuthology.orchestra.run.smithi153.stdout: +3244(172 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.845 INFO:teuthology.orchestra.run.smithi153.stdout: +3245(173 mod 256): READ 0x1d000 thru 0x1dfff (0x1000 bytes) 2024-03-28T23:11:39.845 INFO:teuthology.orchestra.run.smithi153.stdout: +3246(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.845 INFO:teuthology.orchestra.run.smithi153.stdout: +3247(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.845 INFO:teuthology.orchestra.run.smithi153.stdout: +3248(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.845 INFO:teuthology.orchestra.run.smithi153.stdout: +3249(177 mod 256): TRUNCATE DOWN from 0x6f000 to 0x7000 ******WWWW 2024-03-28T23:11:39.845 INFO:teuthology.orchestra.run.smithi153.stdout: +3250(178 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.845 INFO:teuthology.orchestra.run.smithi153.stdout: +3251(179 mod 256): MAPWRITE 0x1a000 thru 0x1a2a5 (0x2a6 bytes) 2024-03-28T23:11:39.845 INFO:teuthology.orchestra.run.smithi153.stdout: +3252(180 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.846 INFO:teuthology.orchestra.run.smithi153.stdout: +3253(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.846 INFO:teuthology.orchestra.run.smithi153.stdout: +3254(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.846 INFO:teuthology.orchestra.run.smithi153.stdout: +3255(183 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.846 INFO:teuthology.orchestra.run.smithi153.stdout: +3256(184 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.846 INFO:teuthology.orchestra.run.smithi153.stdout: +3257(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.846 INFO:teuthology.orchestra.run.smithi153.stdout: +3258(186 mod 256): PUNCH 0x7da0 thru 0x91a7 (0x1408 bytes) 2024-03-28T23:11:39.846 INFO:teuthology.orchestra.run.smithi153.stdout: +3259(187 mod 256): MAPREAD 0x7000 thru 0x7b6b (0xb6c bytes) 2024-03-28T23:11:39.846 INFO:teuthology.orchestra.run.smithi153.stdout: +3260(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.846 INFO:teuthology.orchestra.run.smithi153.stdout: +3261(189 mod 256): TRUNCATE DOWN from 0x1a2a6 to 0x2000 2024-03-28T23:11:39.846 INFO:teuthology.orchestra.run.smithi153.stdout: +3262(190 mod 256): MAPREAD 0x1000 thru 0x11f4 (0x1f5 bytes) 2024-03-28T23:11:39.846 INFO:teuthology.orchestra.run.smithi153.stdout: +3263(191 mod 256): PUNCH 0x1ccd thru 0x1fff (0x333 bytes) 2024-03-28T23:11:39.846 INFO:teuthology.orchestra.run.smithi153.stdout: +3264(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.846 INFO:teuthology.orchestra.run.smithi153.stdout: +3265(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.847 INFO:teuthology.orchestra.run.smithi153.stdout: +3266(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.847 INFO:teuthology.orchestra.run.smithi153.stdout: +3267(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.847 INFO:teuthology.orchestra.run.smithi153.stdout: +3268(196 mod 256): MAPWRITE 0x46000 thru 0x47ddc (0x1ddd bytes) 2024-03-28T23:11:39.847 INFO:teuthology.orchestra.run.smithi153.stdout: +3269(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.847 INFO:teuthology.orchestra.run.smithi153.stdout: +3270(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.847 INFO:teuthology.orchestra.run.smithi153.stdout: +3271(199 mod 256): WRITE 0x66000 thru 0x66fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.847 INFO:teuthology.orchestra.run.smithi153.stdout: +3272(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.847 INFO:teuthology.orchestra.run.smithi153.stdout: +3273(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.847 INFO:teuthology.orchestra.run.smithi153.stdout: +3274(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.847 INFO:teuthology.orchestra.run.smithi153.stdout: +3275(203 mod 256): MAPREAD 0x42000 thru 0x43d92 (0x1d93 bytes) 2024-03-28T23:11:39.847 INFO:teuthology.orchestra.run.smithi153.stdout: +3276(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.847 INFO:teuthology.orchestra.run.smithi153.stdout: +3277(205 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.847 INFO:teuthology.orchestra.run.smithi153.stdout: +3278(206 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.848 INFO:teuthology.orchestra.run.smithi153.stdout: +3279(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.848 INFO:teuthology.orchestra.run.smithi153.stdout: +3280(208 mod 256): PUNCH 0x237c7 thru 0x24a67 (0x12a1 bytes) 2024-03-28T23:11:39.848 INFO:teuthology.orchestra.run.smithi153.stdout: +3281(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.848 INFO:teuthology.orchestra.run.smithi153.stdout: +3282(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.848 INFO:teuthology.orchestra.run.smithi153.stdout: +3283(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.848 INFO:teuthology.orchestra.run.smithi153.stdout: +3284(212 mod 256): MAPREAD 0x4c000 thru 0x4ca05 (0xa06 bytes) 2024-03-28T23:11:39.848 INFO:teuthology.orchestra.run.smithi153.stdout: +3285(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.848 INFO:teuthology.orchestra.run.smithi153.stdout: +3286(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.848 INFO:teuthology.orchestra.run.smithi153.stdout: +3287(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.848 INFO:teuthology.orchestra.run.smithi153.stdout: +3288(216 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.848 INFO:teuthology.orchestra.run.smithi153.stdout: +3289(217 mod 256): MAPREAD 0x2c000 thru 0x2c5df (0x5e0 bytes) 2024-03-28T23:11:39.848 INFO:teuthology.orchestra.run.smithi153.stdout: +3290(218 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.848 INFO:teuthology.orchestra.run.smithi153.stdout: +3291(219 mod 256): TRUNCATE DOWN from 0x67000 to 0x3a000 2024-03-28T23:11:39.848 INFO:teuthology.orchestra.run.smithi153.stdout: +3292(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.849 INFO:teuthology.orchestra.run.smithi153.stdout: +3293(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.849 INFO:teuthology.orchestra.run.smithi153.stdout: +3294(222 mod 256): TRUNCATE DOWN from 0x3a000 to 0x23000 ******WWWW 2024-03-28T23:11:39.849 INFO:teuthology.orchestra.run.smithi153.stdout: +3295(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.849 INFO:teuthology.orchestra.run.smithi153.stdout: +3296(224 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.849 INFO:teuthology.orchestra.run.smithi153.stdout: +3297(225 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.849 INFO:teuthology.orchestra.run.smithi153.stdout: +3298(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.849 INFO:teuthology.orchestra.run.smithi153.stdout: +3299(227 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.849 INFO:teuthology.orchestra.run.smithi153.stdout: +3300(228 mod 256): WRITE 0x60000 thru 0x60fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.849 INFO:teuthology.orchestra.run.smithi153.stdout: +3301(229 mod 256): COPY 0x8000 thru 0x8fff (0x1000 bytes) to 0x5e000 thru 0x5efff 2024-03-28T23:11:39.849 INFO:teuthology.orchestra.run.smithi153.stdout: +3302(230 mod 256): MAPREAD 0x4c000 thru 0x4dcf6 (0x1cf7 bytes) 2024-03-28T23:11:39.849 INFO:teuthology.orchestra.run.smithi153.stdout: +3303(231 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.849 INFO:teuthology.orchestra.run.smithi153.stdout: +3304(232 mod 256): MAPWRITE 0x11000 thru 0x114ee (0x4ef bytes) 2024-03-28T23:11:39.849 INFO:teuthology.orchestra.run.smithi153.stdout: +3305(233 mod 256): WRITE 0x20000 thru 0x20fff (0x1000 bytes) 2024-03-28T23:11:39.849 INFO:teuthology.orchestra.run.smithi153.stdout: +3306(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.850 INFO:teuthology.orchestra.run.smithi153.stdout: +3307(235 mod 256): TRUNCATE UP from 0x61000 to 0x78000 2024-03-28T23:11:39.850 INFO:teuthology.orchestra.run.smithi153.stdout: +3308(236 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.850 INFO:teuthology.orchestra.run.smithi153.stdout: +3309(237 mod 256): PUNCH 0x4fe26 thru 0x4fe45 (0x20 bytes) 2024-03-28T23:11:39.850 INFO:teuthology.orchestra.run.smithi153.stdout: +3310(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.850 INFO:teuthology.orchestra.run.smithi153.stdout: +3311(239 mod 256): PUNCH 0x315ca thru 0x3349b (0x1ed2 bytes) 2024-03-28T23:11:39.850 INFO:teuthology.orchestra.run.smithi153.stdout: +3312(240 mod 256): MAPREAD 0x16000 thru 0x165a2 (0x5a3 bytes) 2024-03-28T23:11:39.850 INFO:teuthology.orchestra.run.smithi153.stdout: +3313(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.850 INFO:teuthology.orchestra.run.smithi153.stdout: +3314(242 mod 256): WRITE 0x78000 thru 0x78fff (0x1000 bytes) EXTEND 2024-03-28T23:11:39.850 INFO:teuthology.orchestra.run.smithi153.stdout: +3315(243 mod 256): PUNCH 0x1079 thru 0x2010 (0xf98 bytes) 2024-03-28T23:11:39.850 INFO:teuthology.orchestra.run.smithi153.stdout: +3316(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.850 INFO:teuthology.orchestra.run.smithi153.stdout: +3317(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.850 INFO:teuthology.orchestra.run.smithi153.stdout: +3318(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.850 INFO:teuthology.orchestra.run.smithi153.stdout: +3319(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.851 INFO:teuthology.orchestra.run.smithi153.stdout: +3320(248 mod 256): TRUNCATE DOWN from 0x79000 to 0x74000 2024-03-28T23:11:39.851 INFO:teuthology.orchestra.run.smithi153.stdout: +3321(249 mod 256): PUNCH 0x6cc63 thru 0x6cc93 (0x31 bytes) 2024-03-28T23:11:39.851 INFO:teuthology.orchestra.run.smithi153.stdout: +3322(250 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.851 INFO:teuthology.orchestra.run.smithi153.stdout: +3323(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.851 INFO:teuthology.orchestra.run.smithi153.stdout: +3324(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.851 INFO:teuthology.orchestra.run.smithi153.stdout: +3325(253 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.851 INFO:teuthology.orchestra.run.smithi153.stdout: +3326(254 mod 256): MAPREAD 0x49000 thru 0x4ad9f (0x1da0 bytes) 2024-03-28T23:11:39.851 INFO:teuthology.orchestra.run.smithi153.stdout: +3327(255 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.851 INFO:teuthology.orchestra.run.smithi153.stdout: +3328( 0 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.851 INFO:teuthology.orchestra.run.smithi153.stdout: +3329( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.851 INFO:teuthology.orchestra.run.smithi153.stdout: +3330( 2 mod 256): MAPREAD 0xf000 thru 0x106ad (0x16ae bytes) 2024-03-28T23:11:39.851 INFO:teuthology.orchestra.run.smithi153.stdout: +3331( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.851 INFO:teuthology.orchestra.run.smithi153.stdout: +3332( 4 mod 256): COPY 0x22000 thru 0x22fff (0x1000 bytes) to 0x53000 thru 0x53fff 2024-03-28T23:11:39.852 INFO:teuthology.orchestra.run.smithi153.stdout: +3333( 5 mod 256): MAPREAD 0x45000 thru 0x45dc5 (0xdc6 bytes) 2024-03-28T23:11:39.852 INFO:teuthology.orchestra.run.smithi153.stdout: +3334( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.852 INFO:teuthology.orchestra.run.smithi153.stdout: +3335( 7 mod 256): PUNCH 0x5e273 thru 0x5fb4b (0x18d9 bytes) 2024-03-28T23:11:39.852 INFO:teuthology.orchestra.run.smithi153.stdout: +3336( 8 mod 256): COPY 0x41000 thru 0x41fff (0x1000 bytes) to 0x33000 thru 0x33fff 2024-03-28T23:11:39.852 INFO:teuthology.orchestra.run.smithi153.stdout: +3337( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.852 INFO:teuthology.orchestra.run.smithi153.stdout: +3338( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.852 INFO:teuthology.orchestra.run.smithi153.stdout: +3339( 11 mod 256): COPY 0x6e000 thru 0x6efff (0x1000 bytes) to 0x26000 thru 0x26fff 2024-03-28T23:11:39.852 INFO:teuthology.orchestra.run.smithi153.stdout: +3340( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.852 INFO:teuthology.orchestra.run.smithi153.stdout: +3341( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.852 INFO:teuthology.orchestra.run.smithi153.stdout: +3342( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.852 INFO:teuthology.orchestra.run.smithi153.stdout: +3343( 15 mod 256): MAPREAD 0x6000 thru 0x6a13 (0xa14 bytes) 2024-03-28T23:11:39.852 INFO:teuthology.orchestra.run.smithi153.stdout: +3344( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.852 INFO:teuthology.orchestra.run.smithi153.stdout: +3345( 17 mod 256): TRUNCATE DOWN from 0x74000 to 0x6b000 2024-03-28T23:11:39.852 INFO:teuthology.orchestra.run.smithi153.stdout: +3346( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.853 INFO:teuthology.orchestra.run.smithi153.stdout: +3347( 19 mod 256): WRITE 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-28T23:11:39.853 INFO:teuthology.orchestra.run.smithi153.stdout: +3348( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.853 INFO:teuthology.orchestra.run.smithi153.stdout: +3349( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.853 INFO:teuthology.orchestra.run.smithi153.stdout: +3350( 22 mod 256): MAPWRITE 0x24000 thru 0x246bb (0x6bc bytes) 2024-03-28T23:11:39.853 INFO:teuthology.orchestra.run.smithi153.stdout: +3351( 23 mod 256): MAPWRITE 0x3b000 thru 0x3c9a8 (0x19a9 bytes) 2024-03-28T23:11:39.853 INFO:teuthology.orchestra.run.smithi153.stdout: +3352( 24 mod 256): TRUNCATE DOWN from 0x6b000 to 0x51000 2024-03-28T23:11:39.853 INFO:teuthology.orchestra.run.smithi153.stdout: +3353( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.853 INFO:teuthology.orchestra.run.smithi153.stdout: +3354( 26 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.853 INFO:teuthology.orchestra.run.smithi153.stdout: +3355( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.853 INFO:teuthology.orchestra.run.smithi153.stdout: +3356( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.853 INFO:teuthology.orchestra.run.smithi153.stdout: +3357( 29 mod 256): MAPREAD 0x12000 thru 0x12f40 (0xf41 bytes) 2024-03-28T23:11:39.853 INFO:teuthology.orchestra.run.smithi153.stdout: +3358( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.853 INFO:teuthology.orchestra.run.smithi153.stdout: +3359( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.853 INFO:teuthology.orchestra.run.smithi153.stdout: +3360( 32 mod 256): MAPWRITE 0x56000 thru 0x57196 (0x1197 bytes) 2024-03-28T23:11:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: +3361( 33 mod 256): READ 0x1b000 thru 0x1bfff (0x1000 bytes) 2024-03-28T23:11:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: +3362( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: +3363( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: +3364( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: +3365( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: +3366( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: +3367( 39 mod 256): PUNCH 0xf536 thru 0x11394 (0x1e5f bytes) 2024-03-28T23:11:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: +3368( 40 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: +3369( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: +3370( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: +3371( 43 mod 256): MAPREAD 0x51000 thru 0x52b54 (0x1b55 bytes) 2024-03-28T23:11:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: +3372( 44 mod 256): TRUNCATE DOWN from 0x57197 to 0x2000 ******WWWW 2024-03-28T23:11:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: +3373( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: +3374( 46 mod 256): PUNCH 0x7f8 thru 0x1fff (0x1808 bytes) 2024-03-28T23:11:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: +3375( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: +3376( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: +3377( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: +3378( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: +3379( 51 mod 256): PUNCH 0x156a thru 0x1ee8 (0x97f bytes) 2024-03-28T23:11:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: +3380( 52 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: +3381( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: +3382( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: +3383( 55 mod 256): TRUNCATE UP from 0x2000 to 0x8000 2024-03-28T23:11:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: +3384( 56 mod 256): TRUNCATE UP from 0x8000 to 0x39000 ******WWWW 2024-03-28T23:11:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: +3385( 57 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: +3386( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: +3387( 59 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.855 INFO:teuthology.orchestra.run.smithi153.stdout: +3388( 60 mod 256): WRITE 0x69000 thru 0x69fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: +3389( 61 mod 256): PUNCH 0x1b7e1 thru 0x1c870 (0x1090 bytes) 2024-03-28T23:11:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: +3390( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: +3391( 63 mod 256): TRUNCATE DOWN from 0x6a000 to 0x19000 ******WWWW 2024-03-28T23:11:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: +3392( 64 mod 256): MAPREAD 0xa000 thru 0xb41f (0x1420 bytes) 2024-03-28T23:11:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: +3393( 65 mod 256): READ 0xb000 thru 0xbfff (0x1000 bytes) 2024-03-28T23:11:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: +3394( 66 mod 256): PUNCH 0xf8f0 thru 0xfc20 (0x331 bytes) 2024-03-28T23:11:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: +3395( 67 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: +3396( 68 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: +3397( 69 mod 256): PUNCH 0xb6b6 thru 0xd39f (0x1cea bytes) 2024-03-28T23:11:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: +3398( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: +3399( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: +3400( 72 mod 256): MAPREAD 0xb000 thru 0xca3b (0x1a3c bytes) 2024-03-28T23:11:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: +3401( 73 mod 256): READ 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-28T23:11:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: +3402( 74 mod 256): WRITE 0x76000 thru 0x76fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: +3403( 75 mod 256): COPY 0x22000 thru 0x22fff (0x1000 bytes) to 0x70000 thru 0x70fff 2024-03-28T23:11:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: +3404( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: +3405( 77 mod 256): MAPWRITE 0x19000 thru 0x1aa73 (0x1a74 bytes) 2024-03-28T23:11:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: +3406( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: +3407( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: +3408( 80 mod 256): MAPWRITE 0x12000 thru 0x12bb4 (0xbb5 bytes) 2024-03-28T23:11:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: +3409( 81 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.857 INFO:teuthology.orchestra.run.smithi153.stdout: +3410( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: +3411( 83 mod 256): COPY 0x12000 thru 0x12fff (0x1000 bytes) to 0x73000 thru 0x73fff 2024-03-28T23:11:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: +3412( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: +3413( 85 mod 256): TRUNCATE DOWN from 0x77000 to 0x59000 2024-03-28T23:11:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: +3414( 86 mod 256): MAPREAD 0x18000 thru 0x19403 (0x1404 bytes) 2024-03-28T23:11:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: +3415( 87 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: +3416( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: +3417( 89 mod 256): COPY 0x38000 thru 0x38fff (0x1000 bytes) to 0x4000 thru 0x4fff 2024-03-28T23:11:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: +3418( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: +3419( 91 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-28T23:11:39.858 INFO:teuthology.orchestra.run.smithi153.stdout: +3420( 92 mod 256): MAPWRITE 0x4000 thru 0x41d5 (0x1d6 bytes) 2024-03-28T23:11:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: +3421( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: +3422( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: +3423( 95 mod 256): WRITE 0x31000 thru 0x31fff (0x1000 bytes) 2024-03-28T23:11:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: +3424( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: +3425( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: +3426( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: +3427( 99 mod 256): WRITE 0x6f000 thru 0x6ffff (0x1000 bytes) HOLE 2024-03-28T23:11:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: +3428(100 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: +3429(101 mod 256): TRUNCATE UP from 0x70000 to 0x74000 2024-03-28T23:11:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: +3430(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: +3431(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: +3432(104 mod 256): MAPREAD 0x28000 thru 0x2891a (0x91b bytes) 2024-03-28T23:11:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: +3433(105 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.859 INFO:teuthology.orchestra.run.smithi153.stdout: +3434(106 mod 256): MAPREAD 0x36000 thru 0x36a27 (0xa28 bytes) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3435(107 mod 256): MAPREAD 0x38000 thru 0x3850b (0x50c bytes) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3436(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3437(109 mod 256): MAPWRITE 0x53000 thru 0x54304 (0x1305 bytes) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3438(110 mod 256): MAPREAD 0x24000 thru 0x25df8 (0x1df9 bytes) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3439(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3440(112 mod 256): MAPREAD 0x40000 thru 0x40fcc (0xfcd bytes) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3441(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3442(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3443(115 mod 256): PUNCH 0x53bf9 thru 0x55987 (0x1d8f bytes) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3444(116 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3445(117 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3446(118 mod 256): MAPREAD 0x56000 thru 0x56b67 (0xb68 bytes) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3447(119 mod 256): PUNCH 0x487d2 thru 0x48945 (0x174 bytes) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3448(120 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.860 INFO:teuthology.orchestra.run.smithi153.stdout: +3449(121 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: +3450(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: +3451(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: +3452(124 mod 256): READ 0x65000 thru 0x65fff (0x1000 bytes) 2024-03-28T23:11:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: +3453(125 mod 256): READ 0x58000 thru 0x58fff (0x1000 bytes) 2024-03-28T23:11:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: +3454(126 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: +3455(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: +3456(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: +3457(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: +3458(130 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: +3459(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: +3460(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: +3461(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: +3462(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.861 INFO:teuthology.orchestra.run.smithi153.stdout: +3463(135 mod 256): PUNCH 0x1ffc4 thru 0x20a02 (0xa3f bytes) 2024-03-28T23:11:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: +3464(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: +3465(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: +3466(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: +3467(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: +3468(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: +3469(141 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: +3470(142 mod 256): TRUNCATE DOWN from 0x74000 to 0x3c000 2024-03-28T23:11:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: +3471(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: +3472(144 mod 256): MAPWRITE 0x4a000 thru 0x4a0a6 (0xa7 bytes) 2024-03-28T23:11:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: +3473(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: +3474(146 mod 256): MAPWRITE 0x3e000 thru 0x3e37b (0x37c bytes) 2024-03-28T23:11:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: +3475(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: +3476(148 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.862 INFO:teuthology.orchestra.run.smithi153.stdout: +3477(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3478(150 mod 256): MAPWRITE 0x2d000 thru 0x2ed8b (0x1d8c bytes) 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3479(151 mod 256): COPY 0x7000 thru 0x7fff (0x1000 bytes) to 0x14000 thru 0x14fff 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3480(152 mod 256): MAPWRITE 0x2b000 thru 0x2c1bb (0x11bc bytes) 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3481(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3482(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3483(155 mod 256): PUNCH 0x5571 thru 0x7102 (0x1b92 bytes) 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3484(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3485(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3486(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3487(159 mod 256): MAPREAD 0x19000 thru 0x194d9 (0x4da bytes) 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3488(160 mod 256): TRUNCATE DOWN from 0x4a0a7 to 0x26000 ******WWWW 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3489(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3490(162 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0xd000 thru 0xdfff 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3491(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.863 INFO:teuthology.orchestra.run.smithi153.stdout: +3492(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: +3493(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: +3494(166 mod 256): MAPREAD 0x3000 thru 0x3e46 (0xe47 bytes) 2024-03-28T23:11:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: +3495(167 mod 256): PUNCH 0x212d1 thru 0x224b5 (0x11e5 bytes) 2024-03-28T23:11:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: +3496(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: +3497(169 mod 256): MAPREAD 0xd000 thru 0xefe2 (0x1fe3 bytes) 2024-03-28T23:11:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: +3498(170 mod 256): COPY 0x0 thru 0xfff (0x1000 bytes) to 0x5c000 thru 0x5cfff 2024-03-28T23:11:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: +3499(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: +3500(172 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: +3501(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: +3502(174 mod 256): PUNCH 0x52e27 thru 0x53065 (0x23f bytes) 2024-03-28T23:11:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: +3503(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: +3504(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: +3505(177 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.864 INFO:teuthology.orchestra.run.smithi153.stdout: +3506(178 mod 256): WRITE 0x39000 thru 0x39fff (0x1000 bytes) 2024-03-28T23:11:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: +3507(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: +3508(180 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: +3509(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: +3510(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: +3511(183 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: +3512(184 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: +3513(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: +3514(186 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: +3515(187 mod 256): TRUNCATE DOWN from 0x5d000 to 0x3000 ******WWWW 2024-03-28T23:11:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: +3516(188 mod 256): PUNCH 0x624 thru 0x17c4 (0x11a1 bytes) 2024-03-28T23:11:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: +3517(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: +3518(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: +3519(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.865 INFO:teuthology.orchestra.run.smithi153.stdout: +3520(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: +3521(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: +3522(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: +3523(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: +3524(196 mod 256): PUNCH 0x6cf thru 0x1dd5 (0x1707 bytes) 2024-03-28T23:11:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: +3525(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: +3526(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: +3527(199 mod 256): PUNCH 0x178a thru 0x2a03 (0x127a bytes) 2024-03-28T23:11:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: +3528(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: +3529(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: +3530(202 mod 256): MAPWRITE 0x58000 thru 0x59b24 (0x1b25 bytes) 2024-03-28T23:11:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: +3531(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: +3532(204 mod 256): MAPWRITE 0x4e000 thru 0x4ee97 (0xe98 bytes) 2024-03-28T23:11:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: +3533(205 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.866 INFO:teuthology.orchestra.run.smithi153.stdout: +3534(206 mod 256): MAPWRITE 0x6000 thru 0x7aba (0x1abb bytes) 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3535(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3536(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3537(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3538(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3539(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3540(212 mod 256): READ 0x49000 thru 0x49fff (0x1000 bytes) 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3541(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3542(214 mod 256): PUNCH 0x483c4 thru 0x4931c (0xf59 bytes) 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3543(215 mod 256): WRITE 0x44000 thru 0x44fff (0x1000 bytes) 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3544(216 mod 256): COPY 0x15000 thru 0x15fff (0x1000 bytes) to 0x73000 thru 0x73fff 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3545(217 mod 256): MAPREAD 0x2b000 thru 0x2b811 (0x812 bytes) 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3546(218 mod 256): MAPREAD 0xa000 thru 0xb10d (0x110e bytes) 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3547(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3548(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: +3549(221 mod 256): MAPWRITE 0x5b000 thru 0x5bdc8 (0xdc9 bytes) 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3550(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3551(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3552(224 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3553(225 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3554(226 mod 256): TRUNCATE DOWN from 0x74000 to 0x4f000 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3555(227 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3556(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3557(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3558(230 mod 256): MAPREAD 0x18000 thru 0x1863d (0x63e bytes) 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3559(231 mod 256): MAPWRITE 0x28000 thru 0x29eaf (0x1eb0 bytes) 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3560(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3561(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3562(234 mod 256): MAPWRITE 0x68000 thru 0x69b54 (0x1b55 bytes) 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3563(235 mod 256): PUNCH 0xf4d1 thru 0x111e0 (0x1d10 bytes) 2024-03-28T23:11:39.868 INFO:teuthology.orchestra.run.smithi153.stdout: +3564(236 mod 256): WRITE 0x68000 thru 0x68fff (0x1000 bytes) 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3565(237 mod 256): MAPWRITE 0x33000 thru 0x33caa (0xcab bytes) 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3566(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3567(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3568(240 mod 256): MAPREAD 0x67000 thru 0x67e5d (0xe5e bytes) 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3569(241 mod 256): COPY 0x1000 thru 0x1fff (0x1000 bytes) to 0x2a000 thru 0x2afff 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3570(242 mod 256): READ 0x48000 thru 0x48fff (0x1000 bytes) 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3571(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3572(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3573(245 mod 256): READ 0x57000 thru 0x57fff (0x1000 bytes) 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3574(246 mod 256): MAPREAD 0x57000 thru 0x58d50 (0x1d51 bytes) 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3575(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3576(248 mod 256): MAPREAD 0x24000 thru 0x240de (0xdf bytes) 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3577(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3578(250 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.869 INFO:teuthology.orchestra.run.smithi153.stdout: +3579(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: +3580(252 mod 256): PUNCH 0x4915b thru 0x4a7ea (0x1690 bytes) 2024-03-28T23:11:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: +3581(253 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: +3582(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: +3583(255 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: +3584( 0 mod 256): TRUNCATE DOWN from 0x69b55 to 0x9000 ******WWWW 2024-03-28T23:11:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: +3585( 1 mod 256): TRUNCATE UP from 0x9000 to 0x52000 ******WWWW 2024-03-28T23:11:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: +3586( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: +3587( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: +3588( 4 mod 256): WRITE 0x47000 thru 0x47fff (0x1000 bytes) 2024-03-28T23:11:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: +3589( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: +3590( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: +3591( 7 mod 256): MAPWRITE 0x79000 thru 0x79c0b (0xc0c bytes) 2024-03-28T23:11:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: +3592( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.870 INFO:teuthology.orchestra.run.smithi153.stdout: +3593( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3594( 10 mod 256): MAPWRITE 0x51000 thru 0x529fa (0x19fb bytes) 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3595( 11 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3596( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3597( 13 mod 256): MAPREAD 0x25000 thru 0x26420 (0x1421 bytes) 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3598( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3599( 15 mod 256): READ 0x57000 thru 0x57fff (0x1000 bytes) 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3600( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3601( 17 mod 256): MAPWRITE 0x70000 thru 0x7012c (0x12d bytes) 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3602( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3603( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3604( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3605( 21 mod 256): MAPREAD 0x5d000 thru 0x5dda2 (0xda3 bytes) 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3606( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3607( 23 mod 256): COPY 0x53000 thru 0x53fff (0x1000 bytes) to 0x29000 thru 0x29fff 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3608( 24 mod 256): TRUNCATE DOWN from 0x79c0c to 0x23000 ******WWWW 2024-03-28T23:11:39.871 INFO:teuthology.orchestra.run.smithi153.stdout: +3609( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: +3610( 26 mod 256): PUNCH 0xa8ed thru 0xc80a (0x1f1e bytes) 2024-03-28T23:11:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: +3611( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: +3612( 28 mod 256): READ 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-28T23:11:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: +3613( 29 mod 256): MAPREAD 0x12000 thru 0x121d9 (0x1da bytes) 2024-03-28T23:11:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: +3614( 30 mod 256): TRUNCATE UP from 0x23000 to 0x47000 ******WWWW 2024-03-28T23:11:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: +3615( 31 mod 256): COPY 0x1d000 thru 0x1dfff (0x1000 bytes) to 0x2e000 thru 0x2efff 2024-03-28T23:11:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: +3616( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: +3617( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: +3618( 34 mod 256): MAPWRITE 0x6d000 thru 0x6e969 (0x196a bytes) 2024-03-28T23:11:39.872 INFO:teuthology.orchestra.run.smithi153.stdout: +3619( 35 mod 256): READ 0x52000 thru 0x52fff (0x1000 bytes) 2024-03-28T23:11:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: +3620( 36 mod 256): PUNCH 0x588e4 thru 0x5a066 (0x1783 bytes) 2024-03-28T23:11:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: +3621( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: +3622( 38 mod 256): MAPREAD 0x48000 thru 0x49bff (0x1c00 bytes) 2024-03-28T23:11:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: +3623( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: +3624( 40 mod 256): MAPWRITE 0x26000 thru 0x27fda (0x1fdb bytes) 2024-03-28T23:11:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: +3625( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: +3626( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: +3627( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: +3628( 44 mod 256): MAPREAD 0x12000 thru 0x134bd (0x14be bytes) 2024-03-28T23:11:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: +3629( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: +3630( 46 mod 256): PUNCH 0x5cfba thru 0x5d14d (0x194 bytes) 2024-03-28T23:11:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: +3631( 47 mod 256): MAPWRITE 0x15000 thru 0x16f89 (0x1f8a bytes) 2024-03-28T23:11:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: +3632( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.873 INFO:teuthology.orchestra.run.smithi153.stdout: +3633( 49 mod 256): WRITE 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-28T23:11:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: +3634( 50 mod 256): PUNCH 0x1d5d3 thru 0x1ecdc (0x170a bytes) 2024-03-28T23:11:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: +3635( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: +3636( 52 mod 256): PUNCH 0x6c332 thru 0x6c541 (0x210 bytes) 2024-03-28T23:11:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: +3637( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: +3638( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: +3639( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: +3640( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: +3641( 57 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: +3642( 58 mod 256): WRITE 0x71000 thru 0x71fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: +3643( 59 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: +3644( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: +3645( 61 mod 256): WRITE 0x76000 thru 0x76fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.874 INFO:teuthology.orchestra.run.smithi153.stdout: +3646( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3647( 63 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3648( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3649( 65 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3650( 66 mod 256): TRUNCATE DOWN from 0x77000 to 0x3000 ******WWWW 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3651( 67 mod 256): READ 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3652( 68 mod 256): MAPREAD 0x1000 thru 0x1628 (0x629 bytes) 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3653( 69 mod 256): PUNCH 0x8e3 thru 0x2209 (0x1927 bytes) 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3654( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3655( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3656( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3657( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3658( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3659( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3660( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: +3661( 77 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3662( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3663( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3664( 80 mod 256): MAPREAD 0x0 thru 0xb78 (0xb79 bytes) 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3665( 81 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3666( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3667( 83 mod 256): PUNCH 0x9fb thru 0xf7a (0x580 bytes) 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3668( 84 mod 256): PUNCH 0x242e thru 0x2fff (0xbd2 bytes) 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3669( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3670( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3671( 87 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3672( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3673( 89 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3674( 90 mod 256): PUNCH 0x2c69 thru 0x2fff (0x397 bytes) 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3675( 91 mod 256): TRUNCATE UP from 0x3000 to 0x49000 ******WWWW 2024-03-28T23:11:39.876 INFO:teuthology.orchestra.run.smithi153.stdout: +3676( 92 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: +3677( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: +3678( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: +3679( 95 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: +3680( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: +3681( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: +3682( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: +3683( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: +3684(100 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: +3685(101 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: +3686(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: +3687(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: +3688(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: +3689(105 mod 256): MAPREAD 0x9000 thru 0x952a (0x52b bytes) 2024-03-28T23:11:39.877 INFO:teuthology.orchestra.run.smithi153.stdout: +3690(106 mod 256): MAPWRITE 0x16000 thru 0x171f5 (0x11f6 bytes) 2024-03-28T23:11:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: +3691(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: +3692(108 mod 256): MAPWRITE 0x6c000 thru 0x6c105 (0x106 bytes) 2024-03-28T23:11:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: +3693(109 mod 256): TRUNCATE UP from 0x6c106 to 0x71000 2024-03-28T23:11:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: +3694(110 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: +3695(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: +3696(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: +3697(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: +3698(114 mod 256): COPY 0x17000 thru 0x17fff (0x1000 bytes) to 0x3c000 thru 0x3cfff 2024-03-28T23:11:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: +3699(115 mod 256): MAPWRITE 0x34000 thru 0x35c2a (0x1c2b bytes) 2024-03-28T23:11:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: +3700(116 mod 256): TRUNCATE DOWN from 0x71000 to 0x22000 ******WWWW 2024-03-28T23:11:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: +3701(117 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: +3702(118 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: +3703(119 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.878 INFO:teuthology.orchestra.run.smithi153.stdout: +3704(120 mod 256): WRITE 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-28T23:11:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: +3705(121 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: +3706(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: +3707(123 mod 256): WRITE 0x40000 thru 0x40fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: +3708(124 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: +3709(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: +3710(126 mod 256): COPY 0x18000 thru 0x18fff (0x1000 bytes) to 0x1c000 thru 0x1cfff 2024-03-28T23:11:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: +3711(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: +3712(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: +3713(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: +3714(130 mod 256): TRUNCATE UP from 0x41000 to 0x5a000 2024-03-28T23:11:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: +3715(131 mod 256): MAPREAD 0x3e000 thru 0x3e72d (0x72e bytes) 2024-03-28T23:11:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: +3716(132 mod 256): MAPWRITE 0xa000 thru 0xa8a1 (0x8a2 bytes) 2024-03-28T23:11:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: +3717(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.879 INFO:teuthology.orchestra.run.smithi153.stdout: +3718(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: +3719(135 mod 256): MAPREAD 0x35000 thru 0x36231 (0x1232 bytes) 2024-03-28T23:11:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: +3720(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: +3721(137 mod 256): COPY 0x2d000 thru 0x2dfff (0x1000 bytes) to 0x61000 thru 0x61fff 2024-03-28T23:11:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: +3722(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: +3723(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: +3724(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: +3725(141 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-28T23:11:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: +3726(142 mod 256): COPY 0x47000 thru 0x47fff (0x1000 bytes) to 0x77000 thru 0x77fff 2024-03-28T23:11:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: +3727(143 mod 256): COPY 0x6a000 thru 0x6afff (0x1000 bytes) to 0x68000 thru 0x68fff 2024-03-28T23:11:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: +3728(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: +3729(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: +3730(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: +3731(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.880 INFO:teuthology.orchestra.run.smithi153.stdout: +3732(148 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3733(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3734(150 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3735(151 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3736(152 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3737(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3738(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3739(155 mod 256): MAPWRITE 0x5d000 thru 0x5d4df (0x4e0 bytes) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3740(156 mod 256): PUNCH 0x2c305 thru 0x2c7ac (0x4a8 bytes) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3741(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3742(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3743(159 mod 256): MAPREAD 0x53000 thru 0x54ffc (0x1ffd bytes) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3744(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3745(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3746(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.881 INFO:teuthology.orchestra.run.smithi153.stdout: +3747(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: +3748(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: +3749(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: +3750(166 mod 256): WRITE 0x27000 thru 0x27fff (0x1000 bytes) 2024-03-28T23:11:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: +3751(167 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: +3752(168 mod 256): TRUNCATE DOWN from 0x78000 to 0x50000 2024-03-28T23:11:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: +3753(169 mod 256): MAPREAD 0x6000 thru 0x73b2 (0x13b3 bytes) 2024-03-28T23:11:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: +3754(170 mod 256): MAPREAD 0x20000 thru 0x20c9d (0xc9e bytes) 2024-03-28T23:11:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: +3755(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: +3756(172 mod 256): MAPWRITE 0xf000 thru 0x107c2 (0x17c3 bytes) 2024-03-28T23:11:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: +3757(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: +3758(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: +3759(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: +3760(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.882 INFO:teuthology.orchestra.run.smithi153.stdout: +3761(177 mod 256): TRUNCATE DOWN from 0x50000 to 0x22000 ******WWWW 2024-03-28T23:11:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: +3762(178 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: +3763(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: +3764(180 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: +3765(181 mod 256): TRUNCATE DOWN from 0x22000 to 0xa000 2024-03-28T23:11:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: +3766(182 mod 256): TRUNCATE UP from 0xa000 to 0x2c000 2024-03-28T23:11:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: +3767(183 mod 256): WRITE 0x56000 thru 0x56fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: +3768(184 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: +3769(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: +3770(186 mod 256): PUNCH 0x3dd0b thru 0x3e6c0 (0x9b6 bytes) 2024-03-28T23:11:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: +3771(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: +3772(188 mod 256): MAPWRITE 0x19000 thru 0x1a1a1 (0x11a2 bytes) 2024-03-28T23:11:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: +3773(189 mod 256): COPY 0x3d000 thru 0x3dfff (0x1000 bytes) to 0x29000 thru 0x29fff 2024-03-28T23:11:39.883 INFO:teuthology.orchestra.run.smithi153.stdout: +3774(190 mod 256): MAPWRITE 0xc000 thru 0xc38d (0x38e bytes) 2024-03-28T23:11:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: +3775(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: +3776(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: +3777(193 mod 256): COPY 0xc000 thru 0xcfff (0x1000 bytes) to 0x63000 thru 0x63fff 2024-03-28T23:11:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: +3778(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: +3779(195 mod 256): TRUNCATE DOWN from 0x64000 to 0x31000 ******WWWW 2024-03-28T23:11:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: +3780(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: +3781(197 mod 256): PUNCH 0x1c282 thru 0x1cdf6 (0xb75 bytes) 2024-03-28T23:11:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: +3782(198 mod 256): READ 0xf000 thru 0xffff (0x1000 bytes) 2024-03-28T23:11:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: +3783(199 mod 256): MAPWRITE 0x42000 thru 0x4239e (0x39f bytes) 2024-03-28T23:11:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: +3784(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: +3785(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: +3786(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: +3787(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.884 INFO:teuthology.orchestra.run.smithi153.stdout: +3788(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: +3789(205 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: +3790(206 mod 256): PUNCH 0x37e07 thru 0x392ce (0x14c8 bytes) ******PPPP 2024-03-28T23:11:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: +3791(207 mod 256): MAPWRITE 0xc000 thru 0xda4b (0x1a4c bytes) 2024-03-28T23:11:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: +3792(208 mod 256): PUNCH 0xb1b6 thru 0xb7cc (0x617 bytes) 2024-03-28T23:11:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: +3793(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: +3794(210 mod 256): MAPREAD 0x1f000 thru 0x1ffd3 (0xfd4 bytes) 2024-03-28T23:11:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: +3795(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: +3796(212 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: +3797(213 mod 256): TRUNCATE DOWN from 0x4239f to 0x22000 ******WWWW 2024-03-28T23:11:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: +3798(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: +3799(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: +3800(216 mod 256): MAPREAD 0xd000 thru 0xe0c4 (0x10c5 bytes) 2024-03-28T23:11:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: +3801(217 mod 256): MAPREAD 0xe000 thru 0xe4ae (0x4af bytes) 2024-03-28T23:11:39.885 INFO:teuthology.orchestra.run.smithi153.stdout: +3802(218 mod 256): WRITE 0x5b000 thru 0x5bfff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: +3803(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: +3804(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: +3805(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: +3806(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: +3807(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: +3808(224 mod 256): PUNCH 0x6069 thru 0x713c (0x10d4 bytes) 2024-03-28T23:11:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: +3809(225 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: +3810(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: +3811(227 mod 256): MAPREAD 0x2b000 thru 0x2bc78 (0xc79 bytes) 2024-03-28T23:11:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: +3812(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: +3813(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: +3814(230 mod 256): WRITE 0x53000 thru 0x53fff (0x1000 bytes) 2024-03-28T23:11:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: +3815(231 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.886 INFO:teuthology.orchestra.run.smithi153.stdout: +3816(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3817(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3818(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3819(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3820(236 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3821(237 mod 256): READ 0x53000 thru 0x53fff (0x1000 bytes) 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3822(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3823(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3824(240 mod 256): MAPWRITE 0x69000 thru 0x6ac7e (0x1c7f bytes) 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3825(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3826(242 mod 256): MAPREAD 0x10000 thru 0x112ee (0x12ef bytes) 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3827(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3828(244 mod 256): COPY 0x60000 thru 0x60fff (0x1000 bytes) to 0x26000 thru 0x26fff 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3829(245 mod 256): TRUNCATE UP from 0x6ac7f to 0x72000 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3830(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.887 INFO:teuthology.orchestra.run.smithi153.stdout: +3831(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: +3832(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: +3833(249 mod 256): TRUNCATE DOWN from 0x72000 to 0x2000 ******WWWW 2024-03-28T23:11:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: +3834(250 mod 256): MAPWRITE 0x1e000 thru 0x1f762 (0x1763 bytes) 2024-03-28T23:11:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: +3835(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: +3836(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: +3837(253 mod 256): PUNCH 0x1b1bc thru 0x1c131 (0xf76 bytes) 2024-03-28T23:11:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: +3838(254 mod 256): READ 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-28T23:11:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: +3839(255 mod 256): PUNCH 0x1890b thru 0x1a7a2 (0x1e98 bytes) 2024-03-28T23:11:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: +3840( 0 mod 256): READ 0x8000 thru 0x8fff (0x1000 bytes) 2024-03-28T23:11:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: +3841( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: +3842( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: +3843( 3 mod 256): PUNCH 0xc2ee thru 0xdeb4 (0x1bc7 bytes) 2024-03-28T23:11:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: +3844( 4 mod 256): COPY 0x3000 thru 0x3fff (0x1000 bytes) to 0xa000 thru 0xafff 2024-03-28T23:11:39.888 INFO:teuthology.orchestra.run.smithi153.stdout: +3845( 5 mod 256): MAPREAD 0x16000 thru 0x161ae (0x1af bytes) 2024-03-28T23:11:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: +3846( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: +3847( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: +3848( 8 mod 256): MAPREAD 0xe000 thru 0xf7ea (0x17eb bytes) 2024-03-28T23:11:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: +3849( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: +3850( 10 mod 256): WRITE 0x56000 thru 0x56fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: +3851( 11 mod 256): COPY 0x2e000 thru 0x2efff (0x1000 bytes) to 0x6e000 thru 0x6efff 2024-03-28T23:11:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: +3852( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: +3853( 13 mod 256): WRITE 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-28T23:11:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: +3854( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: +3855( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: +3856( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: +3857( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: +3858( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.889 INFO:teuthology.orchestra.run.smithi153.stdout: +3859( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: +3860( 20 mod 256): MAPWRITE 0x6b000 thru 0x6ce8a (0x1e8b bytes) 2024-03-28T23:11:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: +3861( 21 mod 256): MAPWRITE 0x68000 thru 0x68d03 (0xd04 bytes) 2024-03-28T23:11:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: +3862( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: +3863( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: +3864( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: +3865( 25 mod 256): TRUNCATE DOWN from 0x6f000 to 0x2d000 ******WWWW 2024-03-28T23:11:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: +3866( 26 mod 256): MAPWRITE 0x57000 thru 0x5893b (0x193c bytes) 2024-03-28T23:11:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: +3867( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: +3868( 28 mod 256): COPY 0x2b000 thru 0x2bfff (0x1000 bytes) to 0x26000 thru 0x26fff 2024-03-28T23:11:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: +3869( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: +3870( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: +3871( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: +3872( 32 mod 256): MAPREAD 0x32000 thru 0x32da4 (0xda5 bytes) 2024-03-28T23:11:39.890 INFO:teuthology.orchestra.run.smithi153.stdout: +3873( 33 mod 256): MAPWRITE 0x6a000 thru 0x6b73e (0x173f bytes) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3874( 34 mod 256): MAPREAD 0x4a000 thru 0x4b33c (0x133d bytes) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3875( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3876( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3877( 37 mod 256): WRITE 0x2f000 thru 0x2ffff (0x1000 bytes) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3878( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3879( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3880( 40 mod 256): WRITE 0x4e000 thru 0x4efff (0x1000 bytes) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3881( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3882( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3883( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3884( 44 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3885( 45 mod 256): MAPREAD 0x65000 thru 0x665d3 (0x15d4 bytes) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3886( 46 mod 256): PUNCH 0x302ce thru 0x318d3 (0x1606 bytes) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3887( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.891 INFO:teuthology.orchestra.run.smithi153.stdout: +3888( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: +3889( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: +3890( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: +3891( 51 mod 256): COPY 0x2d000 thru 0x2dfff (0x1000 bytes) to 0x4d000 thru 0x4dfff 2024-03-28T23:11:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: +3892( 52 mod 256): COPY 0x47000 thru 0x47fff (0x1000 bytes) to 0x6000 thru 0x6fff 2024-03-28T23:11:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: +3893( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: +3894( 54 mod 256): MAPREAD 0x24000 thru 0x256eb (0x16ec bytes) 2024-03-28T23:11:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: +3895( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: +3896( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: +3897( 57 mod 256): PUNCH 0x3ff74 thru 0x41dde (0x1e6b bytes) 2024-03-28T23:11:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: +3898( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: +3899( 59 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: +3900( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: +3901( 61 mod 256): TRUNCATE DOWN from 0x6b73f to 0x41000 2024-03-28T23:11:39.892 INFO:teuthology.orchestra.run.smithi153.stdout: +3902( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: +3903( 63 mod 256): PUNCH 0x2816e thru 0x2817c (0xf bytes) 2024-03-28T23:11:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: +3904( 64 mod 256): WRITE 0x68000 thru 0x68fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: +3905( 65 mod 256): READ 0x25000 thru 0x25fff (0x1000 bytes) 2024-03-28T23:11:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: +3906( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: +3907( 67 mod 256): WRITE 0x30000 thru 0x30fff (0x1000 bytes) 2024-03-28T23:11:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: +3908( 68 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: +3909( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: +3910( 70 mod 256): COPY 0xc000 thru 0xcfff (0x1000 bytes) to 0x72000 thru 0x72fff 2024-03-28T23:11:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: +3911( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: +3912( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: +3913( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: +3914( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: +3915( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.893 INFO:teuthology.orchestra.run.smithi153.stdout: +3916( 76 mod 256): TRUNCATE DOWN from 0x73000 to 0x5c000 2024-03-28T23:11:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: +3917( 77 mod 256): MAPWRITE 0x3000 thru 0x3e66 (0xe67 bytes) 2024-03-28T23:11:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: +3918( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: +3919( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: +3920( 80 mod 256): MAPWRITE 0x1a000 thru 0x1ae02 (0xe03 bytes) 2024-03-28T23:11:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: +3921( 81 mod 256): COPY 0x44000 thru 0x44fff (0x1000 bytes) to 0x2a000 thru 0x2afff 2024-03-28T23:11:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: +3922( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: +3923( 83 mod 256): WRITE 0x48000 thru 0x48fff (0x1000 bytes) 2024-03-28T23:11:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: +3924( 84 mod 256): MAPWRITE 0x3c000 thru 0x3c69f (0x6a0 bytes) 2024-03-28T23:11:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: +3925( 85 mod 256): COPY 0x37000 thru 0x37fff (0x1000 bytes) to 0x13000 thru 0x13fff EEEE****** 2024-03-28T23:11:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: +3926( 86 mod 256): PUNCH 0x16f8e thru 0x180b3 (0x1126 bytes) 2024-03-28T23:11:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: +3927( 87 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: +3928( 88 mod 256): WRITE 0x2000 thru 0x2fff (0x1000 bytes) 2024-03-28T23:11:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: +3929( 89 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.894 INFO:teuthology.orchestra.run.smithi153.stdout: +3930( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: +3931( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: +3932( 92 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: +3933( 93 mod 256): WRITE 0x45000 thru 0x45fff (0x1000 bytes) 2024-03-28T23:11:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: +3934( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: +3935( 95 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: +3936( 96 mod 256): MAPREAD 0xd000 thru 0xd603 (0x604 bytes) 2024-03-28T23:11:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: +3937( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: +3938( 98 mod 256): TRUNCATE DOWN from 0x5c000 to 0x30000 ******WWWW 2024-03-28T23:11:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: +3939( 99 mod 256): MAPWRITE 0x4000 thru 0x4f43 (0xf44 bytes) 2024-03-28T23:11:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: +3940(100 mod 256): TRUNCATE DOWN from 0x30000 to 0xc000 2024-03-28T23:11:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: +3941(101 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: +3942(102 mod 256): TRUNCATE UP from 0xc000 to 0x22000 2024-03-28T23:11:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: +3943(103 mod 256): TRUNCATE UP from 0x22000 to 0x70000 ******WWWW 2024-03-28T23:11:39.895 INFO:teuthology.orchestra.run.smithi153.stdout: +3944(104 mod 256): MAPWRITE 0x4a000 thru 0x4a18b (0x18c bytes) 2024-03-28T23:11:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: +3945(105 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: +3946(106 mod 256): MAPWRITE 0x74000 thru 0x750ae (0x10af bytes) 2024-03-28T23:11:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: +3947(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: +3948(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: +3949(109 mod 256): COPY 0x53000 thru 0x53fff (0x1000 bytes) to 0x3b000 thru 0x3bfff 2024-03-28T23:11:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: +3950(110 mod 256): PUNCH 0x21abc thru 0x2279c (0xce1 bytes) 2024-03-28T23:11:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: +3951(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: +3952(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: +3953(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: +3954(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: +3955(115 mod 256): PUNCH 0x7f27 thru 0x9408 (0x14e2 bytes) 2024-03-28T23:11:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: +3956(116 mod 256): MAPREAD 0x5c000 thru 0x5c9c9 (0x9ca bytes) 2024-03-28T23:11:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: +3957(117 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.896 INFO:teuthology.orchestra.run.smithi153.stdout: +3958(118 mod 256): PUNCH 0x22655 thru 0x23d4b (0x16f7 bytes) 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3959(119 mod 256): COPY 0x29000 thru 0x29fff (0x1000 bytes) to 0x21000 thru 0x21fff 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3960(120 mod 256): PUNCH 0x878 thru 0x25af (0x1d38 bytes) 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3961(121 mod 256): MAPREAD 0x41000 thru 0x41ad7 (0xad8 bytes) 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3962(122 mod 256): READ 0x6e000 thru 0x6efff (0x1000 bytes) 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3963(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3964(124 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3965(125 mod 256): PUNCH 0x33cbd thru 0x357f6 (0x1b3a bytes) 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3966(126 mod 256): MAPWRITE 0x66000 thru 0x67bab (0x1bac bytes) 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3967(127 mod 256): READ 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3968(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3969(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3970(130 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3971(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3972(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.897 INFO:teuthology.orchestra.run.smithi153.stdout: +3973(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: +3974(134 mod 256): MAPREAD 0x9000 thru 0xa10b (0x110c bytes) 2024-03-28T23:11:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: +3975(135 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: +3976(136 mod 256): MAPWRITE 0x2b000 thru 0x2ba5d (0xa5e bytes) 2024-03-28T23:11:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: +3977(137 mod 256): PUNCH 0x138aa thru 0x147fe (0xf55 bytes) 2024-03-28T23:11:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: +3978(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: +3979(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: +3980(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: +3981(141 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: +3982(142 mod 256): TRUNCATE DOWN from 0x750af to 0x52000 2024-03-28T23:11:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: +3983(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: +3984(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: +3985(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: +3986(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.898 INFO:teuthology.orchestra.run.smithi153.stdout: +3987(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +3988(148 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +3989(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +3990(150 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +3991(151 mod 256): PUNCH 0x1b9b0 thru 0x1d50d (0x1b5e bytes) 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +3992(152 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +3993(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +3994(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +3995(155 mod 256): MAPREAD 0x10000 thru 0x115e7 (0x15e8 bytes) 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +3996(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +3997(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +3998(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +3999(159 mod 256): MAPREAD 0x34000 thru 0x34d74 (0xd75 bytes) 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +4000(160 mod 256): COPY 0x23000 thru 0x23fff (0x1000 bytes) to 0x54000 thru 0x54fff 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +4001(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.899 INFO:teuthology.orchestra.run.smithi153.stdout: +4002(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4003(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4004(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4005(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4006(166 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x41000 thru 0x41fff 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4007(167 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4008(168 mod 256): MAPREAD 0x3a000 thru 0x3b8ab (0x18ac bytes) 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4009(169 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4010(170 mod 256): TRUNCATE DOWN from 0x55000 to 0x41000 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4011(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4012(172 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4013(173 mod 256): COPY 0x1c000 thru 0x1cfff (0x1000 bytes) to 0x4e000 thru 0x4efff 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4014(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4015(175 mod 256): PUNCH 0x280e3 thru 0x2958a (0x14a8 bytes) 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4016(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.900 INFO:teuthology.orchestra.run.smithi153.stdout: +4017(177 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4018(178 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4019(179 mod 256): WRITE 0x46000 thru 0x46fff (0x1000 bytes) 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4020(180 mod 256): MAPREAD 0x11000 thru 0x11910 (0x911 bytes) 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4021(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4022(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4023(183 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4024(184 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4025(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4026(186 mod 256): TRUNCATE DOWN from 0x4f000 to 0x26000 ******WWWW 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4027(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4028(188 mod 256): TRUNCATE UP from 0x26000 to 0x29000 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4029(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4030(190 mod 256): READ 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4031(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.901 INFO:teuthology.orchestra.run.smithi153.stdout: +4032(192 mod 256): WRITE 0x48000 thru 0x48fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: +4033(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: +4034(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: +4035(195 mod 256): MAPWRITE 0x3e000 thru 0x3e950 (0x951 bytes) 2024-03-28T23:11:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: +4036(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: +4037(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: +4038(198 mod 256): PUNCH 0x34448 thru 0x35bac (0x1765 bytes) 2024-03-28T23:11:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: +4039(199 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: +4040(200 mod 256): TRUNCATE UP from 0x49000 to 0x57000 2024-03-28T23:11:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: +4041(201 mod 256): TRUNCATE UP from 0x57000 to 0x59000 2024-03-28T23:11:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: +4042(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: +4043(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: +4044(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: +4045(205 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.902 INFO:teuthology.orchestra.run.smithi153.stdout: +4046(206 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: +4047(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: +4048(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: +4049(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: +4050(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: +4051(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: +4052(212 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: +4053(213 mod 256): WRITE 0x3c000 thru 0x3cfff (0x1000 bytes) 2024-03-28T23:11:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: +4054(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: +4055(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: +4056(216 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: +4057(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: +4058(218 mod 256): MAPREAD 0x18000 thru 0x1984b (0x184c bytes) 2024-03-28T23:11:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: +4059(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.903 INFO:teuthology.orchestra.run.smithi153.stdout: +4060(220 mod 256): PUNCH 0x4fe70 thru 0x5098c (0xb1d bytes) 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4061(221 mod 256): READ 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4062(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4063(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4064(224 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4065(225 mod 256): TRUNCATE DOWN from 0x59000 to 0x36000 ******WWWW 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4066(226 mod 256): WRITE 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4067(227 mod 256): MAPREAD 0x25000 thru 0x268a9 (0x18aa bytes) 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4068(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4069(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4070(230 mod 256): PUNCH 0x26041 thru 0x2651d (0x4dd bytes) 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4071(231 mod 256): COPY 0x5000 thru 0x5fff (0x1000 bytes) to 0x3d000 thru 0x3dfff 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4072(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4073(233 mod 256): MAPWRITE 0x57000 thru 0x57bcd (0xbce bytes) 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4074(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4075(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.904 INFO:teuthology.orchestra.run.smithi153.stdout: +4076(236 mod 256): COPY 0xd000 thru 0xdfff (0x1000 bytes) to 0x23000 thru 0x23fff 2024-03-28T23:11:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: +4077(237 mod 256): MAPWRITE 0x14000 thru 0x14242 (0x243 bytes) 2024-03-28T23:11:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: +4078(238 mod 256): READ 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-28T23:11:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: +4079(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: +4080(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: +4081(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: +4082(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: +4083(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: +4084(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: +4085(245 mod 256): WRITE 0x37000 thru 0x37fff (0x1000 bytes) ***WWWW 2024-03-28T23:11:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: +4086(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: +4087(247 mod 256): COPY 0x31000 thru 0x31fff (0x1000 bytes) to 0x57000 thru 0x57fff 2024-03-28T23:11:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: +4088(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: +4089(249 mod 256): MAPREAD 0x1e000 thru 0x1f97c (0x197d bytes) 2024-03-28T23:11:39.905 INFO:teuthology.orchestra.run.smithi153.stdout: +4090(250 mod 256): WRITE 0x4c000 thru 0x4cfff (0x1000 bytes) 2024-03-28T23:11:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: +4091(251 mod 256): READ 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-28T23:11:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: +4092(252 mod 256): READ 0x37000 thru 0x37fff (0x1000 bytes) ***RRRR*** 2024-03-28T23:11:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: +4093(253 mod 256): PUNCH 0x36c46 thru 0x3758b (0x946 bytes) 2024-03-28T23:11:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: +4094(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: +4095(255 mod 256): MAPWRITE 0x6f000 thru 0x6f3c4 (0x3c5 bytes) 2024-03-28T23:11:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: +4096( 0 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: +4097( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: +4098( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: +4099( 3 mod 256): COPY 0x35000 thru 0x35fff (0x1000 bytes) to 0x1c000 thru 0x1cfff 2024-03-28T23:11:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: +4100( 4 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: +4101( 5 mod 256): MAPREAD 0x61000 thru 0x62c1e (0x1c1f bytes) 2024-03-28T23:11:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: +4102( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: +4103( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.906 INFO:teuthology.orchestra.run.smithi153.stdout: +4104( 8 mod 256): COPY 0x68000 thru 0x68fff (0x1000 bytes) to 0x59000 thru 0x59fff 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4105( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4106( 10 mod 256): MAPWRITE 0x1f000 thru 0x1f921 (0x922 bytes) 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4107( 11 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4108( 12 mod 256): COPY 0x47000 thru 0x47fff (0x1000 bytes) to 0x22000 thru 0x22fff 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4109( 13 mod 256): PUNCH 0x41dd1 thru 0x42907 (0xb37 bytes) 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4110( 14 mod 256): TRUNCATE UP from 0x6f3c5 to 0x75000 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4111( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4112( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4113( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4114( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4115( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4116( 20 mod 256): TRUNCATE UP from 0x75000 to 0x76000 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4117( 21 mod 256): MAPREAD 0x69000 thru 0x69176 (0x177 bytes) 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4118( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.907 INFO:teuthology.orchestra.run.smithi153.stdout: +4119( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: +4120( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: +4121( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: +4122( 26 mod 256): MAPWRITE 0x66000 thru 0x673f9 (0x13fa bytes) 2024-03-28T23:11:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: +4123( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: +4124( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: +4125( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: +4126( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: +4127( 31 mod 256): COPY 0x7000 thru 0x7fff (0x1000 bytes) to 0x34000 thru 0x34fff 2024-03-28T23:11:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: +4128( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: +4129( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: +4130( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: +4131( 35 mod 256): MAPWRITE 0x25000 thru 0x260e9 (0x10ea bytes) 2024-03-28T23:11:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: +4132( 36 mod 256): COPY 0x4c000 thru 0x4cfff (0x1000 bytes) to 0x13000 thru 0x13fff 2024-03-28T23:11:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: +4133( 37 mod 256): MAPWRITE 0x60000 thru 0x615eb (0x15ec bytes) 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4134( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4135( 39 mod 256): TRUNCATE DOWN from 0x76000 to 0xd000 ******WWWW 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4136( 40 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4137( 41 mod 256): PUNCH 0x5438 thru 0x6172 (0xd3b bytes) 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4138( 42 mod 256): READ 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4139( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4140( 44 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4141( 45 mod 256): MAPREAD 0x4000 thru 0x584e (0x184f bytes) 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4142( 46 mod 256): MAPREAD 0x0 thru 0x1c89 (0x1c8a bytes) 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4143( 47 mod 256): TRUNCATE UP from 0xd000 to 0x2c000 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4144( 48 mod 256): READ 0x22000 thru 0x22fff (0x1000 bytes) 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4145( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4146( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4147( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.909 INFO:teuthology.orchestra.run.smithi153.stdout: +4148( 52 mod 256): MAPREAD 0x22000 thru 0x22e4e (0xe4f bytes) 2024-03-28T23:11:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: +4149( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: +4150( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: +4151( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: +4152( 56 mod 256): MAPWRITE 0x17000 thru 0x184ae (0x14af bytes) 2024-03-28T23:11:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: +4153( 57 mod 256): MAPWRITE 0x28000 thru 0x283b7 (0x3b8 bytes) 2024-03-28T23:11:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: +4154( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: +4155( 59 mod 256): WRITE 0x53000 thru 0x53fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: +4156( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: +4157( 61 mod 256): READ 0x31000 thru 0x31fff (0x1000 bytes) 2024-03-28T23:11:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: +4158( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: +4159( 63 mod 256): READ 0x3e000 thru 0x3efff (0x1000 bytes) 2024-03-28T23:11:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: +4160( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: +4161( 65 mod 256): READ 0x26000 thru 0x26fff (0x1000 bytes) 2024-03-28T23:11:39.910 INFO:teuthology.orchestra.run.smithi153.stdout: +4162( 66 mod 256): TRUNCATE UP from 0x54000 to 0x61000 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4163( 67 mod 256): TRUNCATE UP from 0x61000 to 0x6e000 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4164( 68 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4165( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4166( 70 mod 256): READ 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4167( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4168( 72 mod 256): TRUNCATE DOWN from 0x6e000 to 0x45000 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4169( 73 mod 256): COPY 0x7000 thru 0x7fff (0x1000 bytes) to 0x4b000 thru 0x4bfff 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4170( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4171( 75 mod 256): TRUNCATE UP from 0x4c000 to 0x79000 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4172( 76 mod 256): MAPWRITE 0x54000 thru 0x54669 (0x66a bytes) 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4173( 77 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4174( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4175( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4176( 80 mod 256): TRUNCATE DOWN from 0x79000 to 0x69000 2024-03-28T23:11:39.911 INFO:teuthology.orchestra.run.smithi153.stdout: +4177( 81 mod 256): MAPREAD 0x1d000 thru 0x1d15a (0x15b bytes) 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4178( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4179( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4180( 84 mod 256): COPY 0xd000 thru 0xdfff (0x1000 bytes) to 0x15000 thru 0x15fff 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4181( 85 mod 256): WRITE 0x3000 thru 0x3fff (0x1000 bytes) 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4182( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4183( 87 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4184( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4185( 89 mod 256): MAPWRITE 0x55000 thru 0x5523c (0x23d bytes) 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4186( 90 mod 256): WRITE 0x6f000 thru 0x6ffff (0x1000 bytes) HOLE 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4187( 91 mod 256): PUNCH 0x4a1c1 thru 0x4a437 (0x277 bytes) 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4188( 92 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4189( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4190( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4191( 95 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.912 INFO:teuthology.orchestra.run.smithi153.stdout: +4192( 96 mod 256): MAPREAD 0x34000 thru 0x34a60 (0xa61 bytes) 2024-03-28T23:11:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: +4193( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: +4194( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: +4195( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: +4196(100 mod 256): MAPWRITE 0x52000 thru 0x533f3 (0x13f4 bytes) 2024-03-28T23:11:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: +4197(101 mod 256): MAPWRITE 0x16000 thru 0x16d9e (0xd9f bytes) 2024-03-28T23:11:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: +4198(102 mod 256): MAPREAD 0x27000 thru 0x28a1e (0x1a1f bytes) 2024-03-28T23:11:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: +4199(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: +4200(104 mod 256): READ 0x6e000 thru 0x6efff (0x1000 bytes) 2024-03-28T23:11:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: +4201(105 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: +4202(106 mod 256): COPY 0x5f000 thru 0x5ffff (0x1000 bytes) to 0x20000 thru 0x20fff 2024-03-28T23:11:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: +4203(107 mod 256): PUNCH 0x17bb thru 0x3686 (0x1ecc bytes) 2024-03-28T23:11:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: +4204(108 mod 256): MAPREAD 0xf000 thru 0x10efe (0x1eff bytes) 2024-03-28T23:11:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: +4205(109 mod 256): MAPREAD 0x5c000 thru 0x5cbe0 (0xbe1 bytes) 2024-03-28T23:11:39.913 INFO:teuthology.orchestra.run.smithi153.stdout: +4206(110 mod 256): TRUNCATE DOWN from 0x70000 to 0x34000 ******WWWW 2024-03-28T23:11:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: +4207(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: +4208(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: +4209(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: +4210(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: +4211(115 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: +4212(116 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: +4213(117 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: +4214(118 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: +4215(119 mod 256): PUNCH 0x12f7e thru 0x13f73 (0xff6 bytes) 2024-03-28T23:11:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: +4216(120 mod 256): MAPREAD 0x13000 thru 0x14c04 (0x1c05 bytes) 2024-03-28T23:11:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: +4217(121 mod 256): MAPREAD 0x29000 thru 0x2aeba (0x1ebb bytes) 2024-03-28T23:11:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: +4218(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: +4219(123 mod 256): MAPREAD 0x14000 thru 0x1505a (0x105b bytes) 2024-03-28T23:11:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: +4220(124 mod 256): TRUNCATE DOWN from 0x34000 to 0x17000 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4221(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4222(126 mod 256): READ 0xc000 thru 0xcfff (0x1000 bytes) 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4223(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4224(128 mod 256): MAPWRITE 0x68000 thru 0x68d05 (0xd06 bytes) 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4225(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4226(130 mod 256): PUNCH 0x9a41 thru 0xb994 (0x1f54 bytes) 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4227(131 mod 256): MAPREAD 0x3d000 thru 0x3e727 (0x1728 bytes) 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4228(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4229(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4230(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4231(135 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4232(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4233(137 mod 256): MAPWRITE 0x56000 thru 0x5738a (0x138b bytes) 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4234(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.915 INFO:teuthology.orchestra.run.smithi153.stdout: +4235(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4236(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4237(141 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4238(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4239(143 mod 256): MAPREAD 0xe000 thru 0xe2fe (0x2ff bytes) 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4240(144 mod 256): TRUNCATE DOWN from 0x68d06 to 0x3d000 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4241(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4242(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4243(147 mod 256): WRITE 0x16000 thru 0x16fff (0x1000 bytes) 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4244(148 mod 256): READ 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4245(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4246(150 mod 256): PUNCH 0x391bb thru 0x3a293 (0x10d9 bytes) 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4247(151 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4248(152 mod 256): PUNCH 0x14a5a thru 0x15815 (0xdbc bytes) 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4249(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.916 INFO:teuthology.orchestra.run.smithi153.stdout: +4250(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: +4251(155 mod 256): COPY 0x12000 thru 0x12fff (0x1000 bytes) to 0x4000 thru 0x4fff 2024-03-28T23:11:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: +4252(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: +4253(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: +4254(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: +4255(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: +4256(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: +4257(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: +4258(162 mod 256): MAPREAD 0x2a000 thru 0x2a7bb (0x7bc bytes) 2024-03-28T23:11:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: +4259(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: +4260(164 mod 256): WRITE 0x3a000 thru 0x3afff (0x1000 bytes) 2024-03-28T23:11:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: +4261(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: +4262(166 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: +4263(167 mod 256): TRUNCATE DOWN from 0x3d000 to 0x35000 ******WWWW 2024-03-28T23:11:39.917 INFO:teuthology.orchestra.run.smithi153.stdout: +4264(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: +4265(169 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: +4266(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: +4267(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: +4268(172 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: +4269(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: +4270(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: +4271(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: +4272(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: +4273(177 mod 256): PUNCH 0x1afbf thru 0x1bf65 (0xfa7 bytes) 2024-03-28T23:11:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: +4274(178 mod 256): WRITE 0x29000 thru 0x29fff (0x1000 bytes) 2024-03-28T23:11:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: +4275(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: +4276(180 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: +4277(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.918 INFO:teuthology.orchestra.run.smithi153.stdout: +4278(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: +4279(183 mod 256): WRITE 0x66000 thru 0x66fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: +4280(184 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: +4281(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: +4282(186 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: +4283(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: +4284(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: +4285(189 mod 256): COPY 0x48000 thru 0x48fff (0x1000 bytes) to 0x11000 thru 0x11fff 2024-03-28T23:11:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: +4286(190 mod 256): TRUNCATE DOWN from 0x67000 to 0x27000 ******WWWW 2024-03-28T23:11:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: +4287(191 mod 256): PUNCH 0xf204 thru 0x11022 (0x1e1f bytes) 2024-03-28T23:11:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: +4288(192 mod 256): MAPWRITE 0x42000 thru 0x42a56 (0xa57 bytes) 2024-03-28T23:11:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: +4289(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: +4290(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: +4291(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.919 INFO:teuthology.orchestra.run.smithi153.stdout: +4292(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4293(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4294(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4295(199 mod 256): COPY 0x2a000 thru 0x2afff (0x1000 bytes) to 0x23000 thru 0x23fff 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4296(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4297(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4298(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4299(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4300(204 mod 256): MAPWRITE 0x4000 thru 0x4443 (0x444 bytes) 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4301(205 mod 256): READ 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4302(206 mod 256): TRUNCATE DOWN from 0x42a57 to 0x8000 ******WWWW 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4303(207 mod 256): PUNCH 0x7ec2 thru 0x7fff (0x13e bytes) 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4304(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4305(209 mod 256): MAPWRITE 0x53000 thru 0x54c2f (0x1c30 bytes) 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4306(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.920 INFO:teuthology.orchestra.run.smithi153.stdout: +4307(211 mod 256): PUNCH 0x540fb thru 0x54c2f (0xb35 bytes) 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4308(212 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4309(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4310(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4311(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4312(216 mod 256): TRUNCATE UP from 0x54c30 to 0x70000 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4313(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4314(218 mod 256): READ 0x20000 thru 0x20fff (0x1000 bytes) 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4315(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4316(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4317(221 mod 256): MAPWRITE 0x2c000 thru 0x2c248 (0x249 bytes) 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4318(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4319(223 mod 256): MAPWRITE 0x34000 thru 0x350e4 (0x10e5 bytes) 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4320(224 mod 256): PUNCH 0x257c7 thru 0x2693a (0x1174 bytes) 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4321(225 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.921 INFO:teuthology.orchestra.run.smithi153.stdout: +4322(226 mod 256): MAPWRITE 0x6f000 thru 0x6f0ec (0xed bytes) 2024-03-28T23:11:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: +4323(227 mod 256): TRUNCATE DOWN from 0x70000 to 0xd000 ******WWWW 2024-03-28T23:11:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: +4324(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: +4325(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: +4326(230 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: +4327(231 mod 256): PUNCH 0x58a8 thru 0x75d6 (0x1d2f bytes) 2024-03-28T23:11:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: +4328(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: +4329(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: +4330(234 mod 256): PUNCH 0xa494 thru 0xc020 (0x1b8d bytes) 2024-03-28T23:11:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: +4331(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: +4332(236 mod 256): PUNCH 0x7a0c thru 0x815d (0x752 bytes) 2024-03-28T23:11:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: +4333(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: +4334(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: +4335(239 mod 256): MAPREAD 0x6000 thru 0x7e6c (0x1e6d bytes) 2024-03-28T23:11:39.922 INFO:teuthology.orchestra.run.smithi153.stdout: +4336(240 mod 256): MAPWRITE 0xd000 thru 0xd1b7 (0x1b8 bytes) 2024-03-28T23:11:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: +4337(241 mod 256): COPY 0x3000 thru 0x3fff (0x1000 bytes) to 0x30000 thru 0x30fff 2024-03-28T23:11:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: +4338(242 mod 256): TRUNCATE DOWN from 0x31000 to 0x13000 2024-03-28T23:11:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: +4339(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: +4340(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: +4341(245 mod 256): PUNCH 0x333c thru 0x4ae6 (0x17ab bytes) 2024-03-28T23:11:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: +4342(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: +4343(247 mod 256): TRUNCATE UP from 0x13000 to 0x5b000 ******WWWW 2024-03-28T23:11:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: +4344(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: +4345(249 mod 256): MAPREAD 0x19000 thru 0x1a641 (0x1642 bytes) 2024-03-28T23:11:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: +4346(250 mod 256): PUNCH 0xbf10 thru 0xc673 (0x764 bytes) 2024-03-28T23:11:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: +4347(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: +4348(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.923 INFO:teuthology.orchestra.run.smithi153.stdout: +4349(253 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: +4350(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: +4351(255 mod 256): WRITE 0x2e000 thru 0x2efff (0x1000 bytes) 2024-03-28T23:11:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: +4352( 0 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: +4353( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: +4354( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: +4355( 3 mod 256): MAPREAD 0x2a000 thru 0x2bc45 (0x1c46 bytes) 2024-03-28T23:11:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: +4356( 4 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: +4357( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: +4358( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: +4359( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: +4360( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: +4361( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: +4362( 10 mod 256): MAPREAD 0x19000 thru 0x1a345 (0x1346 bytes) 2024-03-28T23:11:39.924 INFO:teuthology.orchestra.run.smithi153.stdout: +4363( 11 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: +4364( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: +4365( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: +4366( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: +4367( 15 mod 256): TRUNCATE DOWN from 0x5b000 to 0x2000 ******WWWW 2024-03-28T23:11:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: +4368( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: +4369( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: +4370( 18 mod 256): PUNCH 0xcfe thru 0x1fff (0x1302 bytes) 2024-03-28T23:11:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: +4371( 19 mod 256): PUNCH 0x12ff thru 0x1fff (0xd01 bytes) 2024-03-28T23:11:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: +4372( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: +4373( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: +4374( 22 mod 256): WRITE 0x52000 thru 0x52fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: +4375( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.925 INFO:teuthology.orchestra.run.smithi153.stdout: +4376( 24 mod 256): COPY 0xe000 thru 0xefff (0x1000 bytes) to 0x4e000 thru 0x4efff 2024-03-28T23:11:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: +4377( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: +4378( 26 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: +4379( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: +4380( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: +4381( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: +4382( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: +4383( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: +4384( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: +4385( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: +4386( 34 mod 256): TRUNCATE DOWN from 0x53000 to 0x4f000 2024-03-28T23:11:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: +4387( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: +4388( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: +4389( 37 mod 256): COPY 0x3c000 thru 0x3cfff (0x1000 bytes) to 0x1c000 thru 0x1cfff 2024-03-28T23:11:39.926 INFO:teuthology.orchestra.run.smithi153.stdout: +4390( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4391( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4392( 40 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4393( 41 mod 256): MAPREAD 0x36000 thru 0x36065 (0x66 bytes) 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4394( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4395( 43 mod 256): COPY 0x3000 thru 0x3fff (0x1000 bytes) to 0x2d000 thru 0x2dfff 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4396( 44 mod 256): MAPREAD 0x2d000 thru 0x2d8ef (0x8f0 bytes) 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4397( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4398( 46 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4399( 47 mod 256): WRITE 0x11000 thru 0x11fff (0x1000 bytes) 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4400( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4401( 49 mod 256): MAPREAD 0x45000 thru 0x462f7 (0x12f8 bytes) 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4402( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4403( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4404( 52 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.927 INFO:teuthology.orchestra.run.smithi153.stdout: +4405( 53 mod 256): MAPWRITE 0x77000 thru 0x78122 (0x1123 bytes) 2024-03-28T23:11:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: +4406( 54 mod 256): TRUNCATE DOWN from 0x78123 to 0x5e000 2024-03-28T23:11:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: +4407( 55 mod 256): MAPREAD 0x38000 thru 0x38464 (0x465 bytes) 2024-03-28T23:11:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: +4408( 56 mod 256): READ 0x1e000 thru 0x1efff (0x1000 bytes) 2024-03-28T23:11:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: +4409( 57 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: +4410( 58 mod 256): READ 0x4c000 thru 0x4cfff (0x1000 bytes) 2024-03-28T23:11:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: +4411( 59 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: +4412( 60 mod 256): PUNCH 0x55aef thru 0x5616d (0x67f bytes) 2024-03-28T23:11:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: +4413( 61 mod 256): TRUNCATE DOWN from 0x5e000 to 0xb000 ******WWWW 2024-03-28T23:11:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: +4414( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: +4415( 63 mod 256): COPY 0x1000 thru 0x1fff (0x1000 bytes) to 0x72000 thru 0x72fff 2024-03-28T23:11:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: +4416( 64 mod 256): PUNCH 0x38794 thru 0x39c54 (0x14c1 bytes) 2024-03-28T23:11:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: +4417( 65 mod 256): PUNCH 0x2d878 thru 0x2e8e5 (0x106e bytes) 2024-03-28T23:11:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: +4418( 66 mod 256): TRUNCATE DOWN from 0x73000 to 0x2b000 ******WWWW 2024-03-28T23:11:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: +4419( 67 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4420( 68 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4421( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4422( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4423( 71 mod 256): PUNCH 0x29d0f thru 0x2a8d3 (0xbc5 bytes) 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4424( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4425( 73 mod 256): TRUNCATE DOWN from 0x2b000 to 0x1f000 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4426( 74 mod 256): TRUNCATE DOWN from 0x1f000 to 0x10000 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4427( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4428( 76 mod 256): PUNCH 0xe217 thru 0xeab7 (0x8a1 bytes) 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4429( 77 mod 256): PUNCH 0x21f2 thru 0x41a8 (0x1fb7 bytes) 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4430( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4431( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4432( 80 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4433( 81 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x66000 thru 0x66fff 2024-03-28T23:11:39.929 INFO:teuthology.orchestra.run.smithi153.stdout: +4434( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: +4435( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: +4436( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: +4437( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: +4438( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: +4439( 87 mod 256): TRUNCATE DOWN from 0x67000 to 0x1000 ******WWWW 2024-03-28T23:11:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: +4440( 88 mod 256): TRUNCATE UP from 0x1000 to 0x50000 ******WWWW 2024-03-28T23:11:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: +4441( 89 mod 256): COPY 0xf000 thru 0xffff (0x1000 bytes) to 0x2e000 thru 0x2efff 2024-03-28T23:11:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: +4442( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: +4443( 91 mod 256): COPY 0x3b000 thru 0x3bfff (0x1000 bytes) to 0xe000 thru 0xefff 2024-03-28T23:11:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: +4444( 92 mod 256): MAPWRITE 0xd000 thru 0xd239 (0x23a bytes) 2024-03-28T23:11:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: +4445( 93 mod 256): MAPWRITE 0x51000 thru 0x5102e (0x2f bytes) 2024-03-28T23:11:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: +4446( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: +4447( 95 mod 256): TRUNCATE UP from 0x5102f to 0x77000 2024-03-28T23:11:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: +4448( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: +4449( 97 mod 256): MAPWRITE 0x54000 thru 0x55702 (0x1703 bytes) 2024-03-28T23:11:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: +4450( 98 mod 256): MAPWRITE 0x29000 thru 0x29360 (0x361 bytes) 2024-03-28T23:11:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: +4451( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: +4452(100 mod 256): PUNCH 0x4f0f7 thru 0x4f636 (0x540 bytes) 2024-03-28T23:11:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: +4453(101 mod 256): PUNCH 0x6faee thru 0x7104f (0x1562 bytes) 2024-03-28T23:11:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: +4454(102 mod 256): MAPWRITE 0x4f000 thru 0x4f138 (0x139 bytes) 2024-03-28T23:11:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: +4455(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: +4456(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: +4457(105 mod 256): TRUNCATE DOWN from 0x77000 to 0x18000 ******WWWW 2024-03-28T23:11:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: +4458(106 mod 256): PUNCH 0x154ee thru 0x165d2 (0x10e5 bytes) 2024-03-28T23:11:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: +4459(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: +4460(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: +4461(109 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.931 INFO:teuthology.orchestra.run.smithi153.stdout: +4462(110 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4463(111 mod 256): MAPREAD 0x5000 thru 0x6acc (0x1acd bytes) 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4464(112 mod 256): MAPWRITE 0x1d000 thru 0x1d39f (0x3a0 bytes) 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4465(113 mod 256): PUNCH 0x119df thru 0x132b9 (0x18db bytes) 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4466(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4467(115 mod 256): TRUNCATE UP from 0x1d3a0 to 0x37000 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4468(116 mod 256): MAPREAD 0x28000 thru 0x296dc (0x16dd bytes) 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4469(117 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4470(118 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4471(119 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4472(120 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4473(121 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4474(122 mod 256): READ 0x16000 thru 0x16fff (0x1000 bytes) 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4475(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4476(124 mod 256): MAPREAD 0x2f000 thru 0x3011f (0x1120 bytes) 2024-03-28T23:11:39.932 INFO:teuthology.orchestra.run.smithi153.stdout: +4477(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: +4478(126 mod 256): TRUNCATE DOWN from 0x37000 to 0x34000 2024-03-28T23:11:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: +4479(127 mod 256): PUNCH 0x12f9e thru 0x1422c (0x128f bytes) 2024-03-28T23:11:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: +4480(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: +4481(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: +4482(130 mod 256): MAPWRITE 0x70000 thru 0x716cf (0x16d0 bytes) 2024-03-28T23:11:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: +4483(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: +4484(132 mod 256): WRITE 0x46000 thru 0x46fff (0x1000 bytes) 2024-03-28T23:11:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: +4485(133 mod 256): MAPREAD 0x36000 thru 0x37467 (0x1468 bytes) 2024-03-28T23:11:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: +4486(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: +4487(135 mod 256): MAPREAD 0x3f000 thru 0x3fa79 (0xa7a bytes) 2024-03-28T23:11:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: +4488(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: +4489(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: +4490(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.933 INFO:teuthology.orchestra.run.smithi153.stdout: +4491(139 mod 256): WRITE 0x5c000 thru 0x5cfff (0x1000 bytes) 2024-03-28T23:11:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: +4492(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: +4493(141 mod 256): MAPREAD 0x1e000 thru 0x1e9ef (0x9f0 bytes) 2024-03-28T23:11:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: +4494(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: +4495(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: +4496(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: +4497(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: +4498(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: +4499(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: +4500(148 mod 256): MAPREAD 0x26000 thru 0x2733b (0x133c bytes) 2024-03-28T23:11:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: +4501(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: +4502(150 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: +4503(151 mod 256): COPY 0x5e000 thru 0x5efff (0x1000 bytes) to 0x30000 thru 0x30fff 2024-03-28T23:11:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: +4504(152 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.934 INFO:teuthology.orchestra.run.smithi153.stdout: +4505(153 mod 256): MAPREAD 0x7000 thru 0x8750 (0x1751 bytes) 2024-03-28T23:11:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: +4506(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: +4507(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: +4508(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: +4509(157 mod 256): TRUNCATE DOWN from 0x716d0 to 0x5000 ******WWWW 2024-03-28T23:11:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: +4510(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: +4511(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: +4512(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: +4513(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: +4514(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: +4515(163 mod 256): READ 0x0 thru 0xfff (0x1000 bytes) 2024-03-28T23:11:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: +4516(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: +4517(165 mod 256): WRITE 0x6f000 thru 0x6ffff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: +4518(166 mod 256): COPY 0x66000 thru 0x66fff (0x1000 bytes) to 0x54000 thru 0x54fff 2024-03-28T23:11:39.935 INFO:teuthology.orchestra.run.smithi153.stdout: +4519(167 mod 256): PUNCH 0x663dc thru 0x6793e (0x1563 bytes) 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4520(168 mod 256): WRITE 0x31000 thru 0x31fff (0x1000 bytes) 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4521(169 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4522(170 mod 256): MAPWRITE 0x0 thru 0xc1d (0xc1e bytes) 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4523(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4524(172 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4525(173 mod 256): MAPREAD 0x10000 thru 0x10770 (0x771 bytes) 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4526(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4527(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4528(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4529(177 mod 256): MAPREAD 0xd000 thru 0xe93d (0x193e bytes) 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4530(178 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4531(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4532(180 mod 256): TRUNCATE DOWN from 0x70000 to 0x13000 ******WWWW 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4533(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.936 INFO:teuthology.orchestra.run.smithi153.stdout: +4534(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4535(183 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4536(184 mod 256): PUNCH 0x8ab thru 0xdbf (0x515 bytes) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4537(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4538(186 mod 256): MAPREAD 0x8000 thru 0x8b22 (0xb23 bytes) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4539(187 mod 256): TRUNCATE UP from 0x13000 to 0x2b000 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4540(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4541(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4542(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4543(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4544(192 mod 256): WRITE 0x10000 thru 0x10fff (0x1000 bytes) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4545(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4546(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4547(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4548(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4549(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.937 INFO:teuthology.orchestra.run.smithi153.stdout: +4550(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: +4551(199 mod 256): COPY 0x26000 thru 0x26fff (0x1000 bytes) to 0x6a000 thru 0x6afff 2024-03-28T23:11:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: +4552(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: +4553(201 mod 256): MAPWRITE 0x33000 thru 0x344c3 (0x14c4 bytes) 2024-03-28T23:11:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: +4554(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: +4555(203 mod 256): MAPREAD 0x66000 thru 0x67ffa (0x1ffb bytes) 2024-03-28T23:11:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: +4556(204 mod 256): PUNCH 0x48357 thru 0x487ec (0x496 bytes) 2024-03-28T23:11:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: +4557(205 mod 256): TRUNCATE DOWN from 0x6b000 to 0x4c000 2024-03-28T23:11:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: +4558(206 mod 256): MAPWRITE 0xa000 thru 0xb08e (0x108f bytes) 2024-03-28T23:11:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: +4559(207 mod 256): WRITE 0x5c000 thru 0x5cfff (0x1000 bytes) HOLE 2024-03-28T23:11:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: +4560(208 mod 256): TRUNCATE UP from 0x5d000 to 0x5f000 2024-03-28T23:11:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: +4561(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: +4562(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: +4563(211 mod 256): WRITE 0x56000 thru 0x56fff (0x1000 bytes) 2024-03-28T23:11:39.938 INFO:teuthology.orchestra.run.smithi153.stdout: +4564(212 mod 256): READ 0x52000 thru 0x52fff (0x1000 bytes) 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4565(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4566(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4567(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4568(216 mod 256): WRITE 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4569(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4570(218 mod 256): MAPWRITE 0x50000 thru 0x5075d (0x75e bytes) 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4571(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4572(220 mod 256): READ 0xf000 thru 0xffff (0x1000 bytes) 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4573(221 mod 256): TRUNCATE DOWN from 0x5f000 to 0x2d000 ******WWWW 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4574(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4575(223 mod 256): MAPREAD 0x1d000 thru 0x1ec8c (0x1c8d bytes) 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4576(224 mod 256): TRUNCATE UP from 0x2d000 to 0x31000 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4577(225 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4578(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4579(227 mod 256): MAPWRITE 0x38000 thru 0x389e3 (0x9e4 bytes) 2024-03-28T23:11:39.939 INFO:teuthology.orchestra.run.smithi153.stdout: +4580(228 mod 256): MAPWRITE 0x2000 thru 0x263d (0x63e bytes) 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4581(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4582(230 mod 256): COPY 0x0 thru 0xfff (0x1000 bytes) to 0x31000 thru 0x31fff 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4583(231 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4584(232 mod 256): MAPREAD 0x1b000 thru 0x1bc2f (0xc30 bytes) 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4585(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4586(234 mod 256): TRUNCATE DOWN from 0x389e4 to 0x32000 ******WWWW 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4587(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4588(236 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4589(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4590(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4591(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4592(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4593(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4594(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.940 INFO:teuthology.orchestra.run.smithi153.stdout: +4595(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4596(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4597(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4598(246 mod 256): TRUNCATE UP from 0x32000 to 0x74000 ******WWWW 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4599(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4600(248 mod 256): MAPWRITE 0x64000 thru 0x655db (0x15dc bytes) 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4601(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4602(250 mod 256): TRUNCATE DOWN from 0x74000 to 0x51000 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4603(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4604(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4605(253 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4606(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4607(255 mod 256): READ 0x3a000 thru 0x3afff (0x1000 bytes) 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4608( 0 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4609( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.941 INFO:teuthology.orchestra.run.smithi153.stdout: +4610( 2 mod 256): MAPWRITE 0x6e000 thru 0x6f232 (0x1233 bytes) 2024-03-28T23:11:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: +4611( 3 mod 256): MAPWRITE 0x1d000 thru 0x1d2f9 (0x2fa bytes) 2024-03-28T23:11:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: +4612( 4 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: +4613( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: +4614( 6 mod 256): TRUNCATE DOWN from 0x6f233 to 0x2d000 ******WWWW 2024-03-28T23:11:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: +4615( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: +4616( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: +4617( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: +4618( 10 mod 256): MAPREAD 0x9000 thru 0x923b (0x23c bytes) 2024-03-28T23:11:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: +4619( 11 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: +4620( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: +4621( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: +4622( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: +4623( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.942 INFO:teuthology.orchestra.run.smithi153.stdout: +4624( 16 mod 256): TRUNCATE UP from 0x2d000 to 0x2d000 2024-03-28T23:11:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: +4625( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: +4626( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: +4627( 19 mod 256): WRITE 0x50000 thru 0x50fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: +4628( 20 mod 256): PUNCH 0x47be5 thru 0x499bc (0x1dd8 bytes) 2024-03-28T23:11:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: +4629( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: +4630( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: +4631( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: +4632( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: +4633( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: +4634( 26 mod 256): READ 0x49000 thru 0x49fff (0x1000 bytes) 2024-03-28T23:11:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: +4635( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: +4636( 28 mod 256): READ 0x35000 thru 0x35fff (0x1000 bytes) 2024-03-28T23:11:39.943 INFO:teuthology.orchestra.run.smithi153.stdout: +4637( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4638( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4639( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4640( 32 mod 256): TRUNCATE UP from 0x51000 to 0x63000 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4641( 33 mod 256): READ 0x46000 thru 0x46fff (0x1000 bytes) 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4642( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4643( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4644( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4645( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4646( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4647( 39 mod 256): READ 0x5c000 thru 0x5cfff (0x1000 bytes) 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4648( 40 mod 256): PUNCH 0x25e8d thru 0x26c0e (0xd82 bytes) 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4649( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4650( 42 mod 256): MAPREAD 0x49000 thru 0x49dc4 (0xdc5 bytes) 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4651( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.944 INFO:teuthology.orchestra.run.smithi153.stdout: +4652( 44 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: +4653( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: +4654( 46 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: +4655( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: +4656( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: +4657( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: +4658( 50 mod 256): MAPREAD 0x4c000 thru 0x4de87 (0x1e88 bytes) 2024-03-28T23:11:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: +4659( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: +4660( 52 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: +4661( 53 mod 256): MAPWRITE 0x39000 thru 0x392a7 (0x2a8 bytes) 2024-03-28T23:11:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: +4662( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: +4663( 55 mod 256): MAPWRITE 0x6b000 thru 0x6b462 (0x463 bytes) 2024-03-28T23:11:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: +4664( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: +4665( 57 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.945 INFO:teuthology.orchestra.run.smithi153.stdout: +4666( 58 mod 256): MAPWRITE 0x59000 thru 0x5ae12 (0x1e13 bytes) 2024-03-28T23:11:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: +4667( 59 mod 256): COPY 0xf000 thru 0xffff (0x1000 bytes) to 0x17000 thru 0x17fff 2024-03-28T23:11:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: +4668( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: +4669( 61 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: +4670( 62 mod 256): WRITE 0x75000 thru 0x75fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: +4671( 63 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: +4672( 64 mod 256): READ 0x60000 thru 0x60fff (0x1000 bytes) 2024-03-28T23:11:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: +4673( 65 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: +4674( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: +4675( 67 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: +4676( 68 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: +4677( 69 mod 256): MAPREAD 0x2f000 thru 0x30bfd (0x1bfe bytes) 2024-03-28T23:11:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: +4678( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: +4679( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.946 INFO:teuthology.orchestra.run.smithi153.stdout: +4680( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: +4681( 73 mod 256): WRITE 0x21000 thru 0x21fff (0x1000 bytes) 2024-03-28T23:11:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: +4682( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: +4683( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: +4684( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: +4685( 77 mod 256): PUNCH 0x6a665 thru 0x6a6ec (0x88 bytes) 2024-03-28T23:11:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: +4686( 78 mod 256): TRUNCATE DOWN from 0x76000 to 0x47000 2024-03-28T23:11:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: +4687( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: +4688( 80 mod 256): TRUNCATE DOWN from 0x47000 to 0x4000 ******WWWW 2024-03-28T23:11:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: +4689( 81 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: +4690( 82 mod 256): MAPWRITE 0x79000 thru 0x7985d (0x85e bytes) 2024-03-28T23:11:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: +4691( 83 mod 256): MAPREAD 0x3000 thru 0x4674 (0x1675 bytes) 2024-03-28T23:11:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: +4692( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: +4693( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.947 INFO:teuthology.orchestra.run.smithi153.stdout: +4694( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: +4695( 87 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: +4696( 88 mod 256): READ 0x5c000 thru 0x5cfff (0x1000 bytes) 2024-03-28T23:11:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: +4697( 89 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: +4698( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: +4699( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: +4700( 92 mod 256): MAPWRITE 0x9000 thru 0xa691 (0x1692 bytes) 2024-03-28T23:11:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: +4701( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: +4702( 94 mod 256): WRITE 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-28T23:11:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: +4703( 95 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: +4704( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: +4705( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: +4706( 98 mod 256): PUNCH 0x471de thru 0x48421 (0x1244 bytes) 2024-03-28T23:11:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: +4707( 99 mod 256): PUNCH 0x698c2 thru 0x6ab93 (0x12d2 bytes) 2024-03-28T23:11:39.948 INFO:teuthology.orchestra.run.smithi153.stdout: +4708(100 mod 256): READ 0x13000 thru 0x13fff (0x1000 bytes) 2024-03-28T23:11:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: +4709(101 mod 256): PUNCH 0x6f959 thru 0x7156f (0x1c17 bytes) 2024-03-28T23:11:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: +4710(102 mod 256): PUNCH 0x35d18 thru 0x36b09 (0xdf2 bytes) 2024-03-28T23:11:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: +4711(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: +4712(104 mod 256): READ 0x40000 thru 0x40fff (0x1000 bytes) 2024-03-28T23:11:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: +4713(105 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: +4714(106 mod 256): READ 0x15000 thru 0x15fff (0x1000 bytes) 2024-03-28T23:11:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: +4715(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: +4716(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: +4717(109 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: +4718(110 mod 256): TRUNCATE DOWN from 0x7985e to 0x75000 2024-03-28T23:11:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: +4719(111 mod 256): WRITE 0x72000 thru 0x72fff (0x1000 bytes) 2024-03-28T23:11:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: +4720(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: +4721(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.949 INFO:teuthology.orchestra.run.smithi153.stdout: +4722(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: +4723(115 mod 256): MAPWRITE 0x32000 thru 0x33b86 (0x1b87 bytes) 2024-03-28T23:11:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: +4724(116 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: +4725(117 mod 256): READ 0x15000 thru 0x15fff (0x1000 bytes) 2024-03-28T23:11:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: +4726(118 mod 256): READ 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-28T23:11:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: +4727(119 mod 256): COPY 0x53000 thru 0x53fff (0x1000 bytes) to 0x73000 thru 0x73fff 2024-03-28T23:11:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: +4728(120 mod 256): TRUNCATE DOWN from 0x75000 to 0x9000 ******WWWW 2024-03-28T23:11:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: +4729(121 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: +4730(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: +4731(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: +4732(124 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: +4733(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: +4734(126 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: +4735(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.950 INFO:teuthology.orchestra.run.smithi153.stdout: +4736(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4737(129 mod 256): TRUNCATE UP from 0x9000 to 0x73000 ******WWWW 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4738(130 mod 256): MAPREAD 0x49000 thru 0x4a061 (0x1062 bytes) 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4739(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4740(132 mod 256): PUNCH 0x4b36c thru 0x4b854 (0x4e9 bytes) 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4741(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4742(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4743(135 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4744(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4745(137 mod 256): READ 0x1c000 thru 0x1cfff (0x1000 bytes) 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4746(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4747(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4748(140 mod 256): COPY 0x63000 thru 0x63fff (0x1000 bytes) to 0x4c000 thru 0x4cfff 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4749(141 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4750(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.951 INFO:teuthology.orchestra.run.smithi153.stdout: +4751(143 mod 256): PUNCH 0x437e9 thru 0x44525 (0xd3d bytes) 2024-03-28T23:11:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: +4752(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: +4753(145 mod 256): TRUNCATE DOWN from 0x73000 to 0x12000 ******WWWW 2024-03-28T23:11:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: +4754(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: +4755(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: +4756(148 mod 256): COPY 0x5000 thru 0x5fff (0x1000 bytes) to 0x65000 thru 0x65fff 2024-03-28T23:11:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: +4757(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: +4758(150 mod 256): TRUNCATE DOWN from 0x66000 to 0x47000 2024-03-28T23:11:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: +4759(151 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: +4760(152 mod 256): TRUNCATE UP from 0x47000 to 0x5e000 2024-03-28T23:11:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: +4761(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: +4762(154 mod 256): MAPREAD 0x18000 thru 0x18aec (0xaed bytes) 2024-03-28T23:11:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: +4763(155 mod 256): WRITE 0x3f000 thru 0x3ffff (0x1000 bytes) 2024-03-28T23:11:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: +4764(156 mod 256): MAPREAD 0x7000 thru 0x7acb (0xacc bytes) 2024-03-28T23:11:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: +4765(157 mod 256): TRUNCATE DOWN from 0x5e000 to 0x27000 ******WWWW 2024-03-28T23:11:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: +4766(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: +4767(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: +4768(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: +4769(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: +4770(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: +4771(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: +4772(164 mod 256): WRITE 0x11000 thru 0x11fff (0x1000 bytes) 2024-03-28T23:11:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: +4773(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: +4774(166 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: +4775(167 mod 256): PUNCH 0x2601f thru 0x26fff (0xfe1 bytes) 2024-03-28T23:11:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: +4776(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: +4777(169 mod 256): TRUNCATE DOWN from 0x27000 to 0x26000 2024-03-28T23:11:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: +4778(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.953 INFO:teuthology.orchestra.run.smithi153.stdout: +4779(171 mod 256): PUNCH 0x15dbe thru 0x16e93 (0x10d6 bytes) 2024-03-28T23:11:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: +4780(172 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: +4781(173 mod 256): PUNCH 0x23066 thru 0x23eea (0xe85 bytes) 2024-03-28T23:11:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: +4782(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: +4783(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: +4784(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: +4785(177 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: +4786(178 mod 256): TRUNCATE DOWN from 0x26000 to 0x6000 2024-03-28T23:11:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: +4787(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: +4788(180 mod 256): MAPREAD 0x2000 thru 0x3543 (0x1544 bytes) 2024-03-28T23:11:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: +4789(181 mod 256): TRUNCATE DOWN from 0x6000 to 0x1000 2024-03-28T23:11:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: +4790(182 mod 256): MAPWRITE 0xa000 thru 0xaa32 (0xa33 bytes) 2024-03-28T23:11:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: +4791(183 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: +4792(184 mod 256): MAPREAD 0x1000 thru 0x2c05 (0x1c06 bytes) 2024-03-28T23:11:39.954 INFO:teuthology.orchestra.run.smithi153.stdout: +4793(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: +4794(186 mod 256): MAPWRITE 0x2b000 thru 0x2b053 (0x54 bytes) 2024-03-28T23:11:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: +4795(187 mod 256): MAPWRITE 0x6f000 thru 0x70b50 (0x1b51 bytes) 2024-03-28T23:11:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: +4796(188 mod 256): PUNCH 0x8d34 thru 0x9516 (0x7e3 bytes) 2024-03-28T23:11:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: +4797(189 mod 256): PUNCH 0x5ff53 thru 0x60321 (0x3cf bytes) 2024-03-28T23:11:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: +4798(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: +4799(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: +4800(192 mod 256): COPY 0x54000 thru 0x54fff (0x1000 bytes) to 0x55000 thru 0x55fff 2024-03-28T23:11:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: +4801(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: +4802(194 mod 256): MAPWRITE 0x40000 thru 0x40500 (0x501 bytes) 2024-03-28T23:11:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: +4803(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: +4804(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: +4805(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.955 INFO:teuthology.orchestra.run.smithi153.stdout: +4806(198 mod 256): PUNCH 0x2421e thru 0x24788 (0x56b bytes) 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4807(199 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4808(200 mod 256): TRUNCATE DOWN from 0x70b51 to 0x49000 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4809(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4810(202 mod 256): MAPREAD 0x25000 thru 0x26fda (0x1fdb bytes) 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4811(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4812(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4813(205 mod 256): WRITE 0x6c000 thru 0x6cfff (0x1000 bytes) HOLE 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4814(206 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4815(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4816(208 mod 256): PUNCH 0x5bb9f thru 0x5c415 (0x877 bytes) 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4817(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4818(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4819(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4820(212 mod 256): TRUNCATE DOWN from 0x6d000 to 0x1f000 ******WWWW 2024-03-28T23:11:39.956 INFO:teuthology.orchestra.run.smithi153.stdout: +4821(213 mod 256): TRUNCATE UP from 0x1f000 to 0x4c000 ******WWWW 2024-03-28T23:11:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: +4822(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: +4823(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: +4824(216 mod 256): MAPWRITE 0x6e000 thru 0x6f4b0 (0x14b1 bytes) 2024-03-28T23:11:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: +4825(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: +4826(218 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: +4827(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: +4828(220 mod 256): MAPREAD 0xc000 thru 0xd26b (0x126c bytes) 2024-03-28T23:11:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: +4829(221 mod 256): COPY 0x4d000 thru 0x4dfff (0x1000 bytes) to 0x10000 thru 0x10fff 2024-03-28T23:11:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: +4830(222 mod 256): PUNCH 0x588d thru 0x6c34 (0x13a8 bytes) 2024-03-28T23:11:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: +4831(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: +4832(224 mod 256): PUNCH 0x2623 thru 0x3d23 (0x1701 bytes) 2024-03-28T23:11:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: +4833(225 mod 256): MAPREAD 0x4000 thru 0x506a (0x106b bytes) 2024-03-28T23:11:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: +4834(226 mod 256): TRUNCATE DOWN from 0x6f4b1 to 0x63000 2024-03-28T23:11:39.957 INFO:teuthology.orchestra.run.smithi153.stdout: +4835(227 mod 256): PUNCH 0x3a688 thru 0x3be09 (0x1782 bytes) 2024-03-28T23:11:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: +4836(228 mod 256): MAPWRITE 0x74000 thru 0x753d8 (0x13d9 bytes) 2024-03-28T23:11:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: +4837(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: +4838(230 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: +4839(231 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: +4840(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: +4841(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: +4842(234 mod 256): MAPREAD 0x3c000 thru 0x3c3ff (0x400 bytes) 2024-03-28T23:11:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: +4843(235 mod 256): PUNCH 0x66f8f thru 0x68a04 (0x1a76 bytes) 2024-03-28T23:11:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: +4844(236 mod 256): READ 0x5f000 thru 0x5ffff (0x1000 bytes) 2024-03-28T23:11:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: +4845(237 mod 256): MAPWRITE 0x6d000 thru 0x6dcf8 (0xcf9 bytes) 2024-03-28T23:11:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: +4846(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: +4847(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: +4848(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.958 INFO:teuthology.orchestra.run.smithi153.stdout: +4849(241 mod 256): MAPWRITE 0x5f000 thru 0x5f0bd (0xbe bytes) 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4850(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4851(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4852(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4853(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4854(246 mod 256): MAPWRITE 0x24000 thru 0x2515e (0x115f bytes) 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4855(247 mod 256): MAPWRITE 0x35000 thru 0x3650c (0x150d bytes) 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4856(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4857(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4858(250 mod 256): READ 0x71000 thru 0x71fff (0x1000 bytes) 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4859(251 mod 256): TRUNCATE DOWN from 0x753d9 to 0x32000 ******WWWW 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4860(252 mod 256): PUNCH 0xe603 thru 0xec32 (0x630 bytes) 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4861(253 mod 256): COPY 0x1e000 thru 0x1efff (0x1000 bytes) to 0x22000 thru 0x22fff 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4862(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4863(255 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: +4864( 0 mod 256): TRUNCATE UP from 0x32000 to 0x51000 ******WWWW 2024-03-28T23:11:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: +4865( 1 mod 256): MAPWRITE 0x62000 thru 0x62f6e (0xf6f bytes) 2024-03-28T23:11:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: +4866( 2 mod 256): MAPWRITE 0x51000 thru 0x51e39 (0xe3a bytes) 2024-03-28T23:11:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: +4867( 3 mod 256): TRUNCATE DOWN from 0x62f6f to 0x4f000 2024-03-28T23:11:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: +4868( 4 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: +4869( 5 mod 256): MAPREAD 0x4000 thru 0x47d0 (0x7d1 bytes) 2024-03-28T23:11:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: +4870( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: +4871( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: +4872( 8 mod 256): MAPWRITE 0x62000 thru 0x63f69 (0x1f6a bytes) 2024-03-28T23:11:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: +4873( 9 mod 256): WRITE 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-28T23:11:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: +4874( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: +4875( 11 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: +4876( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: +4877( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: +4878( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4879( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4880( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4881( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4882( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4883( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4884( 20 mod 256): TRUNCATE DOWN from 0x63f6a to 0x18000 ******WWWW 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4885( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4886( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4887( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4888( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4889( 25 mod 256): MAPREAD 0x5000 thru 0x5548 (0x549 bytes) 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4890( 26 mod 256): TRUNCATE DOWN from 0x18000 to 0x8000 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4891( 27 mod 256): TRUNCATE UP from 0x8000 to 0x4b000 ******WWWW 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4892( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4893( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.961 INFO:teuthology.orchestra.run.smithi153.stdout: +4894( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: +4895( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: +4896( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: +4897( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: +4898( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: +4899( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: +4900( 36 mod 256): MAPREAD 0x13000 thru 0x13d7f (0xd80 bytes) 2024-03-28T23:11:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: +4901( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: +4902( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: +4903( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: +4904( 40 mod 256): PUNCH 0x3f2b0 thru 0x404f8 (0x1249 bytes) 2024-03-28T23:11:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: +4905( 41 mod 256): PUNCH 0x2a1b3 thru 0x2b2bd (0x110b bytes) 2024-03-28T23:11:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: +4906( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: +4907( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.962 INFO:teuthology.orchestra.run.smithi153.stdout: +4908( 44 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4909( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4910( 46 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4911( 47 mod 256): PUNCH 0x32a59 thru 0x32dd3 (0x37b bytes) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4912( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4913( 49 mod 256): PUNCH 0x41a25 thru 0x42cfa (0x12d6 bytes) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4914( 50 mod 256): MAPREAD 0x11000 thru 0x12787 (0x1788 bytes) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4915( 51 mod 256): MAPWRITE 0x63000 thru 0x64897 (0x1898 bytes) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4916( 52 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4917( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4918( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4919( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4920( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4921( 57 mod 256): MAPREAD 0x2d000 thru 0x2dcbd (0xcbe bytes) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4922( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.963 INFO:teuthology.orchestra.run.smithi153.stdout: +4923( 59 mod 256): MAPREAD 0x61000 thru 0x627d0 (0x17d1 bytes) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4924( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4925( 61 mod 256): READ 0x23000 thru 0x23fff (0x1000 bytes) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4926( 62 mod 256): TRUNCATE DOWN from 0x64898 to 0x5d000 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4927( 63 mod 256): READ 0x0 thru 0xfff (0x1000 bytes) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4928( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4929( 65 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4930( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4931( 67 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4932( 68 mod 256): MAPREAD 0x36000 thru 0x36e71 (0xe72 bytes) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4933( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4934( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4935( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4936( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4937( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4938( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.964 INFO:teuthology.orchestra.run.smithi153.stdout: +4939( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4940( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4941( 77 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4942( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4943( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4944( 80 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4945( 81 mod 256): MAPWRITE 0x44000 thru 0x45cde (0x1cdf bytes) 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4946( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4947( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4948( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4949( 85 mod 256): MAPREAD 0x2b000 thru 0x2bcff (0xd00 bytes) 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4950( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4951( 87 mod 256): READ 0x49000 thru 0x49fff (0x1000 bytes) 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4952( 88 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x1b000 thru 0x1bfff 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4953( 89 mod 256): TRUNCATE UP from 0x5d000 to 0x74000 2024-03-28T23:11:39.965 INFO:teuthology.orchestra.run.smithi153.stdout: +4954( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4955( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4956( 92 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4957( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4958( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4959( 95 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4960( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4961( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4962( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4963( 99 mod 256): WRITE 0x52000 thru 0x52fff (0x1000 bytes) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4964(100 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4965(101 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4966(102 mod 256): PUNCH 0x22c6d thru 0x23890 (0xc24 bytes) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4967(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4968(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.966 INFO:teuthology.orchestra.run.smithi153.stdout: +4969(105 mod 256): MAPWRITE 0x0 thru 0x1875 (0x1876 bytes) 2024-03-28T23:11:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: +4970(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: +4971(107 mod 256): TRUNCATE DOWN from 0x74000 to 0x47000 2024-03-28T23:11:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: +4972(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: +4973(109 mod 256): WRITE 0x19000 thru 0x19fff (0x1000 bytes) 2024-03-28T23:11:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: +4974(110 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: +4975(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: +4976(112 mod 256): MAPREAD 0x25000 thru 0x26091 (0x1092 bytes) 2024-03-28T23:11:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: +4977(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: +4978(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: +4979(115 mod 256): MAPREAD 0x1a000 thru 0x1b4d3 (0x14d4 bytes) 2024-03-28T23:11:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: +4980(116 mod 256): PUNCH 0x28a7d thru 0x298fc (0xe80 bytes) 2024-03-28T23:11:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: +4981(117 mod 256): TRUNCATE DOWN from 0x47000 to 0xe000 ******WWWW 2024-03-28T23:11:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: +4982(118 mod 256): TRUNCATE UP from 0xe000 to 0x4e000 ******WWWW 2024-03-28T23:11:39.967 INFO:teuthology.orchestra.run.smithi153.stdout: +4983(119 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: +4984(120 mod 256): COPY 0x4a000 thru 0x4afff (0x1000 bytes) to 0x1f000 thru 0x1ffff 2024-03-28T23:11:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: +4985(121 mod 256): PUNCH 0xd517 thru 0xdd9b (0x885 bytes) 2024-03-28T23:11:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: +4986(122 mod 256): MAPWRITE 0x1a000 thru 0x1a3d4 (0x3d5 bytes) 2024-03-28T23:11:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: +4987(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: +4988(124 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: +4989(125 mod 256): READ 0x25000 thru 0x25fff (0x1000 bytes) 2024-03-28T23:11:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: +4990(126 mod 256): TRUNCATE UP from 0x4e000 to 0x4e000 2024-03-28T23:11:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: +4991(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: +4992(128 mod 256): TRUNCATE DOWN from 0x4e000 to 0x15000 ******WWWW 2024-03-28T23:11:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: +4993(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: +4994(130 mod 256): MAPREAD 0x7000 thru 0x7fb3 (0xfb4 bytes) 2024-03-28T23:11:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: +4995(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: +4996(132 mod 256): READ 0x13000 thru 0x13fff (0x1000 bytes) 2024-03-28T23:11:39.968 INFO:teuthology.orchestra.run.smithi153.stdout: +4997(133 mod 256): MAPWRITE 0x3c000 thru 0x3c0f6 (0xf7 bytes) 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +4998(134 mod 256): MAPREAD 0x11000 thru 0x1110c (0x10d bytes) 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +4999(135 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +5000(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +5001(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +5002(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +5003(139 mod 256): TRUNCATE DOWN from 0x3c0f7 to 0x1f000 ******WWWW 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +5004(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +5005(141 mod 256): MAPWRITE 0x54000 thru 0x55cda (0x1cdb bytes) 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +5006(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +5007(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +5008(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +5009(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +5010(146 mod 256): TRUNCATE DOWN from 0x55cdb to 0x6000 ******WWWW 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +5011(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +5012(148 mod 256): PUNCH 0x46a4 thru 0x5fff (0x195c bytes) 2024-03-28T23:11:39.969 INFO:teuthology.orchestra.run.smithi153.stdout: +5013(149 mod 256): TRUNCATE UP from 0x6000 to 0x6000 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5014(150 mod 256): READ 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5015(151 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5016(152 mod 256): TRUNCATE UP from 0x6000 to 0x44000 ******WWWW 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5017(153 mod 256): TRUNCATE DOWN from 0x44000 to 0x29000 ******WWWW 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5018(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5019(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5020(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5021(157 mod 256): WRITE 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5022(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5023(159 mod 256): PUNCH 0x1d137 thru 0x1e932 (0x17fc bytes) 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5024(160 mod 256): READ 0x16000 thru 0x16fff (0x1000 bytes) 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5025(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5026(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5027(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: +5028(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5029(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5030(166 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5031(167 mod 256): PUNCH 0x225ae thru 0x2422c (0x1c7f bytes) 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5032(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5033(169 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5034(170 mod 256): READ 0x3000 thru 0x3fff (0x1000 bytes) 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5035(171 mod 256): WRITE 0x3e000 thru 0x3efff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5036(172 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5037(173 mod 256): PUNCH 0x1944d thru 0x1a71e (0x12d2 bytes) 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5038(174 mod 256): COPY 0xe000 thru 0xefff (0x1000 bytes) to 0x40000 thru 0x40fff 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5039(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5040(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5041(177 mod 256): WRITE 0x68000 thru 0x68fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5042(178 mod 256): WRITE 0x78000 thru 0x78fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5043(179 mod 256): TRUNCATE DOWN from 0x79000 to 0x29000 ******WWWW 2024-03-28T23:11:39.971 INFO:teuthology.orchestra.run.smithi153.stdout: +5044(180 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5045(181 mod 256): PUNCH 0x169fd thru 0x16f4b (0x54f bytes) 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5046(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5047(183 mod 256): COPY 0x1a000 thru 0x1afff (0x1000 bytes) to 0x1e000 thru 0x1efff 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5048(184 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5049(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5050(186 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5051(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5052(188 mod 256): WRITE 0x32000 thru 0x32fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5053(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5054(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5055(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5056(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5057(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5058(194 mod 256): COPY 0x16000 thru 0x16fff (0x1000 bytes) to 0x6e000 thru 0x6efff 2024-03-28T23:11:39.972 INFO:teuthology.orchestra.run.smithi153.stdout: +5059(195 mod 256): MAPREAD 0x4a000 thru 0x4b92c (0x192d bytes) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5060(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5061(197 mod 256): READ 0x58000 thru 0x58fff (0x1000 bytes) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5062(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5063(199 mod 256): MAPWRITE 0x71000 thru 0x71305 (0x306 bytes) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5064(200 mod 256): MAPREAD 0x69000 thru 0x6a8e5 (0x18e6 bytes) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5065(201 mod 256): MAPWRITE 0x5a000 thru 0x5a543 (0x544 bytes) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5066(202 mod 256): READ 0xc000 thru 0xcfff (0x1000 bytes) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5067(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5068(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5069(205 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5070(206 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5071(207 mod 256): PUNCH 0x87f9 thru 0x96f2 (0xefa bytes) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5072(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5073(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.973 INFO:teuthology.orchestra.run.smithi153.stdout: +5074(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.974 INFO:teuthology.orchestra.run.smithi153.stdout: +5075(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.974 INFO:teuthology.orchestra.run.smithi153.stdout: +5076(212 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.974 INFO:teuthology.orchestra.run.smithi153.stdout: +5077(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.974 INFO:teuthology.orchestra.run.smithi153.stdout: +5078(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.974 INFO:teuthology.orchestra.run.smithi153.stdout: +5079(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.974 INFO:teuthology.orchestra.run.smithi153.stdout: +5080(216 mod 256): TRUNCATE DOWN from 0x71306 to 0x65000 2024-03-28T23:11:39.974 INFO:teuthology.orchestra.run.smithi153.stdout: +5081(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.974 INFO:teuthology.orchestra.run.smithi153.stdout: +5082(218 mod 256): MAPWRITE 0x3000 thru 0x499c (0x199d bytes) 2024-03-28T23:11:39.974 INFO:teuthology.orchestra.run.smithi153.stdout: +5083(219 mod 256): TRUNCATE DOWN from 0x65000 to 0x4000 ******WWWW 2024-03-28T23:11:39.974 INFO:teuthology.orchestra.run.smithi153.stdout: +5084(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.974 INFO:teuthology.orchestra.run.smithi153.stdout: +5085(221 mod 256): WRITE 0x6f000 thru 0x6ffff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.974 INFO:teuthology.orchestra.run.smithi153.stdout: +5086(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.974 INFO:teuthology.orchestra.run.smithi153.stdout: +5087(223 mod 256): WRITE 0x6e000 thru 0x6efff (0x1000 bytes) 2024-03-28T23:11:39.974 INFO:teuthology.orchestra.run.smithi153.stdout: +5088(224 mod 256): PUNCH 0x39f5e thru 0x3afa0 (0x1043 bytes) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5089(225 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5090(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5091(227 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5092(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5093(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5094(230 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5095(231 mod 256): MAPREAD 0x1000 thru 0x21fe (0x11ff bytes) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5096(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5097(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5098(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5099(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5100(236 mod 256): PUNCH 0x66bd4 thru 0x670da (0x507 bytes) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5101(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5102(238 mod 256): WRITE 0x76000 thru 0x76fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5103(239 mod 256): PUNCH 0x62c57 thru 0x63822 (0xbcc bytes) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5104(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.975 INFO:teuthology.orchestra.run.smithi153.stdout: +5105(241 mod 256): MAPREAD 0x32000 thru 0x32c88 (0xc89 bytes) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5106(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5107(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5108(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5109(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5110(246 mod 256): PUNCH 0x24fc2 thru 0x252e1 (0x320 bytes) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5111(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5112(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5113(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5114(250 mod 256): MAPREAD 0x42000 thru 0x42dda (0xddb bytes) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5115(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5116(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5117(253 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5118(254 mod 256): MAPREAD 0xf000 thru 0x1044c (0x144d bytes) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5119(255 mod 256): MAPWRITE 0x26000 thru 0x278e5 (0x18e6 bytes) 2024-03-28T23:11:39.976 INFO:teuthology.orchestra.run.smithi153.stdout: +5120( 0 mod 256): PUNCH 0x3e677 thru 0x3ee70 (0x7fa bytes) 2024-03-28T23:11:39.977 INFO:teuthology.orchestra.run.smithi153.stdout: +5121( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.977 INFO:teuthology.orchestra.run.smithi153.stdout: +5122( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.977 INFO:teuthology.orchestra.run.smithi153.stdout: +5123( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.977 INFO:teuthology.orchestra.run.smithi153.stdout: +5124( 4 mod 256): WRITE 0x43000 thru 0x43fff (0x1000 bytes) 2024-03-28T23:11:39.977 INFO:teuthology.orchestra.run.smithi153.stdout: +5125( 5 mod 256): MAPREAD 0x37000 thru 0x38e5b (0x1e5c bytes) ***RRRR*** 2024-03-28T23:11:39.977 INFO:teuthology.orchestra.run.smithi153.stdout: +5126( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.977 INFO:teuthology.orchestra.run.smithi153.stdout: +5127( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.977 INFO:teuthology.orchestra.run.smithi153.stdout: +5128( 8 mod 256): MAPWRITE 0xd000 thru 0xe531 (0x1532 bytes) 2024-03-28T23:11:39.977 INFO:teuthology.orchestra.run.smithi153.stdout: +5129( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.977 INFO:teuthology.orchestra.run.smithi153.stdout: +5130( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.977 INFO:teuthology.orchestra.run.smithi153.stdout: +5131( 11 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.977 INFO:teuthology.orchestra.run.smithi153.stdout: +5132( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.977 INFO:teuthology.orchestra.run.smithi153.stdout: +5133( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.977 INFO:teuthology.orchestra.run.smithi153.stdout: +5134( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.978 INFO:teuthology.orchestra.run.smithi153.stdout: +5135( 15 mod 256): READ 0x6c000 thru 0x6cfff (0x1000 bytes) 2024-03-28T23:11:39.978 INFO:teuthology.orchestra.run.smithi153.stdout: +5136( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.978 INFO:teuthology.orchestra.run.smithi153.stdout: +5137( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.978 INFO:teuthology.orchestra.run.smithi153.stdout: +5138( 18 mod 256): READ 0x75000 thru 0x75fff (0x1000 bytes) 2024-03-28T23:11:39.978 INFO:teuthology.orchestra.run.smithi153.stdout: +5139( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.978 INFO:teuthology.orchestra.run.smithi153.stdout: +5140( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.978 INFO:teuthology.orchestra.run.smithi153.stdout: +5141( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.978 INFO:teuthology.orchestra.run.smithi153.stdout: +5142( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.978 INFO:teuthology.orchestra.run.smithi153.stdout: +5143( 23 mod 256): MAPWRITE 0x4000 thru 0x503b (0x103c bytes) 2024-03-28T23:11:39.978 INFO:teuthology.orchestra.run.smithi153.stdout: +5144( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.978 INFO:teuthology.orchestra.run.smithi153.stdout: +5145( 25 mod 256): MAPREAD 0x27000 thru 0x288a8 (0x18a9 bytes) 2024-03-28T23:11:39.978 INFO:teuthology.orchestra.run.smithi153.stdout: +5146( 26 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.978 INFO:teuthology.orchestra.run.smithi153.stdout: +5147( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.978 INFO:teuthology.orchestra.run.smithi153.stdout: +5148( 28 mod 256): MAPWRITE 0x6e000 thru 0x6e9d5 (0x9d6 bytes) 2024-03-28T23:11:39.979 INFO:teuthology.orchestra.run.smithi153.stdout: +5149( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.979 INFO:teuthology.orchestra.run.smithi153.stdout: +5150( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.979 INFO:teuthology.orchestra.run.smithi153.stdout: +5151( 31 mod 256): COPY 0x4e000 thru 0x4efff (0x1000 bytes) to 0x1e000 thru 0x1efff 2024-03-28T23:11:39.979 INFO:teuthology.orchestra.run.smithi153.stdout: +5152( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.979 INFO:teuthology.orchestra.run.smithi153.stdout: +5153( 33 mod 256): PUNCH 0x4b615 thru 0x4b6e2 (0xce bytes) 2024-03-28T23:11:39.979 INFO:teuthology.orchestra.run.smithi153.stdout: +5154( 34 mod 256): PUNCH 0x1221e thru 0x13c63 (0x1a46 bytes) 2024-03-28T23:11:39.979 INFO:teuthology.orchestra.run.smithi153.stdout: +5155( 35 mod 256): TRUNCATE DOWN from 0x77000 to 0xe000 ******WWWW 2024-03-28T23:11:39.979 INFO:teuthology.orchestra.run.smithi153.stdout: +5156( 36 mod 256): WRITE 0x12000 thru 0x12fff (0x1000 bytes) HOLE 2024-03-28T23:11:39.979 INFO:teuthology.orchestra.run.smithi153.stdout: +5157( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.979 INFO:teuthology.orchestra.run.smithi153.stdout: +5158( 38 mod 256): PUNCH 0xdae0 thru 0xdb1f (0x40 bytes) 2024-03-28T23:11:39.979 INFO:teuthology.orchestra.run.smithi153.stdout: +5159( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.979 INFO:teuthology.orchestra.run.smithi153.stdout: +5160( 40 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.979 INFO:teuthology.orchestra.run.smithi153.stdout: +5161( 41 mod 256): MAPREAD 0x4000 thru 0x4f69 (0xf6a bytes) 2024-03-28T23:11:39.979 INFO:teuthology.orchestra.run.smithi153.stdout: +5162( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.980 INFO:teuthology.orchestra.run.smithi153.stdout: +5163( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.980 INFO:teuthology.orchestra.run.smithi153.stdout: +5164( 44 mod 256): TRUNCATE UP from 0x13000 to 0x2f000 2024-03-28T23:11:39.980 INFO:teuthology.orchestra.run.smithi153.stdout: +5165( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.980 INFO:teuthology.orchestra.run.smithi153.stdout: +5166( 46 mod 256): MAPREAD 0x24000 thru 0x25313 (0x1314 bytes) 2024-03-28T23:11:39.980 INFO:teuthology.orchestra.run.smithi153.stdout: +5167( 47 mod 256): MAPREAD 0x23000 thru 0x23775 (0x776 bytes) 2024-03-28T23:11:39.980 INFO:teuthology.orchestra.run.smithi153.stdout: +5168( 48 mod 256): PUNCH 0x17791 thru 0x19336 (0x1ba6 bytes) 2024-03-28T23:11:39.980 INFO:teuthology.orchestra.run.smithi153.stdout: +5169( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.980 INFO:teuthology.orchestra.run.smithi153.stdout: +5170( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.980 INFO:teuthology.orchestra.run.smithi153.stdout: +5171( 51 mod 256): PUNCH 0x2d459 thru 0x2d4cd (0x75 bytes) 2024-03-28T23:11:39.980 INFO:teuthology.orchestra.run.smithi153.stdout: +5172( 52 mod 256): MAPWRITE 0x3a000 thru 0x3acda (0xcdb bytes) 2024-03-28T23:11:39.980 INFO:teuthology.orchestra.run.smithi153.stdout: +5173( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.980 INFO:teuthology.orchestra.run.smithi153.stdout: +5174( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.980 INFO:teuthology.orchestra.run.smithi153.stdout: +5175( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.980 INFO:teuthology.orchestra.run.smithi153.stdout: +5176( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5177( 57 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5178( 58 mod 256): MAPWRITE 0x6b000 thru 0x6bc72 (0xc73 bytes) 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5179( 59 mod 256): MAPREAD 0x17000 thru 0x18d4e (0x1d4f bytes) 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5180( 60 mod 256): WRITE 0x55000 thru 0x55fff (0x1000 bytes) 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5181( 61 mod 256): MAPWRITE 0x1a000 thru 0x1b88c (0x188d bytes) 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5182( 62 mod 256): READ 0x42000 thru 0x42fff (0x1000 bytes) 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5183( 63 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5184( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5185( 65 mod 256): PUNCH 0x288f6 thru 0x2a2cc (0x19d7 bytes) 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5186( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5187( 67 mod 256): TRUNCATE DOWN from 0x6bc73 to 0x4c000 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5188( 68 mod 256): COPY 0x3d000 thru 0x3dfff (0x1000 bytes) to 0x3000 thru 0x3fff 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5189( 69 mod 256): READ 0x1a000 thru 0x1afff (0x1000 bytes) 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5190( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.981 INFO:teuthology.orchestra.run.smithi153.stdout: +5191( 71 mod 256): PUNCH 0x352a8 thru 0x36b57 (0x18b0 bytes) 2024-03-28T23:11:39.982 INFO:teuthology.orchestra.run.smithi153.stdout: +5192( 72 mod 256): READ 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-28T23:11:39.982 INFO:teuthology.orchestra.run.smithi153.stdout: +5193( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.982 INFO:teuthology.orchestra.run.smithi153.stdout: +5194( 74 mod 256): WRITE 0x27000 thru 0x27fff (0x1000 bytes) 2024-03-28T23:11:39.982 INFO:teuthology.orchestra.run.smithi153.stdout: +5195( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.982 INFO:teuthology.orchestra.run.smithi153.stdout: +5196( 76 mod 256): TRUNCATE DOWN from 0x4c000 to 0x38000 2024-03-28T23:11:39.982 INFO:teuthology.orchestra.run.smithi153.stdout: +5197( 77 mod 256): TRUNCATE UP from 0x38000 to 0x5d000 2024-03-28T23:11:39.982 INFO:teuthology.orchestra.run.smithi153.stdout: +5198( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.982 INFO:teuthology.orchestra.run.smithi153.stdout: +5199( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.982 INFO:teuthology.orchestra.run.smithi153.stdout: +5200( 80 mod 256): TRUNCATE DOWN from 0x5d000 to 0x21000 ******WWWW 2024-03-28T23:11:39.982 INFO:teuthology.orchestra.run.smithi153.stdout: +5201( 81 mod 256): MAPWRITE 0x12000 thru 0x1233b (0x33c bytes) 2024-03-28T23:11:39.982 INFO:teuthology.orchestra.run.smithi153.stdout: +5202( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.982 INFO:teuthology.orchestra.run.smithi153.stdout: +5203( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.982 INFO:teuthology.orchestra.run.smithi153.stdout: +5204( 84 mod 256): TRUNCATE UP from 0x21000 to 0x4e000 ******WWWW 2024-03-28T23:11:39.982 INFO:teuthology.orchestra.run.smithi153.stdout: +5205( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.983 INFO:teuthology.orchestra.run.smithi153.stdout: +5206( 86 mod 256): MAPREAD 0x1000 thru 0x1b18 (0xb19 bytes) 2024-03-28T23:11:39.983 INFO:teuthology.orchestra.run.smithi153.stdout: +5207( 87 mod 256): MAPWRITE 0x6f000 thru 0x6f7cf (0x7d0 bytes) 2024-03-28T23:11:39.983 INFO:teuthology.orchestra.run.smithi153.stdout: +5208( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.983 INFO:teuthology.orchestra.run.smithi153.stdout: +5209( 89 mod 256): TRUNCATE DOWN from 0x6f7d0 to 0x2f000 ******WWWW 2024-03-28T23:11:39.983 INFO:teuthology.orchestra.run.smithi153.stdout: +5210( 90 mod 256): TRUNCATE UP from 0x2f000 to 0x4c000 ******WWWW 2024-03-28T23:11:39.983 INFO:teuthology.orchestra.run.smithi153.stdout: +5211( 91 mod 256): MAPWRITE 0xa000 thru 0xb65c (0x165d bytes) 2024-03-28T23:11:39.983 INFO:teuthology.orchestra.run.smithi153.stdout: +5212( 92 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.983 INFO:teuthology.orchestra.run.smithi153.stdout: +5213( 93 mod 256): MAPREAD 0x38000 thru 0x380d1 (0xd2 bytes) 2024-03-28T23:11:39.983 INFO:teuthology.orchestra.run.smithi153.stdout: +5214( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.983 INFO:teuthology.orchestra.run.smithi153.stdout: +5215( 95 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.983 INFO:teuthology.orchestra.run.smithi153.stdout: +5216( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.983 INFO:teuthology.orchestra.run.smithi153.stdout: +5217( 97 mod 256): PUNCH 0x2861c thru 0x28f35 (0x91a bytes) 2024-03-28T23:11:39.983 INFO:teuthology.orchestra.run.smithi153.stdout: +5218( 98 mod 256): MAPREAD 0x31000 thru 0x32796 (0x1797 bytes) 2024-03-28T23:11:39.983 INFO:teuthology.orchestra.run.smithi153.stdout: +5219( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5220(100 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5221(101 mod 256): MAPWRITE 0x73000 thru 0x739e9 (0x9ea bytes) 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5222(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5223(103 mod 256): MAPREAD 0x6000 thru 0x7628 (0x1629 bytes) 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5224(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5225(105 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5226(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5227(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5228(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5229(109 mod 256): TRUNCATE DOWN from 0x739ea to 0x22000 ******WWWW 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5230(110 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5231(111 mod 256): COPY 0x2000 thru 0x2fff (0x1000 bytes) to 0x3f000 thru 0x3ffff 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5232(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5233(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.984 INFO:teuthology.orchestra.run.smithi153.stdout: +5234(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5235(115 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5236(116 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5237(117 mod 256): MAPREAD 0x2f000 thru 0x2f286 (0x287 bytes) 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5238(118 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5239(119 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5240(120 mod 256): TRUNCATE UP from 0x40000 to 0x6c000 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5241(121 mod 256): READ 0x28000 thru 0x28fff (0x1000 bytes) 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5242(122 mod 256): COPY 0xd000 thru 0xdfff (0x1000 bytes) to 0x72000 thru 0x72fff 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5243(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5244(124 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5245(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5246(126 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5247(127 mod 256): COPY 0x2c000 thru 0x2cfff (0x1000 bytes) to 0x3000 thru 0x3fff 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5248(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.985 INFO:teuthology.orchestra.run.smithi153.stdout: +5249(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.986 INFO:teuthology.orchestra.run.smithi153.stdout: +5250(130 mod 256): MAPWRITE 0x6a000 thru 0x6ad72 (0xd73 bytes) 2024-03-28T23:11:39.986 INFO:teuthology.orchestra.run.smithi153.stdout: +5251(131 mod 256): PUNCH 0x5a012 thru 0x5af4d (0xf3c bytes) 2024-03-28T23:11:39.986 INFO:teuthology.orchestra.run.smithi153.stdout: +5252(132 mod 256): READ 0x4e000 thru 0x4efff (0x1000 bytes) 2024-03-28T23:11:39.986 INFO:teuthology.orchestra.run.smithi153.stdout: +5253(133 mod 256): READ 0x65000 thru 0x65fff (0x1000 bytes) 2024-03-28T23:11:39.986 INFO:teuthology.orchestra.run.smithi153.stdout: +5254(134 mod 256): TRUNCATE UP from 0x73000 to 0x77000 2024-03-28T23:11:39.986 INFO:teuthology.orchestra.run.smithi153.stdout: +5255(135 mod 256): COPY 0x3b000 thru 0x3bfff (0x1000 bytes) to 0x12000 thru 0x12fff 2024-03-28T23:11:39.986 INFO:teuthology.orchestra.run.smithi153.stdout: +5256(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.986 INFO:teuthology.orchestra.run.smithi153.stdout: +5257(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.986 INFO:teuthology.orchestra.run.smithi153.stdout: +5258(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.986 INFO:teuthology.orchestra.run.smithi153.stdout: +5259(139 mod 256): PUNCH 0x608bf thru 0x6189f (0xfe1 bytes) 2024-03-28T23:11:39.986 INFO:teuthology.orchestra.run.smithi153.stdout: +5260(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.986 INFO:teuthology.orchestra.run.smithi153.stdout: +5261(141 mod 256): MAPWRITE 0x1f000 thru 0x1fc56 (0xc57 bytes) 2024-03-28T23:11:39.986 INFO:teuthology.orchestra.run.smithi153.stdout: +5262(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.986 INFO:teuthology.orchestra.run.smithi153.stdout: +5263(143 mod 256): PUNCH 0x37b72 thru 0x38562 (0x9f1 bytes) ******PPPP 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5264(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5265(145 mod 256): PUNCH 0x2ddfa thru 0x2f9af (0x1bb6 bytes) 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5266(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5267(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5268(148 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5269(149 mod 256): MAPWRITE 0x79000 thru 0x792d0 (0x2d1 bytes) 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5270(150 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5271(151 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5272(152 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5273(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5274(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5275(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5276(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5277(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.987 INFO:teuthology.orchestra.run.smithi153.stdout: +5278(158 mod 256): READ 0x31000 thru 0x31fff (0x1000 bytes) 2024-03-28T23:11:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: +5279(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: +5280(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: +5281(161 mod 256): MAPWRITE 0x17000 thru 0x187ae (0x17af bytes) 2024-03-28T23:11:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: +5282(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: +5283(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: +5284(164 mod 256): TRUNCATE DOWN from 0x792d1 to 0x4c000 2024-03-28T23:11:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: +5285(165 mod 256): MAPREAD 0x47000 thru 0x48f8f (0x1f90 bytes) 2024-03-28T23:11:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: +5286(166 mod 256): READ 0x1e000 thru 0x1efff (0x1000 bytes) 2024-03-28T23:11:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: +5287(167 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: +5288(168 mod 256): TRUNCATE DOWN from 0x4c000 to 0x16000 ******WWWW 2024-03-28T23:11:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: +5289(169 mod 256): COPY 0xc000 thru 0xcfff (0x1000 bytes) to 0x76000 thru 0x76fff 2024-03-28T23:11:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: +5290(170 mod 256): MAPWRITE 0x31000 thru 0x31815 (0x816 bytes) 2024-03-28T23:11:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: +5291(171 mod 256): COPY 0x4000 thru 0x4fff (0x1000 bytes) to 0x4a000 thru 0x4afff 2024-03-28T23:11:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: +5292(172 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5293(173 mod 256): MAPWRITE 0x1d000 thru 0x1d1f0 (0x1f1 bytes) 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5294(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5295(175 mod 256): PUNCH 0x46844 thru 0x4808e (0x184b bytes) 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5296(176 mod 256): TRUNCATE DOWN from 0x77000 to 0x5c000 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5297(177 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5298(178 mod 256): MAPWRITE 0x7000 thru 0x83e9 (0x13ea bytes) 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5299(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5300(180 mod 256): MAPWRITE 0x64000 thru 0x646a1 (0x6a2 bytes) 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5301(181 mod 256): PUNCH 0x4cf47 thru 0x4d9a2 (0xa5c bytes) 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5302(182 mod 256): PUNCH 0x56d73 thru 0x57f37 (0x11c5 bytes) 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5303(183 mod 256): MAPWRITE 0x3000 thru 0x3dca (0xdcb bytes) 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5304(184 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5305(185 mod 256): PUNCH 0x21b3f thru 0x22c97 (0x1159 bytes) 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5306(186 mod 256): PUNCH 0x58d94 thru 0x5a4c4 (0x1731 bytes) 2024-03-28T23:11:39.989 INFO:teuthology.orchestra.run.smithi153.stdout: +5307(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.990 INFO:teuthology.orchestra.run.smithi153.stdout: +5308(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.990 INFO:teuthology.orchestra.run.smithi153.stdout: +5309(189 mod 256): PUNCH 0x5e924 thru 0x603b0 (0x1a8d bytes) 2024-03-28T23:11:39.990 INFO:teuthology.orchestra.run.smithi153.stdout: +5310(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.990 INFO:teuthology.orchestra.run.smithi153.stdout: +5311(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.990 INFO:teuthology.orchestra.run.smithi153.stdout: +5312(192 mod 256): TRUNCATE UP from 0x646a2 to 0x74000 2024-03-28T23:11:39.990 INFO:teuthology.orchestra.run.smithi153.stdout: +5313(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.990 INFO:teuthology.orchestra.run.smithi153.stdout: +5314(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.990 INFO:teuthology.orchestra.run.smithi153.stdout: +5315(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.990 INFO:teuthology.orchestra.run.smithi153.stdout: +5316(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.990 INFO:teuthology.orchestra.run.smithi153.stdout: +5317(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.990 INFO:teuthology.orchestra.run.smithi153.stdout: +5318(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.990 INFO:teuthology.orchestra.run.smithi153.stdout: +5319(199 mod 256): MAPWRITE 0x20000 thru 0x216ab (0x16ac bytes) 2024-03-28T23:11:39.990 INFO:teuthology.orchestra.run.smithi153.stdout: +5320(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.990 INFO:teuthology.orchestra.run.smithi153.stdout: +5321(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.991 INFO:teuthology.orchestra.run.smithi153.stdout: +5322(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.991 INFO:teuthology.orchestra.run.smithi153.stdout: +5323(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.991 INFO:teuthology.orchestra.run.smithi153.stdout: +5324(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.991 INFO:teuthology.orchestra.run.smithi153.stdout: +5325(205 mod 256): MAPREAD 0x26000 thru 0x266c6 (0x6c7 bytes) 2024-03-28T23:11:39.991 INFO:teuthology.orchestra.run.smithi153.stdout: +5326(206 mod 256): COPY 0x11000 thru 0x11fff (0x1000 bytes) to 0x3e000 thru 0x3efff 2024-03-28T23:11:39.991 INFO:teuthology.orchestra.run.smithi153.stdout: +5327(207 mod 256): MAPREAD 0x52000 thru 0x53ccd (0x1cce bytes) 2024-03-28T23:11:39.991 INFO:teuthology.orchestra.run.smithi153.stdout: +5328(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.991 INFO:teuthology.orchestra.run.smithi153.stdout: +5329(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.991 INFO:teuthology.orchestra.run.smithi153.stdout: +5330(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.991 INFO:teuthology.orchestra.run.smithi153.stdout: +5331(211 mod 256): TRUNCATE DOWN from 0x74000 to 0x7000 ******WWWW 2024-03-28T23:11:39.991 INFO:teuthology.orchestra.run.smithi153.stdout: +5332(212 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.991 INFO:teuthology.orchestra.run.smithi153.stdout: +5333(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.991 INFO:teuthology.orchestra.run.smithi153.stdout: +5334(214 mod 256): MAPREAD 0x2000 thru 0x3ced (0x1cee bytes) 2024-03-28T23:11:39.991 INFO:teuthology.orchestra.run.smithi153.stdout: +5335(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.992 INFO:teuthology.orchestra.run.smithi153.stdout: +5336(216 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.992 INFO:teuthology.orchestra.run.smithi153.stdout: +5337(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.992 INFO:teuthology.orchestra.run.smithi153.stdout: +5338(218 mod 256): PUNCH 0x5777 thru 0x621e (0xaa8 bytes) 2024-03-28T23:11:39.992 INFO:teuthology.orchestra.run.smithi153.stdout: +5339(219 mod 256): TRUNCATE UP from 0x7000 to 0x2f000 2024-03-28T23:11:39.992 INFO:teuthology.orchestra.run.smithi153.stdout: +5340(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.992 INFO:teuthology.orchestra.run.smithi153.stdout: +5341(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.992 INFO:teuthology.orchestra.run.smithi153.stdout: +5342(222 mod 256): MAPREAD 0x28000 thru 0x28861 (0x862 bytes) 2024-03-28T23:11:39.992 INFO:teuthology.orchestra.run.smithi153.stdout: +5343(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.992 INFO:teuthology.orchestra.run.smithi153.stdout: +5344(224 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.992 INFO:teuthology.orchestra.run.smithi153.stdout: +5345(225 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.992 INFO:teuthology.orchestra.run.smithi153.stdout: +5346(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.992 INFO:teuthology.orchestra.run.smithi153.stdout: +5347(227 mod 256): WRITE 0x3a000 thru 0x3afff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:39.992 INFO:teuthology.orchestra.run.smithi153.stdout: +5348(228 mod 256): MAPREAD 0x19000 thru 0x1a1fd (0x11fe bytes) 2024-03-28T23:11:39.992 INFO:teuthology.orchestra.run.smithi153.stdout: +5349(229 mod 256): READ 0x38000 thru 0x38fff (0x1000 bytes) 2024-03-28T23:11:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: +5350(230 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: +5351(231 mod 256): MAPWRITE 0x3e000 thru 0x3fa49 (0x1a4a bytes) 2024-03-28T23:11:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: +5352(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: +5353(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: +5354(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: +5355(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: +5356(236 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: +5357(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: +5358(238 mod 256): PUNCH 0x3dbf6 thru 0x3fa49 (0x1e54 bytes) 2024-03-28T23:11:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: +5359(239 mod 256): WRITE 0x3a000 thru 0x3afff (0x1000 bytes) 2024-03-28T23:11:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: +5360(240 mod 256): MAPWRITE 0x10000 thru 0x10901 (0x902 bytes) 2024-03-28T23:11:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: +5361(241 mod 256): TRUNCATE DOWN from 0x3fa4a to 0xa000 ******WWWW 2024-03-28T23:11:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: +5362(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: +5363(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.994 INFO:teuthology.orchestra.run.smithi153.stdout: +5364(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.994 INFO:teuthology.orchestra.run.smithi153.stdout: +5365(245 mod 256): TRUNCATE UP from 0xa000 to 0x62000 ******WWWW 2024-03-28T23:11:39.994 INFO:teuthology.orchestra.run.smithi153.stdout: +5366(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.994 INFO:teuthology.orchestra.run.smithi153.stdout: +5367(247 mod 256): WRITE 0x38000 thru 0x38fff (0x1000 bytes) 2024-03-28T23:11:39.994 INFO:teuthology.orchestra.run.smithi153.stdout: +5368(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.994 INFO:teuthology.orchestra.run.smithi153.stdout: +5369(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.994 INFO:teuthology.orchestra.run.smithi153.stdout: +5370(250 mod 256): MAPREAD 0x5a000 thru 0x5be1f (0x1e20 bytes) 2024-03-28T23:11:39.994 INFO:teuthology.orchestra.run.smithi153.stdout: +5371(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.994 INFO:teuthology.orchestra.run.smithi153.stdout: +5372(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.994 INFO:teuthology.orchestra.run.smithi153.stdout: +5373(253 mod 256): MAPWRITE 0x71000 thru 0x7202e (0x102f bytes) 2024-03-28T23:11:39.994 INFO:teuthology.orchestra.run.smithi153.stdout: +5374(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.994 INFO:teuthology.orchestra.run.smithi153.stdout: +5375(255 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.994 INFO:teuthology.orchestra.run.smithi153.stdout: +5376( 0 mod 256): COPY 0x33000 thru 0x33fff (0x1000 bytes) to 0x2e000 thru 0x2efff 2024-03-28T23:11:39.994 INFO:teuthology.orchestra.run.smithi153.stdout: +5377( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5378( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5379( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5380( 4 mod 256): MAPREAD 0x58000 thru 0x59ee5 (0x1ee6 bytes) 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5381( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5382( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5383( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5384( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5385( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5386( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5387( 11 mod 256): COPY 0xd000 thru 0xdfff (0x1000 bytes) to 0xf000 thru 0xffff 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5388( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5389( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5390( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5391( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.995 INFO:teuthology.orchestra.run.smithi153.stdout: +5392( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5393( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5394( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5395( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5396( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5397( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5398( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5399( 23 mod 256): WRITE 0x60000 thru 0x60fff (0x1000 bytes) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5400( 24 mod 256): MAPWRITE 0xb000 thru 0xb693 (0x694 bytes) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5401( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5402( 26 mod 256): WRITE 0x29000 thru 0x29fff (0x1000 bytes) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5403( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5404( 28 mod 256): PUNCH 0x2aa41 thru 0x2b0c4 (0x684 bytes) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5405( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5406( 30 mod 256): PUNCH 0x189d thru 0x2052 (0x7b6 bytes) 2024-03-28T23:11:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: +5407( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.997 INFO:teuthology.orchestra.run.smithi153.stdout: +5408( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.997 INFO:teuthology.orchestra.run.smithi153.stdout: +5409( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.997 INFO:teuthology.orchestra.run.smithi153.stdout: +5410( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.997 INFO:teuthology.orchestra.run.smithi153.stdout: +5411( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.997 INFO:teuthology.orchestra.run.smithi153.stdout: +5412( 36 mod 256): MAPREAD 0x4a000 thru 0x4b23b (0x123c bytes) 2024-03-28T23:11:39.997 INFO:teuthology.orchestra.run.smithi153.stdout: +5413( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.997 INFO:teuthology.orchestra.run.smithi153.stdout: +5414( 38 mod 256): PUNCH 0x61d24 thru 0x63571 (0x184e bytes) 2024-03-28T23:11:39.997 INFO:teuthology.orchestra.run.smithi153.stdout: +5415( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.997 INFO:teuthology.orchestra.run.smithi153.stdout: +5416( 40 mod 256): MAPWRITE 0x10000 thru 0x10093 (0x94 bytes) 2024-03-28T23:11:39.997 INFO:teuthology.orchestra.run.smithi153.stdout: +5417( 41 mod 256): WRITE 0x6d000 thru 0x6dfff (0x1000 bytes) 2024-03-28T23:11:39.997 INFO:teuthology.orchestra.run.smithi153.stdout: +5418( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.997 INFO:teuthology.orchestra.run.smithi153.stdout: +5419( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.997 INFO:teuthology.orchestra.run.smithi153.stdout: +5420( 44 mod 256): COPY 0x51000 thru 0x51fff (0x1000 bytes) to 0x41000 thru 0x41fff 2024-03-28T23:11:39.997 INFO:teuthology.orchestra.run.smithi153.stdout: +5421( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.998 INFO:teuthology.orchestra.run.smithi153.stdout: +5422( 46 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.998 INFO:teuthology.orchestra.run.smithi153.stdout: +5423( 47 mod 256): TRUNCATE DOWN from 0x7202f to 0x42000 2024-03-28T23:11:39.998 INFO:teuthology.orchestra.run.smithi153.stdout: +5424( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.998 INFO:teuthology.orchestra.run.smithi153.stdout: +5425( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.998 INFO:teuthology.orchestra.run.smithi153.stdout: +5426( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.998 INFO:teuthology.orchestra.run.smithi153.stdout: +5427( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.998 INFO:teuthology.orchestra.run.smithi153.stdout: +5428( 52 mod 256): TRUNCATE DOWN from 0x42000 to 0x3f000 2024-03-28T23:11:39.998 INFO:teuthology.orchestra.run.smithi153.stdout: +5429( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.998 INFO:teuthology.orchestra.run.smithi153.stdout: +5430( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.998 INFO:teuthology.orchestra.run.smithi153.stdout: +5431( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.998 INFO:teuthology.orchestra.run.smithi153.stdout: +5432( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.998 INFO:teuthology.orchestra.run.smithi153.stdout: +5433( 57 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.998 INFO:teuthology.orchestra.run.smithi153.stdout: +5434( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.998 INFO:teuthology.orchestra.run.smithi153.stdout: +5435( 59 mod 256): WRITE 0x38000 thru 0x38fff (0x1000 bytes) 2024-03-28T23:11:39.999 INFO:teuthology.orchestra.run.smithi153.stdout: +5436( 60 mod 256): MAPWRITE 0x50000 thru 0x50922 (0x923 bytes) 2024-03-28T23:11:39.999 INFO:teuthology.orchestra.run.smithi153.stdout: +5437( 61 mod 256): MAPWRITE 0x3a000 thru 0x3bded (0x1dee bytes) 2024-03-28T23:11:39.999 INFO:teuthology.orchestra.run.smithi153.stdout: +5438( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.999 INFO:teuthology.orchestra.run.smithi153.stdout: +5439( 63 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.999 INFO:teuthology.orchestra.run.smithi153.stdout: +5440( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.999 INFO:teuthology.orchestra.run.smithi153.stdout: +5441( 65 mod 256): MAPREAD 0x14000 thru 0x143f7 (0x3f8 bytes) 2024-03-28T23:11:39.999 INFO:teuthology.orchestra.run.smithi153.stdout: +5442( 66 mod 256): READ 0x12000 thru 0x12fff (0x1000 bytes) 2024-03-28T23:11:39.999 INFO:teuthology.orchestra.run.smithi153.stdout: +5443( 67 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.999 INFO:teuthology.orchestra.run.smithi153.stdout: +5444( 68 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.999 INFO:teuthology.orchestra.run.smithi153.stdout: +5445( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.999 INFO:teuthology.orchestra.run.smithi153.stdout: +5446( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.999 INFO:teuthology.orchestra.run.smithi153.stdout: +5447( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.999 INFO:teuthology.orchestra.run.smithi153.stdout: +5448( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:39.999 INFO:teuthology.orchestra.run.smithi153.stdout: +5449( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.000 INFO:teuthology.orchestra.run.smithi153.stdout: +5450( 74 mod 256): TRUNCATE DOWN from 0x50923 to 0x1000 ******WWWW 2024-03-28T23:11:40.000 INFO:teuthology.orchestra.run.smithi153.stdout: +5451( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.000 INFO:teuthology.orchestra.run.smithi153.stdout: +5452( 76 mod 256): MAPWRITE 0x2f000 thru 0x300d9 (0x10da bytes) 2024-03-28T23:11:40.000 INFO:teuthology.orchestra.run.smithi153.stdout: +5453( 77 mod 256): MAPWRITE 0x41000 thru 0x41e66 (0xe67 bytes) 2024-03-28T23:11:40.000 INFO:teuthology.orchestra.run.smithi153.stdout: +5454( 78 mod 256): TRUNCATE DOWN from 0x41e67 to 0x38000 2024-03-28T23:11:40.000 INFO:teuthology.orchestra.run.smithi153.stdout: +5455( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.000 INFO:teuthology.orchestra.run.smithi153.stdout: +5456( 80 mod 256): WRITE 0x66000 thru 0x66fff (0x1000 bytes) HOLE 2024-03-28T23:11:40.000 INFO:teuthology.orchestra.run.smithi153.stdout: +5457( 81 mod 256): MAPWRITE 0x6e000 thru 0x6fa15 (0x1a16 bytes) 2024-03-28T23:11:40.000 INFO:teuthology.orchestra.run.smithi153.stdout: +5458( 82 mod 256): COPY 0x32000 thru 0x32fff (0x1000 bytes) to 0x2c000 thru 0x2cfff 2024-03-28T23:11:40.000 INFO:teuthology.orchestra.run.smithi153.stdout: +5459( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.000 INFO:teuthology.orchestra.run.smithi153.stdout: +5460( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.000 INFO:teuthology.orchestra.run.smithi153.stdout: +5461( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.000 INFO:teuthology.orchestra.run.smithi153.stdout: +5462( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.000 INFO:teuthology.orchestra.run.smithi153.stdout: +5463( 87 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5464( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5465( 89 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5466( 90 mod 256): PUNCH 0x3df37 thru 0x3effe (0x10c8 bytes) 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5467( 91 mod 256): WRITE 0x39000 thru 0x39fff (0x1000 bytes) 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5468( 92 mod 256): TRUNCATE DOWN from 0x6fa16 to 0x3b000 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5469( 93 mod 256): COPY 0x25000 thru 0x25fff (0x1000 bytes) to 0x5000 thru 0x5fff 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5470( 94 mod 256): PUNCH 0x39f5c thru 0x3a84d (0x8f2 bytes) 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5471( 95 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5472( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5473( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5474( 98 mod 256): COPY 0x23000 thru 0x23fff (0x1000 bytes) to 0x14000 thru 0x14fff 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5475( 99 mod 256): MAPWRITE 0x1e000 thru 0x1fcab (0x1cac bytes) 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5476(100 mod 256): PUNCH 0x34330 thru 0x34af7 (0x7c8 bytes) 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5477(101 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.001 INFO:teuthology.orchestra.run.smithi153.stdout: +5478(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.002 INFO:teuthology.orchestra.run.smithi153.stdout: +5479(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.002 INFO:teuthology.orchestra.run.smithi153.stdout: +5480(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.002 INFO:teuthology.orchestra.run.smithi153.stdout: +5481(105 mod 256): MAPREAD 0x19000 thru 0x1abe1 (0x1be2 bytes) 2024-03-28T23:11:40.002 INFO:teuthology.orchestra.run.smithi153.stdout: +5482(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.002 INFO:teuthology.orchestra.run.smithi153.stdout: +5483(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.002 INFO:teuthology.orchestra.run.smithi153.stdout: +5484(108 mod 256): COPY 0x24000 thru 0x24fff (0x1000 bytes) to 0x6c000 thru 0x6cfff 2024-03-28T23:11:40.002 INFO:teuthology.orchestra.run.smithi153.stdout: +5485(109 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.002 INFO:teuthology.orchestra.run.smithi153.stdout: +5486(110 mod 256): PUNCH 0x381b2 thru 0x3976b (0x15ba bytes) 2024-03-28T23:11:40.002 INFO:teuthology.orchestra.run.smithi153.stdout: +5487(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.002 INFO:teuthology.orchestra.run.smithi153.stdout: +5488(112 mod 256): TRUNCATE DOWN from 0x6d000 to 0x16000 ******WWWW 2024-03-28T23:11:40.002 INFO:teuthology.orchestra.run.smithi153.stdout: +5489(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.002 INFO:teuthology.orchestra.run.smithi153.stdout: +5490(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.002 INFO:teuthology.orchestra.run.smithi153.stdout: +5491(115 mod 256): MAPWRITE 0xe000 thru 0xf67c (0x167d bytes) 2024-03-28T23:11:40.002 INFO:teuthology.orchestra.run.smithi153.stdout: +5492(116 mod 256): READ 0xf000 thru 0xffff (0x1000 bytes) 2024-03-28T23:11:40.003 INFO:teuthology.orchestra.run.smithi153.stdout: +5493(117 mod 256): MAPWRITE 0x6a000 thru 0x6ad44 (0xd45 bytes) 2024-03-28T23:11:40.003 INFO:teuthology.orchestra.run.smithi153.stdout: +5494(118 mod 256): COPY 0x3e000 thru 0x3efff (0x1000 bytes) to 0x70000 thru 0x70fff 2024-03-28T23:11:40.003 INFO:teuthology.orchestra.run.smithi153.stdout: +5495(119 mod 256): MAPREAD 0x30000 thru 0x31b11 (0x1b12 bytes) 2024-03-28T23:11:40.003 INFO:teuthology.orchestra.run.smithi153.stdout: +5496(120 mod 256): MAPWRITE 0x6d000 thru 0x6ed98 (0x1d99 bytes) 2024-03-28T23:11:40.003 INFO:teuthology.orchestra.run.smithi153.stdout: +5497(121 mod 256): COPY 0x3b000 thru 0x3bfff (0x1000 bytes) to 0x22000 thru 0x22fff 2024-03-28T23:11:40.003 INFO:teuthology.orchestra.run.smithi153.stdout: +5498(122 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x44000 thru 0x44fff 2024-03-28T23:11:40.003 INFO:teuthology.orchestra.run.smithi153.stdout: +5499(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.003 INFO:teuthology.orchestra.run.smithi153.stdout: +5500(124 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.003 INFO:teuthology.orchestra.run.smithi153.stdout: +5501(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.003 INFO:teuthology.orchestra.run.smithi153.stdout: +5502(126 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.003 INFO:teuthology.orchestra.run.smithi153.stdout: +5503(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.003 INFO:teuthology.orchestra.run.smithi153.stdout: +5504(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.003 INFO:teuthology.orchestra.run.smithi153.stdout: +5505(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.003 INFO:teuthology.orchestra.run.smithi153.stdout: +5506(130 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5507(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5508(132 mod 256): MAPREAD 0xa000 thru 0xa58a (0x58b bytes) 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5509(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5510(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5511(135 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5512(136 mod 256): PUNCH 0x6e98d thru 0x70890 (0x1f04 bytes) 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5513(137 mod 256): TRUNCATE DOWN from 0x71000 to 0x25000 ******WWWW 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5514(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5515(139 mod 256): COPY 0x1f000 thru 0x1ffff (0x1000 bytes) to 0x1000 thru 0x1fff 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5516(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5517(141 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5518(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5519(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5520(144 mod 256): TRUNCATE UP from 0x25000 to 0x57000 ******WWWW 2024-03-28T23:11:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: +5521(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5522(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5523(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5524(148 mod 256): TRUNCATE UP from 0x57000 to 0x6e000 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5525(149 mod 256): PUNCH 0xd9b9 thru 0xea7d (0x10c5 bytes) 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5526(150 mod 256): TRUNCATE DOWN from 0x6e000 to 0x54000 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5527(151 mod 256): MAPWRITE 0x23000 thru 0x24b78 (0x1b79 bytes) 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5528(152 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5529(153 mod 256): TRUNCATE UP from 0x54000 to 0x67000 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5530(154 mod 256): PUNCH 0x53484 thru 0x55037 (0x1bb4 bytes) 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5531(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5532(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5533(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5534(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5535(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.005 INFO:teuthology.orchestra.run.smithi153.stdout: +5536(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.006 INFO:teuthology.orchestra.run.smithi153.stdout: +5537(161 mod 256): MAPREAD 0x2e000 thru 0x2e49a (0x49b bytes) 2024-03-28T23:11:40.006 INFO:teuthology.orchestra.run.smithi153.stdout: +5538(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.006 INFO:teuthology.orchestra.run.smithi153.stdout: +5539(163 mod 256): WRITE 0x5000 thru 0x5fff (0x1000 bytes) 2024-03-28T23:11:40.006 INFO:teuthology.orchestra.run.smithi153.stdout: +5540(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.006 INFO:teuthology.orchestra.run.smithi153.stdout: +5541(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.006 INFO:teuthology.orchestra.run.smithi153.stdout: +5542(166 mod 256): TRUNCATE UP from 0x67000 to 0x71000 2024-03-28T23:11:40.006 INFO:teuthology.orchestra.run.smithi153.stdout: +5543(167 mod 256): MAPREAD 0x38000 thru 0x38ad1 (0xad2 bytes) 2024-03-28T23:11:40.006 INFO:teuthology.orchestra.run.smithi153.stdout: +5544(168 mod 256): PUNCH 0x1f70d thru 0x213e1 (0x1cd5 bytes) 2024-03-28T23:11:40.006 INFO:teuthology.orchestra.run.smithi153.stdout: +5545(169 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.006 INFO:teuthology.orchestra.run.smithi153.stdout: +5546(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.006 INFO:teuthology.orchestra.run.smithi153.stdout: +5547(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.006 INFO:teuthology.orchestra.run.smithi153.stdout: +5548(172 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.006 INFO:teuthology.orchestra.run.smithi153.stdout: +5549(173 mod 256): PUNCH 0x3405 thru 0x49e9 (0x15e5 bytes) 2024-03-28T23:11:40.007 INFO:teuthology.orchestra.run.smithi153.stdout: +5550(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.007 INFO:teuthology.orchestra.run.smithi153.stdout: +5551(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.007 INFO:teuthology.orchestra.run.smithi153.stdout: +5552(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.007 INFO:teuthology.orchestra.run.smithi153.stdout: +5553(177 mod 256): READ 0x50000 thru 0x50fff (0x1000 bytes) 2024-03-28T23:11:40.007 INFO:teuthology.orchestra.run.smithi153.stdout: +5554(178 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.007 INFO:teuthology.orchestra.run.smithi153.stdout: +5555(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.007 INFO:teuthology.orchestra.run.smithi153.stdout: +5556(180 mod 256): MAPWRITE 0x74000 thru 0x75d8d (0x1d8e bytes) 2024-03-28T23:11:40.007 INFO:teuthology.orchestra.run.smithi153.stdout: +5557(181 mod 256): READ 0x2b000 thru 0x2bfff (0x1000 bytes) 2024-03-28T23:11:40.007 INFO:teuthology.orchestra.run.smithi153.stdout: +5558(182 mod 256): MAPREAD 0x23000 thru 0x24604 (0x1605 bytes) 2024-03-28T23:11:40.007 INFO:teuthology.orchestra.run.smithi153.stdout: +5559(183 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.007 INFO:teuthology.orchestra.run.smithi153.stdout: +5560(184 mod 256): WRITE 0x57000 thru 0x57fff (0x1000 bytes) 2024-03-28T23:11:40.007 INFO:teuthology.orchestra.run.smithi153.stdout: +5561(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.007 INFO:teuthology.orchestra.run.smithi153.stdout: +5562(186 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.007 INFO:teuthology.orchestra.run.smithi153.stdout: +5563(187 mod 256): PUNCH 0x623d thru 0x6362 (0x126 bytes) 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5564(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5565(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5566(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5567(191 mod 256): COPY 0x59000 thru 0x59fff (0x1000 bytes) to 0x39000 thru 0x39fff 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5568(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5569(193 mod 256): PUNCH 0x144dd thru 0x1530a (0xe2e bytes) 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5570(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5571(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5572(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5573(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5574(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5575(199 mod 256): WRITE 0x65000 thru 0x65fff (0x1000 bytes) 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5576(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5577(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.008 INFO:teuthology.orchestra.run.smithi153.stdout: +5578(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5579(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5580(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5581(205 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5582(206 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5583(207 mod 256): MAPWRITE 0x16000 thru 0x17edd (0x1ede bytes) 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5584(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5585(209 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5586(210 mod 256): MAPREAD 0x2b000 thru 0x2b46a (0x46b bytes) 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5587(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5588(212 mod 256): WRITE 0x30000 thru 0x30fff (0x1000 bytes) 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5589(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5590(214 mod 256): PUNCH 0x15aa5 thru 0x170f3 (0x164f bytes) 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5591(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5592(216 mod 256): TRUNCATE DOWN from 0x75d8e to 0x63000 2024-03-28T23:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: +5593(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: +5594(218 mod 256): MAPREAD 0x5f000 thru 0x60d2e (0x1d2f bytes) 2024-03-28T23:11:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: +5595(219 mod 256): MAPREAD 0x48000 thru 0x49c1a (0x1c1b bytes) 2024-03-28T23:11:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: +5596(220 mod 256): MAPWRITE 0x28000 thru 0x2871b (0x71c bytes) 2024-03-28T23:11:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: +5597(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: +5598(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: +5599(223 mod 256): TRUNCATE DOWN from 0x63000 to 0x40000 2024-03-28T23:11:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: +5600(224 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: +5601(225 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: +5602(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: +5603(227 mod 256): MAPREAD 0x25000 thru 0x26bdf (0x1be0 bytes) 2024-03-28T23:11:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: +5604(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: +5605(229 mod 256): PUNCH 0x2e43c thru 0x2fa34 (0x15f9 bytes) 2024-03-28T23:11:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: +5606(230 mod 256): COPY 0x12000 thru 0x12fff (0x1000 bytes) to 0x6b000 thru 0x6bfff 2024-03-28T23:11:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: +5607(231 mod 256): TRUNCATE DOWN from 0x6c000 to 0x51000 2024-03-28T23:11:40.011 INFO:teuthology.orchestra.run.smithi153.stdout: +5608(232 mod 256): MAPREAD 0x21000 thru 0x210eb (0xec bytes) 2024-03-28T23:11:40.011 INFO:teuthology.orchestra.run.smithi153.stdout: +5609(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.011 INFO:teuthology.orchestra.run.smithi153.stdout: +5610(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.011 INFO:teuthology.orchestra.run.smithi153.stdout: +5611(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.011 INFO:teuthology.orchestra.run.smithi153.stdout: +5612(236 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.011 INFO:teuthology.orchestra.run.smithi153.stdout: +5613(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.011 INFO:teuthology.orchestra.run.smithi153.stdout: +5614(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.011 INFO:teuthology.orchestra.run.smithi153.stdout: +5615(239 mod 256): TRUNCATE DOWN from 0x51000 to 0x2d000 ******WWWW 2024-03-28T23:11:40.011 INFO:teuthology.orchestra.run.smithi153.stdout: +5616(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.011 INFO:teuthology.orchestra.run.smithi153.stdout: +5617(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.011 INFO:teuthology.orchestra.run.smithi153.stdout: +5618(242 mod 256): MAPREAD 0x11000 thru 0x119ba (0x9bb bytes) 2024-03-28T23:11:40.011 INFO:teuthology.orchestra.run.smithi153.stdout: +5619(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.011 INFO:teuthology.orchestra.run.smithi153.stdout: +5620(244 mod 256): READ 0x28000 thru 0x28fff (0x1000 bytes) 2024-03-28T23:11:40.011 INFO:teuthology.orchestra.run.smithi153.stdout: +5621(245 mod 256): PUNCH 0x1c0c7 thru 0x1c5d5 (0x50f bytes) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5622(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5623(247 mod 256): MAPWRITE 0x76000 thru 0x77608 (0x1609 bytes) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5624(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5625(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5626(250 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5627(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5628(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5629(253 mod 256): PUNCH 0x16f1c thru 0x17e5f (0xf44 bytes) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5630(254 mod 256): MAPWRITE 0x1000 thru 0x11ad (0x1ae bytes) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5631(255 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5632( 0 mod 256): MAPWRITE 0x6f000 thru 0x6fd82 (0xd83 bytes) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5633( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5634( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5635( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.012 INFO:teuthology.orchestra.run.smithi153.stdout: +5636( 4 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5637( 5 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5638( 6 mod 256): MAPWRITE 0x13000 thru 0x149df (0x19e0 bytes) 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5639( 7 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5640( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5641( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5642( 10 mod 256): PUNCH 0x4344f thru 0x44776 (0x1328 bytes) 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5643( 11 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5644( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5645( 13 mod 256): MAPWRITE 0x35000 thru 0x367e5 (0x17e6 bytes) 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5646( 14 mod 256): READ 0x53000 thru 0x53fff (0x1000 bytes) 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5647( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5648( 16 mod 256): TRUNCATE DOWN from 0x77609 to 0x1f000 ******WWWW 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5649( 17 mod 256): MAPWRITE 0x6c000 thru 0x6da1c (0x1a1d bytes) 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5650( 18 mod 256): MAPREAD 0x0 thru 0x72f (0x730 bytes) 2024-03-28T23:11:40.013 INFO:teuthology.orchestra.run.smithi153.stdout: +5651( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: +5652( 20 mod 256): TRUNCATE DOWN from 0x6da1d to 0x52000 2024-03-28T23:11:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: +5653( 21 mod 256): TRUNCATE DOWN from 0x52000 to 0x0 ******WWWW 2024-03-28T23:11:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: +5654( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: +5655( 23 mod 256): TRUNCATE UP from 0x0 to 0x26000 2024-03-28T23:11:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: +5656( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: +5657( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: +5658( 26 mod 256): PUNCH 0x192d4 thru 0x19534 (0x261 bytes) 2024-03-28T23:11:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: +5659( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: +5660( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: +5661( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: +5662( 30 mod 256): MAPWRITE 0x3b000 thru 0x3be49 (0xe4a bytes) 2024-03-28T23:11:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: +5663( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: +5664( 32 mod 256): PUNCH 0x435a thru 0x57cc (0x1473 bytes) 2024-03-28T23:11:40.014 INFO:teuthology.orchestra.run.smithi153.stdout: +5665( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.015 INFO:teuthology.orchestra.run.smithi153.stdout: +5666( 34 mod 256): MAPREAD 0x10000 thru 0x11aec (0x1aed bytes) 2024-03-28T23:11:40.015 INFO:teuthology.orchestra.run.smithi153.stdout: +5667( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.015 INFO:teuthology.orchestra.run.smithi153.stdout: +5668( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.015 INFO:teuthology.orchestra.run.smithi153.stdout: +5669( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.015 INFO:teuthology.orchestra.run.smithi153.stdout: +5670( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.015 INFO:teuthology.orchestra.run.smithi153.stdout: +5671( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.015 INFO:teuthology.orchestra.run.smithi153.stdout: +5672( 40 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.015 INFO:teuthology.orchestra.run.smithi153.stdout: +5673( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.015 INFO:teuthology.orchestra.run.smithi153.stdout: +5674( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.015 INFO:teuthology.orchestra.run.smithi153.stdout: +5675( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.015 INFO:teuthology.orchestra.run.smithi153.stdout: +5676( 44 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.015 INFO:teuthology.orchestra.run.smithi153.stdout: +5677( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.015 INFO:teuthology.orchestra.run.smithi153.stdout: +5678( 46 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.015 INFO:teuthology.orchestra.run.smithi153.stdout: +5679( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5680( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5681( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5682( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5683( 51 mod 256): MAPWRITE 0x74000 thru 0x751c4 (0x11c5 bytes) 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5684( 52 mod 256): MAPWRITE 0x64000 thru 0x65119 (0x111a bytes) 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5685( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5686( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5687( 55 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5688( 56 mod 256): MAPREAD 0x21000 thru 0x22c70 (0x1c71 bytes) 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5689( 57 mod 256): PUNCH 0x27948 thru 0x28a93 (0x114c bytes) 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5690( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5691( 59 mod 256): TRUNCATE DOWN from 0x751c5 to 0x20000 ******WWWW 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5692( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5693( 61 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.016 INFO:teuthology.orchestra.run.smithi153.stdout: +5694( 62 mod 256): MAPREAD 0x1c000 thru 0x1d70d (0x170e bytes) 2024-03-28T23:11:40.017 INFO:teuthology.orchestra.run.smithi153.stdout: +5695( 63 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.017 INFO:teuthology.orchestra.run.smithi153.stdout: +5696( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.017 INFO:teuthology.orchestra.run.smithi153.stdout: +5697( 65 mod 256): MAPWRITE 0x6f000 thru 0x6f0e7 (0xe8 bytes) 2024-03-28T23:11:40.017 INFO:teuthology.orchestra.run.smithi153.stdout: +5698( 66 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.017 INFO:teuthology.orchestra.run.smithi153.stdout: +5699( 67 mod 256): WRITE 0x74000 thru 0x74fff (0x1000 bytes) HOLE 2024-03-28T23:11:40.017 INFO:teuthology.orchestra.run.smithi153.stdout: +5700( 68 mod 256): COPY 0x1f000 thru 0x1ffff (0x1000 bytes) to 0x5e000 thru 0x5efff 2024-03-28T23:11:40.017 INFO:teuthology.orchestra.run.smithi153.stdout: +5701( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.017 INFO:teuthology.orchestra.run.smithi153.stdout: +5702( 70 mod 256): TRUNCATE DOWN from 0x75000 to 0xf000 ******WWWW 2024-03-28T23:11:40.017 INFO:teuthology.orchestra.run.smithi153.stdout: +5703( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.017 INFO:teuthology.orchestra.run.smithi153.stdout: +5704( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.017 INFO:teuthology.orchestra.run.smithi153.stdout: +5705( 73 mod 256): PUNCH 0xda14 thru 0xefff (0x15ec bytes) 2024-03-28T23:11:40.017 INFO:teuthology.orchestra.run.smithi153.stdout: +5706( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.017 INFO:teuthology.orchestra.run.smithi153.stdout: +5707( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.017 INFO:teuthology.orchestra.run.smithi153.stdout: +5708( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5709( 77 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5710( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5711( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5712( 80 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5713( 81 mod 256): PUNCH 0x70f9 thru 0x7f26 (0xe2e bytes) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5714( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5715( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5716( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5717( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5718( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5719( 87 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5720( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5721( 89 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5722( 90 mod 256): READ 0xb000 thru 0xbfff (0x1000 bytes) 2024-03-28T23:11:40.018 INFO:teuthology.orchestra.run.smithi153.stdout: +5723( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5724( 92 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5725( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5726( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5727( 95 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5728( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5729( 97 mod 256): TRUNCATE UP from 0xf000 to 0x4b000 ******WWWW 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5730( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5731( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5732(100 mod 256): PUNCH 0x21b50 thru 0x2261d (0xace bytes) 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5733(101 mod 256): TRUNCATE UP from 0x4b000 to 0x4f000 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5734(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5735(103 mod 256): TRUNCATE DOWN from 0x4f000 to 0x13000 ******WWWW 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5736(104 mod 256): READ 0x11000 thru 0x11fff (0x1000 bytes) 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5737(105 mod 256): TRUNCATE UP from 0x13000 to 0x67000 ******WWWW 2024-03-28T23:11:40.019 INFO:teuthology.orchestra.run.smithi153.stdout: +5738(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.020 INFO:teuthology.orchestra.run.smithi153.stdout: +5739(107 mod 256): WRITE 0x40000 thru 0x40fff (0x1000 bytes) 2024-03-28T23:11:40.020 INFO:teuthology.orchestra.run.smithi153.stdout: +5740(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.020 INFO:teuthology.orchestra.run.smithi153.stdout: +5741(109 mod 256): TRUNCATE DOWN from 0x67000 to 0x1f000 ******WWWW 2024-03-28T23:11:40.020 INFO:teuthology.orchestra.run.smithi153.stdout: +5742(110 mod 256): PUNCH 0x1b242 thru 0x1be7f (0xc3e bytes) 2024-03-28T23:11:40.020 INFO:teuthology.orchestra.run.smithi153.stdout: +5743(111 mod 256): MAPWRITE 0x26000 thru 0x26640 (0x641 bytes) 2024-03-28T23:11:40.020 INFO:teuthology.orchestra.run.smithi153.stdout: +5744(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.020 INFO:teuthology.orchestra.run.smithi153.stdout: +5745(113 mod 256): TRUNCATE DOWN from 0x26641 to 0xd000 2024-03-28T23:11:40.020 INFO:teuthology.orchestra.run.smithi153.stdout: +5746(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.020 INFO:teuthology.orchestra.run.smithi153.stdout: +5747(115 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.020 INFO:teuthology.orchestra.run.smithi153.stdout: +5748(116 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.020 INFO:teuthology.orchestra.run.smithi153.stdout: +5749(117 mod 256): MAPREAD 0x4000 thru 0x58e4 (0x18e5 bytes) 2024-03-28T23:11:40.020 INFO:teuthology.orchestra.run.smithi153.stdout: +5750(118 mod 256): TRUNCATE UP from 0xd000 to 0x60000 ******WWWW 2024-03-28T23:11:40.020 INFO:teuthology.orchestra.run.smithi153.stdout: +5751(119 mod 256): READ 0x59000 thru 0x59fff (0x1000 bytes) 2024-03-28T23:11:40.020 INFO:teuthology.orchestra.run.smithi153.stdout: +5752(120 mod 256): MAPREAD 0x53000 thru 0x538e7 (0x8e8 bytes) 2024-03-28T23:11:40.021 INFO:teuthology.orchestra.run.smithi153.stdout: +5753(121 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.021 INFO:teuthology.orchestra.run.smithi153.stdout: +5754(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.021 INFO:teuthology.orchestra.run.smithi153.stdout: +5755(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.021 INFO:teuthology.orchestra.run.smithi153.stdout: +5756(124 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.021 INFO:teuthology.orchestra.run.smithi153.stdout: +5757(125 mod 256): TRUNCATE UP from 0x60000 to 0x72000 2024-03-28T23:11:40.021 INFO:teuthology.orchestra.run.smithi153.stdout: +5758(126 mod 256): TRUNCATE DOWN from 0x72000 to 0x8000 ******WWWW 2024-03-28T23:11:40.021 INFO:teuthology.orchestra.run.smithi153.stdout: +5759(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.021 INFO:teuthology.orchestra.run.smithi153.stdout: +5760(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.021 INFO:teuthology.orchestra.run.smithi153.stdout: +5761(129 mod 256): MAPREAD 0x3000 thru 0x3ccf (0xcd0 bytes) 2024-03-28T23:11:40.021 INFO:teuthology.orchestra.run.smithi153.stdout: +5762(130 mod 256): READ 0x4000 thru 0x4fff (0x1000 bytes) 2024-03-28T23:11:40.021 INFO:teuthology.orchestra.run.smithi153.stdout: +5763(131 mod 256): MAPREAD 0x7000 thru 0x77ae (0x7af bytes) 2024-03-28T23:11:40.021 INFO:teuthology.orchestra.run.smithi153.stdout: +5764(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.021 INFO:teuthology.orchestra.run.smithi153.stdout: +5765(133 mod 256): TRUNCATE UP from 0x8000 to 0x58000 ******WWWW 2024-03-28T23:11:40.021 INFO:teuthology.orchestra.run.smithi153.stdout: +5766(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.022 INFO:teuthology.orchestra.run.smithi153.stdout: +5767(135 mod 256): MAPREAD 0xa000 thru 0xaa0b (0xa0c bytes) 2024-03-28T23:11:40.022 INFO:teuthology.orchestra.run.smithi153.stdout: +5768(136 mod 256): MAPREAD 0x29000 thru 0x292fe (0x2ff bytes) 2024-03-28T23:11:40.022 INFO:teuthology.orchestra.run.smithi153.stdout: +5769(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.022 INFO:teuthology.orchestra.run.smithi153.stdout: +5770(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.022 INFO:teuthology.orchestra.run.smithi153.stdout: +5771(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.022 INFO:teuthology.orchestra.run.smithi153.stdout: +5772(140 mod 256): WRITE 0x24000 thru 0x24fff (0x1000 bytes) 2024-03-28T23:11:40.022 INFO:teuthology.orchestra.run.smithi153.stdout: +5773(141 mod 256): MAPREAD 0x3000 thru 0x3d16 (0xd17 bytes) 2024-03-28T23:11:40.022 INFO:teuthology.orchestra.run.smithi153.stdout: +5774(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.022 INFO:teuthology.orchestra.run.smithi153.stdout: +5775(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.022 INFO:teuthology.orchestra.run.smithi153.stdout: +5776(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.022 INFO:teuthology.orchestra.run.smithi153.stdout: +5777(145 mod 256): PUNCH 0x40687 thru 0x41668 (0xfe2 bytes) 2024-03-28T23:11:40.022 INFO:teuthology.orchestra.run.smithi153.stdout: +5778(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.022 INFO:teuthology.orchestra.run.smithi153.stdout: +5779(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.022 INFO:teuthology.orchestra.run.smithi153.stdout: +5780(148 mod 256): TRUNCATE DOWN from 0x58000 to 0x36000 ******WWWW 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5781(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5782(150 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5783(151 mod 256): MAPWRITE 0x50000 thru 0x51754 (0x1755 bytes) 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5784(152 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5785(153 mod 256): PUNCH 0x1fd13 thru 0x21838 (0x1b26 bytes) 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5786(154 mod 256): TRUNCATE DOWN from 0x51755 to 0xf000 ******WWWW 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5787(155 mod 256): WRITE 0x61000 thru 0x61fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5788(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5789(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5790(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5791(159 mod 256): READ 0x33000 thru 0x33fff (0x1000 bytes) 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5792(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5793(161 mod 256): READ 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5794(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.023 INFO:teuthology.orchestra.run.smithi153.stdout: +5795(163 mod 256): TRUNCATE UP from 0x62000 to 0x74000 2024-03-28T23:11:40.024 INFO:teuthology.orchestra.run.smithi153.stdout: +5796(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.024 INFO:teuthology.orchestra.run.smithi153.stdout: +5797(165 mod 256): MAPWRITE 0x17000 thru 0x170d8 (0xd9 bytes) 2024-03-28T23:11:40.024 INFO:teuthology.orchestra.run.smithi153.stdout: +5798(166 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.024 INFO:teuthology.orchestra.run.smithi153.stdout: +5799(167 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.024 INFO:teuthology.orchestra.run.smithi153.stdout: +5800(168 mod 256): MAPWRITE 0x1a000 thru 0x1b2ca (0x12cb bytes) 2024-03-28T23:11:40.024 INFO:teuthology.orchestra.run.smithi153.stdout: +5801(169 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.024 INFO:teuthology.orchestra.run.smithi153.stdout: +5802(170 mod 256): WRITE 0x51000 thru 0x51fff (0x1000 bytes) 2024-03-28T23:11:40.024 INFO:teuthology.orchestra.run.smithi153.stdout: +5803(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.024 INFO:teuthology.orchestra.run.smithi153.stdout: +5804(172 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.024 INFO:teuthology.orchestra.run.smithi153.stdout: +5805(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.024 INFO:teuthology.orchestra.run.smithi153.stdout: +5806(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.024 INFO:teuthology.orchestra.run.smithi153.stdout: +5807(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.024 INFO:teuthology.orchestra.run.smithi153.stdout: +5808(176 mod 256): MAPWRITE 0x8000 thru 0x9cfd (0x1cfe bytes) 2024-03-28T23:11:40.024 INFO:teuthology.orchestra.run.smithi153.stdout: +5809(177 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.025 INFO:teuthology.orchestra.run.smithi153.stdout: +5810(178 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.025 INFO:teuthology.orchestra.run.smithi153.stdout: +5811(179 mod 256): PUNCH 0x65c3e thru 0x65d87 (0x14a bytes) 2024-03-28T23:11:40.025 INFO:teuthology.orchestra.run.smithi153.stdout: +5812(180 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.025 INFO:teuthology.orchestra.run.smithi153.stdout: +5813(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.025 INFO:teuthology.orchestra.run.smithi153.stdout: +5814(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.025 INFO:teuthology.orchestra.run.smithi153.stdout: +5815(183 mod 256): MAPREAD 0x2b000 thru 0x2bf4f (0xf50 bytes) 2024-03-28T23:11:40.025 INFO:teuthology.orchestra.run.smithi153.stdout: +5816(184 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.025 INFO:teuthology.orchestra.run.smithi153.stdout: +5817(185 mod 256): MAPWRITE 0x51000 thru 0x52cd2 (0x1cd3 bytes) 2024-03-28T23:11:40.025 INFO:teuthology.orchestra.run.smithi153.stdout: +5818(186 mod 256): PUNCH 0x6f533 thru 0x6fd5e (0x82c bytes) 2024-03-28T23:11:40.025 INFO:teuthology.orchestra.run.smithi153.stdout: +5819(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.025 INFO:teuthology.orchestra.run.smithi153.stdout: +5820(188 mod 256): MAPWRITE 0x4a000 thru 0x4b32a (0x132b bytes) 2024-03-28T23:11:40.025 INFO:teuthology.orchestra.run.smithi153.stdout: +5821(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.025 INFO:teuthology.orchestra.run.smithi153.stdout: +5822(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.025 INFO:teuthology.orchestra.run.smithi153.stdout: +5823(191 mod 256): PUNCH 0x4b824 thru 0x4cb35 (0x1312 bytes) 2024-03-28T23:11:40.026 INFO:teuthology.orchestra.run.smithi153.stdout: +5824(192 mod 256): COPY 0x56000 thru 0x56fff (0x1000 bytes) to 0x8000 thru 0x8fff 2024-03-28T23:11:40.026 INFO:teuthology.orchestra.run.smithi153.stdout: +5825(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.026 INFO:teuthology.orchestra.run.smithi153.stdout: +5826(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.026 INFO:teuthology.orchestra.run.smithi153.stdout: +5827(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.026 INFO:teuthology.orchestra.run.smithi153.stdout: +5828(196 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.026 INFO:teuthology.orchestra.run.smithi153.stdout: +5829(197 mod 256): COPY 0x18000 thru 0x18fff (0x1000 bytes) to 0x5c000 thru 0x5cfff 2024-03-28T23:11:40.026 INFO:teuthology.orchestra.run.smithi153.stdout: +5830(198 mod 256): MAPWRITE 0x2e000 thru 0x2fb1c (0x1b1d bytes) 2024-03-28T23:11:40.026 INFO:teuthology.orchestra.run.smithi153.stdout: +5831(199 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.026 INFO:teuthology.orchestra.run.smithi153.stdout: +5832(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.026 INFO:teuthology.orchestra.run.smithi153.stdout: +5833(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.026 INFO:teuthology.orchestra.run.smithi153.stdout: +5834(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.026 INFO:teuthology.orchestra.run.smithi153.stdout: +5835(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.026 INFO:teuthology.orchestra.run.smithi153.stdout: +5836(204 mod 256): MAPWRITE 0x74000 thru 0x75765 (0x1766 bytes) 2024-03-28T23:11:40.026 INFO:teuthology.orchestra.run.smithi153.stdout: +5837(205 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.027 INFO:teuthology.orchestra.run.smithi153.stdout: +5838(206 mod 256): WRITE 0x32000 thru 0x32fff (0x1000 bytes) 2024-03-28T23:11:40.027 INFO:teuthology.orchestra.run.smithi153.stdout: +5839(207 mod 256): WRITE 0x54000 thru 0x54fff (0x1000 bytes) 2024-03-28T23:11:40.027 INFO:teuthology.orchestra.run.smithi153.stdout: +5840(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.027 INFO:teuthology.orchestra.run.smithi153.stdout: +5841(209 mod 256): WRITE 0x4d000 thru 0x4dfff (0x1000 bytes) 2024-03-28T23:11:40.027 INFO:teuthology.orchestra.run.smithi153.stdout: +5842(210 mod 256): TRUNCATE DOWN from 0x75766 to 0x20000 ******WWWW 2024-03-28T23:11:40.027 INFO:teuthology.orchestra.run.smithi153.stdout: +5843(211 mod 256): READ 0x19000 thru 0x19fff (0x1000 bytes) 2024-03-28T23:11:40.027 INFO:teuthology.orchestra.run.smithi153.stdout: +5844(212 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.027 INFO:teuthology.orchestra.run.smithi153.stdout: +5845(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.027 INFO:teuthology.orchestra.run.smithi153.stdout: +5846(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.027 INFO:teuthology.orchestra.run.smithi153.stdout: +5847(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.027 INFO:teuthology.orchestra.run.smithi153.stdout: +5848(216 mod 256): MAPREAD 0x5000 thru 0x5ce2 (0xce3 bytes) 2024-03-28T23:11:40.027 INFO:teuthology.orchestra.run.smithi153.stdout: +5849(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.027 INFO:teuthology.orchestra.run.smithi153.stdout: +5850(218 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.027 INFO:teuthology.orchestra.run.smithi153.stdout: +5851(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5852(220 mod 256): PUNCH 0x7cca thru 0x7e91 (0x1c8 bytes) 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5853(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5854(222 mod 256): MAPWRITE 0x59000 thru 0x5a069 (0x106a bytes) 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5855(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5856(224 mod 256): TRUNCATE DOWN from 0x5a06a to 0x58000 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5857(225 mod 256): TRUNCATE DOWN from 0x58000 to 0x1f000 ******WWWW 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5858(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5859(227 mod 256): TRUNCATE UP from 0x1f000 to 0x77000 ******WWWW 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5860(228 mod 256): COPY 0x72000 thru 0x72fff (0x1000 bytes) to 0x29000 thru 0x29fff 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5861(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5862(230 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5863(231 mod 256): TRUNCATE DOWN from 0x77000 to 0x22000 ******WWWW 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5864(232 mod 256): MAPWRITE 0xe000 thru 0xe14c (0x14d bytes) 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5865(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.028 INFO:teuthology.orchestra.run.smithi153.stdout: +5866(234 mod 256): COPY 0x1b000 thru 0x1bfff (0x1000 bytes) to 0x28000 thru 0x28fff 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5867(235 mod 256): MAPREAD 0x1e000 thru 0x1e840 (0x841 bytes) 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5868(236 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5869(237 mod 256): PUNCH 0x6f6d thru 0x7b62 (0xbf6 bytes) 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5870(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5871(239 mod 256): MAPWRITE 0x6d000 thru 0x6eb69 (0x1b6a bytes) 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5872(240 mod 256): MAPWRITE 0x48000 thru 0x48475 (0x476 bytes) 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5873(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5874(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5875(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5876(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5877(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5878(246 mod 256): READ 0x55000 thru 0x55fff (0x1000 bytes) 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5879(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5880(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.029 INFO:teuthology.orchestra.run.smithi153.stdout: +5881(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.030 INFO:teuthology.orchestra.run.smithi153.stdout: +5882(250 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.030 INFO:teuthology.orchestra.run.smithi153.stdout: +5883(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.030 INFO:teuthology.orchestra.run.smithi153.stdout: +5884(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.030 INFO:teuthology.orchestra.run.smithi153.stdout: +5885(253 mod 256): MAPWRITE 0x2e000 thru 0x2f955 (0x1956 bytes) 2024-03-28T23:11:40.030 INFO:teuthology.orchestra.run.smithi153.stdout: +5886(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.030 INFO:teuthology.orchestra.run.smithi153.stdout: +5887(255 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.030 INFO:teuthology.orchestra.run.smithi153.stdout: +5888( 0 mod 256): MAPWRITE 0x74000 thru 0x74a1a (0xa1b bytes) 2024-03-28T23:11:40.030 INFO:teuthology.orchestra.run.smithi153.stdout: +5889( 1 mod 256): TRUNCATE DOWN from 0x74a1b to 0x4000 ******WWWW 2024-03-28T23:11:40.030 INFO:teuthology.orchestra.run.smithi153.stdout: +5890( 2 mod 256): PUNCH 0x2823 thru 0x3fff (0x17dd bytes) 2024-03-28T23:11:40.030 INFO:teuthology.orchestra.run.smithi153.stdout: +5891( 3 mod 256): PUNCH 0xe24 thru 0x23b6 (0x1593 bytes) 2024-03-28T23:11:40.030 INFO:teuthology.orchestra.run.smithi153.stdout: +5892( 4 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.030 INFO:teuthology.orchestra.run.smithi153.stdout: +5893( 5 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.030 INFO:teuthology.orchestra.run.smithi153.stdout: +5894( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.030 INFO:teuthology.orchestra.run.smithi153.stdout: +5895( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5896( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5897( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5898( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5899( 11 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5900( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5901( 13 mod 256): PUNCH 0x1e13 thru 0x3c3b (0x1e29 bytes) 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5902( 14 mod 256): TRUNCATE UP from 0x4000 to 0x34000 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5903( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5904( 16 mod 256): MAPREAD 0x8000 thru 0x9969 (0x196a bytes) 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5905( 17 mod 256): PUNCH 0x64ac thru 0x841b (0x1f70 bytes) 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5906( 18 mod 256): MAPREAD 0x15000 thru 0x166ab (0x16ac bytes) 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5907( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5908( 20 mod 256): PUNCH 0x27705 thru 0x27afb (0x3f7 bytes) 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5909( 21 mod 256): PUNCH 0x2fa09 thru 0x309da (0xfd2 bytes) 2024-03-28T23:11:40.031 INFO:teuthology.orchestra.run.smithi153.stdout: +5910( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.032 INFO:teuthology.orchestra.run.smithi153.stdout: +5911( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.032 INFO:teuthology.orchestra.run.smithi153.stdout: +5912( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.032 INFO:teuthology.orchestra.run.smithi153.stdout: +5913( 25 mod 256): TRUNCATE UP from 0x34000 to 0x4f000 ******WWWW 2024-03-28T23:11:40.032 INFO:teuthology.orchestra.run.smithi153.stdout: +5914( 26 mod 256): MAPWRITE 0x3a000 thru 0x3ad37 (0xd38 bytes) 2024-03-28T23:11:40.032 INFO:teuthology.orchestra.run.smithi153.stdout: +5915( 27 mod 256): COPY 0x0 thru 0xfff (0x1000 bytes) to 0x1f000 thru 0x1ffff 2024-03-28T23:11:40.032 INFO:teuthology.orchestra.run.smithi153.stdout: +5916( 28 mod 256): MAPWRITE 0x54000 thru 0x55f97 (0x1f98 bytes) 2024-03-28T23:11:40.032 INFO:teuthology.orchestra.run.smithi153.stdout: +5917( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.032 INFO:teuthology.orchestra.run.smithi153.stdout: +5918( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.032 INFO:teuthology.orchestra.run.smithi153.stdout: +5919( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.032 INFO:teuthology.orchestra.run.smithi153.stdout: +5920( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.032 INFO:teuthology.orchestra.run.smithi153.stdout: +5921( 33 mod 256): WRITE 0x55000 thru 0x55fff (0x1000 bytes) EXTEND 2024-03-28T23:11:40.032 INFO:teuthology.orchestra.run.smithi153.stdout: +5922( 34 mod 256): TRUNCATE DOWN from 0x56000 to 0x22000 ******WWWW 2024-03-28T23:11:40.032 INFO:teuthology.orchestra.run.smithi153.stdout: +5923( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.032 INFO:teuthology.orchestra.run.smithi153.stdout: +5924( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5925( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5926( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5927( 39 mod 256): MAPWRITE 0xc000 thru 0xdd1a (0x1d1b bytes) 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5928( 40 mod 256): PUNCH 0x1d5f7 thru 0x1d898 (0x2a2 bytes) 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5929( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5930( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5931( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5932( 44 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5933( 45 mod 256): MAPWRITE 0x59000 thru 0x59050 (0x51 bytes) 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5934( 46 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5935( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5936( 48 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5937( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5938( 50 mod 256): TRUNCATE DOWN from 0x59051 to 0xa000 ******WWWW 2024-03-28T23:11:40.033 INFO:teuthology.orchestra.run.smithi153.stdout: +5939( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.034 INFO:teuthology.orchestra.run.smithi153.stdout: +5940( 52 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.034 INFO:teuthology.orchestra.run.smithi153.stdout: +5941( 53 mod 256): WRITE 0x25000 thru 0x25fff (0x1000 bytes) HOLE 2024-03-28T23:11:40.034 INFO:teuthology.orchestra.run.smithi153.stdout: +5942( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.034 INFO:teuthology.orchestra.run.smithi153.stdout: +5943( 55 mod 256): MAPREAD 0x8000 thru 0x82e3 (0x2e4 bytes) 2024-03-28T23:11:40.034 INFO:teuthology.orchestra.run.smithi153.stdout: +5944( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.034 INFO:teuthology.orchestra.run.smithi153.stdout: +5945( 57 mod 256): PUNCH 0x12ee1 thru 0x138d3 (0x9f3 bytes) 2024-03-28T23:11:40.034 INFO:teuthology.orchestra.run.smithi153.stdout: +5946( 58 mod 256): READ 0x14000 thru 0x14fff (0x1000 bytes) 2024-03-28T23:11:40.034 INFO:teuthology.orchestra.run.smithi153.stdout: +5947( 59 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.034 INFO:teuthology.orchestra.run.smithi153.stdout: +5948( 60 mod 256): PUNCH 0x20685 thru 0x206ba (0x36 bytes) 2024-03-28T23:11:40.034 INFO:teuthology.orchestra.run.smithi153.stdout: +5949( 61 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.034 INFO:teuthology.orchestra.run.smithi153.stdout: +5950( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.034 INFO:teuthology.orchestra.run.smithi153.stdout: +5951( 63 mod 256): PUNCH 0x234c4 thru 0x24f39 (0x1a76 bytes) 2024-03-28T23:11:40.034 INFO:teuthology.orchestra.run.smithi153.stdout: +5952( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.034 INFO:teuthology.orchestra.run.smithi153.stdout: +5953( 65 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5954( 66 mod 256): MAPREAD 0x9000 thru 0xa632 (0x1633 bytes) 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5955( 67 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5956( 68 mod 256): PUNCH 0x7dc4 thru 0x89f4 (0xc31 bytes) 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5957( 69 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5958( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5959( 71 mod 256): MAPREAD 0x16000 thru 0x1677f (0x780 bytes) 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5960( 72 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5961( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5962( 74 mod 256): WRITE 0x56000 thru 0x56fff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5963( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5964( 76 mod 256): MAPREAD 0x27000 thru 0x2795f (0x960 bytes) 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5965( 77 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5966( 78 mod 256): TRUNCATE DOWN from 0x57000 to 0x3a000 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5967( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.035 INFO:teuthology.orchestra.run.smithi153.stdout: +5968( 80 mod 256): MAPREAD 0x33000 thru 0x34d4b (0x1d4c bytes) 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5969( 81 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5970( 82 mod 256): TRUNCATE DOWN from 0x3a000 to 0x34000 ******WWWW 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5971( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5972( 84 mod 256): MAPWRITE 0x4000 thru 0x56d3 (0x16d4 bytes) 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5973( 85 mod 256): TRUNCATE UP from 0x34000 to 0x46000 ******WWWW 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5974( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5975( 87 mod 256): MAPREAD 0x24000 thru 0x25ba4 (0x1ba5 bytes) 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5976( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5977( 89 mod 256): TRUNCATE DOWN from 0x46000 to 0x2a000 ******WWWW 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5978( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5979( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5980( 92 mod 256): COPY 0x18000 thru 0x18fff (0x1000 bytes) to 0x15000 thru 0x15fff 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5981( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5982( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: +5983( 95 mod 256): MAPWRITE 0x4f000 thru 0x4fad3 (0xad4 bytes) 2024-03-28T23:11:40.037 INFO:teuthology.orchestra.run.smithi153.stdout: +5984( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.037 INFO:teuthology.orchestra.run.smithi153.stdout: +5985( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.037 INFO:teuthology.orchestra.run.smithi153.stdout: +5986( 98 mod 256): PUNCH 0x1b816 thru 0x1c9b8 (0x11a3 bytes) 2024-03-28T23:11:40.037 INFO:teuthology.orchestra.run.smithi153.stdout: +5987( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.037 INFO:teuthology.orchestra.run.smithi153.stdout: +5988(100 mod 256): MAPWRITE 0x17000 thru 0x18df0 (0x1df1 bytes) 2024-03-28T23:11:40.037 INFO:teuthology.orchestra.run.smithi153.stdout: +5989(101 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.037 INFO:teuthology.orchestra.run.smithi153.stdout: +5990(102 mod 256): PUNCH 0x260e9 thru 0x26c49 (0xb61 bytes) 2024-03-28T23:11:40.037 INFO:teuthology.orchestra.run.smithi153.stdout: +5991(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.037 INFO:teuthology.orchestra.run.smithi153.stdout: +5992(104 mod 256): READ 0x16000 thru 0x16fff (0x1000 bytes) 2024-03-28T23:11:40.037 INFO:teuthology.orchestra.run.smithi153.stdout: +5993(105 mod 256): MAPREAD 0x21000 thru 0x22afe (0x1aff bytes) 2024-03-28T23:11:40.037 INFO:teuthology.orchestra.run.smithi153.stdout: +5994(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.037 INFO:teuthology.orchestra.run.smithi153.stdout: +5995(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +5996(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +5997(109 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +5998(110 mod 256): PUNCH 0x1f2b0 thru 0x20bb7 (0x1908 bytes) 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +5999(111 mod 256): READ 0x3e000 thru 0x3efff (0x1000 bytes) 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +6000(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +6001(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +6002(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +6003(115 mod 256): PUNCH 0x4046 thru 0x5795 (0x1750 bytes) 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +6004(116 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +6005(117 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +6006(118 mod 256): COPY 0x18000 thru 0x18fff (0x1000 bytes) to 0x1e000 thru 0x1efff 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +6007(119 mod 256): MAPWRITE 0x71000 thru 0x71557 (0x558 bytes) 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +6008(120 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +6009(121 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.038 INFO:teuthology.orchestra.run.smithi153.stdout: +6010(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.039 INFO:teuthology.orchestra.run.smithi153.stdout: +6011(123 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.039 INFO:teuthology.orchestra.run.smithi153.stdout: +6012(124 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.039 INFO:teuthology.orchestra.run.smithi153.stdout: +6013(125 mod 256): TRUNCATE DOWN from 0x71558 to 0x61000 2024-03-28T23:11:40.039 INFO:teuthology.orchestra.run.smithi153.stdout: +6014(126 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.039 INFO:teuthology.orchestra.run.smithi153.stdout: +6015(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.039 INFO:teuthology.orchestra.run.smithi153.stdout: +6016(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.039 INFO:teuthology.orchestra.run.smithi153.stdout: +6017(129 mod 256): TRUNCATE UP from 0x61000 to 0x6f000 2024-03-28T23:11:40.039 INFO:teuthology.orchestra.run.smithi153.stdout: +6018(130 mod 256): COPY 0x12000 thru 0x12fff (0x1000 bytes) to 0x3a000 thru 0x3afff 2024-03-28T23:11:40.039 INFO:teuthology.orchestra.run.smithi153.stdout: +6019(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.039 INFO:teuthology.orchestra.run.smithi153.stdout: +6020(132 mod 256): MAPREAD 0x4000 thru 0x427a (0x27b bytes) 2024-03-28T23:11:40.039 INFO:teuthology.orchestra.run.smithi153.stdout: +6021(133 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.039 INFO:teuthology.orchestra.run.smithi153.stdout: +6022(134 mod 256): PUNCH 0x297e2 thru 0x2a9f9 (0x1218 bytes) 2024-03-28T23:11:40.039 INFO:teuthology.orchestra.run.smithi153.stdout: +6023(135 mod 256): MAPWRITE 0x2f000 thru 0x30924 (0x1925 bytes) 2024-03-28T23:11:40.039 INFO:teuthology.orchestra.run.smithi153.stdout: +6024(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.040 INFO:teuthology.orchestra.run.smithi153.stdout: +6025(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.040 INFO:teuthology.orchestra.run.smithi153.stdout: +6026(138 mod 256): MAPREAD 0x3f000 thru 0x409ea (0x19eb bytes) 2024-03-28T23:11:40.040 INFO:teuthology.orchestra.run.smithi153.stdout: +6027(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.040 INFO:teuthology.orchestra.run.smithi153.stdout: +6028(140 mod 256): MAPREAD 0x35000 thru 0x36114 (0x1115 bytes) 2024-03-28T23:11:40.040 INFO:teuthology.orchestra.run.smithi153.stdout: +6029(141 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.040 INFO:teuthology.orchestra.run.smithi153.stdout: +6030(142 mod 256): TRUNCATE DOWN from 0x6f000 to 0x5f000 2024-03-28T23:11:40.040 INFO:teuthology.orchestra.run.smithi153.stdout: +6031(143 mod 256): MAPWRITE 0x56000 thru 0x575ec (0x15ed bytes) 2024-03-28T23:11:40.040 INFO:teuthology.orchestra.run.smithi153.stdout: +6032(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.040 INFO:teuthology.orchestra.run.smithi153.stdout: +6033(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.040 INFO:teuthology.orchestra.run.smithi153.stdout: +6034(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.040 INFO:teuthology.orchestra.run.smithi153.stdout: +6035(147 mod 256): MAPREAD 0x3e000 thru 0x3efc8 (0xfc9 bytes) 2024-03-28T23:11:40.040 INFO:teuthology.orchestra.run.smithi153.stdout: +6036(148 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.040 INFO:teuthology.orchestra.run.smithi153.stdout: +6037(149 mod 256): COPY 0x56000 thru 0x56fff (0x1000 bytes) to 0x22000 thru 0x22fff 2024-03-28T23:11:40.040 INFO:teuthology.orchestra.run.smithi153.stdout: +6038(150 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6039(151 mod 256): READ 0x26000 thru 0x26fff (0x1000 bytes) 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6040(152 mod 256): WRITE 0x14000 thru 0x14fff (0x1000 bytes) 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6041(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6042(154 mod 256): TRUNCATE DOWN from 0x5f000 to 0x55000 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6043(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6044(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6045(157 mod 256): WRITE 0x5a000 thru 0x5afff (0x1000 bytes) HOLE 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6046(158 mod 256): MAPREAD 0x24000 thru 0x244bd (0x4be bytes) 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6047(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6048(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6049(161 mod 256): COPY 0x19000 thru 0x19fff (0x1000 bytes) to 0x42000 thru 0x42fff 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6050(162 mod 256): READ 0x40000 thru 0x40fff (0x1000 bytes) 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6051(163 mod 256): READ 0x3d000 thru 0x3dfff (0x1000 bytes) 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6052(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.041 INFO:teuthology.orchestra.run.smithi153.stdout: +6053(165 mod 256): COPY 0x49000 thru 0x49fff (0x1000 bytes) to 0x0 thru 0xfff 2024-03-28T23:11:40.042 INFO:teuthology.orchestra.run.smithi153.stdout: +6054(166 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.042 INFO:teuthology.orchestra.run.smithi153.stdout: +6055(167 mod 256): WRITE 0x53000 thru 0x53fff (0x1000 bytes) 2024-03-28T23:11:40.042 INFO:teuthology.orchestra.run.smithi153.stdout: +6056(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.042 INFO:teuthology.orchestra.run.smithi153.stdout: +6057(169 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.042 INFO:teuthology.orchestra.run.smithi153.stdout: +6058(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.042 INFO:teuthology.orchestra.run.smithi153.stdout: +6059(171 mod 256): MAPWRITE 0x17000 thru 0x1748d (0x48e bytes) 2024-03-28T23:11:40.042 INFO:teuthology.orchestra.run.smithi153.stdout: +6060(172 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.042 INFO:teuthology.orchestra.run.smithi153.stdout: +6061(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.042 INFO:teuthology.orchestra.run.smithi153.stdout: +6062(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.042 INFO:teuthology.orchestra.run.smithi153.stdout: +6063(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.042 INFO:teuthology.orchestra.run.smithi153.stdout: +6064(176 mod 256): MAPREAD 0x1c000 thru 0x1ccc5 (0xcc6 bytes) 2024-03-28T23:11:40.042 INFO:teuthology.orchestra.run.smithi153.stdout: +6065(177 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x40000 thru 0x40fff 2024-03-28T23:11:40.042 INFO:teuthology.orchestra.run.smithi153.stdout: +6066(178 mod 256): MAPREAD 0x1b000 thru 0x1b415 (0x416 bytes) 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6067(179 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6068(180 mod 256): TRUNCATE DOWN from 0x5b000 to 0x8000 ******WWWW 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6069(181 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6070(182 mod 256): MAPREAD 0x1000 thru 0x1768 (0x769 bytes) 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6071(183 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6072(184 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6073(185 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6074(186 mod 256): PUNCH 0x3501 thru 0x3827 (0x327 bytes) 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6075(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6076(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6077(189 mod 256): COPY 0x1000 thru 0x1fff (0x1000 bytes) to 0x41000 thru 0x41fff 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6078(190 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6079(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6080(192 mod 256): TRUNCATE UP from 0x42000 to 0x54000 2024-03-28T23:11:40.043 INFO:teuthology.orchestra.run.smithi153.stdout: +6081(193 mod 256): MAPWRITE 0x53000 thru 0x539c0 (0x9c1 bytes) 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6082(194 mod 256): MAPREAD 0x2e000 thru 0x2ec05 (0xc06 bytes) 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6083(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6084(196 mod 256): COPY 0x31000 thru 0x31fff (0x1000 bytes) to 0x5e000 thru 0x5efff 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6085(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6086(198 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6087(199 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6088(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6089(201 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6090(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6091(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6092(204 mod 256): MAPWRITE 0x64000 thru 0x654f3 (0x14f4 bytes) 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6093(205 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6094(206 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6095(207 mod 256): PUNCH 0x1336f thru 0x13a4f (0x6e1 bytes) 2024-03-28T23:11:40.044 INFO:teuthology.orchestra.run.smithi153.stdout: +6096(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.045 INFO:teuthology.orchestra.run.smithi153.stdout: +6097(209 mod 256): TRUNCATE DOWN from 0x654f4 to 0x4b000 2024-03-28T23:11:40.045 INFO:teuthology.orchestra.run.smithi153.stdout: +6098(210 mod 256): READ 0x23000 thru 0x23fff (0x1000 bytes) 2024-03-28T23:11:40.045 INFO:teuthology.orchestra.run.smithi153.stdout: +6099(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.045 INFO:teuthology.orchestra.run.smithi153.stdout: +6100(212 mod 256): TRUNCATE DOWN from 0x4b000 to 0x2000 ******WWWW 2024-03-28T23:11:40.045 INFO:teuthology.orchestra.run.smithi153.stdout: +6101(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.045 INFO:teuthology.orchestra.run.smithi153.stdout: +6102(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.045 INFO:teuthology.orchestra.run.smithi153.stdout: +6103(215 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.045 INFO:teuthology.orchestra.run.smithi153.stdout: +6104(216 mod 256): PUNCH 0x11d5 thru 0x1fff (0xe2b bytes) 2024-03-28T23:11:40.045 INFO:teuthology.orchestra.run.smithi153.stdout: +6105(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.045 INFO:teuthology.orchestra.run.smithi153.stdout: +6106(218 mod 256): MAPREAD 0x1000 thru 0x132c (0x32d bytes) 2024-03-28T23:11:40.045 INFO:teuthology.orchestra.run.smithi153.stdout: +6107(219 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.045 INFO:teuthology.orchestra.run.smithi153.stdout: +6108(220 mod 256): MAPWRITE 0x3a000 thru 0x3ae4a (0xe4b bytes) 2024-03-28T23:11:40.045 INFO:teuthology.orchestra.run.smithi153.stdout: +6109(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.045 INFO:teuthology.orchestra.run.smithi153.stdout: +6110(222 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.046 INFO:teuthology.orchestra.run.smithi153.stdout: +6111(223 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.046 INFO:teuthology.orchestra.run.smithi153.stdout: +6112(224 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.046 INFO:teuthology.orchestra.run.smithi153.stdout: +6113(225 mod 256): COPY 0x16000 thru 0x16fff (0x1000 bytes) to 0x69000 thru 0x69fff 2024-03-28T23:11:40.046 INFO:teuthology.orchestra.run.smithi153.stdout: +6114(226 mod 256): MAPREAD 0x44000 thru 0x445e4 (0x5e5 bytes) 2024-03-28T23:11:40.046 INFO:teuthology.orchestra.run.smithi153.stdout: +6115(227 mod 256): WRITE 0x28000 thru 0x28fff (0x1000 bytes) 2024-03-28T23:11:40.046 INFO:teuthology.orchestra.run.smithi153.stdout: +6116(228 mod 256): MAPWRITE 0x34000 thru 0x34eb3 (0xeb4 bytes) 2024-03-28T23:11:40.046 INFO:teuthology.orchestra.run.smithi153.stdout: +6117(229 mod 256): COPY 0xe000 thru 0xefff (0x1000 bytes) to 0x54000 thru 0x54fff 2024-03-28T23:11:40.046 INFO:teuthology.orchestra.run.smithi153.stdout: +6118(230 mod 256): COPY 0x18000 thru 0x18fff (0x1000 bytes) to 0x76000 thru 0x76fff 2024-03-28T23:11:40.046 INFO:teuthology.orchestra.run.smithi153.stdout: +6119(231 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.046 INFO:teuthology.orchestra.run.smithi153.stdout: +6120(232 mod 256): READ 0x17000 thru 0x17fff (0x1000 bytes) 2024-03-28T23:11:40.046 INFO:teuthology.orchestra.run.smithi153.stdout: +6121(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.046 INFO:teuthology.orchestra.run.smithi153.stdout: +6122(234 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.046 INFO:teuthology.orchestra.run.smithi153.stdout: +6123(235 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.046 INFO:teuthology.orchestra.run.smithi153.stdout: +6124(236 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6125(237 mod 256): MAPREAD 0xb000 thru 0xbdc4 (0xdc5 bytes) 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6126(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6127(239 mod 256): PUNCH 0x18c2a thru 0x1a71c (0x1af3 bytes) 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6128(240 mod 256): READ 0x41000 thru 0x41fff (0x1000 bytes) 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6129(241 mod 256): PUNCH 0x600e thru 0x70ac (0x109f bytes) 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6130(242 mod 256): PUNCH 0x1f97 thru 0x3669 (0x16d3 bytes) 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6131(243 mod 256): COPY 0x4f000 thru 0x4ffff (0x1000 bytes) to 0x14000 thru 0x14fff 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6132(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6133(245 mod 256): COPY 0x6b000 thru 0x6bfff (0x1000 bytes) to 0x57000 thru 0x57fff 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6134(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6135(247 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6136(248 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6137(249 mod 256): READ 0xa000 thru 0xafff (0x1000 bytes) 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6138(250 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.047 INFO:teuthology.orchestra.run.smithi153.stdout: +6139(251 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.048 INFO:teuthology.orchestra.run.smithi153.stdout: +6140(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.048 INFO:teuthology.orchestra.run.smithi153.stdout: +6141(253 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.048 INFO:teuthology.orchestra.run.smithi153.stdout: +6142(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.048 INFO:teuthology.orchestra.run.smithi153.stdout: +6143(255 mod 256): TRUNCATE DOWN from 0x77000 to 0xc000 ******WWWW 2024-03-28T23:11:40.048 INFO:teuthology.orchestra.run.smithi153.stdout: +6144( 0 mod 256): MAPWRITE 0x79000 thru 0x7a05f (0x1060 bytes) 2024-03-28T23:11:40.048 INFO:teuthology.orchestra.run.smithi153.stdout: +6145( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.048 INFO:teuthology.orchestra.run.smithi153.stdout: +6146( 2 mod 256): READ 0x1c000 thru 0x1cfff (0x1000 bytes) 2024-03-28T23:11:40.048 INFO:teuthology.orchestra.run.smithi153.stdout: +6147( 3 mod 256): MAPREAD 0x1a000 thru 0x1a315 (0x316 bytes) 2024-03-28T23:11:40.048 INFO:teuthology.orchestra.run.smithi153.stdout: +6148( 4 mod 256): TRUNCATE DOWN from 0x7a060 to 0x6b000 2024-03-28T23:11:40.048 INFO:teuthology.orchestra.run.smithi153.stdout: +6149( 5 mod 256): READ 0xb000 thru 0xbfff (0x1000 bytes) 2024-03-28T23:11:40.048 INFO:teuthology.orchestra.run.smithi153.stdout: +6150( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.048 INFO:teuthology.orchestra.run.smithi153.stdout: +6151( 7 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.048 INFO:teuthology.orchestra.run.smithi153.stdout: +6152( 8 mod 256): TRUNCATE DOWN from 0x6b000 to 0xd000 ******WWWW 2024-03-28T23:11:40.048 INFO:teuthology.orchestra.run.smithi153.stdout: +6153( 9 mod 256): MAPWRITE 0x26000 thru 0x272b7 (0x12b8 bytes) 2024-03-28T23:11:40.049 INFO:teuthology.orchestra.run.smithi153.stdout: +6154( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.049 INFO:teuthology.orchestra.run.smithi153.stdout: +6155( 11 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.049 INFO:teuthology.orchestra.run.smithi153.stdout: +6156( 12 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.049 INFO:teuthology.orchestra.run.smithi153.stdout: +6157( 13 mod 256): PUNCH 0xf380 thru 0xfa19 (0x69a bytes) 2024-03-28T23:11:40.049 INFO:teuthology.orchestra.run.smithi153.stdout: +6158( 14 mod 256): READ 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-28T23:11:40.049 INFO:teuthology.orchestra.run.smithi153.stdout: +6159( 15 mod 256): MAPWRITE 0x2e000 thru 0x2e1c2 (0x1c3 bytes) 2024-03-28T23:11:40.049 INFO:teuthology.orchestra.run.smithi153.stdout: +6160( 16 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.049 INFO:teuthology.orchestra.run.smithi153.stdout: +6161( 17 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.049 INFO:teuthology.orchestra.run.smithi153.stdout: +6162( 18 mod 256): WRITE 0x32000 thru 0x32fff (0x1000 bytes) HOLE 2024-03-28T23:11:40.049 INFO:teuthology.orchestra.run.smithi153.stdout: +6163( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.049 INFO:teuthology.orchestra.run.smithi153.stdout: +6164( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.049 INFO:teuthology.orchestra.run.smithi153.stdout: +6165( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.049 INFO:teuthology.orchestra.run.smithi153.stdout: +6166( 22 mod 256): TRUNCATE UP from 0x33000 to 0x43000 ******WWWW 2024-03-28T23:11:40.049 INFO:teuthology.orchestra.run.smithi153.stdout: +6167( 23 mod 256): MAPWRITE 0x1c000 thru 0x1deec (0x1eed bytes) 2024-03-28T23:11:40.050 INFO:teuthology.orchestra.run.smithi153.stdout: +6168( 24 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.050 INFO:teuthology.orchestra.run.smithi153.stdout: +6169( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.050 INFO:teuthology.orchestra.run.smithi153.stdout: +6170( 26 mod 256): MAPREAD 0x16000 thru 0x175a8 (0x15a9 bytes) 2024-03-28T23:11:40.050 INFO:teuthology.orchestra.run.smithi153.stdout: +6171( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.050 INFO:teuthology.orchestra.run.smithi153.stdout: +6172( 28 mod 256): MAPREAD 0x3d000 thru 0x3dc9d (0xc9e bytes) 2024-03-28T23:11:40.050 INFO:teuthology.orchestra.run.smithi153.stdout: +6173( 29 mod 256): READ 0x16000 thru 0x16fff (0x1000 bytes) 2024-03-28T23:11:40.050 INFO:teuthology.orchestra.run.smithi153.stdout: +6174( 30 mod 256): COPY 0x3d000 thru 0x3dfff (0x1000 bytes) to 0x49000 thru 0x49fff 2024-03-28T23:11:40.050 INFO:teuthology.orchestra.run.smithi153.stdout: +6175( 31 mod 256): MAPWRITE 0x71000 thru 0x72ee6 (0x1ee7 bytes) 2024-03-28T23:11:40.050 INFO:teuthology.orchestra.run.smithi153.stdout: +6176( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.050 INFO:teuthology.orchestra.run.smithi153.stdout: +6177( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.050 INFO:teuthology.orchestra.run.smithi153.stdout: +6178( 34 mod 256): PUNCH 0x56af5 thru 0x57a17 (0xf23 bytes) 2024-03-28T23:11:40.050 INFO:teuthology.orchestra.run.smithi153.stdout: +6179( 35 mod 256): MAPREAD 0x16000 thru 0x17556 (0x1557 bytes) 2024-03-28T23:11:40.050 INFO:teuthology.orchestra.run.smithi153.stdout: +6180( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.050 INFO:teuthology.orchestra.run.smithi153.stdout: +6181( 37 mod 256): PUNCH 0x699f1 thru 0x6a120 (0x730 bytes) 2024-03-28T23:11:40.051 INFO:teuthology.orchestra.run.smithi153.stdout: +6182( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.051 INFO:teuthology.orchestra.run.smithi153.stdout: +6183( 39 mod 256): TRUNCATE DOWN from 0x72ee7 to 0x46000 2024-03-28T23:11:40.051 INFO:teuthology.orchestra.run.smithi153.stdout: +6184( 40 mod 256): MAPWRITE 0x17000 thru 0x17317 (0x318 bytes) 2024-03-28T23:11:40.051 INFO:teuthology.orchestra.run.smithi153.stdout: +6185( 41 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.051 INFO:teuthology.orchestra.run.smithi153.stdout: +6186( 42 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.051 INFO:teuthology.orchestra.run.smithi153.stdout: +6187( 43 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.051 INFO:teuthology.orchestra.run.smithi153.stdout: +6188( 44 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.051 INFO:teuthology.orchestra.run.smithi153.stdout: +6189( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.051 INFO:teuthology.orchestra.run.smithi153.stdout: +6190( 46 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.051 INFO:teuthology.orchestra.run.smithi153.stdout: +6191( 47 mod 256): MAPREAD 0x29000 thru 0x29f56 (0xf57 bytes) 2024-03-28T23:11:40.051 INFO:teuthology.orchestra.run.smithi153.stdout: +6192( 48 mod 256): TRUNCATE DOWN from 0x46000 to 0x14000 ******WWWW 2024-03-28T23:11:40.051 INFO:teuthology.orchestra.run.smithi153.stdout: +6193( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.051 INFO:teuthology.orchestra.run.smithi153.stdout: +6194( 50 mod 256): TRUNCATE UP from 0x14000 to 0x46000 ******WWWW 2024-03-28T23:11:40.051 INFO:teuthology.orchestra.run.smithi153.stdout: +6195( 51 mod 256): MAPWRITE 0x18000 thru 0x19f51 (0x1f52 bytes) 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6196( 52 mod 256): READ 0x21000 thru 0x21fff (0x1000 bytes) 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6197( 53 mod 256): PUNCH 0x39c53 thru 0x3a4fb (0x8a9 bytes) 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6198( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6199( 55 mod 256): TRUNCATE UP from 0x46000 to 0x5b000 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6200( 56 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6201( 57 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6202( 58 mod 256): PUNCH 0x4349b thru 0x43d95 (0x8fb bytes) 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6203( 59 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6204( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6205( 61 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6206( 62 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6207( 63 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6208( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6209( 65 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.052 INFO:teuthology.orchestra.run.smithi153.stdout: +6210( 66 mod 256): COPY 0x3f000 thru 0x3ffff (0x1000 bytes) to 0x1d000 thru 0x1dfff 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6211( 67 mod 256): READ 0x2c000 thru 0x2cfff (0x1000 bytes) 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6212( 68 mod 256): TRUNCATE DOWN from 0x5b000 to 0x53000 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6213( 69 mod 256): TRUNCATE DOWN from 0x53000 to 0x51000 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6214( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6215( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6216( 72 mod 256): MAPWRITE 0x79000 thru 0x7994e (0x94f bytes) 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6217( 73 mod 256): WRITE 0x2b000 thru 0x2bfff (0x1000 bytes) 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6218( 74 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6219( 75 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6220( 76 mod 256): MAPREAD 0x41000 thru 0x421de (0x11df bytes) 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6221( 77 mod 256): MAPREAD 0x2000 thru 0x3d8b (0x1d8c bytes) 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6222( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6223( 79 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6224( 80 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.053 INFO:teuthology.orchestra.run.smithi153.stdout: +6225( 81 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.054 INFO:teuthology.orchestra.run.smithi153.stdout: +6226( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.054 INFO:teuthology.orchestra.run.smithi153.stdout: +6227( 83 mod 256): PUNCH 0x49834 thru 0x4b03e (0x180b bytes) 2024-03-28T23:11:40.054 INFO:teuthology.orchestra.run.smithi153.stdout: +6228( 84 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.054 INFO:teuthology.orchestra.run.smithi153.stdout: +6229( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.054 INFO:teuthology.orchestra.run.smithi153.stdout: +6230( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.054 INFO:teuthology.orchestra.run.smithi153.stdout: +6231( 87 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.054 INFO:teuthology.orchestra.run.smithi153.stdout: +6232( 88 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.054 INFO:teuthology.orchestra.run.smithi153.stdout: +6233( 89 mod 256): MAPREAD 0xf000 thru 0xfa46 (0xa47 bytes) 2024-03-28T23:11:40.054 INFO:teuthology.orchestra.run.smithi153.stdout: +6234( 90 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x6c000 thru 0x6cfff 2024-03-28T23:11:40.054 INFO:teuthology.orchestra.run.smithi153.stdout: +6235( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.054 INFO:teuthology.orchestra.run.smithi153.stdout: +6236( 92 mod 256): READ 0x27000 thru 0x27fff (0x1000 bytes) 2024-03-28T23:11:40.054 INFO:teuthology.orchestra.run.smithi153.stdout: +6237( 93 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.054 INFO:teuthology.orchestra.run.smithi153.stdout: +6238( 94 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.054 INFO:teuthology.orchestra.run.smithi153.stdout: +6239( 95 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6240( 96 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6241( 97 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6242( 98 mod 256): MAPREAD 0x3f000 thru 0x4009f (0x10a0 bytes) 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6243( 99 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6244(100 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6245(101 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6246(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6247(103 mod 256): TRUNCATE DOWN from 0x7994f to 0x23000 ******WWWW 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6248(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6249(105 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6250(106 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6251(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6252(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6253(109 mod 256): MAPWRITE 0x1e000 thru 0x1f7a1 (0x17a2 bytes) 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6254(110 mod 256): TRUNCATE UP from 0x23000 to 0x79000 ******WWWW 2024-03-28T23:11:40.055 INFO:teuthology.orchestra.run.smithi153.stdout: +6255(111 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.056 INFO:teuthology.orchestra.run.smithi153.stdout: +6256(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.056 INFO:teuthology.orchestra.run.smithi153.stdout: +6257(113 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.056 INFO:teuthology.orchestra.run.smithi153.stdout: +6258(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.056 INFO:teuthology.orchestra.run.smithi153.stdout: +6259(115 mod 256): PUNCH 0x26a0c thru 0x27018 (0x60d bytes) 2024-03-28T23:11:40.056 INFO:teuthology.orchestra.run.smithi153.stdout: +6260(116 mod 256): READ 0x22000 thru 0x22fff (0x1000 bytes) 2024-03-28T23:11:40.056 INFO:teuthology.orchestra.run.smithi153.stdout: +6261(117 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.056 INFO:teuthology.orchestra.run.smithi153.stdout: +6262(118 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.056 INFO:teuthology.orchestra.run.smithi153.stdout: +6263(119 mod 256): READ 0x6c000 thru 0x6cfff (0x1000 bytes) 2024-03-28T23:11:40.056 INFO:teuthology.orchestra.run.smithi153.stdout: +6264(120 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.056 INFO:teuthology.orchestra.run.smithi153.stdout: +6265(121 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.056 INFO:teuthology.orchestra.run.smithi153.stdout: +6266(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.056 INFO:teuthology.orchestra.run.smithi153.stdout: +6267(123 mod 256): PUNCH 0x469a2 thru 0x474a5 (0xb04 bytes) 2024-03-28T23:11:40.056 INFO:teuthology.orchestra.run.smithi153.stdout: +6268(124 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6269(125 mod 256): MAPREAD 0x20000 thru 0x21cd5 (0x1cd6 bytes) 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6270(126 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6271(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6272(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6273(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6274(130 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6275(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6276(132 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6277(133 mod 256): READ 0x71000 thru 0x71fff (0x1000 bytes) 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6278(134 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6279(135 mod 256): READ 0x67000 thru 0x67fff (0x1000 bytes) 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6280(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6281(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6282(138 mod 256): TRUNCATE DOWN from 0x79000 to 0x23000 ******WWWW 2024-03-28T23:11:40.057 INFO:teuthology.orchestra.run.smithi153.stdout: +6283(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.058 INFO:teuthology.orchestra.run.smithi153.stdout: +6284(140 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.058 INFO:teuthology.orchestra.run.smithi153.stdout: +6285(141 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.058 INFO:teuthology.orchestra.run.smithi153.stdout: +6286(142 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.058 INFO:teuthology.orchestra.run.smithi153.stdout: +6287(143 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.058 INFO:teuthology.orchestra.run.smithi153.stdout: +6288(144 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.058 INFO:teuthology.orchestra.run.smithi153.stdout: +6289(145 mod 256): MAPWRITE 0x45000 thru 0x46ff7 (0x1ff8 bytes) 2024-03-28T23:11:40.058 INFO:teuthology.orchestra.run.smithi153.stdout: +6290(146 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.058 INFO:teuthology.orchestra.run.smithi153.stdout: +6291(147 mod 256): TRUNCATE UP from 0x46ff8 to 0x77000 2024-03-28T23:11:40.058 INFO:teuthology.orchestra.run.smithi153.stdout: +6292(148 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.058 INFO:teuthology.orchestra.run.smithi153.stdout: +6293(149 mod 256): TRUNCATE DOWN from 0x77000 to 0x26000 ******WWWW 2024-03-28T23:11:40.058 INFO:teuthology.orchestra.run.smithi153.stdout: +6294(150 mod 256): PUNCH 0x25cbb thru 0x25fff (0x345 bytes) 2024-03-28T23:11:40.058 INFO:teuthology.orchestra.run.smithi153.stdout: +6295(151 mod 256): TRUNCATE DOWN from 0x26000 to 0x1d000 2024-03-28T23:11:40.058 INFO:teuthology.orchestra.run.smithi153.stdout: +6296(152 mod 256): TRUNCATE UP from 0x1d000 to 0x5d000 ******WWWW 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6297(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6298(154 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6299(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6300(156 mod 256): READ 0x2e000 thru 0x2efff (0x1000 bytes) 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6301(157 mod 256): WRITE 0x55000 thru 0x55fff (0x1000 bytes) 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6302(158 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6303(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6304(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6305(161 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6306(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6307(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6308(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6309(165 mod 256): MAPWRITE 0x26000 thru 0x26c9f (0xca0 bytes) 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6310(166 mod 256): COPY 0x28000 thru 0x28fff (0x1000 bytes) to 0x9000 thru 0x9fff 2024-03-28T23:11:40.059 INFO:teuthology.orchestra.run.smithi153.stdout: +6311(167 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6312(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6313(169 mod 256): TRUNCATE UP from 0x5d000 to 0x79000 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6314(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6315(171 mod 256): MAPWRITE 0x17000 thru 0x17fb1 (0xfb2 bytes) 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6316(172 mod 256): PUNCH 0x38491 thru 0x38e4f (0x9bf bytes) 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6317(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6318(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6319(175 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6320(176 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6321(177 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6322(178 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6323(179 mod 256): TRUNCATE DOWN from 0x79000 to 0x28000 ******WWWW 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6324(180 mod 256): MAPREAD 0x10000 thru 0x1073b (0x73c bytes) 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6325(181 mod 256): WRITE 0x3e000 thru 0x3efff (0x1000 bytes) HOLE ***WWWW 2024-03-28T23:11:40.060 INFO:teuthology.orchestra.run.smithi153.stdout: +6326(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6327(183 mod 256): MAPWRITE 0x54000 thru 0x55afe (0x1aff bytes) 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6328(184 mod 256): TRUNCATE DOWN from 0x55aff to 0x2b000 ******WWWW 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6329(185 mod 256): COPY 0x4000 thru 0x4fff (0x1000 bytes) to 0x46000 thru 0x46fff 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6330(186 mod 256): TRUNCATE DOWN from 0x47000 to 0x33000 ******WWWW 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6331(187 mod 256): WRITE 0x1000 thru 0x1fff (0x1000 bytes) 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6332(188 mod 256): MAPWRITE 0x71000 thru 0x72d2d (0x1d2e bytes) 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6333(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6334(190 mod 256): MAPREAD 0xb000 thru 0xceda (0x1edb bytes) 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6335(191 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6336(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6337(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6338(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6339(195 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6340(196 mod 256): READ 0x50000 thru 0x50fff (0x1000 bytes) 2024-03-28T23:11:40.061 INFO:teuthology.orchestra.run.smithi153.stdout: +6341(197 mod 256): PUNCH 0x10f45 thru 0x122c8 (0x1384 bytes) 2024-03-28T23:11:40.062 INFO:teuthology.orchestra.run.smithi153.stdout: +6342(198 mod 256): COPY 0x25000 thru 0x25fff (0x1000 bytes) to 0x4f000 thru 0x4ffff 2024-03-28T23:11:40.062 INFO:teuthology.orchestra.run.smithi153.stdout: +6343(199 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.062 INFO:teuthology.orchestra.run.smithi153.stdout: +6344(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.062 INFO:teuthology.orchestra.run.smithi153.stdout: +6345(201 mod 256): MAPWRITE 0x4d000 thru 0x4da71 (0xa72 bytes) 2024-03-28T23:11:40.062 INFO:teuthology.orchestra.run.smithi153.stdout: +6346(202 mod 256): TRUNCATE DOWN from 0x72d2e to 0x14000 ******WWWW 2024-03-28T23:11:40.062 INFO:teuthology.orchestra.run.smithi153.stdout: +6347(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.062 INFO:teuthology.orchestra.run.smithi153.stdout: +6348(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.062 INFO:teuthology.orchestra.run.smithi153.stdout: +6349(205 mod 256): MAPREAD 0xc000 thru 0xc59f (0x5a0 bytes) 2024-03-28T23:11:40.062 INFO:teuthology.orchestra.run.smithi153.stdout: +6350(206 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.062 INFO:teuthology.orchestra.run.smithi153.stdout: +6351(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.062 INFO:teuthology.orchestra.run.smithi153.stdout: +6352(208 mod 256): WRITE 0x24000 thru 0x24fff (0x1000 bytes) HOLE 2024-03-28T23:11:40.062 INFO:teuthology.orchestra.run.smithi153.stdout: +6353(209 mod 256): WRITE 0x1f000 thru 0x1ffff (0x1000 bytes) 2024-03-28T23:11:40.062 INFO:teuthology.orchestra.run.smithi153.stdout: +6354(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.062 INFO:teuthology.orchestra.run.smithi153.stdout: +6355(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.063 INFO:teuthology.orchestra.run.smithi153.stdout: +6356(212 mod 256): TRUNCATE UP from 0x25000 to 0x67000 ******WWWW 2024-03-28T23:11:40.063 INFO:teuthology.orchestra.run.smithi153.stdout: +6357(213 mod 256): PUNCH 0x242d thru 0x2eea (0xabe bytes) 2024-03-28T23:11:40.063 INFO:teuthology.orchestra.run.smithi153.stdout: +6358(214 mod 256): MAPWRITE 0x8000 thru 0x82e6 (0x2e7 bytes) 2024-03-28T23:11:40.063 INFO:teuthology.orchestra.run.smithi153.stdout: +6359(215 mod 256): PUNCH 0x35c40 thru 0x36ba7 (0xf68 bytes) 2024-03-28T23:11:40.063 INFO:teuthology.orchestra.run.smithi153.stdout: +6360(216 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.063 INFO:teuthology.orchestra.run.smithi153.stdout: +6361(217 mod 256): MAPREAD 0x21000 thru 0x222cb (0x12cc bytes) 2024-03-28T23:11:40.063 INFO:teuthology.orchestra.run.smithi153.stdout: +6362(218 mod 256): MAPWRITE 0x7000 thru 0x80e5 (0x10e6 bytes) 2024-03-28T23:11:40.063 INFO:teuthology.orchestra.run.smithi153.stdout: +6363(219 mod 256): TRUNCATE DOWN from 0x67000 to 0x5f000 2024-03-28T23:11:40.063 INFO:teuthology.orchestra.run.smithi153.stdout: +6364(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.063 INFO:teuthology.orchestra.run.smithi153.stdout: +6365(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.063 INFO:teuthology.orchestra.run.smithi153.stdout: +6366(222 mod 256): MAPREAD 0x59000 thru 0x59628 (0x629 bytes) 2024-03-28T23:11:40.063 INFO:teuthology.orchestra.run.smithi153.stdout: +6367(223 mod 256): MAPREAD 0x8000 thru 0x87ad (0x7ae bytes) 2024-03-28T23:11:40.063 INFO:teuthology.orchestra.run.smithi153.stdout: +6368(224 mod 256): PUNCH 0x2d0d7 thru 0x2da54 (0x97e bytes) 2024-03-28T23:11:40.063 INFO:teuthology.orchestra.run.smithi153.stdout: +6369(225 mod 256): MAPWRITE 0x16000 thru 0x17ac0 (0x1ac1 bytes) 2024-03-28T23:11:40.064 INFO:teuthology.orchestra.run.smithi153.stdout: +6370(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.064 INFO:teuthology.orchestra.run.smithi153.stdout: +6371(227 mod 256): COPY 0x2a000 thru 0x2afff (0x1000 bytes) to 0x7000 thru 0x7fff 2024-03-28T23:11:40.064 INFO:teuthology.orchestra.run.smithi153.stdout: +6372(228 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.064 INFO:teuthology.orchestra.run.smithi153.stdout: +6373(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.064 INFO:teuthology.orchestra.run.smithi153.stdout: +6374(230 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.064 INFO:teuthology.orchestra.run.smithi153.stdout: +6375(231 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.064 INFO:teuthology.orchestra.run.smithi153.stdout: +6376(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.064 INFO:teuthology.orchestra.run.smithi153.stdout: +6377(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.064 INFO:teuthology.orchestra.run.smithi153.stdout: +6378(234 mod 256): TRUNCATE DOWN from 0x5f000 to 0x3e000 2024-03-28T23:11:40.064 INFO:teuthology.orchestra.run.smithi153.stdout: +6379(235 mod 256): MAPWRITE 0x66000 thru 0x67b5f (0x1b60 bytes) 2024-03-28T23:11:40.064 INFO:teuthology.orchestra.run.smithi153.stdout: +6380(236 mod 256): PUNCH 0x2602f thru 0x27efb (0x1ecd bytes) 2024-03-28T23:11:40.064 INFO:teuthology.orchestra.run.smithi153.stdout: +6381(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.064 INFO:teuthology.orchestra.run.smithi153.stdout: +6382(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.064 INFO:teuthology.orchestra.run.smithi153.stdout: +6383(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.065 INFO:teuthology.orchestra.run.smithi153.stdout: +6384(240 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.065 INFO:teuthology.orchestra.run.smithi153.stdout: +6385(241 mod 256): PUNCH 0x1a7ea thru 0x1a8b4 (0xcb bytes) 2024-03-28T23:11:40.065 INFO:teuthology.orchestra.run.smithi153.stdout: +6386(242 mod 256): WRITE 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-28T23:11:40.065 INFO:teuthology.orchestra.run.smithi153.stdout: +6387(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.065 INFO:teuthology.orchestra.run.smithi153.stdout: +6388(244 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.065 INFO:teuthology.orchestra.run.smithi153.stdout: +6389(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.065 INFO:teuthology.orchestra.run.smithi153.stdout: +6390(246 mod 256): MAPREAD 0x2e000 thru 0x2ec4f (0xc50 bytes) 2024-03-28T23:11:40.065 INFO:teuthology.orchestra.run.smithi153.stdout: +6391(247 mod 256): TRUNCATE DOWN from 0x67b60 to 0x53000 2024-03-28T23:11:40.065 INFO:teuthology.orchestra.run.smithi153.stdout: +6392(248 mod 256): TRUNCATE DOWN from 0x53000 to 0x4f000 2024-03-28T23:11:40.065 INFO:teuthology.orchestra.run.smithi153.stdout: +6393(249 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.065 INFO:teuthology.orchestra.run.smithi153.stdout: +6394(250 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.065 INFO:teuthology.orchestra.run.smithi153.stdout: +6395(251 mod 256): PUNCH 0xa535 thru 0xb5a1 (0x106d bytes) 2024-03-28T23:11:40.065 INFO:teuthology.orchestra.run.smithi153.stdout: +6396(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.065 INFO:teuthology.orchestra.run.smithi153.stdout: +6397(253 mod 256): TRUNCATE DOWN from 0x4f000 to 0x22000 ******WWWW 2024-03-28T23:11:40.066 INFO:teuthology.orchestra.run.smithi153.stdout: +6398(254 mod 256): PUNCH 0x4f05 thru 0x4f11 (0xd bytes) 2024-03-28T23:11:40.066 INFO:teuthology.orchestra.run.smithi153.stdout: +6399(255 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.066 INFO:teuthology.orchestra.run.smithi153.stdout: +6400( 0 mod 256): COPY 0x6000 thru 0x6fff (0x1000 bytes) to 0x40000 thru 0x40fff 2024-03-28T23:11:40.066 INFO:teuthology.orchestra.run.smithi153.stdout: +6401( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.066 INFO:teuthology.orchestra.run.smithi153.stdout: +6402( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.066 INFO:teuthology.orchestra.run.smithi153.stdout: +6403( 3 mod 256): COPY 0x2e000 thru 0x2efff (0x1000 bytes) to 0x4c000 thru 0x4cfff 2024-03-28T23:11:40.066 INFO:teuthology.orchestra.run.smithi153.stdout: +6404( 4 mod 256): MAPREAD 0x2d000 thru 0x2e05f (0x1060 bytes) 2024-03-28T23:11:40.066 INFO:teuthology.orchestra.run.smithi153.stdout: +6405( 5 mod 256): TRUNCATE UP from 0x4d000 to 0x75000 2024-03-28T23:11:40.066 INFO:teuthology.orchestra.run.smithi153.stdout: +6406( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.066 INFO:teuthology.orchestra.run.smithi153.stdout: +6407( 7 mod 256): MAPWRITE 0x12000 thru 0x12a80 (0xa81 bytes) 2024-03-28T23:11:40.066 INFO:teuthology.orchestra.run.smithi153.stdout: +6408( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.066 INFO:teuthology.orchestra.run.smithi153.stdout: +6409( 9 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.066 INFO:teuthology.orchestra.run.smithi153.stdout: +6410( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.066 INFO:teuthology.orchestra.run.smithi153.stdout: +6411( 11 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6412( 12 mod 256): PUNCH 0x49c6c thru 0x4afff (0x1394 bytes) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6413( 13 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6414( 14 mod 256): WRITE 0x74000 thru 0x74fff (0x1000 bytes) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6415( 15 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6416( 16 mod 256): WRITE 0x39000 thru 0x39fff (0x1000 bytes) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6417( 17 mod 256): PUNCH 0xf5ac thru 0x10eb5 (0x190a bytes) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6418( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6419( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6420( 20 mod 256): MAPWRITE 0x56000 thru 0x57025 (0x1026 bytes) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6421( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6422( 22 mod 256): MAPREAD 0x3d000 thru 0x3df5d (0xf5e bytes) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6423( 23 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6424( 24 mod 256): MAPREAD 0x12000 thru 0x13795 (0x1796 bytes) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6425( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6426( 26 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.067 INFO:teuthology.orchestra.run.smithi153.stdout: +6427( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.068 INFO:teuthology.orchestra.run.smithi153.stdout: +6428( 28 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.068 INFO:teuthology.orchestra.run.smithi153.stdout: +6429( 29 mod 256): PUNCH 0x4b103 thru 0x4b9c4 (0x8c2 bytes) 2024-03-28T23:11:40.068 INFO:teuthology.orchestra.run.smithi153.stdout: +6430( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.068 INFO:teuthology.orchestra.run.smithi153.stdout: +6431( 31 mod 256): PUNCH 0x5870 thru 0x6ec0 (0x1651 bytes) 2024-03-28T23:11:40.068 INFO:teuthology.orchestra.run.smithi153.stdout: +6432( 32 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.068 INFO:teuthology.orchestra.run.smithi153.stdout: +6433( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.068 INFO:teuthology.orchestra.run.smithi153.stdout: +6434( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.068 INFO:teuthology.orchestra.run.smithi153.stdout: +6435( 35 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.068 INFO:teuthology.orchestra.run.smithi153.stdout: +6436( 36 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.068 INFO:teuthology.orchestra.run.smithi153.stdout: +6437( 37 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.068 INFO:teuthology.orchestra.run.smithi153.stdout: +6438( 38 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.068 INFO:teuthology.orchestra.run.smithi153.stdout: +6439( 39 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.068 INFO:teuthology.orchestra.run.smithi153.stdout: +6440( 40 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.068 INFO:teuthology.orchestra.run.smithi153.stdout: +6441( 41 mod 256): MAPREAD 0x74000 thru 0x74b9d (0xb9e bytes) 2024-03-28T23:11:40.069 INFO:teuthology.orchestra.run.smithi153.stdout: +6442( 42 mod 256): WRITE 0x9000 thru 0x9fff (0x1000 bytes) 2024-03-28T23:11:40.069 INFO:teuthology.orchestra.run.smithi153.stdout: +6443( 43 mod 256): PUNCH 0x669eb thru 0x67140 (0x756 bytes) 2024-03-28T23:11:40.069 INFO:teuthology.orchestra.run.smithi153.stdout: +6444( 44 mod 256): COPY 0x1a000 thru 0x1afff (0x1000 bytes) to 0x19000 thru 0x19fff 2024-03-28T23:11:40.069 INFO:teuthology.orchestra.run.smithi153.stdout: +6445( 45 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.069 INFO:teuthology.orchestra.run.smithi153.stdout: +6446( 46 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.069 INFO:teuthology.orchestra.run.smithi153.stdout: +6447( 47 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.069 INFO:teuthology.orchestra.run.smithi153.stdout: +6448( 48 mod 256): TRUNCATE DOWN from 0x75000 to 0x1e000 ******WWWW 2024-03-28T23:11:40.069 INFO:teuthology.orchestra.run.smithi153.stdout: +6449( 49 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.069 INFO:teuthology.orchestra.run.smithi153.stdout: +6450( 50 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.069 INFO:teuthology.orchestra.run.smithi153.stdout: +6451( 51 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.069 INFO:teuthology.orchestra.run.smithi153.stdout: +6452( 52 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.069 INFO:teuthology.orchestra.run.smithi153.stdout: +6453( 53 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.069 INFO:teuthology.orchestra.run.smithi153.stdout: +6454( 54 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.069 INFO:teuthology.orchestra.run.smithi153.stdout: +6455( 55 mod 256): PUNCH 0x57b thru 0x1106 (0xb8c bytes) 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6456( 56 mod 256): COPY 0x2000 thru 0x2fff (0x1000 bytes) to 0xb000 thru 0xbfff 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6457( 57 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6458( 58 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6459( 59 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6460( 60 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6461( 61 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6462( 62 mod 256): MAPWRITE 0x30000 thru 0x30129 (0x12a bytes) 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6463( 63 mod 256): PUNCH 0x2c99 thru 0x2fdc (0x344 bytes) 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6464( 64 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6465( 65 mod 256): MAPWRITE 0x2e000 thru 0x2ee78 (0xe79 bytes) 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6466( 66 mod 256): TRUNCATE DOWN from 0x3012a to 0x6000 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6467( 67 mod 256): COPY 0x3000 thru 0x3fff (0x1000 bytes) to 0x47000 thru 0x47fff 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6468( 68 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6469( 69 mod 256): MAPWRITE 0x20000 thru 0x2020c (0x20d bytes) 2024-03-28T23:11:40.070 INFO:teuthology.orchestra.run.smithi153.stdout: +6470( 70 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.071 INFO:teuthology.orchestra.run.smithi153.stdout: +6471( 71 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.071 INFO:teuthology.orchestra.run.smithi153.stdout: +6472( 72 mod 256): READ 0x6000 thru 0x6fff (0x1000 bytes) 2024-03-28T23:11:40.071 INFO:teuthology.orchestra.run.smithi153.stdout: +6473( 73 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.071 INFO:teuthology.orchestra.run.smithi153.stdout: +6474( 74 mod 256): MAPWRITE 0x69000 thru 0x695ec (0x5ed bytes) 2024-03-28T23:11:40.071 INFO:teuthology.orchestra.run.smithi153.stdout: +6475( 75 mod 256): MAPWRITE 0x70000 thru 0x70f13 (0xf14 bytes) 2024-03-28T23:11:40.071 INFO:teuthology.orchestra.run.smithi153.stdout: +6476( 76 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.071 INFO:teuthology.orchestra.run.smithi153.stdout: +6477( 77 mod 256): COPY 0x3c000 thru 0x3cfff (0x1000 bytes) to 0x4a000 thru 0x4afff 2024-03-28T23:11:40.071 INFO:teuthology.orchestra.run.smithi153.stdout: +6478( 78 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.071 INFO:teuthology.orchestra.run.smithi153.stdout: +6479( 79 mod 256): COPY 0x4000 thru 0x4fff (0x1000 bytes) to 0x77000 thru 0x77fff 2024-03-28T23:11:40.071 INFO:teuthology.orchestra.run.smithi153.stdout: +6480( 80 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.071 INFO:teuthology.orchestra.run.smithi153.stdout: +6481( 81 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.071 INFO:teuthology.orchestra.run.smithi153.stdout: +6482( 82 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.071 INFO:teuthology.orchestra.run.smithi153.stdout: +6483( 83 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.071 INFO:teuthology.orchestra.run.smithi153.stdout: +6484( 84 mod 256): PUNCH 0xd34b thru 0xef88 (0x1c3e bytes) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6485( 85 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6486( 86 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6487( 87 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6488( 88 mod 256): PUNCH 0x3bb65 thru 0x3d59f (0x1a3b bytes) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6489( 89 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6490( 90 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6491( 91 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6492( 92 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6493( 93 mod 256): WRITE 0x35000 thru 0x35fff (0x1000 bytes) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6494( 94 mod 256): READ 0x68000 thru 0x68fff (0x1000 bytes) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6495( 95 mod 256): PUNCH 0x17f05 thru 0x19e3e (0x1f3a bytes) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6496( 96 mod 256): MAPWRITE 0x2000 thru 0x30d4 (0x10d5 bytes) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6497( 97 mod 256): MAPREAD 0x20000 thru 0x211a5 (0x11a6 bytes) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6498( 98 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.072 INFO:teuthology.orchestra.run.smithi153.stdout: +6499( 99 mod 256): MAPWRITE 0x66000 thru 0x67745 (0x1746 bytes) 2024-03-28T23:11:40.073 INFO:teuthology.orchestra.run.smithi153.stdout: +6500(100 mod 256): MAPREAD 0x64000 thru 0x643cc (0x3cd bytes) 2024-03-28T23:11:40.073 INFO:teuthology.orchestra.run.smithi153.stdout: +6501(101 mod 256): MAPREAD 0x34000 thru 0x35b1a (0x1b1b bytes) 2024-03-28T23:11:40.073 INFO:teuthology.orchestra.run.smithi153.stdout: +6502(102 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.073 INFO:teuthology.orchestra.run.smithi153.stdout: +6503(103 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.073 INFO:teuthology.orchestra.run.smithi153.stdout: +6504(104 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.073 INFO:teuthology.orchestra.run.smithi153.stdout: +6505(105 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.073 INFO:teuthology.orchestra.run.smithi153.stdout: +6506(106 mod 256): PUNCH 0x643c7 thru 0x6503d (0xc77 bytes) 2024-03-28T23:11:40.073 INFO:teuthology.orchestra.run.smithi153.stdout: +6507(107 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.073 INFO:teuthology.orchestra.run.smithi153.stdout: +6508(108 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.073 INFO:teuthology.orchestra.run.smithi153.stdout: +6509(109 mod 256): MAPREAD 0x2f000 thru 0x30bec (0x1bed bytes) 2024-03-28T23:11:40.073 INFO:teuthology.orchestra.run.smithi153.stdout: +6510(110 mod 256): MAPWRITE 0x27000 thru 0x27b7e (0xb7f bytes) 2024-03-28T23:11:40.073 INFO:teuthology.orchestra.run.smithi153.stdout: +6511(111 mod 256): MAPWRITE 0x53000 thru 0x53c57 (0xc58 bytes) 2024-03-28T23:11:40.073 INFO:teuthology.orchestra.run.smithi153.stdout: +6512(112 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.073 INFO:teuthology.orchestra.run.smithi153.stdout: +6513(113 mod 256): TRUNCATE DOWN from 0x78000 to 0x52000 2024-03-28T23:11:40.074 INFO:teuthology.orchestra.run.smithi153.stdout: +6514(114 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.074 INFO:teuthology.orchestra.run.smithi153.stdout: +6515(115 mod 256): MAPWRITE 0x8000 thru 0x9809 (0x180a bytes) 2024-03-28T23:11:40.074 INFO:teuthology.orchestra.run.smithi153.stdout: +6516(116 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.074 INFO:teuthology.orchestra.run.smithi153.stdout: +6517(117 mod 256): PUNCH 0x1d4d6 thru 0x1edae (0x18d9 bytes) 2024-03-28T23:11:40.074 INFO:teuthology.orchestra.run.smithi153.stdout: +6518(118 mod 256): PUNCH 0x27dcc thru 0x296f7 (0x192c bytes) 2024-03-28T23:11:40.074 INFO:teuthology.orchestra.run.smithi153.stdout: +6519(119 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.074 INFO:teuthology.orchestra.run.smithi153.stdout: +6520(120 mod 256): MAPREAD 0x31000 thru 0x3154c (0x54d bytes) 2024-03-28T23:11:40.074 INFO:teuthology.orchestra.run.smithi153.stdout: +6521(121 mod 256): MAPWRITE 0x24000 thru 0x2461d (0x61e bytes) 2024-03-28T23:11:40.074 INFO:teuthology.orchestra.run.smithi153.stdout: +6522(122 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.074 INFO:teuthology.orchestra.run.smithi153.stdout: +6523(123 mod 256): PUNCH 0x4e262 thru 0x4eded (0xb8c bytes) 2024-03-28T23:11:40.074 INFO:teuthology.orchestra.run.smithi153.stdout: +6524(124 mod 256): TRUNCATE UP from 0x52000 to 0x55000 2024-03-28T23:11:40.074 INFO:teuthology.orchestra.run.smithi153.stdout: +6525(125 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.074 INFO:teuthology.orchestra.run.smithi153.stdout: +6526(126 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.074 INFO:teuthology.orchestra.run.smithi153.stdout: +6527(127 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.075 INFO:teuthology.orchestra.run.smithi153.stdout: +6528(128 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.075 INFO:teuthology.orchestra.run.smithi153.stdout: +6529(129 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.075 INFO:teuthology.orchestra.run.smithi153.stdout: +6530(130 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.075 INFO:teuthology.orchestra.run.smithi153.stdout: +6531(131 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.075 INFO:teuthology.orchestra.run.smithi153.stdout: +6532(132 mod 256): COPY 0x24000 thru 0x24fff (0x1000 bytes) to 0x5b000 thru 0x5bfff 2024-03-28T23:11:40.075 INFO:teuthology.orchestra.run.smithi153.stdout: +6533(133 mod 256): PUNCH 0x49239 thru 0x4a75f (0x1527 bytes) 2024-03-28T23:11:40.075 INFO:teuthology.orchestra.run.smithi153.stdout: +6534(134 mod 256): MAPREAD 0x4000 thru 0x5214 (0x1215 bytes) 2024-03-28T23:11:40.075 INFO:teuthology.orchestra.run.smithi153.stdout: +6535(135 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.075 INFO:teuthology.orchestra.run.smithi153.stdout: +6536(136 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.075 INFO:teuthology.orchestra.run.smithi153.stdout: +6537(137 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.075 INFO:teuthology.orchestra.run.smithi153.stdout: +6538(138 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.075 INFO:teuthology.orchestra.run.smithi153.stdout: +6539(139 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.075 INFO:teuthology.orchestra.run.smithi153.stdout: +6540(140 mod 256): READ 0x29000 thru 0x29fff (0x1000 bytes) 2024-03-28T23:11:40.075 INFO:teuthology.orchestra.run.smithi153.stdout: +6541(141 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.076 INFO:teuthology.orchestra.run.smithi153.stdout: +6542(142 mod 256): MAPREAD 0x1e000 thru 0x1e7b4 (0x7b5 bytes) 2024-03-28T23:11:40.076 INFO:teuthology.orchestra.run.smithi153.stdout: +6543(143 mod 256): WRITE 0x3f000 thru 0x3ffff (0x1000 bytes) 2024-03-28T23:11:40.076 INFO:teuthology.orchestra.run.smithi153.stdout: +6544(144 mod 256): TRUNCATE UP from 0x5c000 to 0x6e000 2024-03-28T23:11:40.076 INFO:teuthology.orchestra.run.smithi153.stdout: +6545(145 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.076 INFO:teuthology.orchestra.run.smithi153.stdout: +6546(146 mod 256): WRITE 0x70000 thru 0x70fff (0x1000 bytes) HOLE 2024-03-28T23:11:40.076 INFO:teuthology.orchestra.run.smithi153.stdout: +6547(147 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.076 INFO:teuthology.orchestra.run.smithi153.stdout: +6548(148 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.076 INFO:teuthology.orchestra.run.smithi153.stdout: +6549(149 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.076 INFO:teuthology.orchestra.run.smithi153.stdout: +6550(150 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.076 INFO:teuthology.orchestra.run.smithi153.stdout: +6551(151 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.076 INFO:teuthology.orchestra.run.smithi153.stdout: +6552(152 mod 256): PUNCH 0x2937 thru 0x3214 (0x8de bytes) 2024-03-28T23:11:40.076 INFO:teuthology.orchestra.run.smithi153.stdout: +6553(153 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.076 INFO:teuthology.orchestra.run.smithi153.stdout: +6554(154 mod 256): PUNCH 0x22a1b thru 0x23fa5 (0x158b bytes) 2024-03-28T23:11:40.076 INFO:teuthology.orchestra.run.smithi153.stdout: +6555(155 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6556(156 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6557(157 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6558(158 mod 256): MAPWRITE 0x8000 thru 0x916b (0x116c bytes) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6559(159 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6560(160 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6561(161 mod 256): PUNCH 0x259ec thru 0x278e6 (0x1efb bytes) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6562(162 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6563(163 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6564(164 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6565(165 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6566(166 mod 256): MAPWRITE 0x44000 thru 0x44834 (0x835 bytes) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6567(167 mod 256): MAPWRITE 0x20000 thru 0x21e04 (0x1e05 bytes) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6568(168 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6569(169 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6570(170 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.077 INFO:teuthology.orchestra.run.smithi153.stdout: +6571(171 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.078 INFO:teuthology.orchestra.run.smithi153.stdout: +6572(172 mod 256): MAPWRITE 0x71000 thru 0x712fe (0x2ff bytes) 2024-03-28T23:11:40.078 INFO:teuthology.orchestra.run.smithi153.stdout: +6573(173 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.078 INFO:teuthology.orchestra.run.smithi153.stdout: +6574(174 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.078 INFO:teuthology.orchestra.run.smithi153.stdout: +6575(175 mod 256): TRUNCATE DOWN from 0x712ff to 0x38000 2024-03-28T23:11:40.078 INFO:teuthology.orchestra.run.smithi153.stdout: +6576(176 mod 256): PUNCH 0x2739a thru 0x27cb8 (0x91f bytes) 2024-03-28T23:11:40.078 INFO:teuthology.orchestra.run.smithi153.stdout: +6577(177 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.078 INFO:teuthology.orchestra.run.smithi153.stdout: +6578(178 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.078 INFO:teuthology.orchestra.run.smithi153.stdout: +6579(179 mod 256): TRUNCATE UP from 0x38000 to 0x58000 2024-03-28T23:11:40.078 INFO:teuthology.orchestra.run.smithi153.stdout: +6580(180 mod 256): MAPREAD 0x1000 thru 0x1d51 (0xd52 bytes) 2024-03-28T23:11:40.078 INFO:teuthology.orchestra.run.smithi153.stdout: +6581(181 mod 256): MAPREAD 0x38000 thru 0x39ba1 (0x1ba2 bytes) 2024-03-28T23:11:40.078 INFO:teuthology.orchestra.run.smithi153.stdout: +6582(182 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.078 INFO:teuthology.orchestra.run.smithi153.stdout: +6583(183 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.078 INFO:teuthology.orchestra.run.smithi153.stdout: +6584(184 mod 256): WRITE 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-03-28T23:11:40.078 INFO:teuthology.orchestra.run.smithi153.stdout: +6585(185 mod 256): WRITE 0x1d000 thru 0x1dfff (0x1000 bytes) 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6586(186 mod 256): MAPREAD 0x2c000 thru 0x2d7f5 (0x17f6 bytes) 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6587(187 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6588(188 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6589(189 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6590(190 mod 256): TRUNCATE UP from 0x58000 to 0x75000 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6591(191 mod 256): TRUNCATE DOWN from 0x75000 to 0x18000 ******WWWW 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6592(192 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6593(193 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6594(194 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6595(195 mod 256): COPY 0xd000 thru 0xdfff (0x1000 bytes) to 0x46000 thru 0x46fff 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6596(196 mod 256): PUNCH 0x3a94a thru 0x3c54f (0x1c06 bytes) 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6597(197 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6598(198 mod 256): WRITE 0x37000 thru 0x37fff (0x1000 bytes) ***WWWW 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6599(199 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.079 INFO:teuthology.orchestra.run.smithi153.stdout: +6600(200 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6601(201 mod 256): READ 0x2a000 thru 0x2afff (0x1000 bytes) 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6602(202 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6603(203 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6604(204 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6605(205 mod 256): COPY 0x1000 thru 0x1fff (0x1000 bytes) to 0x33000 thru 0x33fff 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6606(206 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6607(207 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6608(208 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6609(209 mod 256): MAPREAD 0xc000 thru 0xd404 (0x1405 bytes) 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6610(210 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6611(211 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6612(212 mod 256): WRITE 0x15000 thru 0x15fff (0x1000 bytes) 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6613(213 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6614(214 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.080 INFO:teuthology.orchestra.run.smithi153.stdout: +6615(215 mod 256): WRITE 0x25000 thru 0x25fff (0x1000 bytes) 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6616(216 mod 256): PUNCH 0x19d2f thru 0x1afeb (0x12bd bytes) 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6617(217 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6618(218 mod 256): READ 0x34000 thru 0x34fff (0x1000 bytes) 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6619(219 mod 256): MAPREAD 0xa000 thru 0xb184 (0x1185 bytes) 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6620(220 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6621(221 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6622(222 mod 256): COPY 0x17000 thru 0x17fff (0x1000 bytes) to 0x35000 thru 0x35fff 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6623(223 mod 256): MAPWRITE 0x54000 thru 0x55d80 (0x1d81 bytes) 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6624(224 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6625(225 mod 256): TRUNCATE UP from 0x55d81 to 0x61000 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6626(226 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6627(227 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6628(228 mod 256): MAPREAD 0x5a000 thru 0x5acce (0xccf bytes) 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6629(229 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6630(230 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.081 INFO:teuthology.orchestra.run.smithi153.stdout: +6631(231 mod 256): MAPWRITE 0x47000 thru 0x4799d (0x99e bytes) 2024-03-28T23:11:40.082 INFO:teuthology.orchestra.run.smithi153.stdout: +6632(232 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.082 INFO:teuthology.orchestra.run.smithi153.stdout: +6633(233 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.082 INFO:teuthology.orchestra.run.smithi153.stdout: +6634(234 mod 256): MAPREAD 0x58000 thru 0x59863 (0x1864 bytes) 2024-03-28T23:11:40.082 INFO:teuthology.orchestra.run.smithi153.stdout: +6635(235 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x33000 thru 0x33fff 2024-03-28T23:11:40.082 INFO:teuthology.orchestra.run.smithi153.stdout: +6636(236 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.082 INFO:teuthology.orchestra.run.smithi153.stdout: +6637(237 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.082 INFO:teuthology.orchestra.run.smithi153.stdout: +6638(238 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.082 INFO:teuthology.orchestra.run.smithi153.stdout: +6639(239 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.082 INFO:teuthology.orchestra.run.smithi153.stdout: +6640(240 mod 256): MAPWRITE 0x39000 thru 0x3ae3b (0x1e3c bytes) 2024-03-28T23:11:40.082 INFO:teuthology.orchestra.run.smithi153.stdout: +6641(241 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.082 INFO:teuthology.orchestra.run.smithi153.stdout: +6642(242 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.082 INFO:teuthology.orchestra.run.smithi153.stdout: +6643(243 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.082 INFO:teuthology.orchestra.run.smithi153.stdout: +6644(244 mod 256): PUNCH 0x1b47e thru 0x1c5d4 (0x1157 bytes) 2024-03-28T23:11:40.082 INFO:teuthology.orchestra.run.smithi153.stdout: +6645(245 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6646(246 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6647(247 mod 256): MAPREAD 0x54000 thru 0x54dcc (0xdcd bytes) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6648(248 mod 256): PUNCH 0x2013f thru 0x219f3 (0x18b5 bytes) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6649(249 mod 256): MAPREAD 0x5c000 thru 0x5d508 (0x1509 bytes) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6650(250 mod 256): PUNCH 0x51a6d thru 0x525ce (0xb62 bytes) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6651(251 mod 256): PUNCH 0x4aa6 thru 0x4c26 (0x181 bytes) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6652(252 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6653(253 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6654(254 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6655(255 mod 256): MAPWRITE 0x2f000 thru 0x307c0 (0x17c1 bytes) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6656( 0 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6657( 1 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6658( 2 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6659( 3 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.083 INFO:teuthology.orchestra.run.smithi153.stdout: +6660( 4 mod 256): COPY 0x1f000 thru 0x1ffff (0x1000 bytes) to 0x3b000 thru 0x3bfff 2024-03-28T23:11:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: +6661( 5 mod 256): MAPREAD 0x3c000 thru 0x3cc3e (0xc3f bytes) 2024-03-28T23:11:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: +6662( 6 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: +6663( 7 mod 256): MAPWRITE 0x21000 thru 0x223f5 (0x13f6 bytes) 2024-03-28T23:11:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: +6664( 8 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: +6665( 9 mod 256): READ 0x0 thru 0xfff (0x1000 bytes) 2024-03-28T23:11:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: +6666( 10 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: +6667( 11 mod 256): MAPREAD 0x49000 thru 0x49d7b (0xd7c bytes) 2024-03-28T23:11:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: +6668( 12 mod 256): WRITE 0x6a000 thru 0x6afff (0x1000 bytes) HOLE 2024-03-28T23:11:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: +6669( 13 mod 256): MAPWRITE 0x1d000 thru 0x1dfda (0xfdb bytes) 2024-03-28T23:11:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: +6670( 14 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: +6671( 15 mod 256): MAPREAD 0x0 thru 0x1a71 (0x1a72 bytes) 2024-03-28T23:11:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: +6672( 16 mod 256): MAPWRITE 0x21000 thru 0x2198a (0x98b bytes) 2024-03-28T23:11:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: +6673( 17 mod 256): MAPWRITE 0x72000 thru 0x722f2 (0x2f3 bytes) 2024-03-28T23:11:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: +6674( 18 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6675( 19 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6676( 20 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6677( 21 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6678( 22 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6679( 23 mod 256): MAPWRITE 0xf000 thru 0x10f15 (0x1f16 bytes) 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6680( 24 mod 256): MAPREAD 0x5b000 thru 0x5c7ac (0x17ad bytes) 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6681( 25 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6682( 26 mod 256): TRUNCATE DOWN from 0x722f3 to 0x6f000 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6683( 27 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6684( 28 mod 256): TRUNCATE DOWN from 0x6f000 to 0x39000 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6685( 29 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6686( 30 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6687( 31 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6688( 32 mod 256): READ 0x32000 thru 0x32fff (0x1000 bytes) 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6689( 33 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.085 INFO:teuthology.orchestra.run.smithi153.stdout: +6690( 34 mod 256): SKIPPED (no operation) 2024-03-28T23:11:40.086 INFO:teuthology.orchestra.run.smithi153.stdout: +6691( 35 mod 256): PUNCH 0xcb30 thru 0xe83a (0x1d0b bytes) 2024-03-28T23:11:40.086 INFO:teuthology.orchestra.run.smithi153.stdout: +6692( 36 mod 256): MAPREAD 0x37000 thru 0x382a5 (0x12a6 bytes) ***RRRR*** 2024-03-28T23:11:40.086 INFO:teuthology.orchestra.run.smithi153.stdout: +Log of operations saved to "/tmp/tmp.l0v0NkF9eFtest/junk.fsxops"; replay with --replay-ops 2024-03-28T23:11:40.086 INFO:teuthology.orchestra.run.smithi153.stdout: +Correct content saved for comparison 2024-03-28T23:11:40.086 INFO:teuthology.orchestra.run.smithi153.stdout: +(maybe hexdump "/tmp/tmp.l0v0NkF9eFtest/junk" vs "/tmp/tmp.l0v0NkF9eFtest/junk.fsxgood") 2024-03-28T23:11:40.086 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/263 2024-03-28T23:11:40.086 INFO:teuthology.orchestra.run.smithi153.stdout:Failures: generic/263 2024-03-28T23:11:40.086 INFO:teuthology.orchestra.run.smithi153.stdout:Failed 1 of 1 tests 2024-03-28T23:11:40.086 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:40.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T23:11:40.087 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-28T23:11:40.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-28T23:11:40.088 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-03-28T23:11:40.694 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:40.706 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:40.708 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:40.711 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:40.711 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:41.634 INFO:teuthology.orchestra.run.smithi153.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:11:41.649 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/264 2024-03-28T23:11:41.649 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/264 2024-03-28T23:11:41.649 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:41.663 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:41.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:41.824 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-03-28T23:11:42.460 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:42.470 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:42.472 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:42.474 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:42.474 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:43.485 INFO:teuthology.orchestra.run.smithi153.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:11:43.503 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/265 2024-03-28T23:11:43.503 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/265 2024-03-28T23:11:43.503 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:43.515 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:43.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:43.629 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-03-28T23:11:44.211 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:44.224 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:44.225 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:44.228 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:44.228 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:45.255 INFO:teuthology.orchestra.run.smithi153.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:11:45.275 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/266 2024-03-28T23:11:45.276 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/266 2024-03-28T23:11:45.276 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:45.291 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:45.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:45.407 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-03-28T23:11:45.977 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:45.988 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:45.990 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:45.993 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:45.993 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:46.989 INFO:teuthology.orchestra.run.smithi153.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:11:47.006 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/267 2024-03-28T23:11:47.006 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/267 2024-03-28T23:11:47.006 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:47.018 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:47.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:47.160 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-03-28T23:11:47.552 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:11:47.559 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:11:47.692 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:47.704 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:47.705 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:47.708 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:48.732 INFO:teuthology.orchestra.run.smithi153.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:11:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/268 2024-03-28T23:11:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/268 2024-03-28T23:11:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:48.763 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:48.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:48.931 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-03-28T23:11:49.452 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:49.463 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:49.464 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:49.467 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:49.467 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:50.097 INFO:teuthology.orchestra.run.smithi153.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T23:11:50.111 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/269 2024-03-28T23:11:50.111 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/269 2024-03-28T23:11:50.111 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:50.120 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:50.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:50.162 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-03-28T23:11:50.703 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:50.717 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:50.718 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:50.722 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:50.722 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:51.324 INFO:teuthology.orchestra.run.smithi153.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:11:51.336 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/270 2024-03-28T23:11:51.337 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/270 2024-03-28T23:11:51.337 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:51.345 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:51.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:51.388 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-03-28T23:11:51.951 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:51.965 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:51.967 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:51.970 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:51.970 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:52.995 INFO:teuthology.orchestra.run.smithi153.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:11:53.016 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/271 2024-03-28T23:11:53.016 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/271 2024-03-28T23:11:53.017 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:53.028 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:53.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:53.216 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-03-28T23:11:53.752 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:53.764 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:53.765 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:53.767 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:53.767 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:54.814 INFO:teuthology.orchestra.run.smithi153.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:11:54.830 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/272 2024-03-28T23:11:54.830 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/272 2024-03-28T23:11:54.830 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:54.846 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:54.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:54.952 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-03-28T23:11:55.545 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:55.557 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:55.558 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:55.561 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:55.562 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:56.195 INFO:teuthology.orchestra.run.smithi153.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T23:11:56.208 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/273 2024-03-28T23:11:56.208 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/273 2024-03-28T23:11:56.208 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:56.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:56.264 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-03-28T23:11:56.838 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:56.852 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:56.853 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:56.856 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:56.857 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:57.530 INFO:teuthology.orchestra.run.smithi153.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-28T23:11:57.542 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/274 2024-03-28T23:11:57.542 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/274 2024-03-28T23:11:57.542 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:57.550 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:57.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:57.601 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-03-28T23:11:58.173 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:58.185 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:58.186 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:58.189 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:58.189 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:58.803 INFO:teuthology.orchestra.run.smithi153.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T23:11:58.817 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/275 2024-03-28T23:11:58.817 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/275 2024-03-28T23:11:58.817 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:11:58.828 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:11:58.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:11:58.877 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-03-28T23:11:59.471 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:11:59.483 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:11:59.484 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:11:59.487 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:11:59.487 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:00.461 INFO:teuthology.orchestra.run.smithi153.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:00.476 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/276 2024-03-28T23:12:00.484 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/276 2024-03-28T23:12:00.484 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:00.500 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:00.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:00.605 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-03-28T23:12:01.182 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:01.193 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:01.194 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:01.197 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:01.197 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:01.994 INFO:teuthology.orchestra.run.smithi153.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-03-28T23:12:02.009 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/277 2024-03-28T23:12:02.009 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/277 2024-03-28T23:12:02.009 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:02.021 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:02.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:02.081 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-03-28T23:12:02.622 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:02.634 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:02.635 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:02.638 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:02.639 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:03.680 INFO:teuthology.orchestra.run.smithi153.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:03.699 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/278 2024-03-28T23:12:03.699 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/278 2024-03-28T23:12:03.699 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:03.714 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:03.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:03.852 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-03-28T23:12:04.419 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:04.432 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:04.433 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:04.436 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:04.436 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:05.488 INFO:teuthology.orchestra.run.smithi153.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:05.504 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/279 2024-03-28T23:12:05.505 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/279 2024-03-28T23:12:05.505 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:05.517 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:05.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:05.627 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-03-28T23:12:06.183 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:06.196 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:06.197 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:06.199 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:06.200 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:06.801 INFO:teuthology.orchestra.run.smithi153.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:12:06.812 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/280 2024-03-28T23:12:06.812 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/280 2024-03-28T23:12:06.812 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:06.820 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:06.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:06.859 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-03-28T23:12:07.442 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:07.454 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:07.456 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:07.459 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:07.459 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:08.544 INFO:teuthology.orchestra.run.smithi153.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:08.566 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/281 2024-03-28T23:12:08.566 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/281 2024-03-28T23:12:08.566 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:08.576 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:08.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:08.741 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-03-28T23:12:09.290 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:09.303 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:09.305 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:09.308 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:09.308 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:10.490 INFO:teuthology.orchestra.run.smithi153.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:10.527 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/282 2024-03-28T23:12:10.527 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/282 2024-03-28T23:12:10.528 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:10.550 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:10.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:10.644 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-03-28T23:12:11.201 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:11.213 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:11.215 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:11.219 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:12.316 INFO:teuthology.orchestra.run.smithi153.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:12.332 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/283 2024-03-28T23:12:12.332 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/283 2024-03-28T23:12:12.332 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:12.347 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:12.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:12.457 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-03-28T23:12:13.008 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:13.020 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:13.021 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:13.023 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:13.024 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:13.964 INFO:teuthology.orchestra.run.smithi153.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:13.992 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/284 2024-03-28T23:12:13.992 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/284 2024-03-28T23:12:13.992 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:14.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:14.177 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-03-28T23:12:14.720 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:14.733 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:14.735 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:14.738 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:14.738 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:17.698 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:12:17.707 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:12:18.201 INFO:teuthology.orchestra.run.smithi153.stdout:generic/285 4s 2024-03-28T23:12:18.215 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/285 2024-03-28T23:12:18.215 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:18.222 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:18.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:18.648 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-03-28T23:12:19.423 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:19.436 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:19.438 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:19.441 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:19.441 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:20.167 INFO:teuthology.orchestra.run.smithi153.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T23:12:20.181 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/286 2024-03-28T23:12:20.181 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/286 2024-03-28T23:12:20.182 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:20.190 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:20.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:20.239 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-03-28T23:12:20.881 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:20.895 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:20.897 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:20.901 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:20.901 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:21.942 INFO:teuthology.orchestra.run.smithi153.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:21.959 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/287 2024-03-28T23:12:21.959 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/287 2024-03-28T23:12:21.960 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:21.978 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:22.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:22.172 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-03-28T23:12:22.873 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:22.888 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:22.890 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:22.893 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:22.894 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:23.767 INFO:teuthology.orchestra.run.smithi153.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:23.789 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/288 2024-03-28T23:12:23.789 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/288 2024-03-28T23:12:23.790 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:23.800 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:23.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:23.841 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-03-28T23:12:24.363 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:24.376 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:24.377 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:24.380 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:24.381 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/289 2024-03-28T23:12:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/289 2024-03-28T23:12:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:25.425 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:25.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:25.598 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-03-28T23:12:26.143 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:26.156 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:26.157 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:26.160 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:26.161 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:27.172 INFO:teuthology.orchestra.run.smithi153.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:27.197 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/290 2024-03-28T23:12:27.198 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/290 2024-03-28T23:12:27.198 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:27.208 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:27.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:27.377 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-03-28T23:12:27.981 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:27.995 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:27.997 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:28.001 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:28.001 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:28.978 INFO:teuthology.orchestra.run.smithi153.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:28.997 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/291 2024-03-28T23:12:28.997 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/291 2024-03-28T23:12:28.997 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:29.008 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:29.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:29.167 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-03-28T23:12:29.748 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:29.761 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:29.762 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:29.765 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:29.765 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:30.714 INFO:teuthology.orchestra.run.smithi153.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:30.745 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/292 2024-03-28T23:12:30.745 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/292 2024-03-28T23:12:30.746 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:30.752 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:30.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:30.934 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-03-28T23:12:31.518 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:31.532 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:31.534 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:31.538 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:31.538 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:32.474 INFO:teuthology.orchestra.run.smithi153.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:32.507 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/293 2024-03-28T23:12:32.507 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/293 2024-03-28T23:12:32.507 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:32.527 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:32.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:32.742 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-03-28T23:12:33.299 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:33.311 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:33.312 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:33.315 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:33.315 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:34.506 INFO:teuthology.orchestra.run.smithi153.stdout:generic/294 1s 2024-03-28T23:12:34.552 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/294 2024-03-28T23:12:34.555 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:34.570 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:34.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:34.623 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-03-28T23:12:35.243 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:35.255 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:35.257 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:35.260 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:35.260 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:36.305 INFO:teuthology.orchestra.run.smithi153.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:36.328 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/295 2024-03-28T23:12:36.328 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/295 2024-03-28T23:12:36.328 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:36.339 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:36.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:36.471 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-03-28T23:12:37.053 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:37.064 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:37.065 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:37.068 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:37.068 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:38.070 INFO:teuthology.orchestra.run.smithi153.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:38.092 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/296 2024-03-28T23:12:38.093 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/296 2024-03-28T23:12:38.093 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:38.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:38.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:38.343 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-03-28T23:12:38.859 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:38.873 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:38.874 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:38.878 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:38.878 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:39.880 INFO:teuthology.orchestra.run.smithi153.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:39.896 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/297 2024-03-28T23:12:39.896 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/297 2024-03-28T23:12:39.896 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:40.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:40.118 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-03-28T23:12:40.674 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:40.688 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:40.690 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:40.693 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:40.693 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:41.650 INFO:teuthology.orchestra.run.smithi153.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:41.667 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/298 2024-03-28T23:12:41.667 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/298 2024-03-28T23:12:41.667 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:41.679 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:41.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:41.896 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-03-28T23:12:42.462 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:42.474 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:42.475 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:42.478 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:42.478 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:43.281 INFO:teuthology.orchestra.run.smithi153.stdout:generic/299 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:12:43.294 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/299 2024-03-28T23:12:43.294 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/299 2024-03-28T23:12:43.295 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:43.306 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:43.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:43.402 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-03-28T23:12:43.962 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:43.976 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:43.977 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:43.981 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:44.759 INFO:teuthology.orchestra.run.smithi153.stdout:generic/300 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:12:44.772 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/300 2024-03-28T23:12:44.773 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/300 2024-03-28T23:12:44.773 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:44.782 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:44.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:44.825 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-03-28T23:12:45.370 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:45.383 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:45.385 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:45.389 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:45.389 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:46.340 INFO:teuthology.orchestra.run.smithi153.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:46.363 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/301 2024-03-28T23:12:46.365 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/301 2024-03-28T23:12:46.365 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:46.383 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:46.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:46.574 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-03-28T23:12:47.138 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:47.150 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:47.151 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:47.154 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:47.154 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:48.138 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:12:48.139 INFO:teuthology.orchestra.run.smithi153.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:48.150 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:12:48.162 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/302 2024-03-28T23:12:48.167 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/302 2024-03-28T23:12:48.167 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:48.177 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:48.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:48.390 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-03-28T23:12:48.957 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:48.970 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:48.970 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:48.972 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:48.972 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:49.646 INFO:teuthology.orchestra.run.smithi153.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:12:49.660 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/303 2024-03-28T23:12:49.660 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/303 2024-03-28T23:12:49.660 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:49.670 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:49.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:49.784 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-03-28T23:12:50.487 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:50.500 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:50.500 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:50.502 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:50.502 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:51.211 INFO:teuthology.orchestra.run.smithi153.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-28T23:12:51.223 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/304 2024-03-28T23:12:51.223 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/304 2024-03-28T23:12:51.223 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:51.232 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:51.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:51.350 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-03-28T23:12:52.042 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:52.054 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:52.055 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:52.059 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:52.059 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:53.014 INFO:teuthology.orchestra.run.smithi153.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:12:53.037 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/305 2024-03-28T23:12:53.037 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/305 2024-03-28T23:12:53.037 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:53.059 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:53.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:53.233 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-03-28T23:12:53.784 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:53.795 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:53.797 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:53.799 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:53.800 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:55.078 INFO:teuthology.orchestra.run.smithi153.stdout:generic/306 1s 2024-03-28T23:12:55.109 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/306 2024-03-28T23:12:55.109 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:55.122 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:55.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:55.372 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-03-28T23:12:56.131 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:56.142 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:56.143 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:56.146 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:56.146 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:58.411 INFO:teuthology.orchestra.run.smithi153.stdout:generic/307 2s 2024-03-28T23:12:58.431 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/307 2024-03-28T23:12:58.432 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:58.443 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:58.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:58.478 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-03-28T23:12:59.013 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:12:59.026 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:12:59.027 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:12:59.030 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:12:59.030 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:59.726 INFO:teuthology.orchestra.run.smithi153.stdout:generic/308 0s 2024-03-28T23:12:59.742 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/308 2024-03-28T23:12:59.743 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:12:59.752 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:12:59.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:12:59.812 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-03-28T23:13:00.377 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:13:00.392 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:13:00.394 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:13:00.398 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:13:00.398 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:13:02.177 INFO:teuthology.orchestra.run.smithi153.stdout:generic/309 2s 2024-03-28T23:13:02.193 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/309 2024-03-28T23:13:02.193 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:13:02.201 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:13:02.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:13:02.311 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-03-28T23:13:03.045 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:13:03.058 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:13:03.060 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:13:03.063 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:13:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:13:18.377 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:13:18.383 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:13:48.520 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:13:48.529 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:14:18.658 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:14:18.666 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:14:37.588 INFO:teuthology.orchestra.run.smithi153.stdout:generic/310 94s 2024-03-28T23:14:37.607 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/310 2024-03-28T23:14:37.607 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:14:37.616 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:37.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:14:37.860 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-03-28T23:14:38.668 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:14:38.679 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:14:38.680 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:14:38.683 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:14:38.683 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:39.504 INFO:teuthology.orchestra.run.smithi153.stdout:generic/311 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:14:39.517 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/311 2024-03-28T23:14:39.518 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/311 2024-03-28T23:14:39.518 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:14:39.527 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:39.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:14:39.569 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-03-28T23:14:40.143 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:14:40.156 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:14:40.157 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:14:40.160 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:14:40.161 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:40.785 INFO:teuthology.orchestra.run.smithi153.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T23:14:40.797 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/312 2024-03-28T23:14:40.797 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/312 2024-03-28T23:14:40.798 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:14:40.806 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:40.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:14:40.852 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-03-28T23:14:41.392 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:14:41.404 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:14:41.405 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:14:41.408 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:14:41.408 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:47.355 INFO:teuthology.orchestra.run.smithi153.stdout:generic/313 6s 2024-03-28T23:14:47.374 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/313 2024-03-28T23:14:47.374 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:14:47.386 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:47.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:14:47.430 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-03-28T23:14:47.969 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:14:47.982 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:14:47.983 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:14:47.986 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:14:47.986 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:48.804 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:14:48.812 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:14:49.235 INFO:teuthology.orchestra.run.smithi153.stdout:generic/314 1s 2024-03-28T23:14:49.252 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/314 2024-03-28T23:14:49.252 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:14:49.260 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:49.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:14:49.310 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-03-28T23:14:49.852 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:14:49.865 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:14:49.866 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:14:49.870 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:14:49.870 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:50.487 INFO:teuthology.orchestra.run.smithi153.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-28T23:14:50.500 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/315 2024-03-28T23:14:50.500 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/315 2024-03-28T23:14:50.500 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:14:50.507 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:50.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:14:50.550 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-03-28T23:14:51.118 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:14:51.130 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:14:51.132 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:14:51.135 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:14:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:52.076 INFO:teuthology.orchestra.run.smithi153.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-28T23:14:52.087 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/316 2024-03-28T23:14:52.087 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/316 2024-03-28T23:14:52.087 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:14:52.096 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:52.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:14:52.204 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-03-28T23:14:52.891 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:14:52.904 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:14:52.905 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:14:52.908 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:14:52.908 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:54.323 INFO:teuthology.orchestra.run.smithi153.stdout:generic/317 1s 2024-03-28T23:14:54.340 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/317 2024-03-28T23:14:54.340 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:14:54.348 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:54.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:14:54.375 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-03-28T23:14:54.889 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:14:54.902 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:14:54.902 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:14:54.905 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:14:54.905 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:56.131 INFO:teuthology.orchestra.run.smithi153.stdout:generic/318 1s 2024-03-28T23:14:56.147 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/318 2024-03-28T23:14:56.147 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:14:56.156 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:56.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:14:56.182 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-03-28T23:14:56.719 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:14:56.732 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:14:56.733 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:14:56.736 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:14:56.736 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:57.669 INFO:teuthology.orchestra.run.smithi153.stdout:generic/319 1s 2024-03-28T23:14:57.688 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/319 2024-03-28T23:14:57.688 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:14:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:57.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:14:57.720 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-03-28T23:14:58.314 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:14:58.328 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:14:58.330 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:14:58.333 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:14:58.333 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:58.930 INFO:teuthology.orchestra.run.smithi153.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T23:14:58.945 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/320 2024-03-28T23:14:58.945 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/320 2024-03-28T23:14:58.945 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:14:58.958 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:14:59.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:14:59.003 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-03-28T23:14:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:14:59.621 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:14:59.623 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:14:59.626 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:14:59.626 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:15:00.314 INFO:teuthology.orchestra.run.smithi153.stdout:generic/321 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:15:00.326 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/321 2024-03-28T23:15:00.326 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/321 2024-03-28T23:15:00.326 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:15:00.335 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:15:00.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:15:00.375 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-03-28T23:15:00.959 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:15:00.973 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:15:00.975 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:15:00.978 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:15:00.978 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:15:01.617 INFO:teuthology.orchestra.run.smithi153.stdout:generic/322 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:15:01.630 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/322 2024-03-28T23:15:01.630 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/322 2024-03-28T23:15:01.631 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:15:01.644 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:15:01.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:15:01.685 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-03-28T23:15:02.245 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:15:02.258 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:15:02.260 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:15:02.264 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:15:02.264 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:15:18.950 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:15:18.957 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:15:49.087 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:15:49.093 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:16:19.348 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:16:19.355 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:16:49.760 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:16:49.767 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:17:04.411 INFO:teuthology.orchestra.run.smithi153.stdout:generic/323 122s 2024-03-28T23:17:04.428 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/323 2024-03-28T23:17:04.429 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:04.437 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:04.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:04.526 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-03-28T23:17:05.231 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:05.244 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:05.245 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:05.248 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:05.248 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:05.838 INFO:teuthology.orchestra.run.smithi153.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2024-03-28T23:17:05.852 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/324 2024-03-28T23:17:05.852 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/324 2024-03-28T23:17:05.852 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:05.861 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:05.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:05.900 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-03-28T23:17:06.454 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:06.467 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:06.468 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:06.471 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:06.471 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:07.129 INFO:teuthology.orchestra.run.smithi153.stdout:generic/325 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:17:07.145 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/325 2024-03-28T23:17:07.146 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/325 2024-03-28T23:17:07.146 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:07.159 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:07.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:07.203 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-03-28T23:17:07.786 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:07.798 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:07.799 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:07.802 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:07.802 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:08.765 INFO:teuthology.orchestra.run.smithi153.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:17:08.782 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/326 2024-03-28T23:17:08.783 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/326 2024-03-28T23:17:08.783 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:08.795 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:08.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:08.906 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-03-28T23:17:09.515 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:09.528 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:09.529 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:09.532 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:09.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:10.477 INFO:teuthology.orchestra.run.smithi153.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:17:10.491 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/327 2024-03-28T23:17:10.491 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/327 2024-03-28T23:17:10.491 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:10.510 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:10.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:10.636 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-03-28T23:17:11.230 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:11.242 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:11.243 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:11.246 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:12.215 INFO:teuthology.orchestra.run.smithi153.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:17:12.234 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/328 2024-03-28T23:17:12.236 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/328 2024-03-28T23:17:12.236 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:12.256 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:12.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:12.345 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-03-28T23:17:12.950 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:12.962 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:12.963 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:12.966 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:12.966 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:13.931 INFO:teuthology.orchestra.run.smithi153.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:17:13.958 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/329 2024-03-28T23:17:13.958 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/329 2024-03-28T23:17:13.958 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:13.964 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:14.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:14.053 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-03-28T23:17:14.621 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:14.634 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:14.635 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:14.638 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:14.638 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:15.595 INFO:teuthology.orchestra.run.smithi153.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:17:15.607 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/330 2024-03-28T23:17:15.607 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/330 2024-03-28T23:17:15.607 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:15.619 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:15.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:15.733 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-03-28T23:17:16.338 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:16.349 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:16.351 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:16.354 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:16.354 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:17.285 INFO:teuthology.orchestra.run.smithi153.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:17:17.321 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/331 2024-03-28T23:17:17.321 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/331 2024-03-28T23:17:17.321 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:17.341 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:17.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:17.466 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-03-28T23:17:17.996 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:18.007 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:18.008 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:18.010 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:18.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:18.970 INFO:teuthology.orchestra.run.smithi153.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:17:18.991 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/332 2024-03-28T23:17:18.991 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/332 2024-03-28T23:17:18.991 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:19.003 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:19.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:19.113 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-03-28T23:17:19.737 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:19.750 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:19.752 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:19.756 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:19.756 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:19.914 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:17:19.918 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:17:20.646 INFO:teuthology.orchestra.run.smithi153.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:17:20.667 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/333 2024-03-28T23:17:20.667 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/333 2024-03-28T23:17:20.667 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:20.686 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:20.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:20.811 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-03-28T23:17:21.427 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:21.441 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:21.443 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:21.445 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:22.362 INFO:teuthology.orchestra.run.smithi153.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:17:22.383 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/334 2024-03-28T23:17:22.383 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/334 2024-03-28T23:17:22.383 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:22.395 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:22.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:22.521 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-03-28T23:17:23.112 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:23.123 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:23.125 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:23.128 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:23.784 INFO:teuthology.orchestra.run.smithi153.stdout:generic/335 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:17:23.796 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/335 2024-03-28T23:17:23.796 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/335 2024-03-28T23:17:23.796 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:23.804 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:23.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:23.842 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-03-28T23:17:24.365 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:24.378 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:24.379 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:24.382 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:24.382 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:25.065 INFO:teuthology.orchestra.run.smithi153.stdout:generic/336 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:17:25.078 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/336 2024-03-28T23:17:25.078 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/336 2024-03-28T23:17:25.078 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:25.090 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:25.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:25.139 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-03-28T23:17:25.694 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:25.707 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:25.709 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:25.712 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:25.712 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:26.717 INFO:teuthology.orchestra.run.smithi153.stdout:generic/337 1s 2024-03-28T23:17:26.734 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/337 2024-03-28T23:17:26.734 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:26.743 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:26.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:26.771 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-03-28T23:17:27.318 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:27.334 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:27.334 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:27.337 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:27.337 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:28.009 INFO:teuthology.orchestra.run.smithi153.stdout:generic/338 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:17:28.021 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/338 2024-03-28T23:17:28.021 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/338 2024-03-28T23:17:28.021 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:17:28.032 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:28.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:17:28.075 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-03-28T23:17:28.646 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:17:28.658 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:17:28.659 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:17:28.663 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:17:50.047 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:17:50.054 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:18:20.178 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:18:20.187 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:18:50.447 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:18:50.454 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:18:53.684 INFO:teuthology.orchestra.run.smithi153.stdout:generic/339 84s 2024-03-28T23:18:56.306 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/339 2024-03-28T23:18:56.306 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:18:56.317 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:18:56.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:18:56.351 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-03-28T23:18:56.884 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:18:56.895 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:18:56.897 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:18:56.900 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:18:56.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:03.218 INFO:teuthology.orchestra.run.smithi153.stdout:generic/340 6s 2024-03-28T23:19:03.246 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/340 2024-03-28T23:19:03.246 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:19:03.262 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:03.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:19:03.311 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-03-28T23:19:04.084 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:19:04.101 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:19:04.102 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:19:04.105 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:19:04.105 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:04.702 INFO:teuthology.orchestra.run.smithi153.stdout:generic/341 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:19:04.716 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/341 2024-03-28T23:19:04.716 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/341 2024-03-28T23:19:04.717 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:19:04.728 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:04.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:19:04.769 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-03-28T23:19:05.333 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:19:05.346 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:19:05.348 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:19:05.351 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:19:05.351 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:05.963 INFO:teuthology.orchestra.run.smithi153.stdout:generic/342 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:19:05.974 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/342 2024-03-28T23:19:05.974 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/342 2024-03-28T23:19:05.974 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:19:05.983 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:06.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:19:06.020 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-03-28T23:19:06.559 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:19:06.573 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:19:06.575 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:19:06.578 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:19:06.579 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:07.282 INFO:teuthology.orchestra.run.smithi153.stdout:generic/343 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:19:07.294 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/343 2024-03-28T23:19:07.294 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/343 2024-03-28T23:19:07.294 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:19:07.302 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:07.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:19:07.346 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-03-28T23:19:07.885 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:19:07.898 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:19:07.899 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:19:07.902 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:19:07.902 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:19.032 INFO:teuthology.orchestra.run.smithi153.stdout:generic/344 11s 2024-03-28T23:19:19.062 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/344 2024-03-28T23:19:19.062 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:19:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:19.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:19:19.124 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-03-28T23:19:19.901 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:19:19.915 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:19:19.917 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:19:19.921 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:19:19.921 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:21.524 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:19:21.532 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:19:33.339 INFO:teuthology.orchestra.run.smithi153.stdout:generic/345 13s 2024-03-28T23:19:33.376 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/345 2024-03-28T23:19:33.376 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:19:33.390 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:33.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:19:33.431 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-03-28T23:19:34.330 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:19:34.358 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:19:34.359 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:19:34.361 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:19:34.361 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:39.867 INFO:teuthology.orchestra.run.smithi153.stdout:generic/346 5s 2024-03-28T23:19:39.896 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/346 2024-03-28T23:19:39.896 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:19:39.914 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:39.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:19:39.976 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-03-28T23:19:40.600 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:19:40.615 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:19:40.617 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:19:40.620 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:19:40.620 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:41.353 INFO:teuthology.orchestra.run.smithi153.stdout:generic/347 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:19:41.366 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/347 2024-03-28T23:19:41.366 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/347 2024-03-28T23:19:41.366 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:19:41.376 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:41.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:19:41.414 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-03-28T23:19:41.940 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:19:41.953 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:19:41.955 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:19:41.959 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:19:41.959 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:42.622 INFO:teuthology.orchestra.run.smithi153.stdout:generic/348 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:19:42.637 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/348 2024-03-28T23:19:42.637 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/348 2024-03-28T23:19:42.638 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:19:42.648 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:42.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:19:42.700 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-03-28T23:19:43.259 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:19:43.271 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:19:43.272 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:19:43.275 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:19:43.276 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:44.147 INFO:teuthology.orchestra.run.smithi153.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-28T23:19:44.162 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/349 2024-03-28T23:19:44.162 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/349 2024-03-28T23:19:44.162 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:19:44.173 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:44.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:19:44.233 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-03-28T23:19:44.774 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:19:44.787 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:19:44.789 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:19:44.793 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:19:44.793 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:46.206 INFO:teuthology.orchestra.run.smithi153.stdout:generic/350 2s 2024-03-28T23:19:46.222 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/350 2024-03-28T23:19:46.222 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:19:46.230 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:46.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:19:46.256 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-03-28T23:19:46.797 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:19:46.810 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:19:46.811 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:19:46.814 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:19:46.814 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:47.405 INFO:teuthology.orchestra.run.smithi153.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T23:19:47.419 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/351 2024-03-28T23:19:47.419 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/351 2024-03-28T23:19:47.419 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:19:47.430 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:47.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:19:47.479 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-03-28T23:19:48.015 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:19:48.026 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:19:48.028 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:19:48.031 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:19:48.031 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:48.893 INFO:teuthology.orchestra.run.smithi153.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:19:48.921 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/352 2024-03-28T23:19:48.921 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/352 2024-03-28T23:19:48.921 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:19:48.942 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:49.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:19:49.248 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-03-28T23:19:49.779 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:19:49.793 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:19:49.794 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:19:49.798 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:19:49.798 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:50.688 INFO:teuthology.orchestra.run.smithi153.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:19:50.703 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/353 2024-03-28T23:19:50.704 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/353 2024-03-28T23:19:50.704 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:19:50.719 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:50.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:19:50.967 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-03-28T23:19:51.476 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:19:51.488 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:19:51.489 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:19:51.492 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:19:51.492 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:19:51.817 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:19:51.823 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:20:03.071 INFO:teuthology.orchestra.run.smithi153.stdout:generic/354 12s 2024-03-28T23:20:03.102 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/354 2024-03-28T23:20:03.103 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:03.116 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:03.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:03.166 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-03-28T23:20:03.870 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:03.880 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:03.881 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:03.884 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:03.884 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:05.374 INFO:teuthology.orchestra.run.smithi153.stdout:generic/355 1s 2024-03-28T23:20:05.391 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/355 2024-03-28T23:20:05.391 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:05.398 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:05.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:05.521 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-03-28T23:20:06.192 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:06.205 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:06.206 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:06.210 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:06.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:07.094 INFO:teuthology.orchestra.run.smithi153.stdout:generic/356 [not run] swapfiles are not supported 2024-03-28T23:20:07.108 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/356 2024-03-28T23:20:07.108 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/356 2024-03-28T23:20:07.108 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:07.119 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:07.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:07.165 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-03-28T23:20:07.732 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:07.748 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:07.749 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:07.753 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:07.753 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:08.596 INFO:teuthology.orchestra.run.smithi153.stdout:generic/357 [not run] swapfiles are not supported 2024-03-28T23:20:08.609 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/357 2024-03-28T23:20:08.609 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/357 2024-03-28T23:20:08.609 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:08.618 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:08.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:08.660 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-03-28T23:20:09.215 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:09.228 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:09.230 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:09.233 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:09.233 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:10.165 INFO:teuthology.orchestra.run.smithi153.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:20:10.181 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/358 2024-03-28T23:20:10.182 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/358 2024-03-28T23:20:10.182 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:10.198 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:10.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:10.514 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-03-28T23:20:11.015 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:11.026 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:11.027 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:11.031 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:11.031 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:11.922 INFO:teuthology.orchestra.run.smithi153.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:20:11.953 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/359 2024-03-28T23:20:11.953 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/359 2024-03-28T23:20:11.953 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:11.964 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:12.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:12.214 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-03-28T23:20:12.700 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:12.710 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:12.711 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:12.714 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:12.714 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:13.376 INFO:teuthology.orchestra.run.smithi153.stdout:generic/360 1s 2024-03-28T23:20:13.393 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/360 2024-03-28T23:20:13.393 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:13.401 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:13.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:13.439 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-03-28T23:20:14.017 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:14.029 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:14.031 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:14.034 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:14.034 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:14.633 INFO:teuthology.orchestra.run.smithi153.stdout:generic/361 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:20:14.645 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/361 2024-03-28T23:20:14.645 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/361 2024-03-28T23:20:14.645 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:14.656 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:14.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:14.706 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-03-28T23:20:15.263 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:15.275 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:15.277 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:15.280 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:15.280 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:15.883 INFO:teuthology.orchestra.run.smithi153.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-28T23:20:15.893 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/362 2024-03-28T23:20:15.893 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/362 2024-03-28T23:20:15.894 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:15.901 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:15.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:15.937 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-03-28T23:20:16.513 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:16.526 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:16.527 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:16.530 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:17.107 INFO:teuthology.orchestra.run.smithi153.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-28T23:20:17.117 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/363 2024-03-28T23:20:17.117 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/363 2024-03-28T23:20:17.117 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:17.124 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:17.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:17.157 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-03-28T23:20:17.723 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:17.736 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:17.738 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:17.741 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:17.741 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:18.312 INFO:teuthology.orchestra.run.smithi153.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-28T23:20:18.324 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/364 2024-03-28T23:20:18.324 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/364 2024-03-28T23:20:18.325 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:18.334 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:18.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:18.372 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-03-28T23:20:18.947 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:18.961 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:18.962 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:18.965 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:18.965 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:19.567 INFO:teuthology.orchestra.run.smithi153.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-28T23:20:19.580 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/365 2024-03-28T23:20:19.580 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/365 2024-03-28T23:20:19.580 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:19.589 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:19.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:19.626 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-03-28T23:20:20.180 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:20.193 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:20.195 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:20.197 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:20.197 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:20.750 INFO:teuthology.orchestra.run.smithi153.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-28T23:20:20.764 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/366 2024-03-28T23:20:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/366 2024-03-28T23:20:20.765 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:20.776 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:20.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:20.819 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-03-28T23:20:21.376 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:21.389 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:21.390 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:21.393 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:21.920 INFO:teuthology.orchestra.run.smithi153.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-28T23:20:21.930 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/367 2024-03-28T23:20:21.930 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/367 2024-03-28T23:20:21.930 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:21.937 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:21.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:21.971 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-03-28T23:20:21.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:20:22.021 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:20:22.492 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:22.503 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:22.504 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:22.507 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:22.507 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:23.049 INFO:teuthology.orchestra.run.smithi153.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-28T23:20:23.061 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/368 2024-03-28T23:20:23.061 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/368 2024-03-28T23:20:23.061 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:23.070 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:23.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:23.107 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-03-28T23:20:23.701 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:23.714 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:23.715 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:23.718 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:23.719 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:24.325 INFO:teuthology.orchestra.run.smithi153.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-28T23:20:24.338 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/369 2024-03-28T23:20:24.338 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/369 2024-03-28T23:20:24.339 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:24.350 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:24.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:24.392 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-03-28T23:20:24.940 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:24.952 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:24.954 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:24.957 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:24.958 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:25.521 INFO:teuthology.orchestra.run.smithi153.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-28T23:20:25.532 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/370 2024-03-28T23:20:25.532 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/370 2024-03-28T23:20:25.533 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:25.542 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:25.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:25.579 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-03-28T23:20:26.100 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:26.113 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:26.116 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:26.119 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:26.763 INFO:teuthology.orchestra.run.smithi153.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T23:20:26.774 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/371 2024-03-28T23:20:26.774 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/371 2024-03-28T23:20:26.774 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:26.784 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:26.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:26.831 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-03-28T23:20:27.391 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:27.405 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:27.407 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:27.410 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:27.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:28.316 INFO:teuthology.orchestra.run.smithi153.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:20:28.347 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/372 2024-03-28T23:20:28.348 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/372 2024-03-28T23:20:28.348 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:28.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:28.673 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-03-28T23:20:29.153 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:29.166 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:29.168 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:29.172 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:29.172 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:30.153 INFO:teuthology.orchestra.run.smithi153.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:20:30.166 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/373 2024-03-28T23:20:30.166 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/373 2024-03-28T23:20:30.166 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:30.184 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:30.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:30.424 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-03-28T23:20:31.008 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:31.019 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:31.020 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:31.024 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:31.024 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:31.845 INFO:teuthology.orchestra.run.smithi153.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-28T23:20:31.937 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/374 2024-03-28T23:20:31.938 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/374 2024-03-28T23:20:31.938 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:31.949 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:32.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:32.310 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-03-28T23:20:32.860 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:32.873 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:32.874 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:32.877 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:32.877 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:33.717 INFO:teuthology.orchestra.run.smithi153.stdout:generic/375 0s 2024-03-28T23:20:33.736 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/375 2024-03-28T23:20:33.736 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:33.747 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:33.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:33.843 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-03-28T23:20:34.550 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:34.562 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:34.563 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:34.566 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:34.566 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:35.140 INFO:teuthology.orchestra.run.smithi153.stdout:generic/376 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:20:35.150 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/376 2024-03-28T23:20:35.150 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/376 2024-03-28T23:20:35.150 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:35.159 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:35.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:35.190 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-03-28T23:20:35.716 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:35.730 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:35.731 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:35.734 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:35.734 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:36.573 INFO:teuthology.orchestra.run.smithi153.stdout:generic/377 1s 2024-03-28T23:20:36.587 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/377 2024-03-28T23:20:36.587 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:36.594 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:36.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:36.623 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-03-28T23:20:37.178 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:37.193 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:37.195 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:37.198 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:37.198 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:38.341 INFO:teuthology.orchestra.run.smithi153.stdout:generic/378 1s 2024-03-28T23:20:38.358 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/378 2024-03-28T23:20:38.358 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:38.367 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:38.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:38.508 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-03-28T23:20:39.187 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:39.198 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:39.199 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:39.201 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:39.201 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:39.773 INFO:teuthology.orchestra.run.smithi153.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:20:39.783 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/379 2024-03-28T23:20:39.783 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/379 2024-03-28T23:20:39.783 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:39.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:39.830 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-03-28T23:20:40.365 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:40.378 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:40.380 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:40.384 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:40.384 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:40.972 INFO:teuthology.orchestra.run.smithi153.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:20:40.985 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/380 2024-03-28T23:20:40.985 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/380 2024-03-28T23:20:40.985 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:40.993 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:41.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:41.029 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-03-28T23:20:41.580 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:41.593 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:41.595 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:41.598 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:41.598 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:42.220 INFO:teuthology.orchestra.run.smithi153.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:20:42.236 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/381 2024-03-28T23:20:42.236 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/381 2024-03-28T23:20:42.236 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:42.248 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:42.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:42.293 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-03-28T23:20:42.833 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:42.846 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:42.848 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:42.852 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:42.852 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:43.441 INFO:teuthology.orchestra.run.smithi153.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:20:43.454 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/382 2024-03-28T23:20:43.455 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/382 2024-03-28T23:20:43.455 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:43.466 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:43.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:43.505 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-03-28T23:20:44.086 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:44.098 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:44.100 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:44.103 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:44.103 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:44.690 INFO:teuthology.orchestra.run.smithi153.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:20:44.707 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/383 2024-03-28T23:20:44.707 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/383 2024-03-28T23:20:44.707 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:44.718 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:44.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:44.756 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-03-28T23:20:45.332 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:45.345 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:45.346 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:45.349 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:45.349 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:45.904 INFO:teuthology.orchestra.run.smithi153.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:20:45.915 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/384 2024-03-28T23:20:45.915 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/384 2024-03-28T23:20:45.915 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:45.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:45.959 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-03-28T23:20:46.534 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:46.547 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:46.549 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:46.552 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:46.552 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:47.146 INFO:teuthology.orchestra.run.smithi153.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/385 2024-03-28T23:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/385 2024-03-28T23:20:47.161 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:47.170 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:47.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:47.214 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-03-28T23:20:47.774 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:47.785 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:47.786 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:47.789 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:47.790 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:48.425 INFO:teuthology.orchestra.run.smithi153.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:20:48.439 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/386 2024-03-28T23:20:48.439 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/386 2024-03-28T23:20:48.439 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:48.447 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:48.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:48.481 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-03-28T23:20:48.993 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:49.003 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:49.004 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:49.007 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:49.999 INFO:teuthology.orchestra.run.smithi153.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:20:50.023 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/387 2024-03-28T23:20:50.024 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/387 2024-03-28T23:20:50.024 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:50.037 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:50.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:50.278 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-03-28T23:20:50.807 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:50.819 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:50.820 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:50.823 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:50.823 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:51.444 INFO:teuthology.orchestra.run.smithi153.stdout:generic/388 [not run] require 172.21.15.153:6789:/scratch to be local device 2024-03-28T23:20:51.453 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/388 2024-03-28T23:20:51.454 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/388 2024-03-28T23:20:51.454 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:51.460 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:51.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:51.496 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-03-28T23:20:51.999 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:52.010 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:52.011 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:52.013 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:52.013 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:52.150 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:20:52.154 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:20:52.588 INFO:teuthology.orchestra.run.smithi153.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-03-28T23:20:52.600 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/389 2024-03-28T23:20:52.600 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/389 2024-03-28T23:20:52.601 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:52.613 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:52.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:52.650 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-03-28T23:20:53.201 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:53.214 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:53.215 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:53.218 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:53.218 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:generic/390 [not run] ceph does not support freezing 2024-03-28T23:20:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/390 2024-03-28T23:20:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/390 2024-03-28T23:20:53.878 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:53.889 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:53.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:53.929 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-03-28T23:20:54.463 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:54.474 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:54.475 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:54.478 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:55.060 INFO:teuthology.orchestra.run.smithi153.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T23:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/391 2024-03-28T23:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/391 2024-03-28T23:20:55.072 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:55.082 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:55.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:55.122 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-03-28T23:20:55.661 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:55.674 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:55.675 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:55.678 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:56.388 INFO:teuthology.orchestra.run.smithi153.stdout:generic/392 [not run] ceph does not support shutdown 2024-03-28T23:20:56.423 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/392 2024-03-28T23:20:56.424 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/392 2024-03-28T23:20:56.424 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:56.434 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:56.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:56.468 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-03-28T23:20:57.017 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:57.029 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:57.031 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:57.034 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:57.034 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:58.518 INFO:teuthology.orchestra.run.smithi153.stdout:generic/393 - output mismatch (see /tmp/tmp.0cGUU1Musyxfstests-dev/results//generic/393.out.bad) 2024-03-28T23:20:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: --- tests/generic/393.out 2024-03-28 21:53:24.357163349 +0000 2024-03-28T23:20:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: +++ /tmp/tmp.0cGUU1Musyxfstests-dev/results//generic/393.out.bad 2024-03-28 23:20:58.514388764 +0000 2024-03-28T23:20:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: @@ -27,8 +27,7 @@ 2024-03-28T23:20:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: * 2024-03-28T23:20:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: 000030 00 00 >..< 2024-03-28T23:20:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: 000032 2024-03-28T23:20:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: -000000 58 58 58 58 00 00 00 00 00 00 00 00 00 00 00 00 >XXXX............< 2024-03-28T23:20:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: -000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >................< 2024-03-28T23:20:58.524 INFO:teuthology.orchestra.run.smithi153.stdout: +000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >................< 2024-03-28T23:20:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: * 2024-03-28T23:20:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: 000030 00 00 >..< 2024-03-28T23:20:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: 000032 2024-03-28T23:20:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: @@ -39,7 +38,6 @@ 2024-03-28T23:20:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: 000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >................< 2024-03-28T23:20:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: * 2024-03-28T23:20:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: 001000 2024-03-28T23:20:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: -000000 58 58 58 58 00 00 00 00 00 00 00 00 00 00 00 00 >XXXX............< 2024-03-28T23:20:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: -000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >................< 2024-03-28T23:20:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: +000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >................< 2024-03-28T23:20:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: * 2024-03-28T23:20:58.525 INFO:teuthology.orchestra.run.smithi153.stdout: 001000 2024-03-28T23:20:58.530 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/393 2024-03-28T23:20:58.530 INFO:teuthology.orchestra.run.smithi153.stdout:Failures: generic/393 2024-03-28T23:20:58.530 INFO:teuthology.orchestra.run.smithi153.stdout:Failed 1 of 1 tests 2024-03-28T23:20:58.538 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:58.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T23:20:58.565 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-28T23:20:58.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-28T23:20:58.566 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-03-28T23:20:59.096 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:20:59.109 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:20:59.110 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:20:59.113 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:20:59.114 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:59.768 INFO:teuthology.orchestra.run.smithi153.stdout:generic/394 0s 2024-03-28T23:20:59.782 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/394 2024-03-28T23:20:59.782 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:20:59.789 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:20:59.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:20:59.877 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-03-28T23:21:00.560 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:00.577 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:00.578 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:00.581 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:00.581 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:02.744 INFO:teuthology.orchestra.run.smithi153.stdout:generic/395 2s 2024-03-28T23:21:02.778 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/395 2024-03-28T23:21:02.778 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:02.790 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:02.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:02.840 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-03-28T23:21:03.393 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:03.406 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:03.407 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:03.410 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:03.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:04.734 INFO:teuthology.orchestra.run.smithi153.stdout:generic/396 1s 2024-03-28T23:21:04.749 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/396 2024-03-28T23:21:04.749 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:04.756 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:04.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:04.782 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-03-28T23:21:05.314 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:05.326 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:05.328 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:05.331 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:05.331 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:07.521 INFO:teuthology.orchestra.run.smithi153.stdout:generic/397 2s 2024-03-28T23:21:07.534 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/397 2024-03-28T23:21:07.534 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:07.541 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:07.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:07.570 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-03-28T23:21:08.069 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:08.081 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:08.082 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:08.084 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:08.085 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:09.078 INFO:teuthology.orchestra.run.smithi153.stdout:generic/398 [not run] kernel doesn't support renameat2 syscall 2024-03-28T23:21:09.089 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/398 2024-03-28T23:21:09.089 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/398 2024-03-28T23:21:09.089 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:09.097 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:09.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:09.210 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-03-28T23:21:09.902 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:09.913 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:09.915 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:09.917 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:09.917 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:10.804 INFO:teuthology.orchestra.run.smithi153.stdout:generic/399 [not run] Filesystem ceph not supported in _scratch_mkfs_sized_encrypted 2024-03-28T23:21:10.815 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/399 2024-03-28T23:21:10.815 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/399 2024-03-28T23:21:10.815 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:10.823 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:10.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:10.874 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-03-28T23:21:11.442 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:11.455 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:11.457 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:11.459 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:11.460 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:12.041 INFO:teuthology.orchestra.run.smithi153.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-28T23:21:12.054 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/400 2024-03-28T23:21:12.054 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/400 2024-03-28T23:21:12.055 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:12.065 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:12.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:12.102 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-03-28T23:21:12.665 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:12.677 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:12.679 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:12.682 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:12.682 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:13.757 INFO:teuthology.orchestra.run.smithi153.stdout:generic/401 1s 2024-03-28T23:21:13.788 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/401 2024-03-28T23:21:13.788 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:13.801 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:13.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:13.854 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-03-28T23:21:14.451 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:14.464 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:14.465 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:14.468 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:14.469 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:15.278 INFO:teuthology.orchestra.run.smithi153.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2024-03-28T23:21:15.296 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/402 2024-03-28T23:21:15.296 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/402 2024-03-28T23:21:15.296 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:15.304 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:15.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:15.335 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-03-28T23:21:15.874 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:15.887 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:15.888 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:15.891 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:15.892 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:17.218 INFO:teuthology.orchestra.run.smithi153.stdout:generic/403 1s 2024-03-28T23:21:17.229 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/403 2024-03-28T23:21:17.229 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:17.237 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:17.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:17.262 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-03-28T23:21:17.786 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:17.797 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:17.798 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:17.801 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:17.801 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:18.439 INFO:teuthology.orchestra.run.smithi153.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T23:21:18.450 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/404 2024-03-28T23:21:18.450 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/404 2024-03-28T23:21:18.450 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:18.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:18.499 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-03-28T23:21:19.050 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:19.063 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:19.065 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:19.071 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:19.071 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:19.732 INFO:teuthology.orchestra.run.smithi153.stdout:generic/405 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:21:19.744 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/405 2024-03-28T23:21:19.744 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/405 2024-03-28T23:21:19.744 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:19.752 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:19.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:19.791 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-03-28T23:21:20.346 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:20.357 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:20.359 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:20.361 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:20.362 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:22.287 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:21:22.295 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:21:24.308 INFO:teuthology.orchestra.run.smithi153.stdout:generic/406 4s 2024-03-28T23:21:24.323 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/406 2024-03-28T23:21:24.323 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:24.332 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:24.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:24.356 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-03-28T23:21:24.911 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:24.922 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:24.924 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:24.927 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:24.927 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:25.685 INFO:teuthology.orchestra.run.smithi153.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:21:25.694 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/407 2024-03-28T23:21:25.694 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/407 2024-03-28T23:21:25.694 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:25.701 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:25.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:25.794 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-03-28T23:21:26.502 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:26.514 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:26.515 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:26.518 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:26.518 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:27.163 INFO:teuthology.orchestra.run.smithi153.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-28T23:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/408 2024-03-28T23:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/408 2024-03-28T23:21:27.177 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:27.187 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:27.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:27.318 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-03-28T23:21:27.979 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:27.989 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:27.991 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:27.993 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:27.993 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:28.578 INFO:teuthology.orchestra.run.smithi153.stdout:generic/409 [not run] require 172.21.15.153:6789:/scratch to be local device 2024-03-28T23:21:28.588 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/409 2024-03-28T23:21:28.588 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/409 2024-03-28T23:21:28.589 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:28.597 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:28.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:28.634 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-03-28T23:21:29.205 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:29.217 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:29.218 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:29.221 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:29.221 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:29.873 INFO:teuthology.orchestra.run.smithi153.stdout:generic/410 [not run] require 172.21.15.153:6789:/scratch to be local device 2024-03-28T23:21:29.889 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/410 2024-03-28T23:21:29.889 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/410 2024-03-28T23:21:29.889 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:29.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:29.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:29.946 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-03-28T23:21:30.496 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:30.509 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:30.510 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:30.513 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:31.125 INFO:teuthology.orchestra.run.smithi153.stdout:generic/411 [not run] require 172.21.15.153:6789:/scratch to be local device 2024-03-28T23:21:31.139 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/411 2024-03-28T23:21:31.139 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/411 2024-03-28T23:21:31.139 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:31.150 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:31.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:31.189 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-03-28T23:21:31.788 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:31.801 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:31.803 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:31.806 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:31.806 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:32.903 INFO:teuthology.orchestra.run.smithi153.stdout:generic/412 0s 2024-03-28T23:21:32.919 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/412 2024-03-28T23:21:32.919 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:32.926 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:32.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:32.952 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-03-28T23:21:33.485 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:33.499 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:33.501 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:33.504 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:33.505 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:34.303 INFO:teuthology.orchestra.run.smithi153.stdout:generic/413 [not run] mount 172.21.15.153:6789:/scratch with dax failed 2024-03-28T23:21:34.316 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/413 2024-03-28T23:21:34.316 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/413 2024-03-28T23:21:34.316 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:34.328 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:34.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:34.374 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-03-28T23:21:34.903 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:34.917 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:34.918 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:34.921 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:34.921 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:35.795 INFO:teuthology.orchestra.run.smithi153.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:21:35.811 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/414 2024-03-28T23:21:35.811 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/414 2024-03-28T23:21:35.811 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:35.823 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:36.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:36.154 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-03-28T23:21:36.656 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:36.668 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:36.669 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:36.673 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:37.569 INFO:teuthology.orchestra.run.smithi153.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:21:37.585 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/415 2024-03-28T23:21:37.585 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/415 2024-03-28T23:21:37.585 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:37.598 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:37.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:37.890 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-03-28T23:21:38.403 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:38.416 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:38.417 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:38.420 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:38.420 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:39.050 INFO:teuthology.orchestra.run.smithi153.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T23:21:39.062 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/416 2024-03-28T23:21:39.062 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/416 2024-03-28T23:21:39.062 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:39.071 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:39.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:39.108 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-03-28T23:21:39.682 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:39.695 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:39.697 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:39.700 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:40.451 INFO:teuthology.orchestra.run.smithi153.stdout:generic/417 [not run] ceph does not support shutdown 2024-03-28T23:21:40.471 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/417 2024-03-28T23:21:40.471 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/417 2024-03-28T23:21:40.471 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:40.479 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:40.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:40.510 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-03-28T23:21:41.061 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:41.074 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:41.075 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:41.078 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:41.078 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:41.747 INFO:teuthology.orchestra.run.smithi153.stdout:generic/418 [not run] require 172.21.15.153:6789:/test to be valid block disk 2024-03-28T23:21:41.761 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/418 2024-03-28T23:21:41.761 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/418 2024-03-28T23:21:41.761 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:41.772 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:41.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:41.817 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-03-28T23:21:42.380 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:42.393 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:42.397 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:42.398 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:42.398 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:43.382 INFO:teuthology.orchestra.run.smithi153.stdout:generic/419 [not run] kernel doesn't support renameat2 syscall 2024-03-28T23:21:43.393 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/419 2024-03-28T23:21:43.394 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/419 2024-03-28T23:21:43.394 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:43.402 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:43.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:43.506 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-03-28T23:21:44.198 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:44.210 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:44.211 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:44.214 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:45.034 INFO:teuthology.orchestra.run.smithi153.stdout:generic/420 1s 2024-03-28T23:21:45.049 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/420 2024-03-28T23:21:45.049 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:45.056 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:45.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:45.175 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-03-28T23:21:45.889 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:45.901 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:45.902 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:45.905 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:52.433 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:21:52.440 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:21:55.464 INFO:teuthology.orchestra.run.smithi153.stdout:generic/421 9s 2024-03-28T23:21:55.502 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/421 2024-03-28T23:21:55.502 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:55.514 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:55.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:55.568 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-03-28T23:21:56.115 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:56.127 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:56.129 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:56.132 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:56.132 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:56.687 INFO:teuthology.orchestra.run.smithi153.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-28T23:21:56.700 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/422 2024-03-28T23:21:56.700 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/422 2024-03-28T23:21:56.700 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:56.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:56.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:56.756 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-03-28T23:21:57.330 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:57.343 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:57.344 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:57.347 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:58.209 INFO:teuthology.orchestra.run.smithi153.stdout:generic/423 1s 2024-03-28T23:21:58.227 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/423 2024-03-28T23:21:58.227 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:58.236 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:58.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:58.346 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-03-28T23:21:59.040 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:21:59.051 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:21:59.053 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:21:59.056 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:59.700 INFO:teuthology.orchestra.run.smithi153.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-03-28T23:21:59.713 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/424 2024-03-28T23:21:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/424 2024-03-28T23:21:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:21:59.725 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:21:59.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:21:59.766 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-03-28T23:22:00.320 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:22:00.333 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:22:00.334 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:22:00.337 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:22:00.337 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:22:00.989 INFO:teuthology.orchestra.run.smithi153.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2024-03-28T23:22:00.999 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/425 2024-03-28T23:22:00.999 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/425 2024-03-28T23:22:01.000 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:22:01.007 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:22:01.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:22:01.093 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-03-28T23:22:01.794 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:22:01.805 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:22:01.807 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:22:01.810 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:22:01.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:22:22.562 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:22:22.568 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:22:53.571 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:22:53.579 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:22:54.469 INFO:tasks.ceph.mds.c.smithi153.stderr:2024-03-28T23:22:54.468+0000 7f40c4c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 354493) UID: 0 2024-03-28T23:22:54.470 INFO:tasks.ceph.mds.a.smithi153.stderr:2024-03-28T23:22:54.468+0000 7f063e400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 354493) UID: 0 2024-03-28T23:23:05.931 INFO:teuthology.orchestra.run.smithi153.stdout:generic/426 63s 2024-03-28T23:23:06.067 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/426 2024-03-28T23:23:06.067 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:23:06.100 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:06.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:23:06.443 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-03-28T23:23:09.627 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:23:09.638 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:23:09.640 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:23:09.643 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:23:09.643 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:10.528 INFO:teuthology.orchestra.run.smithi153.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T23:23:10.540 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/427 2024-03-28T23:23:10.540 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/427 2024-03-28T23:23:10.540 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:23:10.548 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:10.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:23:10.585 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-03-28T23:23:11.112 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:23:11.125 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:23:11.127 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:23:11.130 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:23:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:11.784 INFO:teuthology.orchestra.run.smithi153.stdout:generic/428 0s 2024-03-28T23:23:11.799 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/428 2024-03-28T23:23:11.800 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:23:11.807 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:11.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:23:11.853 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-03-28T23:23:12.385 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:23:12.397 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:23:12.399 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:23:12.402 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:23:12.402 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:24.704 INFO:teuthology.orchestra.run.smithi153.stdout:generic/429 12s 2024-03-28T23:23:24.717 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/429 2024-03-28T23:23:24.717 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:23:24.724 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:24.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:23:24.748 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-03-28T23:23:25.601 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:23:25.632 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:23:25.632 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:23:25.635 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:23:25.635 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:generic/430 1s 2024-03-28T23:23:26.511 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/430 2024-03-28T23:23:26.511 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:23:26.519 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:26.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:23:26.647 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-03-28T23:23:27.429 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:23:27.442 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:23:27.443 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:23:27.446 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:23:27.446 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:28.188 INFO:teuthology.orchestra.run.smithi153.stdout:generic/431 1s 2024-03-28T23:23:28.203 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/431 2024-03-28T23:23:28.204 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:23:28.212 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:28.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:23:28.367 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-03-28T23:23:29.074 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:23:29.084 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:23:29.085 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:23:29.088 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:23:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:29.846 INFO:teuthology.orchestra.run.smithi153.stdout:generic/432 0s 2024-03-28T23:23:29.860 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/432 2024-03-28T23:23:29.860 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:23:29.867 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:29.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:23:29.986 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-03-28T23:23:30.667 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:23:30.677 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:23:30.678 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:23:30.680 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:23:30.680 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:31.400 INFO:teuthology.orchestra.run.smithi153.stdout:generic/433 1s 2024-03-28T23:23:31.416 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/433 2024-03-28T23:23:31.416 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:23:31.425 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:31.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:23:31.537 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-03-28T23:23:32.262 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:23:32.273 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:23:32.274 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:23:32.277 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:23:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:33.059 INFO:teuthology.orchestra.run.smithi153.stdout:generic/434 1s 2024-03-28T23:23:33.074 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/434 2024-03-28T23:23:33.075 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:23:33.082 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:23:33.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:23:33.210 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-03-28T23:23:33.938 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:23:33.950 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:23:33.952 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:23:33.955 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:23:33.955 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:26:46.056 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:26:46.063 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:27:16.229 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:27:16.237 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:27:46.385 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:27:46.395 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:28:16.540 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:28:16.546 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:28:46.687 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:28:46.694 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:29:16.842 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:29:16.851 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:29:46.994 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:29:47.000 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:29:47.109 INFO:tasks.ceph.mds.c.smithi153.stderr:2024-03-28T23:29:47.108+0000 7f40c4c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 359624) UID: 0 2024-03-28T23:29:47.109 INFO:tasks.ceph.mds.a.smithi153.stderr:2024-03-28T23:29:47.108+0000 7f063e400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 359624) UID: 0 2024-03-28T23:32:48.096 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:32:48.103 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:33:18.289 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:33:18.294 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:33:49.120 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:33:49.127 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:34:19.290 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:34:19.302 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:34:49.637 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:34:49.644 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:34:49.758 INFO:tasks.ceph.mds.a.smithi153.stderr:2024-03-28T23:34:49.758+0000 7f063e400640 -1 received signal: Hangup from (PID: 359895) UID: 0 2024-03-28T23:34:49.769 INFO:tasks.ceph.mds.c.smithi153.stderr:2024-03-28T23:34:49.758+0000 7f40c4c00640 -1 received signal: Hangup from (PID: 359895) UID: 0 2024-03-28T23:37:56.266 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:37:56.275 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:38:26.414 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:38:26.420 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:38:53.905 INFO:teuthology.orchestra.run.smithi153.stdout:generic/435 919s 2024-03-28T23:38:53.924 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/435 2024-03-28T23:38:53.924 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:38:53.933 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:38:53.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:38:53.969 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-03-28T23:38:54.663 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:38:54.673 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:38:54.675 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:38:54.679 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:38:54.679 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:38:55.994 INFO:teuthology.orchestra.run.smithi153.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T23:38:56.006 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/436 2024-03-28T23:38:56.006 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/436 2024-03-28T23:38:56.006 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:38:56.017 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:38:56.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:38:56.101 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-03-28T23:38:56.832 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:38:56.846 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:38:56.847 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:38:56.850 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:38:56.850 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:38:57.515 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:38:57.520 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:38:58.296 INFO:teuthology.orchestra.run.smithi153.stdout:generic/437 1s 2024-03-28T23:38:58.314 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/437 2024-03-28T23:38:58.314 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:38:58.322 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:38:58.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:38:58.379 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-03-28T23:38:58.966 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:38:58.979 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:38:58.981 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:38:58.984 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:38:58.984 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:39:27.647 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:39:27.656 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:39:57.819 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:39:57.825 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:40:27.937 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:40:27.945 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:40:58.069 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:40:58.077 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:41:28.207 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:41:28.213 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:41:58.378 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:41:58.386 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:41:58.475 INFO:tasks.ceph.mds.a.smithi153.stderr:2024-03-28T23:41:58.474+0000 7f063e400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 381477) UID: 0 2024-03-28T23:41:58.475 INFO:tasks.ceph.mds.c.smithi153.stderr:2024-03-28T23:41:58.473+0000 7f40c4c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 381477) UID: 0 2024-03-28T23:42:08.952 INFO:teuthology.orchestra.run.smithi153.stdout:generic/438 189s 2024-03-28T23:42:08.965 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/438 2024-03-28T23:42:08.965 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:42:08.972 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:09.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:42:09.010 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-03-28T23:42:09.547 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:42:09.560 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:42:09.561 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:42:09.564 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:42:09.565 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:11.241 INFO:teuthology.orchestra.run.smithi153.stdout:generic/439 2s 2024-03-28T23:42:11.257 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/439 2024-03-28T23:42:11.257 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:42:11.265 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:11.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:42:11.304 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-03-28T23:42:11.762 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:42:11.773 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:42:11.774 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:42:11.777 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:42:11.777 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:13.817 INFO:teuthology.orchestra.run.smithi153.stdout:generic/440 2s 2024-03-28T23:42:13.830 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/440 2024-03-28T23:42:13.830 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:42:13.836 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:13.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:42:13.861 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-03-28T23:42:14.350 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:42:14.361 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:42:14.362 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:42:14.364 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:42:14.365 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:15.013 INFO:teuthology.orchestra.run.smithi153.stdout:generic/441 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:42:15.024 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/441 2024-03-28T23:42:15.024 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/441 2024-03-28T23:42:15.024 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:42:15.030 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:15.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:42:15.063 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-03-28T23:42:15.561 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:42:15.572 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:42:15.574 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:42:15.576 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:42:15.576 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:16.169 INFO:teuthology.orchestra.run.smithi153.stdout:generic/442 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:42:16.182 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/442 2024-03-28T23:42:16.182 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/442 2024-03-28T23:42:16.182 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:42:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:16.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:42:16.226 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-03-28T23:42:16.775 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:42:16.786 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:42:16.788 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:42:16.791 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:42:16.791 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:17.402 INFO:teuthology.orchestra.run.smithi153.stdout:generic/443 1s 2024-03-28T23:42:17.418 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/443 2024-03-28T23:42:17.419 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:42:17.426 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:17.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:42:17.478 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-03-28T23:42:17.993 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:42:18.007 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:42:18.008 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:42:18.011 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:42:18.011 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:18.691 INFO:teuthology.orchestra.run.smithi153.stdout:generic/444 0s 2024-03-28T23:42:18.706 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/444 2024-03-28T23:42:18.706 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:42:18.714 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:18.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:42:18.760 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-03-28T23:42:19.240 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:42:19.251 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:42:19.252 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:42:19.255 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:42:19.255 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:20.489 INFO:teuthology.orchestra.run.smithi153.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T23:42:20.500 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/445 2024-03-28T23:42:20.500 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/445 2024-03-28T23:42:20.500 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:42:20.508 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:20.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:42:20.610 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-03-28T23:42:21.377 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:42:21.388 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:42:21.389 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:42:21.392 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:42:21.392 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:47.121 INFO:teuthology.orchestra.run.smithi153.stdout:generic/446 26s 2024-03-28T23:42:47.156 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/446 2024-03-28T23:42:47.156 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:42:47.169 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:47.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:42:47.216 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-03-28T23:42:47.862 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:42:47.872 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:42:47.874 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:42:47.876 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:42:47.877 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:48.760 INFO:teuthology.orchestra.run.smithi153.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:42:48.789 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/447 2024-03-28T23:42:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/447 2024-03-28T23:42:48.790 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:42:48.809 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:49.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:42:49.202 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-03-28T23:42:49.638 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:42:49.649 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:42:49.650 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:42:49.654 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:42:49.654 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:51.376 INFO:teuthology.orchestra.run.smithi153.stdout:generic/448 2s 2024-03-28T23:42:51.391 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/448 2024-03-28T23:42:51.391 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:42:51.398 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:51.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:42:51.510 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-03-28T23:42:52.218 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:42:52.229 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:42:52.231 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:42:52.233 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:42:52.234 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:54.668 INFO:teuthology.orchestra.run.smithi153.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-28T23:42:54.680 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/449 2024-03-28T23:42:54.680 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/449 2024-03-28T23:42:54.680 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:42:54.691 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:54.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:42:54.797 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-03-28T23:42:55.522 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:42:55.531 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:42:55.533 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:42:55.536 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:42:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:57.019 INFO:teuthology.orchestra.run.smithi153.stdout:generic/450 2s 2024-03-28T23:42:57.032 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/450 2024-03-28T23:42:57.032 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:42:57.040 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:42:57.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:42:57.177 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-03-28T23:42:57.907 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:42:57.919 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:42:57.920 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:42:57.923 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:42:57.923 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:28.697 INFO:teuthology.orchestra.run.smithi153.stdout:generic/451 30s 2024-03-28T23:43:28.713 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/451 2024-03-28T23:43:28.713 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:43:28.721 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:28.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:43:28.818 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-03-28T23:43:29.530 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:43:29.541 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:43:29.543 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:43:29.545 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:43:29.545 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:30.367 INFO:teuthology.orchestra.run.smithi153.stdout:generic/452 1s 2024-03-28T23:43:30.380 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/452 2024-03-28T23:43:30.380 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:43:30.387 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:30.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:43:30.413 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-03-28T23:43:30.950 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:43:30.962 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:43:30.963 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:43:30.966 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:43:30.966 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:31.537 INFO:teuthology.orchestra.run.smithi153.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2024-03-28T23:43:31.548 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/453 2024-03-28T23:43:31.549 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/453 2024-03-28T23:43:31.549 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:43:31.557 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:31.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:43:31.601 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-03-28T23:43:32.116 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:43:32.128 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:43:32.130 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:43:32.133 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:43:32.133 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:32.730 INFO:teuthology.orchestra.run.smithi153.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2024-03-28T23:43:32.742 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/454 2024-03-28T23:43:32.742 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/454 2024-03-28T23:43:32.742 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:43:32.750 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:32.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:43:32.800 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-03-28T23:43:33.296 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:43:33.309 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:43:33.310 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:43:33.313 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:43:33.313 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:34.010 INFO:teuthology.orchestra.run.smithi153.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-28T23:43:34.023 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/455 2024-03-28T23:43:34.023 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/455 2024-03-28T23:43:34.023 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:43:34.031 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:34.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:43:34.063 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-03-28T23:43:34.561 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:43:34.571 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:43:34.572 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:43:34.575 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:43:34.575 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:35.140 INFO:teuthology.orchestra.run.smithi153.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-28T23:43:35.151 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/456 2024-03-28T23:43:35.151 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/456 2024-03-28T23:43:35.151 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:43:35.159 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:35.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:43:35.199 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-03-28T23:43:35.738 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:43:35.752 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:43:35.753 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:43:35.756 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:43:35.757 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:36.858 INFO:teuthology.orchestra.run.smithi153.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:43:36.884 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/457 2024-03-28T23:43:36.884 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/457 2024-03-28T23:43:36.885 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:43:36.895 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:37.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:43:37.055 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-03-28T23:43:37.533 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:43:37.544 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:43:37.545 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:43:37.548 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:43:37.548 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:38.714 INFO:teuthology.orchestra.run.smithi153.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-28T23:43:38.740 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/458 2024-03-28T23:43:38.740 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/458 2024-03-28T23:43:38.740 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:43:38.766 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:39.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:43:39.105 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-03-28T23:43:39.580 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:43:39.590 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:43:39.592 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:43:39.594 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:43:39.594 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:40.499 INFO:teuthology.orchestra.run.smithi153.stdout:generic/459 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:43:40.510 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/459 2024-03-28T23:43:40.510 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/459 2024-03-28T23:43:40.510 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:43:40.519 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:40.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:43:40.562 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-03-28T23:43:41.076 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:43:41.090 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:43:41.091 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:43:41.094 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:43:41.094 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:44.847 INFO:teuthology.orchestra.run.smithi153.stdout:generic/460 3s 2024-03-28T23:43:44.861 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/460 2024-03-28T23:43:44.861 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:43:44.869 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:44.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:43:44.899 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-03-28T23:43:45.405 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:43:45.419 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:43:45.421 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:43:45.424 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:43:45.424 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:46.132 INFO:teuthology.orchestra.run.smithi153.stdout:generic/461 [not run] ceph does not support shutdown 2024-03-28T23:43:46.142 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/461 2024-03-28T23:43:46.143 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/461 2024-03-28T23:43:46.143 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:43:46.152 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:46.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:43:46.185 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-03-28T23:43:46.850 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:43:46.860 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:43:46.861 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:43:46.864 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:43:46.864 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:47.548 INFO:teuthology.orchestra.run.smithi153.stdout:generic/462 [not run] mount 172.21.15.153:6789:/scratch with dax failed 2024-03-28T23:43:47.560 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/462 2024-03-28T23:43:47.561 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/462 2024-03-28T23:43:47.561 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:43:47.571 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:47.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:43:47.606 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-03-28T23:43:48.139 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:43:48.149 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:43:48.150 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:43:48.153 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:43:48.154 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:48.773 INFO:teuthology.orchestra.run.smithi153.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2024-03-28T23:43:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/463 2024-03-28T23:43:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/463 2024-03-28T23:43:48.783 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:43:48.790 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:43:48.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:43:48.907 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-03-28T23:43:49.626 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:43:49.636 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:43:49.637 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:43:49.640 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:43:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:44:50.635 INFO:teuthology.orchestra.run.smithi153.stdout:generic/464 61s 2024-03-28T23:44:50.646 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/464 2024-03-28T23:44:50.646 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:44:50.652 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:44:50.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:44:50.675 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-03-28T23:44:51.204 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:44:51.216 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:44:51.217 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:44:51.220 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:44:51.220 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:45:00.119 INFO:teuthology.orchestra.run.smithi153.stdout:generic/465 8s 2024-03-28T23:45:00.144 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/465 2024-03-28T23:45:00.145 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:45:00.163 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:45:00.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:45:00.213 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-03-28T23:45:00.283 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:45:00.290 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:45:00.848 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:45:00.858 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:45:00.859 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:45:00.862 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:45:00.862 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:45:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:generic/466 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:45:01.450 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/466 2024-03-28T23:45:01.450 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/466 2024-03-28T23:45:01.450 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:45:01.458 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:45:01.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:45:01.500 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-03-28T23:45:02.082 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:45:02.096 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:45:02.098 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:45:02.103 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:45:02.103 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:45:14.402 INFO:teuthology.orchestra.run.smithi153.stdout:generic/467 12s 2024-03-28T23:45:14.493 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/467 2024-03-28T23:45:14.493 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:45:14.514 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:45:14.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:45:14.738 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-03-28T23:45:16.497 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:45:16.510 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:45:16.512 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:45:16.515 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:45:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:45:17.420 INFO:teuthology.orchestra.run.smithi153.stdout:generic/468 [not run] ceph does not support shutdown 2024-03-28T23:45:17.444 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/468 2024-03-28T23:45:17.444 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/468 2024-03-28T23:45:17.444 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:45:17.453 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:45:17.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:45:17.490 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-03-28T23:45:18.059 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:45:18.071 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:45:18.073 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:45:18.078 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:45:18.078 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:45:18.740 INFO:teuthology.orchestra.run.smithi153.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-28T23:45:18.751 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/469 2024-03-28T23:45:18.751 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/469 2024-03-28T23:45:18.751 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:45:18.760 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:45:18.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:45:18.815 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-03-28T23:45:19.438 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:45:19.451 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:45:19.453 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:45:19.456 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:45:19.456 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:45:20.145 INFO:teuthology.orchestra.run.smithi153.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-28T23:45:20.158 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/470 2024-03-28T23:45:20.159 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/470 2024-03-28T23:45:20.159 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:45:20.170 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:45:20.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:45:20.229 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-03-28T23:45:20.810 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:45:20.823 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:45:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:45:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:45:20.829 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:45:30.946 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:45:30.952 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:46:01.145 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:46:01.150 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:46:31.266 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:46:31.274 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:46:32.013 INFO:teuthology.orchestra.run.smithi153.stdout:generic/471 70s 2024-03-28T23:46:32.067 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/471 2024-03-28T23:46:32.067 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:46:32.078 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:46:32.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:46:32.216 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-03-28T23:46:32.931 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:46:32.942 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:46:32.944 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:46:32.946 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:46:32.946 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:46:35.097 INFO:teuthology.orchestra.run.smithi153.stdout:generic/472 [not run] swapfiles are not supported 2024-03-28T23:46:35.109 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/472 2024-03-28T23:46:35.109 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/472 2024-03-28T23:46:35.109 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:46:35.117 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:46:35.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:46:35.155 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-03-28T23:46:35.709 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:46:35.721 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:46:35.723 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:46:35.725 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:46:35.725 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:46:36.390 INFO:teuthology.orchestra.run.smithi153.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-28T23:46:36.405 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/473 2024-03-28T23:46:36.405 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/473 2024-03-28T23:46:36.405 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:46:36.416 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:46:36.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:46:36.466 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-03-28T23:46:37.065 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:46:37.078 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:46:37.079 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:46:37.083 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:46:37.083 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:46:37.810 INFO:teuthology.orchestra.run.smithi153.stdout:generic/474 [not run] ceph does not support shutdown 2024-03-28T23:46:37.834 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/474 2024-03-28T23:46:37.834 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/474 2024-03-28T23:46:37.834 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:46:37.843 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:46:37.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:46:37.876 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-03-28T23:46:38.427 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:46:38.439 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:46:38.441 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:46:38.444 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:46:38.444 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:46:39.119 INFO:teuthology.orchestra.run.smithi153.stdout:generic/475 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-28T23:46:39.132 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/475 2024-03-28T23:46:39.132 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/475 2024-03-28T23:46:39.133 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-28T23:46:39.142 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:46:39.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-28T23:46:39.180 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-03-28T23:46:39.718 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-28T23:46:39.731 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-28T23:46:39.733 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-28T23:46:39.738 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-28T23:46:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-28T23:47:01.999 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:47:02.013 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:47:32.405 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:47:32.411 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:48:02.554 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:48:02.570 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:48:32.776 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:48:32.783 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:49:03.013 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:49:03.034 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:49:33.224 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:49:33.234 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:49:33.422 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-03-28T23:49:33.422+0000 7f9a29600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49126) UID: 0 2024-03-28T23:49:33.422 INFO:tasks.ceph.osd.7.smithi165.stderr:2024-03-28T23:49:33.422+0000 7fdf9b000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49126) UID: 0 2024-03-28T23:49:33.422 INFO:tasks.ceph.osd.6.smithi165.stderr:2024-03-28T23:49:33.422+0000 7fb4ff200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49126) UID: 0 2024-03-28T23:49:33.423 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-03-28T23:49:33.422+0000 7f3384a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49126) UID: 0 2024-03-28T23:52:45.780 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:52:45.792 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:52:46.648 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-03-28T23:52:46.646+0000 7f43d5200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 468150) UID: 0 2024-03-28T23:52:46.651 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-03-28T23:52:46.648+0000 7f277ba00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 468150) UID: 0 2024-03-28T23:52:46.656 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-03-28T23:52:46.653+0000 7fb010800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 468150) UID: 0 2024-03-28T23:52:46.677 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-03-28T23:52:46.672+0000 7fb6b6200640 -1 Fail to open '/proc/468150/cmdline' error = (2) No such file or directory 2024-03-28T23:52:46.677 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-03-28T23:52:46.672+0000 7fb6b6200640 -1 received signal: Hangup from (PID: 468150) UID: 0 2024-03-28T23:58:21.985 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:58:21.992 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T23:58:22.119 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-03-28T23:58:22.118+0000 7f3384a00640 -1 received signal: Hangup from (PID: 49227) UID: 0 2024-03-28T23:58:22.120 INFO:tasks.ceph.osd.7.smithi165.stderr:2024-03-28T23:58:22.105+0000 7fdf9b000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49227) UID: 0 2024-03-28T23:58:22.127 INFO:tasks.ceph.osd.6.smithi165.stderr:2024-03-28T23:58:22.115+0000 7fb4ff200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49227) UID: 0 2024-03-28T23:58:22.143 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-03-28T23:58:22.120+0000 7f9a29600640 -1 Fail to open '/proc/49227/cmdline' error = (2) No such file or directory 2024-03-28T23:58:22.143 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-03-28T23:58:22.139+0000 7f9a29600640 -1 received signal: Hangup from (PID: 49227) UID: 0 2024-03-29T00:00:06.860 INFO:tasks.ceph.mds.a.smithi153.stderr:2024-03-29T00:00:06.859+0000 7f063e400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 468202) UID: 0 2024-03-29T00:00:06.860 INFO:tasks.ceph.mds.c.smithi153.stderr:2024-03-29T00:00:06.859+0000 7f40c4c00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 468202) UID: 0 2024-03-29T00:01:35.736 INFO:teuthology.orchestra.run.smithi165.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.4.log.1: 2024-03-29T00:01:35.737 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: stdin: file size changed while zipping 2024-03-29T00:02:10.027 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T00:02:10.042 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T00:02:10.201 INFO:teuthology.orchestra.run.smithi153.stderr:error: state file /var/lib/logrotate/logrotate.status is already locked 2024-03-29T00:02:10.201 INFO:teuthology.orchestra.run.smithi153.stderr:logrotate does not support parallel execution on the same set of logfiles. 2024-03-29T00:02:10.207 DEBUG:teuthology.orchestra.run:got remote process result: 3 2024-03-29T00:02:10.207 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi153 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-29T00:05:32.252 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-03-29T00:05:32.251+0000 7f277ba00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 468355) UID: 0 2024-03-29T00:05:32.268 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-03-29T00:05:32.252+0000 7f43d5200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 468355) UID: 0 2024-03-29T00:05:32.274 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-03-29T00:05:32.268+0000 7fb010800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 468355) UID: 0 2024-03-29T00:05:32.278 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-03-29T00:05:32.274+0000 7fb6b6200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 468355) UID: 0 2024-03-29T00:50:11.058 INFO:teuthology.orchestra.run.smithi153.stdout:generic/476 3806s 2024-03-29T00:50:11.139 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/476 2024-03-29T00:50:11.139 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:50:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:50:11.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:50:11.214 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-03-29T00:50:19.108 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:50:19.122 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:50:19.123 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:50:19.126 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:50:19.126 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:58:46.957 INFO:teuthology.orchestra.run.smithi153.stdout:generic/477 53s 2024-03-29T00:58:47.066 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/477 2024-03-29T00:58:47.066 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:58:47.090 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:58:47.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:58:47.294 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-03-29T00:58:49.002 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:58:49.016 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:58:49.018 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:58:49.023 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:58:49.023 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:01.678 INFO:teuthology.orchestra.run.smithi153.stdout:generic/478 12s 2024-03-29T00:59:01.698 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/478 2024-03-29T00:59:01.699 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:01.708 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:01.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:01.767 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-03-29T00:59:02.430 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:02.449 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:02.450 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:02.456 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:02.456 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:03.292 INFO:teuthology.orchestra.run.smithi153.stdout:generic/479 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T00:59:03.306 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/479 2024-03-29T00:59:03.306 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/479 2024-03-29T00:59:03.306 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:03.316 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:03.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:03.372 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-03-29T00:59:03.994 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:04.015 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:04.017 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:04.021 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:04.021 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:04.756 INFO:teuthology.orchestra.run.smithi153.stdout:generic/480 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T00:59:04.768 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/480 2024-03-29T00:59:04.769 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/480 2024-03-29T00:59:04.769 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:04.782 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:04.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:04.840 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-03-29T00:59:05.487 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:05.504 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:05.505 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:05.509 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:05.509 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:06.235 INFO:teuthology.orchestra.run.smithi153.stdout:generic/481 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T00:59:06.248 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/481 2024-03-29T00:59:06.248 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/481 2024-03-29T00:59:06.248 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:06.261 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:06.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:06.306 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-03-29T00:59:06.974 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:06.991 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:06.994 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:06.997 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:06.997 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:07.860 INFO:teuthology.orchestra.run.smithi153.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-29T00:59:07.874 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/482 2024-03-29T00:59:07.874 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/482 2024-03-29T00:59:07.874 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:07.884 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:07.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:07.932 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-03-29T00:59:08.610 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:08.624 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:08.626 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:08.630 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:08.630 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:09.325 INFO:teuthology.orchestra.run.smithi153.stdout:generic/483 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T00:59:09.338 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/483 2024-03-29T00:59:09.338 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/483 2024-03-29T00:59:09.339 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:09.350 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:09.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:09.392 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-03-29T00:59:10.059 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:10.074 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:10.075 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:10.078 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:10.078 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:10.805 INFO:teuthology.orchestra.run.smithi153.stdout:generic/484 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T00:59:10.821 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/484 2024-03-29T00:59:10.821 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/484 2024-03-29T00:59:10.821 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:10.832 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:10.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:10.886 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-03-29T00:59:11.553 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:11.568 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:11.570 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:11.575 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:11.575 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:12.316 INFO:teuthology.orchestra.run.smithi153.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-29T00:59:12.330 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/485 2024-03-29T00:59:12.330 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/485 2024-03-29T00:59:12.330 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:12.338 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:12.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:12.392 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-03-29T00:59:13.131 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:13.146 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:13.148 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:13.153 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:13.154 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:14.437 INFO:teuthology.orchestra.run.smithi153.stdout:generic/486 1s 2024-03-29T00:59:14.460 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/486 2024-03-29T00:59:14.460 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:14.471 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:14.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:14.504 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-03-29T00:59:15.178 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:15.192 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:15.194 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:15.199 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:15.199 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:15.930 INFO:teuthology.orchestra.run.smithi153.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2024-03-29T00:59:15.945 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/487 2024-03-29T00:59:15.945 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/487 2024-03-29T00:59:15.945 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:15.959 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:16.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:16.003 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-03-29T00:59:16.671 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:16.689 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:16.691 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:16.694 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:16.694 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:17.399 INFO:teuthology.orchestra.run.smithi153.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-29T00:59:17.412 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/488 2024-03-29T00:59:17.412 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/488 2024-03-29T00:59:17.412 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:17.423 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:17.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:17.474 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-03-29T00:59:18.158 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:18.179 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:18.181 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:18.184 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:18.184 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:18.909 INFO:teuthology.orchestra.run.smithi153.stdout:generic/489 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T00:59:18.921 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/489 2024-03-29T00:59:18.921 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/489 2024-03-29T00:59:18.921 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:18.928 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:18.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:18.979 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-03-29T00:59:19.660 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:19.679 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:19.681 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:19.685 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:19.686 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:22.219 INFO:teuthology.orchestra.run.smithi153.stdout:generic/490 3s 2024-03-29T00:59:22.241 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/490 2024-03-29T00:59:22.241 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:22.252 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:22.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:22.407 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-03-29T00:59:23.244 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:23.260 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:23.263 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:23.266 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:23.267 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:24.005 INFO:teuthology.orchestra.run.smithi153.stdout:generic/491 [not run] ceph does not support freezing 2024-03-29T00:59:24.016 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/491 2024-03-29T00:59:24.016 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/491 2024-03-29T00:59:24.016 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:24.024 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:24.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:24.068 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-03-29T00:59:24.721 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:24.738 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:24.740 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:24.744 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:24.744 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2024-03-29T00:59:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/492 2024-03-29T00:59:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/492 2024-03-29T00:59:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:25.469 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:25.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:25.509 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-03-29T00:59:26.183 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:26.202 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:26.203 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:26.206 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:26.206 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:27.269 INFO:teuthology.orchestra.run.smithi153.stdout:generic/493 [not run] swapfiles are not supported 2024-03-29T00:59:27.289 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/493 2024-03-29T00:59:27.289 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/493 2024-03-29T00:59:27.289 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:27.297 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:27.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:27.353 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-03-29T00:59:28.034 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:28.047 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:28.048 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:28.051 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:28.052 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:29.100 INFO:teuthology.orchestra.run.smithi153.stdout:generic/494 [not run] swapfiles are not supported 2024-03-29T00:59:29.114 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/494 2024-03-29T00:59:29.114 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/494 2024-03-29T00:59:29.114 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:29.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:29.181 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-03-29T00:59:29.849 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:29.866 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:29.869 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:29.875 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:29.876 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:30.914 INFO:teuthology.orchestra.run.smithi153.stdout:generic/495 [not run] swapfiles are not supported 2024-03-29T00:59:30.932 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/495 2024-03-29T00:59:30.932 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/495 2024-03-29T00:59:30.932 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:30.942 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:30.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:30.991 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-03-29T00:59:31.649 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:31.667 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:31.668 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:31.671 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:31.672 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:32.722 INFO:teuthology.orchestra.run.smithi153.stdout:generic/496 [not run] swapfiles are not supported 2024-03-29T00:59:32.737 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/496 2024-03-29T00:59:32.737 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/496 2024-03-29T00:59:32.737 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:32.746 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:32.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:32.796 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-03-29T00:59:33.472 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:33.489 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:33.494 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:33.497 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:33.497 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:34.491 INFO:teuthology.orchestra.run.smithi153.stdout:generic/497 [not run] swapfiles are not supported 2024-03-29T00:59:34.505 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/497 2024-03-29T00:59:34.505 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/497 2024-03-29T00:59:34.506 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:34.514 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:34.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:34.573 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-03-29T00:59:35.243 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:35.259 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:35.262 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:35.265 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:35.265 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:36.015 INFO:teuthology.orchestra.run.smithi153.stdout:generic/498 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T00:59:36.030 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/498 2024-03-29T00:59:36.030 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/498 2024-03-29T00:59:36.030 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:36.040 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:36.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:36.106 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-03-29T00:59:36.771 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:36.790 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:36.792 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:36.796 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:36.796 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:37.526 INFO:teuthology.orchestra.run.smithi153.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-29T00:59:37.538 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/499 2024-03-29T00:59:37.538 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/499 2024-03-29T00:59:37.538 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:37.549 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:37.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:37.601 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-03-29T00:59:38.274 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:38.290 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:38.291 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:38.295 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:38.295 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:39.115 INFO:teuthology.orchestra.run.smithi153.stdout:generic/500 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T00:59:39.127 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/500 2024-03-29T00:59:39.127 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/500 2024-03-29T00:59:39.127 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:39.133 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:39.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:39.184 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-03-29T00:59:39.816 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:39.832 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:39.833 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:39.838 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:39.838 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:41.037 INFO:teuthology.orchestra.run.smithi153.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T00:59:41.061 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/501 2024-03-29T00:59:41.062 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/501 2024-03-29T00:59:41.062 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:41.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:41.258 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-03-29T00:59:41.924 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:41.939 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:41.941 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:41.944 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:41.944 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:42.744 INFO:teuthology.orchestra.run.smithi153.stdout:generic/502 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T00:59:42.757 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/502 2024-03-29T00:59:42.758 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/502 2024-03-29T00:59:42.758 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:42.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:42.830 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-03-29T00:59:43.471 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:43.486 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:43.488 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:43.492 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:43.492 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:44.256 INFO:teuthology.orchestra.run.smithi153.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-29T00:59:44.271 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/503 2024-03-29T00:59:44.272 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/503 2024-03-29T00:59:44.272 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:44.279 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:44.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:44.346 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-03-29T00:59:45.001 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:45.017 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:45.019 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:45.023 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:45.024 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:46.732 INFO:teuthology.orchestra.run.smithi153.stdout:generic/504 1s 2024-03-29T00:59:46.755 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/504 2024-03-29T00:59:46.755 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:46.764 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:46.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:46.822 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-03-29T00:59:47.458 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:47.473 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:47.475 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:47.481 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:47.481 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:48.397 INFO:teuthology.orchestra.run.smithi153.stdout:generic/505 [not run] ceph does not support shutdown 2024-03-29T00:59:48.424 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/505 2024-03-29T00:59:48.424 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/505 2024-03-29T00:59:48.424 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:48.434 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:48.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:48.477 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-03-29T00:59:49.113 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:49.127 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:49.129 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:49.133 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:49.134 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:49.802 INFO:teuthology.orchestra.run.smithi153.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-29T00:59:49.816 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/506 2024-03-29T00:59:49.816 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/506 2024-03-29T00:59:49.816 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:49.825 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:49.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:49.869 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-03-29T00:59:50.532 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:50.549 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:50.551 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:50.555 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:50.555 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:51.300 INFO:teuthology.orchestra.run.smithi153.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-03-29T00:59:51.312 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/507 2024-03-29T00:59:51.313 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/507 2024-03-29T00:59:51.313 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:51.322 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:51.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:51.380 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-03-29T00:59:52.046 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:52.058 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:52.058 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:52.061 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:52.062 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:52.778 INFO:teuthology.orchestra.run.smithi153.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2024-03-29T00:59:52.791 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/508 2024-03-29T00:59:52.791 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/508 2024-03-29T00:59:52.791 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:52.799 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:52.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:52.846 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-03-29T00:59:53.504 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:53.526 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:53.527 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:53.531 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:53.531 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:54.264 INFO:teuthology.orchestra.run.smithi153.stdout:generic/509 [not run] O_TMPFILE is not supported 2024-03-29T00:59:54.276 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/509 2024-03-29T00:59:54.276 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/509 2024-03-29T00:59:54.276 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:54.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:54.327 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-03-29T00:59:54.980 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:54.995 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:54.996 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:54.999 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:54.999 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:55.723 INFO:teuthology.orchestra.run.smithi153.stdout:generic/510 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T00:59:55.739 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/510 2024-03-29T00:59:55.739 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/510 2024-03-29T00:59:55.739 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:55.750 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:55.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:55.801 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-03-29T00:59:56.447 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:56.461 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:56.463 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:56.469 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:56.469 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:57.175 INFO:teuthology.orchestra.run.smithi153.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-29T00:59:57.187 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/511 2024-03-29T00:59:57.189 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/511 2024-03-29T00:59:57.189 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:57.203 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:57.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:57.266 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-03-29T00:59:57.914 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:57.927 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:57.929 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:57.932 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:57.932 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:58.686 INFO:teuthology.orchestra.run.smithi153.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-29T00:59:58.700 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/512 2024-03-29T00:59:58.700 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/512 2024-03-29T00:59:58.700 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T00:59:58.708 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T00:59:58.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T00:59:58.764 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-03-29T00:59:59.423 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T00:59:59.437 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T00:59:59.439 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T00:59:59.443 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T00:59:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:00.510 INFO:teuthology.orchestra.run.smithi153.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T01:00:00.531 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/513 2024-03-29T01:00:00.531 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/513 2024-03-29T01:00:00.531 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:00:00.545 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:00.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:00:00.788 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-03-29T01:00:01.495 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:00:01.512 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:00:01.514 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:00:01.517 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:00:01.517 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:02.653 INFO:teuthology.orchestra.run.smithi153.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T01:00:02.670 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/514 2024-03-29T01:00:02.670 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/514 2024-03-29T01:00:02.670 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:00:02.681 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:02.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:00:02.931 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-03-29T01:00:03.655 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:00:03.672 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:00:03.673 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:00:03.676 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:00:03.676 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:04.757 INFO:teuthology.orchestra.run.smithi153.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T01:00:04.789 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/515 2024-03-29T01:00:04.789 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/515 2024-03-29T01:00:04.789 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:00:04.808 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:05.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:00:05.033 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-03-29T01:00:05.760 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:00:05.777 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:00:05.779 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:00:05.782 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:00:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:06.603 INFO:teuthology.orchestra.run.smithi153.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-29T01:00:06.617 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/516 2024-03-29T01:00:06.618 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/516 2024-03-29T01:00:06.618 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:00:06.629 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:06.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:00:06.761 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-03-29T01:00:07.610 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:00:07.622 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:00:07.623 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:00:07.627 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:00:07.627 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:08.623 INFO:teuthology.orchestra.run.smithi153.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-29T01:00:08.738 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/517 2024-03-29T01:00:08.738 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/517 2024-03-29T01:00:08.738 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:00:08.752 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:09.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:00:09.037 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-03-29T01:00:09.752 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:00:09.768 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:00:09.769 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:00:09.772 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:00:09.772 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:10.882 INFO:teuthology.orchestra.run.smithi153.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T01:00:10.911 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/518 2024-03-29T01:00:10.911 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/518 2024-03-29T01:00:10.911 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:00:10.936 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:11.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:00:11.205 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-03-29T01:00:11.896 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:00:11.914 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:00:11.915 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:00:11.919 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:00:11.919 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:12.728 INFO:teuthology.orchestra.run.smithi153.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2024-03-29T01:00:12.742 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/519 2024-03-29T01:00:12.742 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/519 2024-03-29T01:00:12.742 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:00:12.752 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:12.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:00:12.878 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-03-29T01:00:13.692 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:00:13.706 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:00:13.708 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:00:13.710 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:00:13.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:14.451 INFO:teuthology.orchestra.run.smithi153.stdout:generic/520 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T01:00:14.464 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/520 2024-03-29T01:00:14.464 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/520 2024-03-29T01:00:14.464 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:00:14.472 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:14.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:00:14.527 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-03-29T01:00:15.172 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:00:15.187 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:00:15.189 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:00:15.193 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:00:15.193 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:20.442 INFO:teuthology.orchestra.run.smithi153.stdout:generic/521 - output mismatch (see /tmp/tmp.0cGUU1Musyxfstests-dev/results//generic/521.out.bad) 2024-03-29T01:00:20.453 INFO:teuthology.orchestra.run.smithi153.stdout: --- tests/generic/521.out 2024-03-28 21:53:24.377162993 +0000 2024-03-29T01:00:20.453 INFO:teuthology.orchestra.run.smithi153.stdout: +++ /tmp/tmp.0cGUU1Musyxfstests-dev/results//generic/521.out.bad 2024-03-29 01:00:20.442132682 +0000 2024-03-29T01:00:20.453 INFO:teuthology.orchestra.run.smithi153.stdout: @@ -1,2 +1,870 @@ 2024-03-29T01:00:20.453 INFO:teuthology.orchestra.run.smithi153.stdout: QA output created by 521 2024-03-29T01:00:20.453 INFO:teuthology.orchestra.run.smithi153.stdout: +READ BAD DATA: offset = 0x20000, size = 0x1763d, fname = /tmp/tmp.l0v0NkF9eFtest/junk 2024-03-29T01:00:20.453 INFO:teuthology.orchestra.run.smithi153.stdout: +OFFSET GOOD BAD RANGE 2024-03-29T01:00:20.453 INFO:teuthology.orchestra.run.smithi153.stdout: +0x25000 0x2e79 0x0000 0x0 2024-03-29T01:00:20.453 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.453 INFO:teuthology.orchestra.run.smithi153.stdout: +0x25001 0x792e 0x0000 0x1 2024-03-29T01:00:20.453 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.454 INFO:teuthology.orchestra.run.smithi153.stdout: +0x25002 0x2ec6 0x0000 0x2 2024-03-29T01:00:20.454 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.454 INFO:teuthology.orchestra.run.smithi153.stdout: +0x25003 0xc62e 0x0000 0x3 2024-03-29T01:00:20.454 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.454 INFO:teuthology.orchestra.run.smithi153.stdout: +0x25004 0x2ecb 0x0000 0x4 2024-03-29T01:00:20.454 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.454 INFO:teuthology.orchestra.run.smithi153.stdout: +0x25005 0xcb2e 0x0000 0x5 2024-03-29T01:00:20.454 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.454 INFO:teuthology.orchestra.run.smithi153.stdout: +0x25006 0x2ec1 0x0000 0x6 2024-03-29T01:00:20.454 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.454 INFO:teuthology.orchestra.run.smithi153.stdout: +0x25007 0xc12e 0x0000 0x7 2024-03-29T01:00:20.454 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.455 INFO:teuthology.orchestra.run.smithi153.stdout: +0x25008 0x2e1b 0x0000 0x8 2024-03-29T01:00:20.455 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.455 INFO:teuthology.orchestra.run.smithi153.stdout: +0x25009 0x1b2e 0x0000 0x9 2024-03-29T01:00:20.455 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.455 INFO:teuthology.orchestra.run.smithi153.stdout: +0x2500a 0x2eba 0x0000 0xa 2024-03-29T01:00:20.455 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.455 INFO:teuthology.orchestra.run.smithi153.stdout: +0x2500b 0xba2e 0x0000 0xb 2024-03-29T01:00:20.455 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.455 INFO:teuthology.orchestra.run.smithi153.stdout: +0x2500c 0x2e35 0x0000 0xc 2024-03-29T01:00:20.455 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.455 INFO:teuthology.orchestra.run.smithi153.stdout: +0x2500d 0x352e 0x0000 0xd 2024-03-29T01:00:20.455 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.456 INFO:teuthology.orchestra.run.smithi153.stdout: +0x2500e 0x2e22 0x0000 0xe 2024-03-29T01:00:20.456 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.456 INFO:teuthology.orchestra.run.smithi153.stdout: +0x2500f 0x222e 0x0000 0xf 2024-03-29T01:00:20.456 INFO:teuthology.orchestra.run.smithi153.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-03-29T01:00:20.456 INFO:teuthology.orchestra.run.smithi153.stdout: +LOG DUMP (830 total operations): 2024-03-29T01:00:20.456 INFO:teuthology.orchestra.run.smithi153.stdout: +1( 1 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.456 INFO:teuthology.orchestra.run.smithi153.stdout: +2( 2 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.456 INFO:teuthology.orchestra.run.smithi153.stdout: +3( 3 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.456 INFO:teuthology.orchestra.run.smithi153.stdout: +4( 4 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.456 INFO:teuthology.orchestra.run.smithi153.stdout: +5( 5 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.456 INFO:teuthology.orchestra.run.smithi153.stdout: +6( 6 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.456 INFO:teuthology.orchestra.run.smithi153.stdout: +7( 7 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.456 INFO:teuthology.orchestra.run.smithi153.stdout: +8( 8 mod 256): WRITE 0x22000 thru 0x30fff (0xf000 bytes) HOLE 2024-03-29T01:00:20.456 INFO:teuthology.orchestra.run.smithi153.stdout: +9( 9 mod 256): COPY 0x10000 thru 0x13fff (0x4000 bytes) to 0x1d000 thru 0x20fff 2024-03-29T01:00:20.457 INFO:teuthology.orchestra.run.smithi153.stdout: +10( 10 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.457 INFO:teuthology.orchestra.run.smithi153.stdout: +11( 11 mod 256): MAPREAD 0x24000 thru 0x3003e (0xc03f bytes) 2024-03-29T01:00:20.457 INFO:teuthology.orchestra.run.smithi153.stdout: +12( 12 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.457 INFO:teuthology.orchestra.run.smithi153.stdout: +13( 13 mod 256): PUNCH 0x2d45e thru 0x30fff (0x3ba2 bytes) 2024-03-29T01:00:20.457 INFO:teuthology.orchestra.run.smithi153.stdout: +14( 14 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.457 INFO:teuthology.orchestra.run.smithi153.stdout: +15( 15 mod 256): MAPWRITE 0x36000 thru 0x4560b (0xf60c bytes) 2024-03-29T01:00:20.457 INFO:teuthology.orchestra.run.smithi153.stdout: +16( 16 mod 256): READ 0x33000 thru 0x3dfff (0xb000 bytes) 2024-03-29T01:00:20.457 INFO:teuthology.orchestra.run.smithi153.stdout: +17( 17 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.457 INFO:teuthology.orchestra.run.smithi153.stdout: +18( 18 mod 256): MAPWRITE 0x19000 thru 0x193f3 (0x3f4 bytes) 2024-03-29T01:00:20.457 INFO:teuthology.orchestra.run.smithi153.stdout: +19( 19 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.458 INFO:teuthology.orchestra.run.smithi153.stdout: +20( 20 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.458 INFO:teuthology.orchestra.run.smithi153.stdout: +21( 21 mod 256): PUNCH 0x1ae7 thru 0x1a63d (0x18b57 bytes) 2024-03-29T01:00:20.458 INFO:teuthology.orchestra.run.smithi153.stdout: +22( 22 mod 256): MAPREAD 0x3a000 thru 0x44a15 (0xaa16 bytes) 2024-03-29T01:00:20.458 INFO:teuthology.orchestra.run.smithi153.stdout: +23( 23 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.458 INFO:teuthology.orchestra.run.smithi153.stdout: +24( 24 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.458 INFO:teuthology.orchestra.run.smithi153.stdout: +25( 25 mod 256): TRUNCATE DOWN from 0x4560c to 0x7000 ******WWWW 2024-03-29T01:00:20.458 INFO:teuthology.orchestra.run.smithi153.stdout: +26( 26 mod 256): MAPWRITE 0x4c000 thru 0x55149 (0x914a bytes) 2024-03-29T01:00:20.458 INFO:teuthology.orchestra.run.smithi153.stdout: +27( 27 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.458 INFO:teuthology.orchestra.run.smithi153.stdout: +28( 28 mod 256): MAPREAD 0x47000 thru 0x54d16 (0xdd17 bytes) 2024-03-29T01:00:20.458 INFO:teuthology.orchestra.run.smithi153.stdout: +29( 29 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.458 INFO:teuthology.orchestra.run.smithi153.stdout: +30( 30 mod 256): MAPWRITE 0x3c000 thru 0x49a1b (0xda1c bytes) 2024-03-29T01:00:20.458 INFO:teuthology.orchestra.run.smithi153.stdout: +31( 31 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.458 INFO:teuthology.orchestra.run.smithi153.stdout: +32( 32 mod 256): MAPWRITE 0x10000 thru 0x150aa (0x50ab bytes) 2024-03-29T01:00:20.458 INFO:teuthology.orchestra.run.smithi153.stdout: +33( 33 mod 256): WRITE 0x30000 thru 0x30fff (0x1000 bytes) 2024-03-29T01:00:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: +34( 34 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: +35( 35 mod 256): MAPWRITE 0x48000 thru 0x6508e (0x1d08f bytes) 2024-03-29T01:00:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: +36( 36 mod 256): WRITE 0x5c000 thru 0x65fff (0xa000 bytes) EXTEND 2024-03-29T01:00:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: +37( 37 mod 256): MAPREAD 0x27000 thru 0x3b048 (0x14049 bytes) ***RRRR*** 2024-03-29T01:00:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: +38( 38 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: +39( 39 mod 256): READ 0x46000 thru 0x51fff (0xc000 bytes) 2024-03-29T01:00:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: +40( 40 mod 256): COPY 0x4e000 thru 0x56fff (0x9000 bytes) to 0x7c000 thru 0x84fff 2024-03-29T01:00:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: +41( 41 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: +42( 42 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: +43( 43 mod 256): MAPREAD 0x5e000 thru 0x64a50 (0x6a51 bytes) 2024-03-29T01:00:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: +44( 44 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: +45( 45 mod 256): COPY 0xe000 thru 0x27fff (0x1a000 bytes) to 0x66000 thru 0x7ffff 2024-03-29T01:00:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: +46( 46 mod 256): READ 0x65000 thru 0x77fff (0x13000 bytes) 2024-03-29T01:00:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: +47( 47 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +48( 48 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +49( 49 mod 256): PUNCH 0x596d1 thru 0x6b80b (0x1213b bytes) 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +50( 50 mod 256): TRUNCATE DOWN from 0x85000 to 0x5b000 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +51( 51 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +52( 52 mod 256): COPY 0x3e000 thru 0x54fff (0x17000 bytes) to 0x1000 thru 0x17fff 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +53( 53 mod 256): PUNCH 0x577b5 thru 0x5afff (0x384b bytes) 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +54( 54 mod 256): WRITE 0x23000 thru 0x2efff (0xc000 bytes) 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +55( 55 mod 256): MAPWRITE 0x76000 thru 0x8c071 (0x16072 bytes) 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +56( 56 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +57( 57 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +58( 58 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +59( 59 mod 256): TRUNCATE DOWN from 0x8c072 to 0x60000 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +60( 60 mod 256): WRITE 0x6000 thru 0x20fff (0x1b000 bytes) 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +61( 61 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.460 INFO:teuthology.orchestra.run.smithi153.stdout: +62( 62 mod 256): MAPREAD 0x38000 thru 0x45d49 (0xdd4a bytes) 2024-03-29T01:00:20.461 INFO:teuthology.orchestra.run.smithi153.stdout: +63( 63 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.461 INFO:teuthology.orchestra.run.smithi153.stdout: +64( 64 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.461 INFO:teuthology.orchestra.run.smithi153.stdout: +65( 65 mod 256): MAPWRITE 0x11000 thru 0x269d8 (0x159d9 bytes) 2024-03-29T01:00:20.461 INFO:teuthology.orchestra.run.smithi153.stdout: +66( 66 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.461 INFO:teuthology.orchestra.run.smithi153.stdout: +67( 67 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.461 INFO:teuthology.orchestra.run.smithi153.stdout: +68( 68 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.461 INFO:teuthology.orchestra.run.smithi153.stdout: +69( 69 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.461 INFO:teuthology.orchestra.run.smithi153.stdout: +70( 70 mod 256): WRITE 0x13000 thru 0x16fff (0x4000 bytes) 2024-03-29T01:00:20.461 INFO:teuthology.orchestra.run.smithi153.stdout: +71( 71 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.461 INFO:teuthology.orchestra.run.smithi153.stdout: +72( 72 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.461 INFO:teuthology.orchestra.run.smithi153.stdout: +73( 73 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.461 INFO:teuthology.orchestra.run.smithi153.stdout: +74( 74 mod 256): READ 0x1b000 thru 0x35fff (0x1b000 bytes) ***RRRR*** 2024-03-29T01:00:20.461 INFO:teuthology.orchestra.run.smithi153.stdout: +75( 75 mod 256): TRUNCATE DOWN from 0x60000 to 0x25000 ******WWWW 2024-03-29T01:00:20.461 INFO:teuthology.orchestra.run.smithi153.stdout: +76( 76 mod 256): WRITE 0x7c000 thru 0x90fff (0x15000 bytes) HOLE ***WWWW 2024-03-29T01:00:20.462 INFO:teuthology.orchestra.run.smithi153.stdout: +77( 77 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.462 INFO:teuthology.orchestra.run.smithi153.stdout: +78( 78 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.462 INFO:teuthology.orchestra.run.smithi153.stdout: +79( 79 mod 256): MAPWRITE 0x69000 thru 0x71243 (0x8244 bytes) 2024-03-29T01:00:20.462 INFO:teuthology.orchestra.run.smithi153.stdout: +80( 80 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.462 INFO:teuthology.orchestra.run.smithi153.stdout: +81( 81 mod 256): PUNCH 0x69b2d thru 0x7afb8 (0x1148c bytes) 2024-03-29T01:00:20.462 INFO:teuthology.orchestra.run.smithi153.stdout: +82( 82 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.462 INFO:teuthology.orchestra.run.smithi153.stdout: +83( 83 mod 256): WRITE 0x22000 thru 0x28fff (0x7000 bytes) 2024-03-29T01:00:20.462 INFO:teuthology.orchestra.run.smithi153.stdout: +84( 84 mod 256): PUNCH 0x8a709 thru 0x90fff (0x68f7 bytes) 2024-03-29T01:00:20.462 INFO:teuthology.orchestra.run.smithi153.stdout: +85( 85 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.462 INFO:teuthology.orchestra.run.smithi153.stdout: +86( 86 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.463 INFO:teuthology.orchestra.run.smithi153.stdout: +87( 87 mod 256): READ 0x6d000 thru 0x82fff (0x16000 bytes) 2024-03-29T01:00:20.463 INFO:teuthology.orchestra.run.smithi153.stdout: +88( 88 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.463 INFO:teuthology.orchestra.run.smithi153.stdout: +89( 89 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.463 INFO:teuthology.orchestra.run.smithi153.stdout: +90( 90 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.463 INFO:teuthology.orchestra.run.smithi153.stdout: +91( 91 mod 256): READ 0x77000 thru 0x8ffff (0x19000 bytes) 2024-03-29T01:00:20.463 INFO:teuthology.orchestra.run.smithi153.stdout: +92( 92 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.463 INFO:teuthology.orchestra.run.smithi153.stdout: +93( 93 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.463 INFO:teuthology.orchestra.run.smithi153.stdout: +94( 94 mod 256): PUNCH 0x63b87 thru 0x7b27d (0x176f7 bytes) 2024-03-29T01:00:20.463 INFO:teuthology.orchestra.run.smithi153.stdout: +95( 95 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.463 INFO:teuthology.orchestra.run.smithi153.stdout: +96( 96 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.463 INFO:teuthology.orchestra.run.smithi153.stdout: +97( 97 mod 256): TRUNCATE DOWN from 0x91000 to 0x65000 2024-03-29T01:00:20.463 INFO:teuthology.orchestra.run.smithi153.stdout: +98( 98 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.463 INFO:teuthology.orchestra.run.smithi153.stdout: +99( 99 mod 256): WRITE 0x45000 thru 0x58fff (0x14000 bytes) 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +100(100 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +101(101 mod 256): COPY 0x63000 thru 0x63fff (0x1000 bytes) to 0x8c000 thru 0x8cfff 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +102(102 mod 256): PUNCH 0x18832 thru 0x1bf75 (0x3744 bytes) 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +103(103 mod 256): MAPREAD 0x9000 thru 0x21b25 (0x18b26 bytes) 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +104(104 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +105(105 mod 256): COPY 0x7f000 thru 0x86fff (0x8000 bytes) to 0x4c000 thru 0x53fff 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +106(106 mod 256): READ 0x40000 thru 0x5bfff (0x1c000 bytes) 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +107(107 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +108(108 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +109(109 mod 256): MAPWRITE 0x4c000 thru 0x6687c (0x1a87d bytes) 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +110(110 mod 256): COPY 0x4e000 thru 0x60fff (0x13000 bytes) to 0x31000 thru 0x43fff ******EEEE 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +111(111 mod 256): READ 0x28000 thru 0x3ffff (0x18000 bytes) ***RRRR*** 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +112(112 mod 256): COPY 0x7e000 thru 0x88fff (0xb000 bytes) to 0x54000 thru 0x5efff 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +113(113 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: +114(114 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.465 INFO:teuthology.orchestra.run.smithi153.stdout: +115(115 mod 256): MAPREAD 0x72000 thru 0x734d9 (0x14da bytes) 2024-03-29T01:00:20.465 INFO:teuthology.orchestra.run.smithi153.stdout: +116(116 mod 256): COPY 0x9000 thru 0x9fff (0x1000 bytes) to 0x5c000 thru 0x5cfff 2024-03-29T01:00:20.465 INFO:teuthology.orchestra.run.smithi153.stdout: +117(117 mod 256): TRUNCATE DOWN from 0x8d000 to 0x45000 2024-03-29T01:00:20.465 INFO:teuthology.orchestra.run.smithi153.stdout: +118(118 mod 256): MAPWRITE 0x63000 thru 0x7e96c (0x1b96d bytes) 2024-03-29T01:00:20.465 INFO:teuthology.orchestra.run.smithi153.stdout: +119(119 mod 256): MAPREAD 0xa000 thru 0x159f1 (0xb9f2 bytes) 2024-03-29T01:00:20.465 INFO:teuthology.orchestra.run.smithi153.stdout: +120(120 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.465 INFO:teuthology.orchestra.run.smithi153.stdout: +121(121 mod 256): PUNCH 0x526ef thru 0x704e6 (0x1ddf8 bytes) 2024-03-29T01:00:20.465 INFO:teuthology.orchestra.run.smithi153.stdout: +122(122 mod 256): READ 0x1b000 thru 0x39fff (0x1f000 bytes) ***RRRR*** 2024-03-29T01:00:20.465 INFO:teuthology.orchestra.run.smithi153.stdout: +123(123 mod 256): MAPWRITE 0x3d000 thru 0x43244 (0x6245 bytes) 2024-03-29T01:00:20.466 INFO:teuthology.orchestra.run.smithi153.stdout: +124(124 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.466 INFO:teuthology.orchestra.run.smithi153.stdout: +125(125 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.466 INFO:teuthology.orchestra.run.smithi153.stdout: +126(126 mod 256): COPY 0x1000 thru 0x9fff (0x9000 bytes) to 0x29000 thru 0x31fff ******EEEE 2024-03-29T01:00:20.466 INFO:teuthology.orchestra.run.smithi153.stdout: +127(127 mod 256): MAPREAD 0x4000 thru 0x20757 (0x1c758 bytes) 2024-03-29T01:00:20.466 INFO:teuthology.orchestra.run.smithi153.stdout: +128(128 mod 256): MAPWRITE 0x4b000 thru 0x5509f (0xa0a0 bytes) 2024-03-29T01:00:20.466 INFO:teuthology.orchestra.run.smithi153.stdout: +129(129 mod 256): READ 0x2e000 thru 0x3afff (0xd000 bytes) ***RRRR*** 2024-03-29T01:00:20.466 INFO:teuthology.orchestra.run.smithi153.stdout: +130(130 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.466 INFO:teuthology.orchestra.run.smithi153.stdout: +131(131 mod 256): COPY 0x0 thru 0x19fff (0x1a000 bytes) to 0x3d000 thru 0x56fff 2024-03-29T01:00:20.466 INFO:teuthology.orchestra.run.smithi153.stdout: +132(132 mod 256): TRUNCATE DOWN from 0x7e96d to 0x43000 2024-03-29T01:00:20.466 INFO:teuthology.orchestra.run.smithi153.stdout: +133(133 mod 256): TRUNCATE UP from 0x43000 to 0x4d000 2024-03-29T01:00:20.466 INFO:teuthology.orchestra.run.smithi153.stdout: +134(134 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.466 INFO:teuthology.orchestra.run.smithi153.stdout: +135(135 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: +136(136 mod 256): PUNCH 0x1a9 thru 0x1e771 (0x1e5c9 bytes) 2024-03-29T01:00:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: +137(137 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: +138(138 mod 256): TRUNCATE DOWN from 0x4d000 to 0x29000 ******WWWW 2024-03-29T01:00:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: +139(139 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: +140(140 mod 256): WRITE 0x2b000 thru 0x47fff (0x1d000 bytes) HOLE ***WWWW 2024-03-29T01:00:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: +141(141 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: +142(142 mod 256): WRITE 0x48000 thru 0x5cfff (0x15000 bytes) EXTEND 2024-03-29T01:00:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: +143(143 mod 256): TRUNCATE DOWN from 0x5d000 to 0x4e000 2024-03-29T01:00:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: +144(144 mod 256): WRITE 0x29000 thru 0x31fff (0x9000 bytes) ***WWWW 2024-03-29T01:00:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: +145(145 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: +146(146 mod 256): MAPWRITE 0x4f000 thru 0x6b9ce (0x1c9cf bytes) 2024-03-29T01:00:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: +147(147 mod 256): MAPREAD 0xd000 thru 0x28c40 (0x1bc41 bytes) 2024-03-29T01:00:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: +148(148 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.467 INFO:teuthology.orchestra.run.smithi153.stdout: +149(149 mod 256): COPY 0x10000 thru 0x1bfff (0xc000 bytes) to 0x4e000 thru 0x59fff 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +150(150 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +151(151 mod 256): TRUNCATE DOWN from 0x6b9cf to 0x32000 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +152(152 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +153(153 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +154(154 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +155(155 mod 256): MAPWRITE 0x16000 thru 0x1aba0 (0x4ba1 bytes) 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +156(156 mod 256): MAPWRITE 0xd000 thru 0x1aab1 (0xdab2 bytes) 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +157(157 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +158(158 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +159(159 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +160(160 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +161(161 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +162(162 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +163(163 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.468 INFO:teuthology.orchestra.run.smithi153.stdout: +164(164 mod 256): MAPWRITE 0x7c000 thru 0x869ce (0xa9cf bytes) 2024-03-29T01:00:20.469 INFO:teuthology.orchestra.run.smithi153.stdout: +165(165 mod 256): MAPWRITE 0x81000 thru 0x92686 (0x11687 bytes) 2024-03-29T01:00:20.469 INFO:teuthology.orchestra.run.smithi153.stdout: +166(166 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.469 INFO:teuthology.orchestra.run.smithi153.stdout: +167(167 mod 256): MAPWRITE 0x14000 thru 0x22c4c (0xec4d bytes) 2024-03-29T01:00:20.469 INFO:teuthology.orchestra.run.smithi153.stdout: +168(168 mod 256): COPY 0x66000 thru 0x73fff (0xe000 bytes) to 0x2c000 thru 0x39fff ******EEEE 2024-03-29T01:00:20.469 INFO:teuthology.orchestra.run.smithi153.stdout: +169(169 mod 256): MAPREAD 0x0 thru 0xe22d (0xe22e bytes) 2024-03-29T01:00:20.469 INFO:teuthology.orchestra.run.smithi153.stdout: +170(170 mod 256): READ 0x6000 thru 0x13fff (0xe000 bytes) 2024-03-29T01:00:20.469 INFO:teuthology.orchestra.run.smithi153.stdout: +171(171 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.469 INFO:teuthology.orchestra.run.smithi153.stdout: +172(172 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.469 INFO:teuthology.orchestra.run.smithi153.stdout: +173(173 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.469 INFO:teuthology.orchestra.run.smithi153.stdout: +174(174 mod 256): PUNCH 0x687b4 thru 0x7bfbb (0x13808 bytes) 2024-03-29T01:00:20.469 INFO:teuthology.orchestra.run.smithi153.stdout: +175(175 mod 256): MAPWRITE 0x42000 thru 0x45834 (0x3835 bytes) 2024-03-29T01:00:20.469 INFO:teuthology.orchestra.run.smithi153.stdout: +176(176 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.469 INFO:teuthology.orchestra.run.smithi153.stdout: +177(177 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.469 INFO:teuthology.orchestra.run.smithi153.stdout: +178(178 mod 256): WRITE 0x4c000 thru 0x59fff (0xe000 bytes) 2024-03-29T01:00:20.470 INFO:teuthology.orchestra.run.smithi153.stdout: +179(179 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.470 INFO:teuthology.orchestra.run.smithi153.stdout: +180(180 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.470 INFO:teuthology.orchestra.run.smithi153.stdout: +181(181 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.470 INFO:teuthology.orchestra.run.smithi153.stdout: +182(182 mod 256): MAPWRITE 0x82000 thru 0x91e43 (0xfe44 bytes) 2024-03-29T01:00:20.470 INFO:teuthology.orchestra.run.smithi153.stdout: +183(183 mod 256): MAPWRITE 0x3000 thru 0x1c423 (0x19424 bytes) 2024-03-29T01:00:20.470 INFO:teuthology.orchestra.run.smithi153.stdout: +184(184 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.470 INFO:teuthology.orchestra.run.smithi153.stdout: +185(185 mod 256): READ 0x47000 thru 0x54fff (0xe000 bytes) 2024-03-29T01:00:20.470 INFO:teuthology.orchestra.run.smithi153.stdout: +186(186 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.470 INFO:teuthology.orchestra.run.smithi153.stdout: +187(187 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.470 INFO:teuthology.orchestra.run.smithi153.stdout: +188(188 mod 256): PUNCH 0x79b5b thru 0x92686 (0x18b2c bytes) 2024-03-29T01:00:20.470 INFO:teuthology.orchestra.run.smithi153.stdout: +189(189 mod 256): MAPREAD 0x8f000 thru 0x9191d (0x291e bytes) 2024-03-29T01:00:20.470 INFO:teuthology.orchestra.run.smithi153.stdout: +190(190 mod 256): READ 0x30000 thru 0x4dfff (0x1e000 bytes) ***RRRR*** 2024-03-29T01:00:20.470 INFO:teuthology.orchestra.run.smithi153.stdout: +191(191 mod 256): PUNCH 0x3ca80 thru 0x4c976 (0xfef7 bytes) 2024-03-29T01:00:20.470 INFO:teuthology.orchestra.run.smithi153.stdout: +192(192 mod 256): PUNCH 0x2efdf thru 0x4b682 (0x1c6a4 bytes) ******PPPP 2024-03-29T01:00:20.471 INFO:teuthology.orchestra.run.smithi153.stdout: +193(193 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.471 INFO:teuthology.orchestra.run.smithi153.stdout: +194(194 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.471 INFO:teuthology.orchestra.run.smithi153.stdout: +195(195 mod 256): TRUNCATE DOWN from 0x92687 to 0x0 ******WWWW 2024-03-29T01:00:20.471 INFO:teuthology.orchestra.run.smithi153.stdout: +196(196 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.471 INFO:teuthology.orchestra.run.smithi153.stdout: +197(197 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.471 INFO:teuthology.orchestra.run.smithi153.stdout: +198(198 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.471 INFO:teuthology.orchestra.run.smithi153.stdout: +199(199 mod 256): MAPWRITE 0x27000 thru 0x2e9e2 (0x79e3 bytes) 2024-03-29T01:00:20.471 INFO:teuthology.orchestra.run.smithi153.stdout: +200(200 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.471 INFO:teuthology.orchestra.run.smithi153.stdout: +201(201 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.471 INFO:teuthology.orchestra.run.smithi153.stdout: +202(202 mod 256): TRUNCATE UP from 0x2e9e3 to 0x49000 ******WWWW 2024-03-29T01:00:20.471 INFO:teuthology.orchestra.run.smithi153.stdout: +203(203 mod 256): PUNCH 0x22734 thru 0x22e7f (0x74c bytes) 2024-03-29T01:00:20.471 INFO:teuthology.orchestra.run.smithi153.stdout: +204(204 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +205(205 mod 256): READ 0x23000 thru 0x3cfff (0x1a000 bytes) ***RRRR*** 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +206(206 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +207(207 mod 256): MAPWRITE 0x38000 thru 0x41796 (0x9797 bytes) 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +208(208 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +209(209 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +210(210 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +211(211 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +212(212 mod 256): READ 0x35000 thru 0x47fff (0x13000 bytes) 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +213(213 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +214(214 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +215(215 mod 256): READ 0x7000 thru 0x12fff (0xc000 bytes) 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +216(216 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +217(217 mod 256): MAPWRITE 0x7c000 thru 0x8b2b7 (0xf2b8 bytes) 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +218(218 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.472 INFO:teuthology.orchestra.run.smithi153.stdout: +219(219 mod 256): READ 0x2b000 thru 0x31fff (0x7000 bytes) ***RRRR*** 2024-03-29T01:00:20.473 INFO:teuthology.orchestra.run.smithi153.stdout: +220(220 mod 256): PUNCH 0x35e03 thru 0x434cf (0xd6cd bytes) 2024-03-29T01:00:20.473 INFO:teuthology.orchestra.run.smithi153.stdout: +221(221 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.473 INFO:teuthology.orchestra.run.smithi153.stdout: +222(222 mod 256): MAPREAD 0x57000 thru 0x5ad8a (0x3d8b bytes) 2024-03-29T01:00:20.473 INFO:teuthology.orchestra.run.smithi153.stdout: +223(223 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.473 INFO:teuthology.orchestra.run.smithi153.stdout: +224(224 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.473 INFO:teuthology.orchestra.run.smithi153.stdout: +225(225 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.473 INFO:teuthology.orchestra.run.smithi153.stdout: +226(226 mod 256): PUNCH 0x10ace thru 0x21f5e (0x11491 bytes) 2024-03-29T01:00:20.473 INFO:teuthology.orchestra.run.smithi153.stdout: +227(227 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.473 INFO:teuthology.orchestra.run.smithi153.stdout: +228(228 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.473 INFO:teuthology.orchestra.run.smithi153.stdout: +229(229 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.473 INFO:teuthology.orchestra.run.smithi153.stdout: +230(230 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.473 INFO:teuthology.orchestra.run.smithi153.stdout: +231(231 mod 256): READ 0x33000 thru 0x3ffff (0xd000 bytes) 2024-03-29T01:00:20.473 INFO:teuthology.orchestra.run.smithi153.stdout: +232(232 mod 256): MAPREAD 0x74000 thru 0x78243 (0x4244 bytes) 2024-03-29T01:00:20.473 INFO:teuthology.orchestra.run.smithi153.stdout: +233(233 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.474 INFO:teuthology.orchestra.run.smithi153.stdout: +234(234 mod 256): TRUNCATE DOWN from 0x8b2b8 to 0x9000 ******WWWW 2024-03-29T01:00:20.474 INFO:teuthology.orchestra.run.smithi153.stdout: +235(235 mod 256): READ 0x3000 thru 0x3fff (0x1000 bytes) 2024-03-29T01:00:20.474 INFO:teuthology.orchestra.run.smithi153.stdout: +236(236 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.474 INFO:teuthology.orchestra.run.smithi153.stdout: +237(237 mod 256): TRUNCATE UP from 0x9000 to 0x3d000 ******WWWW 2024-03-29T01:00:20.474 INFO:teuthology.orchestra.run.smithi153.stdout: +238(238 mod 256): TRUNCATE DOWN from 0x3d000 to 0x9000 ******WWWW 2024-03-29T01:00:20.474 INFO:teuthology.orchestra.run.smithi153.stdout: +239(239 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.474 INFO:teuthology.orchestra.run.smithi153.stdout: +240(240 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.474 INFO:teuthology.orchestra.run.smithi153.stdout: +241(241 mod 256): PUNCH 0x78 thru 0x8fff (0x8f88 bytes) 2024-03-29T01:00:20.474 INFO:teuthology.orchestra.run.smithi153.stdout: +242(242 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.474 INFO:teuthology.orchestra.run.smithi153.stdout: +243(243 mod 256): READ 0x1000 thru 0x7fff (0x7000 bytes) 2024-03-29T01:00:20.474 INFO:teuthology.orchestra.run.smithi153.stdout: +244(244 mod 256): MAPREAD 0x3000 thru 0x807f (0x5080 bytes) 2024-03-29T01:00:20.474 INFO:teuthology.orchestra.run.smithi153.stdout: +245(245 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.474 INFO:teuthology.orchestra.run.smithi153.stdout: +246(246 mod 256): MAPREAD 0x2000 thru 0x86e1 (0x66e2 bytes) 2024-03-29T01:00:20.475 INFO:teuthology.orchestra.run.smithi153.stdout: +247(247 mod 256): TRUNCATE UP from 0x9000 to 0x70000 ******WWWW 2024-03-29T01:00:20.475 INFO:teuthology.orchestra.run.smithi153.stdout: +248(248 mod 256): READ 0x24000 thru 0x3efff (0x1b000 bytes) ***RRRR*** 2024-03-29T01:00:20.475 INFO:teuthology.orchestra.run.smithi153.stdout: +249(249 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.475 INFO:teuthology.orchestra.run.smithi153.stdout: +250(250 mod 256): TRUNCATE DOWN from 0x70000 to 0x16000 ******WWWW 2024-03-29T01:00:20.475 INFO:teuthology.orchestra.run.smithi153.stdout: +251(251 mod 256): WRITE 0x52000 thru 0x62fff (0x11000 bytes) HOLE ***WWWW 2024-03-29T01:00:20.475 INFO:teuthology.orchestra.run.smithi153.stdout: +252(252 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.475 INFO:teuthology.orchestra.run.smithi153.stdout: +253(253 mod 256): READ 0x1e000 thru 0x29fff (0xc000 bytes) 2024-03-29T01:00:20.475 INFO:teuthology.orchestra.run.smithi153.stdout: +254(254 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.475 INFO:teuthology.orchestra.run.smithi153.stdout: +255(255 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.475 INFO:teuthology.orchestra.run.smithi153.stdout: +256( 0 mod 256): COPY 0x2000 thru 0x1efff (0x1d000 bytes) to 0x20000 thru 0x3cfff ******EEEE 2024-03-29T01:00:20.475 INFO:teuthology.orchestra.run.smithi153.stdout: +257( 1 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.475 INFO:teuthology.orchestra.run.smithi153.stdout: +258( 2 mod 256): READ 0x2c000 thru 0x45fff (0x1a000 bytes) ***RRRR*** 2024-03-29T01:00:20.475 INFO:teuthology.orchestra.run.smithi153.stdout: +259( 3 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +260( 4 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +261( 5 mod 256): MAPREAD 0x61000 thru 0x6137d (0x37e bytes) 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +262( 6 mod 256): MAPWRITE 0x87000 thru 0x92405 (0xb406 bytes) 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +263( 7 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +264( 8 mod 256): MAPWRITE 0x2a000 thru 0x3ded3 (0x13ed4 bytes) ******WWWW 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +265( 9 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +266( 10 mod 256): PUNCH 0x19b78 thru 0x336f8 (0x19b81 bytes) ******PPPP 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +267( 11 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +268( 12 mod 256): WRITE 0x53000 thru 0x5cfff (0xa000 bytes) 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +269( 13 mod 256): MAPWRITE 0x12000 thru 0x13f19 (0x1f1a bytes) 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +270( 14 mod 256): WRITE 0x61000 thru 0x76fff (0x16000 bytes) 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +271( 15 mod 256): COPY 0x49000 thru 0x57fff (0xf000 bytes) to 0x3000 thru 0x11fff 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +272( 16 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +273( 17 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.476 INFO:teuthology.orchestra.run.smithi153.stdout: +274( 18 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +275( 19 mod 256): MAPWRITE 0x1e000 thru 0x308b2 (0x128b3 bytes) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +276( 20 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +277( 21 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +278( 22 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +279( 23 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +280( 24 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +281( 25 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +282( 26 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +283( 27 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +284( 28 mod 256): MAPREAD 0x65000 thru 0x79535 (0x14536 bytes) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +285( 29 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +286( 30 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +287( 31 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +288( 32 mod 256): MAPREAD 0x21000 thru 0x26f69 (0x5f6a bytes) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +289( 33 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.477 INFO:teuthology.orchestra.run.smithi153.stdout: +290( 34 mod 256): READ 0x8000 thru 0x1efff (0x17000 bytes) 2024-03-29T01:00:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: +291( 35 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: +292( 36 mod 256): PUNCH 0x3f05c thru 0x4ee10 (0xfdb5 bytes) 2024-03-29T01:00:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: +293( 37 mod 256): WRITE 0x10000 thru 0x16fff (0x7000 bytes) 2024-03-29T01:00:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: +294( 38 mod 256): WRITE 0x1f000 thru 0x2bfff (0xd000 bytes) 2024-03-29T01:00:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: +295( 39 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: +296( 40 mod 256): PUNCH 0x72109 thru 0x7d0b2 (0xafaa bytes) 2024-03-29T01:00:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: +297( 41 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: +298( 42 mod 256): PUNCH 0x76ee6 thru 0x92405 (0x1b520 bytes) 2024-03-29T01:00:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: +299( 43 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: +300( 44 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: +301( 45 mod 256): TRUNCATE DOWN from 0x92406 to 0x6e000 2024-03-29T01:00:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: +302( 46 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: +303( 47 mod 256): PUNCH 0x2971f thru 0x3df33 (0x14815 bytes) ******PPPP 2024-03-29T01:00:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: +304( 48 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +305( 49 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +306( 50 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +307( 51 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +308( 52 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +309( 53 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +310( 54 mod 256): MAPREAD 0x5c000 thru 0x6d3e3 (0x113e4 bytes) 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +311( 55 mod 256): TRUNCATE DOWN from 0x6e000 to 0x2a000 ******WWWW 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +312( 56 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +313( 57 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +314( 58 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +315( 59 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +316( 60 mod 256): WRITE 0x77000 thru 0x8ffff (0x19000 bytes) HOLE ***WWWW 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +317( 61 mod 256): PUNCH 0x5e7c3 thru 0x76756 (0x17f94 bytes) 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +318( 62 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.479 INFO:teuthology.orchestra.run.smithi153.stdout: +319( 63 mod 256): WRITE 0x27000 thru 0x41fff (0x1b000 bytes) ***WWWW 2024-03-29T01:00:20.480 INFO:teuthology.orchestra.run.smithi153.stdout: +320( 64 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.480 INFO:teuthology.orchestra.run.smithi153.stdout: +321( 65 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.480 INFO:teuthology.orchestra.run.smithi153.stdout: +322( 66 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.480 INFO:teuthology.orchestra.run.smithi153.stdout: +323( 67 mod 256): COPY 0x5000 thru 0x18fff (0x14000 bytes) to 0x2c000 thru 0x3ffff ******EEEE 2024-03-29T01:00:20.480 INFO:teuthology.orchestra.run.smithi153.stdout: +324( 68 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.480 INFO:teuthology.orchestra.run.smithi153.stdout: +325( 69 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.480 INFO:teuthology.orchestra.run.smithi153.stdout: +326( 70 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.480 INFO:teuthology.orchestra.run.smithi153.stdout: +327( 71 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.480 INFO:teuthology.orchestra.run.smithi153.stdout: +328( 72 mod 256): MAPREAD 0x17000 thru 0x1a4b1 (0x34b2 bytes) 2024-03-29T01:00:20.480 INFO:teuthology.orchestra.run.smithi153.stdout: +329( 73 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.480 INFO:teuthology.orchestra.run.smithi153.stdout: +330( 74 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.480 INFO:teuthology.orchestra.run.smithi153.stdout: +331( 75 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.480 INFO:teuthology.orchestra.run.smithi153.stdout: +332( 76 mod 256): MAPREAD 0x36000 thru 0x4cd42 (0x16d43 bytes) 2024-03-29T01:00:20.480 INFO:teuthology.orchestra.run.smithi153.stdout: +333( 77 mod 256): MAPREAD 0x4b000 thru 0x4e81d (0x381e bytes) 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +334( 78 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +335( 79 mod 256): TRUNCATE DOWN from 0x90000 to 0x10000 ******WWWW 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +336( 80 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +337( 81 mod 256): TRUNCATE UP from 0x10000 to 0x4e000 ******WWWW 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +338( 82 mod 256): PUNCH 0x3f6d7 thru 0x4dfff (0xe929 bytes) 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +339( 83 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +340( 84 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +341( 85 mod 256): MAPWRITE 0x8000 thru 0x1c360 (0x14361 bytes) 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +342( 86 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +343( 87 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +344( 88 mod 256): TRUNCATE DOWN from 0x4e000 to 0x34000 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +345( 89 mod 256): MAPREAD 0x6000 thru 0x1ef1b (0x18f1c bytes) 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +346( 90 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +347( 91 mod 256): READ 0x2a000 thru 0x2dfff (0x4000 bytes) 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +348( 92 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.481 INFO:teuthology.orchestra.run.smithi153.stdout: +349( 93 mod 256): COPY 0xb000 thru 0xffff (0x5000 bytes) to 0x15000 thru 0x19fff 2024-03-29T01:00:20.482 INFO:teuthology.orchestra.run.smithi153.stdout: +350( 94 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.482 INFO:teuthology.orchestra.run.smithi153.stdout: +351( 95 mod 256): READ 0x19000 thru 0x21fff (0x9000 bytes) 2024-03-29T01:00:20.482 INFO:teuthology.orchestra.run.smithi153.stdout: +352( 96 mod 256): TRUNCATE UP from 0x34000 to 0x46000 2024-03-29T01:00:20.482 INFO:teuthology.orchestra.run.smithi153.stdout: +353( 97 mod 256): WRITE 0x59000 thru 0x69fff (0x11000 bytes) HOLE 2024-03-29T01:00:20.482 INFO:teuthology.orchestra.run.smithi153.stdout: +354( 98 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.482 INFO:teuthology.orchestra.run.smithi153.stdout: +355( 99 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.482 INFO:teuthology.orchestra.run.smithi153.stdout: +356(100 mod 256): MAPWRITE 0x1e000 thru 0x322fe (0x142ff bytes) ******WWWW 2024-03-29T01:00:20.482 INFO:teuthology.orchestra.run.smithi153.stdout: +357(101 mod 256): READ 0x18000 thru 0x2efff (0x17000 bytes) 2024-03-29T01:00:20.482 INFO:teuthology.orchestra.run.smithi153.stdout: +358(102 mod 256): MAPWRITE 0xc000 thru 0x2964d (0x1d64e bytes) 2024-03-29T01:00:20.482 INFO:teuthology.orchestra.run.smithi153.stdout: +359(103 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.482 INFO:teuthology.orchestra.run.smithi153.stdout: +360(104 mod 256): TRUNCATE DOWN from 0x6a000 to 0x17000 ******WWWW 2024-03-29T01:00:20.482 INFO:teuthology.orchestra.run.smithi153.stdout: +361(105 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.482 INFO:teuthology.orchestra.run.smithi153.stdout: +362(106 mod 256): MAPWRITE 0x7b000 thru 0x88d75 (0xdd76 bytes) 2024-03-29T01:00:20.483 INFO:teuthology.orchestra.run.smithi153.stdout: +363(107 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.483 INFO:teuthology.orchestra.run.smithi153.stdout: +364(108 mod 256): READ 0x6e000 thru 0x82fff (0x15000 bytes) 2024-03-29T01:00:20.483 INFO:teuthology.orchestra.run.smithi153.stdout: +365(109 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.483 INFO:teuthology.orchestra.run.smithi153.stdout: +366(110 mod 256): TRUNCATE DOWN from 0x88d76 to 0x1c000 ******WWWW 2024-03-29T01:00:20.483 INFO:teuthology.orchestra.run.smithi153.stdout: +367(111 mod 256): MAPWRITE 0x53000 thru 0x61b1c (0xeb1d bytes) 2024-03-29T01:00:20.483 INFO:teuthology.orchestra.run.smithi153.stdout: +368(112 mod 256): WRITE 0x28000 thru 0x44fff (0x1d000 bytes) ***WWWW 2024-03-29T01:00:20.483 INFO:teuthology.orchestra.run.smithi153.stdout: +369(113 mod 256): MAPREAD 0x4a000 thru 0x5fc64 (0x15c65 bytes) 2024-03-29T01:00:20.483 INFO:teuthology.orchestra.run.smithi153.stdout: +370(114 mod 256): WRITE 0x12000 thru 0x1afff (0x9000 bytes) 2024-03-29T01:00:20.483 INFO:teuthology.orchestra.run.smithi153.stdout: +371(115 mod 256): READ 0x49000 thru 0x51fff (0x9000 bytes) 2024-03-29T01:00:20.483 INFO:teuthology.orchestra.run.smithi153.stdout: +372(116 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.483 INFO:teuthology.orchestra.run.smithi153.stdout: +373(117 mod 256): PUNCH 0x3c666 thru 0x465a7 (0x9f42 bytes) 2024-03-29T01:00:20.483 INFO:teuthology.orchestra.run.smithi153.stdout: +374(118 mod 256): COPY 0x32000 thru 0x46fff (0x15000 bytes) to 0x70000 thru 0x84fff 2024-03-29T01:00:20.483 INFO:teuthology.orchestra.run.smithi153.stdout: +375(119 mod 256): COPY 0x76000 thru 0x82fff (0xd000 bytes) to 0x35000 thru 0x41fff 2024-03-29T01:00:20.483 INFO:teuthology.orchestra.run.smithi153.stdout: +376(120 mod 256): PUNCH 0x2a81b thru 0x36fff (0xc7e5 bytes) ******PPPP 2024-03-29T01:00:20.484 INFO:teuthology.orchestra.run.smithi153.stdout: +377(121 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.484 INFO:teuthology.orchestra.run.smithi153.stdout: +378(122 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.484 INFO:teuthology.orchestra.run.smithi153.stdout: +379(123 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.484 INFO:teuthology.orchestra.run.smithi153.stdout: +380(124 mod 256): PUNCH 0x2b911 thru 0x34b0d (0x91fd bytes) ******PPPP 2024-03-29T01:00:20.484 INFO:teuthology.orchestra.run.smithi153.stdout: +381(125 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.484 INFO:teuthology.orchestra.run.smithi153.stdout: +382(126 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.484 INFO:teuthology.orchestra.run.smithi153.stdout: +383(127 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.484 INFO:teuthology.orchestra.run.smithi153.stdout: +384(128 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.484 INFO:teuthology.orchestra.run.smithi153.stdout: +385(129 mod 256): READ 0x5a000 thru 0x72fff (0x19000 bytes) 2024-03-29T01:00:20.484 INFO:teuthology.orchestra.run.smithi153.stdout: +386(130 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.484 INFO:teuthology.orchestra.run.smithi153.stdout: +387(131 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.485 INFO:teuthology.orchestra.run.smithi153.stdout: +388(132 mod 256): PUNCH 0x25629 thru 0x3133e (0xbd16 bytes) ******PPPP 2024-03-29T01:00:20.485 INFO:teuthology.orchestra.run.smithi153.stdout: +389(133 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.485 INFO:teuthology.orchestra.run.smithi153.stdout: +390(134 mod 256): TRUNCATE DOWN from 0x85000 to 0x7c000 2024-03-29T01:00:20.485 INFO:teuthology.orchestra.run.smithi153.stdout: +391(135 mod 256): READ 0x1a000 thru 0x22fff (0x9000 bytes) 2024-03-29T01:00:20.485 INFO:teuthology.orchestra.run.smithi153.stdout: +392(136 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.485 INFO:teuthology.orchestra.run.smithi153.stdout: +393(137 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.485 INFO:teuthology.orchestra.run.smithi153.stdout: +394(138 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.485 INFO:teuthology.orchestra.run.smithi153.stdout: +395(139 mod 256): COPY 0x73000 thru 0x78fff (0x6000 bytes) to 0x86000 thru 0x8bfff 2024-03-29T01:00:20.485 INFO:teuthology.orchestra.run.smithi153.stdout: +396(140 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.485 INFO:teuthology.orchestra.run.smithi153.stdout: +397(141 mod 256): MAPWRITE 0x5b000 thru 0x79e8e (0x1ee8f bytes) 2024-03-29T01:00:20.485 INFO:teuthology.orchestra.run.smithi153.stdout: +398(142 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.486 INFO:teuthology.orchestra.run.smithi153.stdout: +399(143 mod 256): COPY 0x3e000 thru 0x4dfff (0x10000 bytes) to 0x76000 thru 0x85fff 2024-03-29T01:00:20.486 INFO:teuthology.orchestra.run.smithi153.stdout: +400(144 mod 256): MAPREAD 0x40000 thru 0x54a6b (0x14a6c bytes) 2024-03-29T01:00:20.486 INFO:teuthology.orchestra.run.smithi153.stdout: +401(145 mod 256): MAPREAD 0x46000 thru 0x5ccd8 (0x16cd9 bytes) 2024-03-29T01:00:20.486 INFO:teuthology.orchestra.run.smithi153.stdout: +402(146 mod 256): COPY 0x38000 thru 0x4cfff (0x15000 bytes) to 0x68000 thru 0x7cfff 2024-03-29T01:00:20.486 INFO:teuthology.orchestra.run.smithi153.stdout: +403(147 mod 256): WRITE 0x7c000 thru 0x80fff (0x5000 bytes) 2024-03-29T01:00:20.486 INFO:teuthology.orchestra.run.smithi153.stdout: +404(148 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.486 INFO:teuthology.orchestra.run.smithi153.stdout: +405(149 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.486 INFO:teuthology.orchestra.run.smithi153.stdout: +406(150 mod 256): COPY 0x55000 thru 0x5ffff (0xb000 bytes) to 0x3e000 thru 0x48fff 2024-03-29T01:00:20.486 INFO:teuthology.orchestra.run.smithi153.stdout: +407(151 mod 256): PUNCH 0x7d82d thru 0x7f863 (0x2037 bytes) 2024-03-29T01:00:20.486 INFO:teuthology.orchestra.run.smithi153.stdout: +408(152 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.486 INFO:teuthology.orchestra.run.smithi153.stdout: +409(153 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.486 INFO:teuthology.orchestra.run.smithi153.stdout: +410(154 mod 256): MAPREAD 0x2f000 thru 0x3e621 (0xf622 bytes) ***RRRR*** 2024-03-29T01:00:20.487 INFO:teuthology.orchestra.run.smithi153.stdout: +411(155 mod 256): TRUNCATE DOWN from 0x8c000 to 0x62000 2024-03-29T01:00:20.487 INFO:teuthology.orchestra.run.smithi153.stdout: +412(156 mod 256): MAPREAD 0x24000 thru 0x24f4f (0xf50 bytes) 2024-03-29T01:00:20.487 INFO:teuthology.orchestra.run.smithi153.stdout: +413(157 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.487 INFO:teuthology.orchestra.run.smithi153.stdout: +414(158 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.487 INFO:teuthology.orchestra.run.smithi153.stdout: +415(159 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.487 INFO:teuthology.orchestra.run.smithi153.stdout: +416(160 mod 256): COPY 0x5b000 thru 0x5dfff (0x3000 bytes) to 0x7b000 thru 0x7dfff 2024-03-29T01:00:20.487 INFO:teuthology.orchestra.run.smithi153.stdout: +417(161 mod 256): PUNCH 0x76e6e thru 0x7dfff (0x7192 bytes) 2024-03-29T01:00:20.487 INFO:teuthology.orchestra.run.smithi153.stdout: +418(162 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.487 INFO:teuthology.orchestra.run.smithi153.stdout: +419(163 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.487 INFO:teuthology.orchestra.run.smithi153.stdout: +420(164 mod 256): TRUNCATE DOWN from 0x7e000 to 0x51000 2024-03-29T01:00:20.487 INFO:teuthology.orchestra.run.smithi153.stdout: +421(165 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.487 INFO:teuthology.orchestra.run.smithi153.stdout: +422(166 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.487 INFO:teuthology.orchestra.run.smithi153.stdout: +423(167 mod 256): WRITE 0x2d000 thru 0x37fff (0xb000 bytes) ***WWWW 2024-03-29T01:00:20.487 INFO:teuthology.orchestra.run.smithi153.stdout: +424(168 mod 256): READ 0x21000 thru 0x3dfff (0x1d000 bytes) ***RRRR*** 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +425(169 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +426(170 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +427(171 mod 256): PUNCH 0x47a87 thru 0x50fff (0x9579 bytes) 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +428(172 mod 256): MAPREAD 0x7000 thru 0x10074 (0x9075 bytes) 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +429(173 mod 256): READ 0x12000 thru 0x29fff (0x18000 bytes) 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +430(174 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +431(175 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +432(176 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +433(177 mod 256): PUNCH 0x4e7ae thru 0x50fff (0x2852 bytes) 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +434(178 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +435(179 mod 256): TRUNCATE DOWN from 0x51000 to 0x3a000 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +436(180 mod 256): TRUNCATE DOWN from 0x3a000 to 0x25000 ******WWWW 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +437(181 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +438(182 mod 256): WRITE 0x23000 thru 0x32fff (0x10000 bytes) EXTEND ***WWWW 2024-03-29T01:00:20.488 INFO:teuthology.orchestra.run.smithi153.stdout: +439(183 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.489 INFO:teuthology.orchestra.run.smithi153.stdout: +440(184 mod 256): MAPWRITE 0x86000 thru 0x91a0c (0xba0d bytes) 2024-03-29T01:00:20.489 INFO:teuthology.orchestra.run.smithi153.stdout: +441(185 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.489 INFO:teuthology.orchestra.run.smithi153.stdout: +442(186 mod 256): MAPREAD 0x3d000 thru 0x3e7ba (0x17bb bytes) 2024-03-29T01:00:20.489 INFO:teuthology.orchestra.run.smithi153.stdout: +443(187 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.489 INFO:teuthology.orchestra.run.smithi153.stdout: +444(188 mod 256): MAPWRITE 0x6000 thru 0x23f60 (0x1df61 bytes) 2024-03-29T01:00:20.489 INFO:teuthology.orchestra.run.smithi153.stdout: +445(189 mod 256): PUNCH 0x80a2a thru 0x91a0c (0x10fe3 bytes) 2024-03-29T01:00:20.489 INFO:teuthology.orchestra.run.smithi153.stdout: +446(190 mod 256): PUNCH 0x853c1 thru 0x91a0c (0xc64c bytes) 2024-03-29T01:00:20.489 INFO:teuthology.orchestra.run.smithi153.stdout: +447(191 mod 256): PUNCH 0xde62 thru 0x29c0d (0x1bdac bytes) 2024-03-29T01:00:20.489 INFO:teuthology.orchestra.run.smithi153.stdout: +448(192 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.489 INFO:teuthology.orchestra.run.smithi153.stdout: +449(193 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.489 INFO:teuthology.orchestra.run.smithi153.stdout: +450(194 mod 256): READ 0x16000 thru 0x1efff (0x9000 bytes) 2024-03-29T01:00:20.489 INFO:teuthology.orchestra.run.smithi153.stdout: +451(195 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.489 INFO:teuthology.orchestra.run.smithi153.stdout: +452(196 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.489 INFO:teuthology.orchestra.run.smithi153.stdout: +453(197 mod 256): READ 0x8d000 thru 0x90fff (0x4000 bytes) 2024-03-29T01:00:20.490 INFO:teuthology.orchestra.run.smithi153.stdout: +454(198 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.490 INFO:teuthology.orchestra.run.smithi153.stdout: +455(199 mod 256): PUNCH 0x1fc73 thru 0x22521 (0x28af bytes) 2024-03-29T01:00:20.490 INFO:teuthology.orchestra.run.smithi153.stdout: +456(200 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.490 INFO:teuthology.orchestra.run.smithi153.stdout: +457(201 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.490 INFO:teuthology.orchestra.run.smithi153.stdout: +458(202 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.490 INFO:teuthology.orchestra.run.smithi153.stdout: +459(203 mod 256): MAPREAD 0x47000 thru 0x5ff18 (0x18f19 bytes) 2024-03-29T01:00:20.490 INFO:teuthology.orchestra.run.smithi153.stdout: +460(204 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.490 INFO:teuthology.orchestra.run.smithi153.stdout: +461(205 mod 256): READ 0x35000 thru 0x51fff (0x1d000 bytes) 2024-03-29T01:00:20.490 INFO:teuthology.orchestra.run.smithi153.stdout: +462(206 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.490 INFO:teuthology.orchestra.run.smithi153.stdout: +463(207 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.490 INFO:teuthology.orchestra.run.smithi153.stdout: +464(208 mod 256): MAPREAD 0x4000 thru 0xc069 (0x806a bytes) 2024-03-29T01:00:20.490 INFO:teuthology.orchestra.run.smithi153.stdout: +465(209 mod 256): WRITE 0x90000 thru 0x90fff (0x1000 bytes) 2024-03-29T01:00:20.490 INFO:teuthology.orchestra.run.smithi153.stdout: +466(210 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.490 INFO:teuthology.orchestra.run.smithi153.stdout: +467(211 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +468(212 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +469(213 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +470(214 mod 256): MAPWRITE 0x5d000 thru 0x76508 (0x19509 bytes) 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +471(215 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +472(216 mod 256): TRUNCATE DOWN from 0x91a0d to 0x71000 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +473(217 mod 256): PUNCH 0x9757 thru 0x19864 (0x1010e bytes) 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +474(218 mod 256): PUNCH 0x319e2 thru 0x47ceb (0x1630a bytes) 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +475(219 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +476(220 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +477(221 mod 256): READ 0x58000 thru 0x6afff (0x13000 bytes) 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +478(222 mod 256): MAPREAD 0x55000 thru 0x70dcc (0x1bdcd bytes) 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +479(223 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +480(224 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +481(225 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.491 INFO:teuthology.orchestra.run.smithi153.stdout: +482(226 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +483(227 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +484(228 mod 256): MAPWRITE 0x23000 thru 0x3edfb (0x1bdfc bytes) ******WWWW 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +485(229 mod 256): COPY 0x61000 thru 0x6afff (0xa000 bytes) to 0x1e000 thru 0x27fff 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +486(230 mod 256): MAPREAD 0x6a000 thru 0x70f87 (0x6f88 bytes) 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +487(231 mod 256): READ 0x56000 thru 0x58fff (0x3000 bytes) 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +488(232 mod 256): PUNCH 0x3f839 thru 0x57c5e (0x18426 bytes) 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +489(233 mod 256): COPY 0x2d000 thru 0x49fff (0x1d000 bytes) to 0x5f000 thru 0x7bfff EEEE****** 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +490(234 mod 256): WRITE 0x46000 thru 0x5bfff (0x16000 bytes) 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +491(235 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +492(236 mod 256): PUNCH 0x6ab7b thru 0x7bfff (0x11485 bytes) 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +493(237 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +494(238 mod 256): PUNCH 0x6be94 thru 0x744c0 (0x862d bytes) 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +495(239 mod 256): READ 0x4d000 thru 0x50fff (0x4000 bytes) 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +496(240 mod 256): PUNCH 0x744d4 thru 0x7bfff (0x7b2c bytes) 2024-03-29T01:00:20.492 INFO:teuthology.orchestra.run.smithi153.stdout: +497(241 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.493 INFO:teuthology.orchestra.run.smithi153.stdout: +498(242 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.493 INFO:teuthology.orchestra.run.smithi153.stdout: +499(243 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.493 INFO:teuthology.orchestra.run.smithi153.stdout: +500(244 mod 256): MAPWRITE 0x82000 thru 0x83bdc (0x1bdd bytes) 2024-03-29T01:00:20.493 INFO:teuthology.orchestra.run.smithi153.stdout: +501(245 mod 256): MAPWRITE 0x57000 thru 0x64485 (0xd486 bytes) 2024-03-29T01:00:20.493 INFO:teuthology.orchestra.run.smithi153.stdout: +502(246 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.493 INFO:teuthology.orchestra.run.smithi153.stdout: +503(247 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.493 INFO:teuthology.orchestra.run.smithi153.stdout: +504(248 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.493 INFO:teuthology.orchestra.run.smithi153.stdout: +505(249 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.493 INFO:teuthology.orchestra.run.smithi153.stdout: +506(250 mod 256): PUNCH 0x4ecb2 thru 0x5b5da (0xc929 bytes) 2024-03-29T01:00:20.493 INFO:teuthology.orchestra.run.smithi153.stdout: +507(251 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.493 INFO:teuthology.orchestra.run.smithi153.stdout: +508(252 mod 256): PUNCH 0x704b thru 0x9da7 (0x2d5d bytes) 2024-03-29T01:00:20.493 INFO:teuthology.orchestra.run.smithi153.stdout: +509(253 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.493 INFO:teuthology.orchestra.run.smithi153.stdout: +510(254 mod 256): WRITE 0x8f000 thru 0x91fff (0x3000 bytes) HOLE 2024-03-29T01:00:20.493 INFO:teuthology.orchestra.run.smithi153.stdout: +511(255 mod 256): MAPWRITE 0x31000 thru 0x3285b (0x185c bytes) ******WWWW 2024-03-29T01:00:20.494 INFO:teuthology.orchestra.run.smithi153.stdout: +512( 0 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.494 INFO:teuthology.orchestra.run.smithi153.stdout: +513( 1 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.494 INFO:teuthology.orchestra.run.smithi153.stdout: +514( 2 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.494 INFO:teuthology.orchestra.run.smithi153.stdout: +515( 3 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.494 INFO:teuthology.orchestra.run.smithi153.stdout: +516( 4 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.494 INFO:teuthology.orchestra.run.smithi153.stdout: +517( 5 mod 256): MAPWRITE 0x5e000 thru 0x6c6b5 (0xe6b6 bytes) 2024-03-29T01:00:20.494 INFO:teuthology.orchestra.run.smithi153.stdout: +518( 6 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.494 INFO:teuthology.orchestra.run.smithi153.stdout: +519( 7 mod 256): MAPWRITE 0x39000 thru 0x3e7b0 (0x57b1 bytes) 2024-03-29T01:00:20.494 INFO:teuthology.orchestra.run.smithi153.stdout: +520( 8 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.494 INFO:teuthology.orchestra.run.smithi153.stdout: +521( 9 mod 256): TRUNCATE DOWN from 0x92000 to 0x57000 2024-03-29T01:00:20.494 INFO:teuthology.orchestra.run.smithi153.stdout: +522( 10 mod 256): MAPWRITE 0x71000 thru 0x76e34 (0x5e35 bytes) 2024-03-29T01:00:20.494 INFO:teuthology.orchestra.run.smithi153.stdout: +523( 11 mod 256): MAPREAD 0x37000 thru 0x53938 (0x1c939 bytes) 2024-03-29T01:00:20.494 INFO:teuthology.orchestra.run.smithi153.stdout: +524( 12 mod 256): MAPREAD 0x53000 thru 0x630f9 (0x100fa bytes) 2024-03-29T01:00:20.494 INFO:teuthology.orchestra.run.smithi153.stdout: +525( 13 mod 256): READ 0x2000 thru 0x1dfff (0x1c000 bytes) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +526( 14 mod 256): PUNCH 0x630f6 thru 0x76e34 (0x13d3f bytes) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +527( 15 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +528( 16 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +529( 17 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +530( 18 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +531( 19 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +532( 20 mod 256): PUNCH 0x74907 thru 0x76e34 (0x252e bytes) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +533( 21 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +534( 22 mod 256): MAPWRITE 0x1000 thru 0x7536 (0x6537 bytes) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +535( 23 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +536( 24 mod 256): MAPWRITE 0x36000 thru 0x37a89 (0x1a8a bytes) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +537( 25 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +538( 26 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +539( 27 mod 256): READ 0xe000 thru 0x2afff (0x1d000 bytes) 2024-03-29T01:00:20.495 INFO:teuthology.orchestra.run.smithi153.stdout: +540( 28 mod 256): READ 0x12000 thru 0x2ffff (0x1e000 bytes) 2024-03-29T01:00:20.496 INFO:teuthology.orchestra.run.smithi153.stdout: +541( 29 mod 256): MAPWRITE 0x2f000 thru 0x46867 (0x17868 bytes) ******WWWW 2024-03-29T01:00:20.496 INFO:teuthology.orchestra.run.smithi153.stdout: +542( 30 mod 256): COPY 0x54000 thru 0x6dfff (0x1a000 bytes) to 0x25000 thru 0x3efff ******EEEE 2024-03-29T01:00:20.496 INFO:teuthology.orchestra.run.smithi153.stdout: +543( 31 mod 256): PUNCH 0x4d8ff thru 0x6104b (0x1374d bytes) 2024-03-29T01:00:20.496 INFO:teuthology.orchestra.run.smithi153.stdout: +544( 32 mod 256): TRUNCATE DOWN from 0x76e35 to 0xd000 ******WWWW 2024-03-29T01:00:20.496 INFO:teuthology.orchestra.run.smithi153.stdout: +545( 33 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.496 INFO:teuthology.orchestra.run.smithi153.stdout: +546( 34 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.496 INFO:teuthology.orchestra.run.smithi153.stdout: +547( 35 mod 256): MAPREAD 0xc000 thru 0xc729 (0x72a bytes) 2024-03-29T01:00:20.496 INFO:teuthology.orchestra.run.smithi153.stdout: +548( 36 mod 256): MAPWRITE 0x3000 thru 0x1f73d (0x1c73e bytes) 2024-03-29T01:00:20.496 INFO:teuthology.orchestra.run.smithi153.stdout: +549( 37 mod 256): MAPREAD 0xf000 thru 0x1f418 (0x10419 bytes) 2024-03-29T01:00:20.496 INFO:teuthology.orchestra.run.smithi153.stdout: +550( 38 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.496 INFO:teuthology.orchestra.run.smithi153.stdout: +551( 39 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.496 INFO:teuthology.orchestra.run.smithi153.stdout: +552( 40 mod 256): MAPREAD 0x2000 thru 0x1eb07 (0x1cb08 bytes) 2024-03-29T01:00:20.496 INFO:teuthology.orchestra.run.smithi153.stdout: +553( 41 mod 256): WRITE 0x6000 thru 0xbfff (0x6000 bytes) 2024-03-29T01:00:20.496 INFO:teuthology.orchestra.run.smithi153.stdout: +554( 42 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +555( 43 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +556( 44 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +557( 45 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +558( 46 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +559( 47 mod 256): MAPWRITE 0x5000 thru 0x1d211 (0x18212 bytes) 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +560( 48 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +561( 49 mod 256): COPY 0x6000 thru 0x10fff (0xb000 bytes) to 0x32000 thru 0x3cfff 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +562( 50 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +563( 51 mod 256): TRUNCATE DOWN from 0x3d000 to 0x15000 ******WWWW 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +564( 52 mod 256): COPY 0x12000 thru 0x13fff (0x2000 bytes) to 0x7e000 thru 0x7ffff 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +565( 53 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +566( 54 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +567( 55 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +568( 56 mod 256): COPY 0x2f000 thru 0x41fff (0x13000 bytes) to 0x75000 thru 0x87fff EEEE****** 2024-03-29T01:00:20.497 INFO:teuthology.orchestra.run.smithi153.stdout: +569( 57 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.498 INFO:teuthology.orchestra.run.smithi153.stdout: +570( 58 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.498 INFO:teuthology.orchestra.run.smithi153.stdout: +571( 59 mod 256): PUNCH 0x75c7 thru 0x1bfca (0x14a04 bytes) 2024-03-29T01:00:20.498 INFO:teuthology.orchestra.run.smithi153.stdout: +572( 60 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.498 INFO:teuthology.orchestra.run.smithi153.stdout: +573( 61 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.498 INFO:teuthology.orchestra.run.smithi153.stdout: +574( 62 mod 256): COPY 0x14000 thru 0x2bfff (0x18000 bytes) to 0x4e000 thru 0x65fff 2024-03-29T01:00:20.498 INFO:teuthology.orchestra.run.smithi153.stdout: +575( 63 mod 256): PUNCH 0x4c37d thru 0x5b1ce (0xee52 bytes) 2024-03-29T01:00:20.498 INFO:teuthology.orchestra.run.smithi153.stdout: +576( 64 mod 256): MAPREAD 0x2e000 thru 0x3bad5 (0xdad6 bytes) ***RRRR*** 2024-03-29T01:00:20.498 INFO:teuthology.orchestra.run.smithi153.stdout: +577( 65 mod 256): TRUNCATE DOWN from 0x88000 to 0x16000 ******WWWW 2024-03-29T01:00:20.498 INFO:teuthology.orchestra.run.smithi153.stdout: +578( 66 mod 256): READ 0x3000 thru 0x5fff (0x3000 bytes) 2024-03-29T01:00:20.498 INFO:teuthology.orchestra.run.smithi153.stdout: +579( 67 mod 256): MAPWRITE 0x74000 thru 0x88b65 (0x14b66 bytes) 2024-03-29T01:00:20.498 INFO:teuthology.orchestra.run.smithi153.stdout: +580( 68 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.498 INFO:teuthology.orchestra.run.smithi153.stdout: +581( 69 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.498 INFO:teuthology.orchestra.run.smithi153.stdout: +582( 70 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.498 INFO:teuthology.orchestra.run.smithi153.stdout: +583( 71 mod 256): MAPWRITE 0x7a000 thru 0x86fc5 (0xcfc6 bytes) 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +584( 72 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +585( 73 mod 256): MAPREAD 0x28000 thru 0x33e2c (0xbe2d bytes) ***RRRR*** 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +586( 74 mod 256): PUNCH 0x27f21 thru 0x3d3bc (0x1549c bytes) ******PPPP 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +587( 75 mod 256): WRITE 0x14000 thru 0x1efff (0xb000 bytes) 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +588( 76 mod 256): WRITE 0x36000 thru 0x38fff (0x3000 bytes) 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +589( 77 mod 256): MAPREAD 0x6e000 thru 0x82d07 (0x14d08 bytes) 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +590( 78 mod 256): COPY 0x72000 thru 0x77fff (0x6000 bytes) to 0x4b000 thru 0x50fff 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +591( 79 mod 256): PUNCH 0x868b0 thru 0x88b65 (0x22b6 bytes) 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +592( 80 mod 256): PUNCH 0x5b35c thru 0x79e86 (0x1eb2b bytes) 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +593( 81 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +594( 82 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +595( 83 mod 256): READ 0x8000 thru 0x1afff (0x13000 bytes) 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +596( 84 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +597( 85 mod 256): PUNCH 0x2dd7f thru 0x396ea (0xb96c bytes) ******PPPP 2024-03-29T01:00:20.499 INFO:teuthology.orchestra.run.smithi153.stdout: +598( 86 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.500 INFO:teuthology.orchestra.run.smithi153.stdout: +599( 87 mod 256): MAPREAD 0x41000 thru 0x502bd (0xf2be bytes) 2024-03-29T01:00:20.500 INFO:teuthology.orchestra.run.smithi153.stdout: +600( 88 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.500 INFO:teuthology.orchestra.run.smithi153.stdout: +601( 89 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.500 INFO:teuthology.orchestra.run.smithi153.stdout: +602( 90 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.500 INFO:teuthology.orchestra.run.smithi153.stdout: +603( 91 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.500 INFO:teuthology.orchestra.run.smithi153.stdout: +604( 92 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.500 INFO:teuthology.orchestra.run.smithi153.stdout: +605( 93 mod 256): WRITE 0x40000 thru 0x5bfff (0x1c000 bytes) 2024-03-29T01:00:20.500 INFO:teuthology.orchestra.run.smithi153.stdout: +606( 94 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.500 INFO:teuthology.orchestra.run.smithi153.stdout: +607( 95 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.500 INFO:teuthology.orchestra.run.smithi153.stdout: +608( 96 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.500 INFO:teuthology.orchestra.run.smithi153.stdout: +609( 97 mod 256): TRUNCATE DOWN from 0x88b66 to 0x32000 2024-03-29T01:00:20.500 INFO:teuthology.orchestra.run.smithi153.stdout: +610( 98 mod 256): COPY 0x9000 thru 0x11fff (0x9000 bytes) to 0x59000 thru 0x61fff 2024-03-29T01:00:20.500 INFO:teuthology.orchestra.run.smithi153.stdout: +611( 99 mod 256): COPY 0x28000 thru 0x32fff (0xb000 bytes) to 0x52000 thru 0x5cfff EEEE****** 2024-03-29T01:00:20.500 INFO:teuthology.orchestra.run.smithi153.stdout: +612(100 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +613(101 mod 256): TRUNCATE UP from 0x62000 to 0x6a000 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +614(102 mod 256): TRUNCATE DOWN from 0x6a000 to 0x37000 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +615(103 mod 256): PUNCH 0x12bf7 thru 0x13be1 (0xfeb bytes) 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +616(104 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +617(105 mod 256): MAPWRITE 0x2e000 thru 0x4adf7 (0x1cdf8 bytes) ******WWWW 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +618(106 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +619(107 mod 256): MAPREAD 0x3000 thru 0xaccf (0x7cd0 bytes) 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +620(108 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +621(109 mod 256): TRUNCATE DOWN from 0x4adf8 to 0x1d000 ******WWWW 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +622(110 mod 256): MAPWRITE 0x6f000 thru 0x7cd26 (0xdd27 bytes) 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +623(111 mod 256): WRITE 0x2000 thru 0x11fff (0x10000 bytes) 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +624(112 mod 256): TRUNCATE DOWN from 0x7cd27 to 0x6000 ******WWWW 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +625(113 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +626(114 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.501 INFO:teuthology.orchestra.run.smithi153.stdout: +627(115 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.502 INFO:teuthology.orchestra.run.smithi153.stdout: +628(116 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.502 INFO:teuthology.orchestra.run.smithi153.stdout: +629(117 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.502 INFO:teuthology.orchestra.run.smithi153.stdout: +630(118 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.502 INFO:teuthology.orchestra.run.smithi153.stdout: +631(119 mod 256): WRITE 0x0 thru 0x6fff (0x7000 bytes) EXTEND 2024-03-29T01:00:20.502 INFO:teuthology.orchestra.run.smithi153.stdout: +632(120 mod 256): COPY 0x2000 thru 0x5fff (0x4000 bytes) to 0x69000 thru 0x6cfff 2024-03-29T01:00:20.502 INFO:teuthology.orchestra.run.smithi153.stdout: +633(121 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.502 INFO:teuthology.orchestra.run.smithi153.stdout: +634(122 mod 256): TRUNCATE DOWN from 0x6d000 to 0x2c000 ******WWWW 2024-03-29T01:00:20.502 INFO:teuthology.orchestra.run.smithi153.stdout: +635(123 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.502 INFO:teuthology.orchestra.run.smithi153.stdout: +636(124 mod 256): COPY 0x17000 thru 0x2afff (0x14000 bytes) to 0x6b000 thru 0x7efff 2024-03-29T01:00:20.502 INFO:teuthology.orchestra.run.smithi153.stdout: +637(125 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.502 INFO:teuthology.orchestra.run.smithi153.stdout: +638(126 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.502 INFO:teuthology.orchestra.run.smithi153.stdout: +639(127 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.502 INFO:teuthology.orchestra.run.smithi153.stdout: +640(128 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.502 INFO:teuthology.orchestra.run.smithi153.stdout: +641(129 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.503 INFO:teuthology.orchestra.run.smithi153.stdout: +642(130 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.503 INFO:teuthology.orchestra.run.smithi153.stdout: +643(131 mod 256): COPY 0x18000 thru 0x2dfff (0x16000 bytes) to 0x63000 thru 0x78fff 2024-03-29T01:00:20.503 INFO:teuthology.orchestra.run.smithi153.stdout: +644(132 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.503 INFO:teuthology.orchestra.run.smithi153.stdout: +645(133 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.503 INFO:teuthology.orchestra.run.smithi153.stdout: +646(134 mod 256): MAPREAD 0x28000 thru 0x3f7c8 (0x177c9 bytes) ***RRRR*** 2024-03-29T01:00:20.503 INFO:teuthology.orchestra.run.smithi153.stdout: +647(135 mod 256): PUNCH 0x7e7d thru 0x1458d (0xc711 bytes) 2024-03-29T01:00:20.503 INFO:teuthology.orchestra.run.smithi153.stdout: +648(136 mod 256): MAPREAD 0x40000 thru 0x41799 (0x179a bytes) 2024-03-29T01:00:20.503 INFO:teuthology.orchestra.run.smithi153.stdout: +649(137 mod 256): READ 0x3e000 thru 0x3ffff (0x2000 bytes) 2024-03-29T01:00:20.503 INFO:teuthology.orchestra.run.smithi153.stdout: +650(138 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.503 INFO:teuthology.orchestra.run.smithi153.stdout: +651(139 mod 256): WRITE 0x74000 thru 0x8bfff (0x18000 bytes) EXTEND 2024-03-29T01:00:20.503 INFO:teuthology.orchestra.run.smithi153.stdout: +652(140 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.503 INFO:teuthology.orchestra.run.smithi153.stdout: +653(141 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.503 INFO:teuthology.orchestra.run.smithi153.stdout: +654(142 mod 256): COPY 0x40000 thru 0x54fff (0x15000 bytes) to 0x55000 thru 0x69fff 2024-03-29T01:00:20.503 INFO:teuthology.orchestra.run.smithi153.stdout: +655(143 mod 256): MAPWRITE 0x28000 thru 0x292f8 (0x12f9 bytes) 2024-03-29T01:00:20.504 INFO:teuthology.orchestra.run.smithi153.stdout: +656(144 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.504 INFO:teuthology.orchestra.run.smithi153.stdout: +657(145 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.504 INFO:teuthology.orchestra.run.smithi153.stdout: +658(146 mod 256): MAPWRITE 0x5b000 thru 0x66f4e (0xbf4f bytes) 2024-03-29T01:00:20.504 INFO:teuthology.orchestra.run.smithi153.stdout: +659(147 mod 256): WRITE 0x59000 thru 0x5cfff (0x4000 bytes) 2024-03-29T01:00:20.504 INFO:teuthology.orchestra.run.smithi153.stdout: +660(148 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.504 INFO:teuthology.orchestra.run.smithi153.stdout: +661(149 mod 256): MAPWRITE 0x5f000 thru 0x6bfc1 (0xcfc2 bytes) 2024-03-29T01:00:20.504 INFO:teuthology.orchestra.run.smithi153.stdout: +662(150 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.504 INFO:teuthology.orchestra.run.smithi153.stdout: +663(151 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.504 INFO:teuthology.orchestra.run.smithi153.stdout: +664(152 mod 256): MAPWRITE 0x38000 thru 0x4130c (0x930d bytes) 2024-03-29T01:00:20.504 INFO:teuthology.orchestra.run.smithi153.stdout: +665(153 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.504 INFO:teuthology.orchestra.run.smithi153.stdout: +666(154 mod 256): COPY 0x84000 thru 0x8afff (0x7000 bytes) to 0x51000 thru 0x57fff 2024-03-29T01:00:20.504 INFO:teuthology.orchestra.run.smithi153.stdout: +667(155 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.504 INFO:teuthology.orchestra.run.smithi153.stdout: +668(156 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.504 INFO:teuthology.orchestra.run.smithi153.stdout: +669(157 mod 256): PUNCH 0x54aa thru 0x1cd89 (0x178e0 bytes) 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +670(158 mod 256): WRITE 0x5c000 thru 0x77fff (0x1c000 bytes) 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +671(159 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +672(160 mod 256): READ 0x31000 thru 0x35fff (0x5000 bytes) ***RRRR*** 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +673(161 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +674(162 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +675(163 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +676(164 mod 256): TRUNCATE DOWN from 0x8c000 to 0x20000 ******WWWW 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +677(165 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +678(166 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +679(167 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +680(168 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +681(169 mod 256): WRITE 0x71000 thru 0x83fff (0x13000 bytes) HOLE ***WWWW 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +682(170 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +683(171 mod 256): COPY 0x76000 thru 0x81fff (0xc000 bytes) to 0x28000 thru 0x33fff ******EEEE 2024-03-29T01:00:20.505 INFO:teuthology.orchestra.run.smithi153.stdout: +684(172 mod 256): TRUNCATE DOWN from 0x84000 to 0x4e000 2024-03-29T01:00:20.506 INFO:teuthology.orchestra.run.smithi153.stdout: +685(173 mod 256): WRITE 0xd000 thru 0x24fff (0x18000 bytes) 2024-03-29T01:00:20.506 INFO:teuthology.orchestra.run.smithi153.stdout: +686(174 mod 256): TRUNCATE DOWN from 0x4e000 to 0x28000 ******WWWW 2024-03-29T01:00:20.506 INFO:teuthology.orchestra.run.smithi153.stdout: +687(175 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.506 INFO:teuthology.orchestra.run.smithi153.stdout: +688(176 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.506 INFO:teuthology.orchestra.run.smithi153.stdout: +689(177 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.506 INFO:teuthology.orchestra.run.smithi153.stdout: +690(178 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.506 INFO:teuthology.orchestra.run.smithi153.stdout: +691(179 mod 256): MAPREAD 0x1a000 thru 0x277bc (0xd7bd bytes) 2024-03-29T01:00:20.506 INFO:teuthology.orchestra.run.smithi153.stdout: +692(180 mod 256): MAPREAD 0x9000 thru 0xcb68 (0x3b69 bytes) 2024-03-29T01:00:20.506 INFO:teuthology.orchestra.run.smithi153.stdout: +693(181 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.506 INFO:teuthology.orchestra.run.smithi153.stdout: +694(182 mod 256): READ 0xb000 thru 0x14fff (0xa000 bytes) 2024-03-29T01:00:20.506 INFO:teuthology.orchestra.run.smithi153.stdout: +695(183 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.506 INFO:teuthology.orchestra.run.smithi153.stdout: +696(184 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.506 INFO:teuthology.orchestra.run.smithi153.stdout: +697(185 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +698(186 mod 256): READ 0x21000 thru 0x26fff (0x6000 bytes) 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +699(187 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +700(188 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +701(189 mod 256): MAPWRITE 0x8b000 thru 0x8b298 (0x299 bytes) 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +702(190 mod 256): COPY 0x88000 thru 0x89fff (0x2000 bytes) to 0x4f000 thru 0x50fff 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +703(191 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +704(192 mod 256): WRITE 0x8b000 thru 0x90fff (0x6000 bytes) EXTEND 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +705(193 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +706(194 mod 256): PUNCH 0x7c0d2 thru 0x90fff (0x14f2e bytes) 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +707(195 mod 256): MAPWRITE 0x6a000 thru 0x800a6 (0x160a7 bytes) 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +708(196 mod 256): COPY 0x87000 thru 0x8ffff (0x9000 bytes) to 0x78000 thru 0x80fff 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +709(197 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +710(198 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +711(199 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +712(200 mod 256): TRUNCATE DOWN from 0x91000 to 0x8f000 2024-03-29T01:00:20.507 INFO:teuthology.orchestra.run.smithi153.stdout: +713(201 mod 256): WRITE 0x1c000 thru 0x2ffff (0x14000 bytes) 2024-03-29T01:00:20.508 INFO:teuthology.orchestra.run.smithi153.stdout: +714(202 mod 256): WRITE 0x15000 thru 0x1bfff (0x7000 bytes) 2024-03-29T01:00:20.508 INFO:teuthology.orchestra.run.smithi153.stdout: +715(203 mod 256): PUNCH 0x65e48 thru 0x70f3b (0xb0f4 bytes) 2024-03-29T01:00:20.508 INFO:teuthology.orchestra.run.smithi153.stdout: +716(204 mod 256): WRITE 0x8c000 thru 0x91fff (0x6000 bytes) EXTEND 2024-03-29T01:00:20.508 INFO:teuthology.orchestra.run.smithi153.stdout: +717(205 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.508 INFO:teuthology.orchestra.run.smithi153.stdout: +718(206 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.508 INFO:teuthology.orchestra.run.smithi153.stdout: +719(207 mod 256): READ 0x44000 thru 0x44fff (0x1000 bytes) 2024-03-29T01:00:20.508 INFO:teuthology.orchestra.run.smithi153.stdout: +720(208 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.508 INFO:teuthology.orchestra.run.smithi153.stdout: +721(209 mod 256): PUNCH 0x38f7e thru 0x535ef (0x1a672 bytes) 2024-03-29T01:00:20.508 INFO:teuthology.orchestra.run.smithi153.stdout: +722(210 mod 256): COPY 0x5f000 thru 0x7cfff (0x1e000 bytes) to 0x7000 thru 0x24fff 2024-03-29T01:00:20.508 INFO:teuthology.orchestra.run.smithi153.stdout: +723(211 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.508 INFO:teuthology.orchestra.run.smithi153.stdout: +724(212 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.508 INFO:teuthology.orchestra.run.smithi153.stdout: +725(213 mod 256): READ 0x49000 thru 0x56fff (0xe000 bytes) 2024-03-29T01:00:20.508 INFO:teuthology.orchestra.run.smithi153.stdout: +726(214 mod 256): MAPREAD 0x54000 thru 0x6cc57 (0x18c58 bytes) 2024-03-29T01:00:20.509 INFO:teuthology.orchestra.run.smithi153.stdout: +727(215 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.509 INFO:teuthology.orchestra.run.smithi153.stdout: +728(216 mod 256): TRUNCATE DOWN from 0x92000 to 0x6c000 2024-03-29T01:00:20.509 INFO:teuthology.orchestra.run.smithi153.stdout: +729(217 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.509 INFO:teuthology.orchestra.run.smithi153.stdout: +730(218 mod 256): READ 0x4d000 thru 0x4dfff (0x1000 bytes) 2024-03-29T01:00:20.509 INFO:teuthology.orchestra.run.smithi153.stdout: +731(219 mod 256): MAPWRITE 0x3a000 thru 0x3ac91 (0xc92 bytes) 2024-03-29T01:00:20.509 INFO:teuthology.orchestra.run.smithi153.stdout: +732(220 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.509 INFO:teuthology.orchestra.run.smithi153.stdout: +733(221 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.509 INFO:teuthology.orchestra.run.smithi153.stdout: +734(222 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.509 INFO:teuthology.orchestra.run.smithi153.stdout: +735(223 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.509 INFO:teuthology.orchestra.run.smithi153.stdout: +736(224 mod 256): WRITE 0x40000 thru 0x5bfff (0x1c000 bytes) 2024-03-29T01:00:20.509 INFO:teuthology.orchestra.run.smithi153.stdout: +737(225 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.510 INFO:teuthology.orchestra.run.smithi153.stdout: +738(226 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.510 INFO:teuthology.orchestra.run.smithi153.stdout: +739(227 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.510 INFO:teuthology.orchestra.run.smithi153.stdout: +740(228 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.510 INFO:teuthology.orchestra.run.smithi153.stdout: +741(229 mod 256): MAPREAD 0x47000 thru 0x51512 (0xa513 bytes) 2024-03-29T01:00:20.510 INFO:teuthology.orchestra.run.smithi153.stdout: +742(230 mod 256): MAPREAD 0x64000 thru 0x692c6 (0x52c7 bytes) 2024-03-29T01:00:20.510 INFO:teuthology.orchestra.run.smithi153.stdout: +743(231 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.510 INFO:teuthology.orchestra.run.smithi153.stdout: +744(232 mod 256): COPY 0x50000 thru 0x67fff (0x18000 bytes) to 0x34000 thru 0x4bfff 2024-03-29T01:00:20.510 INFO:teuthology.orchestra.run.smithi153.stdout: +745(233 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.510 INFO:teuthology.orchestra.run.smithi153.stdout: +746(234 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.510 INFO:teuthology.orchestra.run.smithi153.stdout: +747(235 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.510 INFO:teuthology.orchestra.run.smithi153.stdout: +748(236 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.510 INFO:teuthology.orchestra.run.smithi153.stdout: +749(237 mod 256): COPY 0x22000 thru 0x2ffff (0xe000 bytes) to 0x41000 thru 0x4efff 2024-03-29T01:00:20.510 INFO:teuthology.orchestra.run.smithi153.stdout: +750(238 mod 256): TRUNCATE UP from 0x6c000 to 0x8d000 2024-03-29T01:00:20.510 INFO:teuthology.orchestra.run.smithi153.stdout: +751(239 mod 256): TRUNCATE DOWN from 0x8d000 to 0x2c000 ******WWWW 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +752(240 mod 256): READ 0x1d000 thru 0x21fff (0x5000 bytes) 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +753(241 mod 256): TRUNCATE UP from 0x2c000 to 0x59000 ******WWWW 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +754(242 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +755(243 mod 256): MAPWRITE 0x25000 thru 0x381d3 (0x131d4 bytes) ******WWWW 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +756(244 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +757(245 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +758(246 mod 256): MAPREAD 0x2000 thru 0x1b877 (0x19878 bytes) 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +759(247 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +760(248 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +761(249 mod 256): MAPREAD 0x4b000 thru 0x58134 (0xd135 bytes) 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +762(250 mod 256): PUNCH 0x3bedb thru 0x53a9a (0x17bc0 bytes) 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +763(251 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +764(252 mod 256): TRUNCATE UP from 0x59000 to 0x77000 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +765(253 mod 256): MAPWRITE 0x33000 thru 0x4e768 (0x1b769 bytes) 2024-03-29T01:00:20.511 INFO:teuthology.orchestra.run.smithi153.stdout: +766(254 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +767(255 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +768( 0 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +769( 1 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +770( 2 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +771( 3 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +772( 4 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +773( 5 mod 256): PUNCH 0xd883 thru 0x2c47e (0x1ebfc bytes) 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +774( 6 mod 256): MAPWRITE 0x53000 thru 0x67a76 (0x14a77 bytes) 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +775( 7 mod 256): MAPREAD 0x11000 thru 0x11f5b (0xf5c bytes) 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +776( 8 mod 256): TRUNCATE DOWN from 0x77000 to 0x65000 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +777( 9 mod 256): MAPREAD 0x10000 thru 0x28136 (0x18137 bytes) 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +778( 10 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +779( 11 mod 256): READ 0x22000 thru 0x30fff (0xf000 bytes) 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +780( 12 mod 256): WRITE 0x87000 thru 0x90fff (0xa000 bytes) HOLE 2024-03-29T01:00:20.512 INFO:teuthology.orchestra.run.smithi153.stdout: +781( 13 mod 256): READ 0x4b000 thru 0x69fff (0x1f000 bytes) 2024-03-29T01:00:20.513 INFO:teuthology.orchestra.run.smithi153.stdout: +782( 14 mod 256): WRITE 0x77000 thru 0x7afff (0x4000 bytes) 2024-03-29T01:00:20.513 INFO:teuthology.orchestra.run.smithi153.stdout: +783( 15 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.513 INFO:teuthology.orchestra.run.smithi153.stdout: +784( 16 mod 256): TRUNCATE DOWN from 0x91000 to 0x24000 ******WWWW 2024-03-29T01:00:20.513 INFO:teuthology.orchestra.run.smithi153.stdout: +785( 17 mod 256): PUNCH 0x1ace4 thru 0x23fff (0x931c bytes) 2024-03-29T01:00:20.513 INFO:teuthology.orchestra.run.smithi153.stdout: +786( 18 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.513 INFO:teuthology.orchestra.run.smithi153.stdout: +787( 19 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.513 INFO:teuthology.orchestra.run.smithi153.stdout: +788( 20 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.513 INFO:teuthology.orchestra.run.smithi153.stdout: +789( 21 mod 256): READ 0x20000 thru 0x22fff (0x3000 bytes) 2024-03-29T01:00:20.513 INFO:teuthology.orchestra.run.smithi153.stdout: +790( 22 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.513 INFO:teuthology.orchestra.run.smithi153.stdout: +791( 23 mod 256): MAPWRITE 0x79000 thru 0x920ad (0x190ae bytes) 2024-03-29T01:00:20.513 INFO:teuthology.orchestra.run.smithi153.stdout: +792( 24 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.513 INFO:teuthology.orchestra.run.smithi153.stdout: +793( 25 mod 256): READ 0x1e000 thru 0x22fff (0x5000 bytes) 2024-03-29T01:00:20.513 INFO:teuthology.orchestra.run.smithi153.stdout: +794( 26 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.513 INFO:teuthology.orchestra.run.smithi153.stdout: +795( 27 mod 256): WRITE 0x2000 thru 0x4fff (0x3000 bytes) 2024-03-29T01:00:20.514 INFO:teuthology.orchestra.run.smithi153.stdout: +796( 28 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.514 INFO:teuthology.orchestra.run.smithi153.stdout: +797( 29 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.514 INFO:teuthology.orchestra.run.smithi153.stdout: +798( 30 mod 256): COPY 0x47000 thru 0x5bfff (0x15000 bytes) to 0x6e000 thru 0x82fff 2024-03-29T01:00:20.514 INFO:teuthology.orchestra.run.smithi153.stdout: +799( 31 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.514 INFO:teuthology.orchestra.run.smithi153.stdout: +800( 32 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.514 INFO:teuthology.orchestra.run.smithi153.stdout: +801( 33 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.514 INFO:teuthology.orchestra.run.smithi153.stdout: +802( 34 mod 256): COPY 0x4f000 thru 0x5afff (0xc000 bytes) to 0x7c000 thru 0x87fff 2024-03-29T01:00:20.514 INFO:teuthology.orchestra.run.smithi153.stdout: +803( 35 mod 256): PUNCH 0x7471 thru 0xf07d (0x7c0d bytes) 2024-03-29T01:00:20.514 INFO:teuthology.orchestra.run.smithi153.stdout: +804( 36 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.515 INFO:teuthology.orchestra.run.smithi153.stdout: +805( 37 mod 256): MAPWRITE 0x8d000 thru 0x92500 (0x5501 bytes) 2024-03-29T01:00:20.515 INFO:teuthology.orchestra.run.smithi153.stdout: +806( 38 mod 256): MAPWRITE 0x7a000 thru 0x8ac5b (0x10c5c bytes) 2024-03-29T01:00:20.515 INFO:teuthology.orchestra.run.smithi153.stdout: +807( 39 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.515 INFO:teuthology.orchestra.run.smithi153.stdout: +808( 40 mod 256): MAPREAD 0x58000 thru 0x76fc2 (0x1efc3 bytes) 2024-03-29T01:00:20.515 INFO:teuthology.orchestra.run.smithi153.stdout: +809( 41 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.515 INFO:teuthology.orchestra.run.smithi153.stdout: +810( 42 mod 256): TRUNCATE DOWN from 0x92501 to 0x2d000 ******WWWW 2024-03-29T01:00:20.515 INFO:teuthology.orchestra.run.smithi153.stdout: +811( 43 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.515 INFO:teuthology.orchestra.run.smithi153.stdout: +812( 44 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.515 INFO:teuthology.orchestra.run.smithi153.stdout: +813( 45 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.515 INFO:teuthology.orchestra.run.smithi153.stdout: +814( 46 mod 256): WRITE 0x25000 thru 0x32fff (0xe000 bytes) EXTEND ***WWWW 2024-03-29T01:00:20.515 INFO:teuthology.orchestra.run.smithi153.stdout: +815( 47 mod 256): READ 0x15000 thru 0x31fff (0x1d000 bytes) ***RRRR*** 2024-03-29T01:00:20.515 INFO:teuthology.orchestra.run.smithi153.stdout: +816( 48 mod 256): MAPWRITE 0x35000 thru 0x504c1 (0x1b4c2 bytes) 2024-03-29T01:00:20.515 INFO:teuthology.orchestra.run.smithi153.stdout: +817( 49 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.516 INFO:teuthology.orchestra.run.smithi153.stdout: +818( 50 mod 256): MAPREAD 0x19000 thru 0x220e5 (0x90e6 bytes) 2024-03-29T01:00:20.516 INFO:teuthology.orchestra.run.smithi153.stdout: +819( 51 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.516 INFO:teuthology.orchestra.run.smithi153.stdout: +820( 52 mod 256): PUNCH 0x31008 thru 0x3af70 (0x9f69 bytes) 2024-03-29T01:00:20.516 INFO:teuthology.orchestra.run.smithi153.stdout: +821( 53 mod 256): MAPWRITE 0x44000 thru 0x463cc (0x23cd bytes) 2024-03-29T01:00:20.516 INFO:teuthology.orchestra.run.smithi153.stdout: +822( 54 mod 256): MAPREAD 0x4b000 thru 0x50246 (0x5247 bytes) 2024-03-29T01:00:20.516 INFO:teuthology.orchestra.run.smithi153.stdout: +823( 55 mod 256): COPY 0x3000 thru 0xffff (0xd000 bytes) to 0x66000 thru 0x72fff 2024-03-29T01:00:20.516 INFO:teuthology.orchestra.run.smithi153.stdout: +824( 56 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.516 INFO:teuthology.orchestra.run.smithi153.stdout: +825( 57 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.516 INFO:teuthology.orchestra.run.smithi153.stdout: +826( 58 mod 256): READ 0x1a000 thru 0x29fff (0x10000 bytes) 2024-03-29T01:00:20.516 INFO:teuthology.orchestra.run.smithi153.stdout: +827( 59 mod 256): PUNCH 0x129d thru 0x1d0a5 (0x1be09 bytes) 2024-03-29T01:00:20.516 INFO:teuthology.orchestra.run.smithi153.stdout: +828( 60 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.516 INFO:teuthology.orchestra.run.smithi153.stdout: +829( 61 mod 256): SKIPPED (no operation) 2024-03-29T01:00:20.517 INFO:teuthology.orchestra.run.smithi153.stdout: +830( 62 mod 256): MAPREAD 0x20000 thru 0x3763c (0x1763d bytes) ***RRRR*** 2024-03-29T01:00:20.517 INFO:teuthology.orchestra.run.smithi153.stdout: +Log of operations saved to "/tmp/tmp.l0v0NkF9eFtest/junk.fsxops"; replay with --replay-ops 2024-03-29T01:00:20.517 INFO:teuthology.orchestra.run.smithi153.stdout: +Correct content saved for comparison 2024-03-29T01:00:20.517 INFO:teuthology.orchestra.run.smithi153.stdout: +(maybe hexdump "/tmp/tmp.l0v0NkF9eFtest/junk" vs "/tmp/tmp.l0v0NkF9eFtest/junk.fsxgood") 2024-03-29T01:00:20.517 INFO:teuthology.orchestra.run.smithi153.stdout: Silence is golden 2024-03-29T01:00:20.518 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/521 2024-03-29T01:00:20.518 INFO:teuthology.orchestra.run.smithi153.stdout:Failures: generic/521 2024-03-29T01:00:20.518 INFO:teuthology.orchestra.run.smithi153.stdout:Failed 1 of 1 tests 2024-03-29T01:00:20.518 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:00:20.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T01:00:20.626 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-29T01:00:20.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-29T01:00:20.626 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-03-29T01:00:21.472 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:00:21.490 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:00:21.492 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:00:21.496 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:00:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:03.900 INFO:teuthology.orchestra.run.smithi153.stdout:generic/522 3462s 2024-03-29T01:58:03.964 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/522 2024-03-29T01:58:03.964 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:03.975 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:04.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:04.031 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-03-29T01:58:05.054 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:05.070 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:05.072 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:05.076 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:05.076 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:06.247 INFO:teuthology.orchestra.run.smithi153.stdout:generic/523 1s 2024-03-29T01:58:06.269 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/523 2024-03-29T01:58:06.269 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:06.280 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:06.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:06.318 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-03-29T01:58:07.000 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:07.015 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:07.017 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:07.021 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:07.021 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:15.242 INFO:teuthology.orchestra.run.smithi153.stdout:generic/524 8s 2024-03-29T01:58:15.267 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/524 2024-03-29T01:58:15.267 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:15.278 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:15.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:15.305 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-03-29T01:58:15.947 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:15.962 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:15.963 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:15.967 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:15.967 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:16.906 INFO:teuthology.orchestra.run.smithi153.stdout:generic/525 [not run] filesystem does not support huge file size 2024-03-29T01:58:16.933 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/525 2024-03-29T01:58:16.933 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/525 2024-03-29T01:58:16.933 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:16.941 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:16.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:16.998 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-03-29T01:58:17.699 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:17.713 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:17.714 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:17.717 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:17.717 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:18.546 INFO:teuthology.orchestra.run.smithi153.stdout:generic/526 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T01:58:18.557 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/526 2024-03-29T01:58:18.557 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/526 2024-03-29T01:58:18.557 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:18.566 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:18.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:18.630 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-03-29T01:58:19.288 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:19.303 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:19.305 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:19.308 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:19.309 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:20.081 INFO:teuthology.orchestra.run.smithi153.stdout:generic/527 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T01:58:20.096 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/527 2024-03-29T01:58:20.096 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/527 2024-03-29T01:58:20.096 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:20.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:20.165 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-03-29T01:58:20.821 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:20.843 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:21.753 INFO:teuthology.orchestra.run.smithi153.stdout:generic/528 0s 2024-03-29T01:58:21.771 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/528 2024-03-29T01:58:21.771 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:21.781 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:21.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:21.862 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-03-29T01:58:22.684 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:22.700 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:22.701 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:22.705 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:22.705 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:23.834 INFO:teuthology.orchestra.run.smithi153.stdout:generic/529 1s 2024-03-29T01:58:23.855 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/529 2024-03-29T01:58:23.855 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:23.863 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:23.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:23.890 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-03-29T01:58:24.550 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:24.567 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:24.568 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:24.572 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:24.572 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:generic/530 [not run] ceph does not support shutdown 2024-03-29T01:58:25.515 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/530 2024-03-29T01:58:25.516 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/530 2024-03-29T01:58:25.516 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:25.530 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:25.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:25.575 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-03-29T01:58:26.240 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:26.257 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:26.259 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:26.263 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:26.263 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:26.972 INFO:teuthology.orchestra.run.smithi153.stdout:generic/531 [not run] O_TMPFILE is not supported 2024-03-29T01:58:26.986 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/531 2024-03-29T01:58:26.986 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/531 2024-03-29T01:58:26.986 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:26.997 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:27.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:27.050 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-03-29T01:58:27.714 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:27.730 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:27.732 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:27.736 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:27.736 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:28.979 INFO:teuthology.orchestra.run.smithi153.stdout:generic/532 1s 2024-03-29T01:58:29.001 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/532 2024-03-29T01:58:29.001 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:29.013 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:29.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:29.054 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-03-29T01:58:29.709 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:29.724 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:29.726 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:29.728 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:29.728 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:31.477 INFO:teuthology.orchestra.run.smithi153.stdout:generic/533 2s 2024-03-29T01:58:31.500 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/533 2024-03-29T01:58:31.501 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:31.513 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:31.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:31.557 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-03-29T01:58:32.179 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:32.198 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:32.200 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:32.203 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:32.962 INFO:teuthology.orchestra.run.smithi153.stdout:generic/534 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T01:58:32.975 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/534 2024-03-29T01:58:32.975 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/534 2024-03-29T01:58:32.975 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:32.986 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:33.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:33.033 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-03-29T01:58:33.664 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:33.680 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:33.681 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:33.685 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:33.685 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:34.579 INFO:teuthology.orchestra.run.smithi153.stdout:generic/535 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T01:58:34.596 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/535 2024-03-29T01:58:34.596 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/535 2024-03-29T01:58:34.596 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:34.607 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:34.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:34.654 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-03-29T01:58:35.306 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:35.325 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:35.326 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:35.328 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:35.329 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:36.256 INFO:teuthology.orchestra.run.smithi153.stdout:generic/536 [not run] ceph does not support shutdown 2024-03-29T01:58:36.280 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/536 2024-03-29T01:58:36.280 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/536 2024-03-29T01:58:36.280 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:36.290 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:36.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:36.333 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-03-29T01:58:36.983 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:36.998 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:37.002 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:37.008 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:37.008 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:37.904 INFO:teuthology.orchestra.run.smithi153.stdout:generic/537 [not run] FSTRIM not supported 2024-03-29T01:58:37.928 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/537 2024-03-29T01:58:37.928 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/537 2024-03-29T01:58:37.928 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T01:58:37.937 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T01:58:37.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T01:58:37.977 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-03-29T01:58:38.647 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T01:58:38.665 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T01:58:38.666 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T01:58:38.671 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T01:58:38.671 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:11:46.470 INFO:teuthology.orchestra.run.smithi153.stdout:generic/538 788s 2024-03-29T02:11:46.493 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/538 2024-03-29T02:11:46.493 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:11:46.503 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:11:46.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:11:46.591 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-03-29T02:11:47.432 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:11:47.452 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:11:47.454 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:11:47.459 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:11:47.459 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:11:50.283 INFO:teuthology.orchestra.run.smithi153.stdout:generic/539 3s 2024-03-29T02:11:50.321 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/539 2024-03-29T02:11:50.322 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:11:50.334 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:11:50.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:11:50.480 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-03-29T02:11:51.342 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:11:51.365 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:11:51.370 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:11:51.377 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:11:51.378 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:11:52.464 INFO:teuthology.orchestra.run.smithi153.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T02:11:52.492 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/540 2024-03-29T02:11:52.492 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/540 2024-03-29T02:11:52.492 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:11:52.503 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:11:52.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:11:52.674 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-03-29T02:11:53.402 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:11:53.418 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:11:53.419 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:11:53.423 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:11:53.423 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:11:54.544 INFO:teuthology.orchestra.run.smithi153.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T02:11:54.568 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/541 2024-03-29T02:11:54.569 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/541 2024-03-29T02:11:54.569 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:11:54.583 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:11:54.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:11:54.871 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-03-29T02:11:55.577 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:11:55.602 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:11:55.603 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:11:55.607 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:11:55.607 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:11:56.817 INFO:teuthology.orchestra.run.smithi153.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T02:11:56.842 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/542 2024-03-29T02:11:56.846 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/542 2024-03-29T02:11:56.846 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:11:56.864 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:11:56.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:11:56.994 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-03-29T02:11:57.743 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:11:57.762 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:11:57.764 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:11:57.768 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:11:57.768 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:11:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T02:11:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/543 2024-03-29T02:11:58.882 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/543 2024-03-29T02:11:58.882 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:11:58.896 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:11:59.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:11:59.035 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-03-29T02:11:59.803 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:11:59.819 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:11:59.820 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:11:59.823 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:11:59.823 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:12:00.978 INFO:teuthology.orchestra.run.smithi153.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T02:12:01.003 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/544 2024-03-29T02:12:01.003 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/544 2024-03-29T02:12:01.003 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:12:01.019 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:12:01.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:12:01.127 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-03-29T02:12:01.876 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:12:01.896 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:12:01.897 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:12:01.901 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:12:01.901 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:12:02.735 INFO:teuthology.orchestra.run.smithi153.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-03-29T02:12:02.749 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/545 2024-03-29T02:12:02.749 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/545 2024-03-29T02:12:02.750 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:12:02.760 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:12:02.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:12:02.817 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-03-29T02:12:03.445 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:12:03.460 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:12:03.461 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:12:03.464 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:12:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:12:04.254 INFO:teuthology.orchestra.run.smithi153.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-29T02:12:04.267 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/546 2024-03-29T02:12:04.267 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/546 2024-03-29T02:12:04.267 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:12:04.277 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:12:04.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:12:04.333 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-03-29T02:12:04.995 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:12:05.010 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:12:05.011 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:12:05.014 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:12:05.015 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:12:05.733 INFO:teuthology.orchestra.run.smithi153.stdout:generic/547 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T02:12:05.749 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/547 2024-03-29T02:12:05.749 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/547 2024-03-29T02:12:05.749 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:12:05.757 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:12:05.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:12:05.799 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-03-29T02:12:06.429 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:12:06.444 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:12:06.445 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:12:06.448 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:12:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:12:08.353 INFO:teuthology.orchestra.run.smithi153.stdout:generic/548 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-29T02:12:08.366 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/548 2024-03-29T02:12:08.366 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/548 2024-03-29T02:12:08.366 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:12:08.377 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:12:08.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:12:08.425 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-03-29T02:12:09.093 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:12:09.109 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:12:09.111 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:12:09.113 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:12:09.114 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:12:10.994 INFO:teuthology.orchestra.run.smithi153.stdout:generic/549 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-29T02:12:11.015 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/549 2024-03-29T02:12:11.015 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/549 2024-03-29T02:12:11.016 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:12:11.023 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:12:11.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:12:11.078 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-03-29T02:12:11.734 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:12:11.750 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:12:11.752 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:12:11.756 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:12:11.756 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:12:13.073 INFO:teuthology.orchestra.run.smithi153.stdout:generic/550 [not run] encryption policy '-c 9 -n 9 -f 0' is unusable; probably missing kernel crypto API support 2024-03-29T02:12:13.122 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/550 2024-03-29T02:12:13.122 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/550 2024-03-29T02:12:13.122 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:12:13.137 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:12:13.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:12:13.183 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-03-29T02:12:13.811 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:12:13.829 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:12:13.831 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:12:13.834 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:12:13.834 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:29.475 INFO:teuthology.orchestra.run.smithi153.stdout:generic/551 1755s 2024-03-29T02:41:29.505 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/551 2024-03-29T02:41:29.505 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:29.516 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:29.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:29.546 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-03-29T02:41:30.527 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:30.540 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:30.542 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:30.544 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:30.544 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:31.429 INFO:teuthology.orchestra.run.smithi153.stdout:generic/552 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T02:41:31.442 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/552 2024-03-29T02:41:31.442 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/552 2024-03-29T02:41:31.442 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:31.451 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:31.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:31.500 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-03-29T02:41:32.158 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:32.172 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:32.174 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:32.177 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:32.178 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:33.030 INFO:teuthology.orchestra.run.smithi153.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2024-03-29T02:41:33.047 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/553 2024-03-29T02:41:33.047 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/553 2024-03-29T02:41:33.047 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:33.055 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:33.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:33.187 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-03-29T02:41:34.032 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:34.049 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:34.051 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:34.053 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:34.053 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:35.165 INFO:teuthology.orchestra.run.smithi153.stdout:generic/554 [not run] swapfiles are not supported 2024-03-29T02:41:35.180 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/554 2024-03-29T02:41:35.180 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/554 2024-03-29T02:41:35.180 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:35.191 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:35.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:35.307 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-03-29T02:41:36.136 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:36.155 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:36.156 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:36.162 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:36.162 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:36.997 INFO:teuthology.orchestra.run.smithi153.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2024-03-29T02:41:37.011 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/555 2024-03-29T02:41:37.011 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/555 2024-03-29T02:41:37.011 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:37.020 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:37.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:37.134 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-03-29T02:41:37.941 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:37.956 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:37.958 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:37.960 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:38.808 INFO:teuthology.orchestra.run.smithi153.stdout:generic/556 [not run] ceph does not support casefold feature 2024-03-29T02:41:38.824 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/556 2024-03-29T02:41:38.824 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/556 2024-03-29T02:41:38.825 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:38.834 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:38.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:38.876 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-03-29T02:41:39.529 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:39.543 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:39.544 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:39.547 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:39.547 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:40.268 INFO:teuthology.orchestra.run.smithi153.stdout:generic/557 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T02:41:40.280 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/557 2024-03-29T02:41:40.280 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/557 2024-03-29T02:41:40.281 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:40.290 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:40.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:40.337 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-03-29T02:41:40.979 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:40.994 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:40.996 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:40.998 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:40.998 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:41.711 INFO:teuthology.orchestra.run.smithi153.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-29T02:41:41.725 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/558 2024-03-29T02:41:41.725 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/558 2024-03-29T02:41:41.726 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:41.736 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:41.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:41.792 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-03-29T02:41:42.443 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:42.458 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:42.459 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:42.463 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:42.463 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:43.135 INFO:teuthology.orchestra.run.smithi153.stdout:generic/559 [not run] duperemove utility required, skipped this test 2024-03-29T02:41:43.147 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/559 2024-03-29T02:41:43.147 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/559 2024-03-29T02:41:43.147 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:43.157 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:43.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:43.198 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-03-29T02:41:43.867 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:43.883 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:43.885 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:43.889 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:44.875 INFO:teuthology.orchestra.run.smithi153.stdout:generic/560 [not run] duperemove utility required, skipped this test 2024-03-29T02:41:45.180 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/560 2024-03-29T02:41:45.180 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/560 2024-03-29T02:41:45.180 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:45.190 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:45.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:45.245 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-03-29T02:41:45.918 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:45.934 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:45.936 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:45.939 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:45.939 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:46.624 INFO:teuthology.orchestra.run.smithi153.stdout:generic/561 [not run] duperemove utility required, skipped this test 2024-03-29T02:41:46.637 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/561 2024-03-29T02:41:46.637 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/561 2024-03-29T02:41:46.638 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:46.648 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:46.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:46.691 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-03-29T02:41:47.343 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:47.359 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:47.361 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:47.363 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:47.364 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:48.407 INFO:teuthology.orchestra.run.smithi153.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T02:41:48.426 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/562 2024-03-29T02:41:48.426 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/562 2024-03-29T02:41:48.426 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:48.436 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:48.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:48.812 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-03-29T02:41:49.484 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:49.499 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:49.500 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:49.502 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:49.502 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:50.264 INFO:teuthology.orchestra.run.smithi153.stdout:generic/563 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T02:41:50.277 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/563 2024-03-29T02:41:50.277 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/563 2024-03-29T02:41:50.277 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:50.291 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:50.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:50.342 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-03-29T02:41:51.010 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:51.031 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:51.032 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:51.039 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:51.039 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:52.189 INFO:teuthology.orchestra.run.smithi153.stdout:generic/564 1s 2024-03-29T02:41:52.211 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/564 2024-03-29T02:41:52.211 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:52.221 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:52.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:52.363 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-03-29T02:41:53.226 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:53.242 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:53.245 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:53.249 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:53.249 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:54.443 INFO:teuthology.orchestra.run.smithi153.stdout:generic/565 1s 2024-03-29T02:41:54.468 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/565 2024-03-29T02:41:54.468 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:54.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:54.596 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-03-29T02:41:55.459 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:55.476 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:55.478 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:55.481 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:55.482 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:56.178 INFO:teuthology.orchestra.run.smithi153.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-29T02:41:56.193 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/566 2024-03-29T02:41:56.193 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/566 2024-03-29T02:41:56.193 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:56.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:56.270 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-03-29T02:41:56.920 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:56.936 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:56.937 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:56.940 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:56.940 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:58.382 INFO:teuthology.orchestra.run.smithi153.stdout:generic/567 1s 2024-03-29T02:41:58.401 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/567 2024-03-29T02:41:58.401 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:58.409 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:58.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:58.440 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-03-29T02:41:59.084 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:41:59.098 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:41:59.100 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:41:59.103 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:41:59.103 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:59.831 INFO:teuthology.orchestra.run.smithi153.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-29T02:41:59.845 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/568 2024-03-29T02:41:59.845 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/568 2024-03-29T02:41:59.845 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:41:59.855 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:41:59.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:41:59.906 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-03-29T02:42:00.565 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:00.586 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:00.588 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:00.592 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:00.592 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:01.293 INFO:teuthology.orchestra.run.smithi153.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-29T02:42:01.307 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/569 2024-03-29T02:42:01.308 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/569 2024-03-29T02:42:01.308 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:01.317 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:01.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:01.374 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-03-29T02:42:02.039 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:02.056 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:02.058 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:02.062 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:02.062 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:02.749 INFO:teuthology.orchestra.run.smithi153.stdout:generic/570 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T02:42:02.764 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/570 2024-03-29T02:42:02.764 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/570 2024-03-29T02:42:02.764 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:02.774 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:02.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:02.820 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-03-29T02:42:03.490 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:03.648 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:03.648 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:03.648 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:03.648 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:04.232 INFO:teuthology.orchestra.run.smithi153.stdout:generic/571 [not run] Require fcntl setlease support 2024-03-29T02:42:04.244 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/571 2024-03-29T02:42:04.244 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/571 2024-03-29T02:42:04.245 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:04.253 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:04.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:04.310 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-03-29T02:42:04.976 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:04.992 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:04.993 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:04.995 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:04.996 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:05.678 INFO:teuthology.orchestra.run.smithi153.stdout:generic/572 [not run] fsverity utility required, skipped this test 2024-03-29T02:42:05.693 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/572 2024-03-29T02:42:05.694 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/572 2024-03-29T02:42:05.694 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:05.704 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:05.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:05.748 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-03-29T02:42:06.418 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:06.434 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:06.438 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:06.439 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:07.112 INFO:teuthology.orchestra.run.smithi153.stdout:generic/573 [not run] fsverity utility required, skipped this test 2024-03-29T02:42:07.127 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/573 2024-03-29T02:42:07.127 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/573 2024-03-29T02:42:07.127 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:07.137 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:07.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:07.190 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-03-29T02:42:07.802 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:07.818 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:07.819 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:07.824 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:07.824 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:08.514 INFO:teuthology.orchestra.run.smithi153.stdout:generic/574 [not run] fsverity utility required, skipped this test 2024-03-29T02:42:08.528 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/574 2024-03-29T02:42:08.529 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/574 2024-03-29T02:42:08.529 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:08.538 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:08.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:08.580 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-03-29T02:42:09.230 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:09.244 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:09.244 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:09.247 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:09.248 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:09.933 INFO:teuthology.orchestra.run.smithi153.stdout:generic/575 [not run] fsverity utility required, skipped this test 2024-03-29T02:42:09.948 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/575 2024-03-29T02:42:09.949 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/575 2024-03-29T02:42:09.949 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:09.958 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:10.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:10.002 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-03-29T02:42:10.648 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:10.665 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:10.669 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:10.672 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:10.672 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:11.709 INFO:teuthology.orchestra.run.smithi153.stdout:generic/576 [not run] fsverity utility required, skipped this test 2024-03-29T02:42:11.721 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/576 2024-03-29T02:42:11.721 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/576 2024-03-29T02:42:11.721 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:11.732 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:11.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:11.777 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-03-29T02:42:12.414 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:12.429 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:12.431 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:12.435 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:12.435 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:13.127 INFO:teuthology.orchestra.run.smithi153.stdout:generic/577 [not run] fsverity utility required, skipped this test 2024-03-29T02:42:13.141 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/577 2024-03-29T02:42:13.141 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/577 2024-03-29T02:42:13.142 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:13.151 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:13.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:13.197 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-03-29T02:42:13.857 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:13.869 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:13.872 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:13.876 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:13.876 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:14.640 INFO:teuthology.orchestra.run.smithi153.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-29T02:42:14.655 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/578 2024-03-29T02:42:14.655 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/578 2024-03-29T02:42:14.655 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:14.665 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:14.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:14.732 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-03-29T02:42:15.388 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:15.403 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:15.405 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:15.409 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:15.409 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:16.153 INFO:teuthology.orchestra.run.smithi153.stdout:generic/579 [not run] fsverity utility required, skipped this test 2024-03-29T02:42:16.167 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/579 2024-03-29T02:42:16.168 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/579 2024-03-29T02:42:16.168 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:16.177 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:16.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:16.230 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-03-29T02:42:16.899 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:16.918 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:16.920 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:16.924 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:16.924 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:20.595 INFO:teuthology.orchestra.run.smithi153.stdout:generic/580 3s 2024-03-29T02:42:20.618 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/580 2024-03-29T02:42:20.618 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:20.628 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:20.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:20.658 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-03-29T02:42:21.325 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:21.340 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:21.342 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:21.346 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:27.774 INFO:teuthology.orchestra.run.smithi153.stdout:generic/581 6s 2024-03-29T02:42:27.792 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/581 2024-03-29T02:42:27.793 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:27.802 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:27.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:27.835 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-03-29T02:42:28.483 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:28.499 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:28.504 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:28.504 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:30.390 INFO:teuthology.orchestra.run.smithi153.stdout:generic/582 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-29T02:42:30.404 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/582 2024-03-29T02:42:30.404 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/582 2024-03-29T02:42:30.404 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:30.415 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:30.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:30.470 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-03-29T02:42:31.231 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:31.245 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:31.247 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:31.251 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:31.251 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:33.361 INFO:teuthology.orchestra.run.smithi153.stdout:generic/583 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-29T02:42:33.375 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/583 2024-03-29T02:42:33.377 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/583 2024-03-29T02:42:33.377 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:33.386 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:33.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:33.436 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-03-29T02:42:34.138 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:34.151 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:34.153 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:34.156 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:34.156 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:35.464 INFO:teuthology.orchestra.run.smithi153.stdout:generic/584 [not run] encryption policy '-c 9 -n 9 -v 2 -f 0' is unusable; probably missing kernel crypto API support 2024-03-29T02:42:35.507 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/584 2024-03-29T02:42:35.507 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/584 2024-03-29T02:42:35.508 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:35.517 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:35.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:35.559 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-03-29T02:42:36.238 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:36.258 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:36.260 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:36.263 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:36.263 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:37.053 INFO:teuthology.orchestra.run.smithi153.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2024-03-29T02:42:37.067 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/585 2024-03-29T02:42:37.067 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/585 2024-03-29T02:42:37.067 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:37.077 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:37.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:37.188 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-03-29T02:42:38.036 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:38.054 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:38.055 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:38.059 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:38.060 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:38.892 INFO:teuthology.orchestra.run.smithi153.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-29T02:42:38.908 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/586 2024-03-29T02:42:38.908 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/586 2024-03-29T02:42:38.908 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:38.918 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:39.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:39.042 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-03-29T02:42:39.910 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:39.924 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:39.926 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:39.930 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:39.930 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:41.014 INFO:teuthology.orchestra.run.smithi153.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-29T02:42:41.027 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/587 2024-03-29T02:42:41.027 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/587 2024-03-29T02:42:41.027 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:41.038 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:41.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:41.081 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-03-29T02:42:41.803 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:41.821 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:41.823 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:41.829 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:41.829 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:43.127 INFO:teuthology.orchestra.run.smithi153.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T02:42:43.144 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/588 2024-03-29T02:42:43.144 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/588 2024-03-29T02:42:43.144 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:43.159 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:43.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:43.452 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-03-29T02:42:44.186 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:44.200 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:44.201 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:44.205 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:44.205 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:44.951 INFO:teuthology.orchestra.run.smithi153.stdout:generic/589 [not run] require 172.21.15.153:6789:/scratch to be local device 2024-03-29T02:42:44.963 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/589 2024-03-29T02:42:44.963 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/589 2024-03-29T02:42:44.963 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:44.970 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:45.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:45.001 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-03-29T02:42:45.646 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:45.662 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:45.663 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:45.667 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:45.667 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:46.400 INFO:teuthology.orchestra.run.smithi153.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-29T02:42:46.413 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/590 2024-03-29T02:42:46.414 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/590 2024-03-29T02:42:46.414 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:46.424 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:46.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:46.484 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-03-29T02:42:47.147 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:47.165 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:47.167 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:47.171 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:47.171 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:48.157 INFO:teuthology.orchestra.run.smithi153.stdout:generic/591 1s 2024-03-29T02:42:48.179 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/591 2024-03-29T02:42:48.179 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:48.189 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:48.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:48.295 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-03-29T02:42:49.134 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:49.153 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:49.154 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:49.160 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:49.161 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:50.789 INFO:teuthology.orchestra.run.smithi153.stdout:generic/592 [not run] kernel does not support encryption policy: '-c 1 -n 4 -v 2 -f 8' 2024-03-29T02:42:50.810 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/592 2024-03-29T02:42:50.811 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/592 2024-03-29T02:42:50.811 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:50.821 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:50.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:50.864 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-03-29T02:42:51.526 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:51.544 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:51.549 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:51.552 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:51.552 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:55.173 INFO:teuthology.orchestra.run.smithi153.stdout:generic/593 4s 2024-03-29T02:42:55.191 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/593 2024-03-29T02:42:55.191 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:55.199 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:55.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:55.233 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-03-29T02:42:55.866 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:55.878 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:55.879 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:55.882 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:55.883 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:56.605 INFO:teuthology.orchestra.run.smithi153.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-29T02:42:56.620 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/594 2024-03-29T02:42:56.620 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/594 2024-03-29T02:42:56.620 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:42:56.629 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:42:56.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:42:56.673 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-03-29T02:42:57.305 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:42:57.323 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:42:57.325 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:42:57.331 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:42:57.331 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:03.693 INFO:teuthology.orchestra.run.smithi153.stdout:generic/595 6s 2024-03-29T02:43:03.730 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/595 2024-03-29T02:43:03.730 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:03.741 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:03.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:03.790 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-03-29T02:43:04.553 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:04.566 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:04.568 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:04.572 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:04.572 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:05.443 INFO:teuthology.orchestra.run.smithi153.stdout:generic/596 [not run] file system doesn't support chattr +S 2024-03-29T02:43:05.457 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/596 2024-03-29T02:43:05.457 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/596 2024-03-29T02:43:05.458 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:05.468 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:05.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:05.530 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-03-29T02:43:06.192 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:06.215 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:06.217 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:06.220 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:06.221 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:08.327 INFO:teuthology.orchestra.run.smithi153.stdout:generic/597 2s 2024-03-29T02:43:08.348 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/597 2024-03-29T02:43:08.348 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:08.357 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:08.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:08.482 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-03-29T02:43:09.336 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:09.350 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:09.351 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:09.354 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:09.354 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:11.281 INFO:teuthology.orchestra.run.smithi153.stdout:generic/598 2s 2024-03-29T02:43:11.298 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/598 2024-03-29T02:43:11.298 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:11.308 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:11.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:11.404 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-03-29T02:43:12.273 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:12.288 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:12.290 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:12.295 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:12.295 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:13.231 INFO:teuthology.orchestra.run.smithi153.stdout:generic/599 [not run] ceph does not support shutdown 2024-03-29T02:43:13.258 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/599 2024-03-29T02:43:13.259 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/599 2024-03-29T02:43:13.259 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:13.267 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:13.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:13.309 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-03-29T02:43:13.985 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:14.003 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:14.005 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:14.008 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:14.702 INFO:teuthology.orchestra.run.smithi153.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-29T02:43:14.719 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/600 2024-03-29T02:43:14.719 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/600 2024-03-29T02:43:14.719 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:14.730 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:14.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:14.778 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-03-29T02:43:15.431 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:15.452 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:15.454 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:15.459 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:15.459 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:16.166 INFO:teuthology.orchestra.run.smithi153.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-29T02:43:16.181 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/601 2024-03-29T02:43:16.182 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/601 2024-03-29T02:43:16.182 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:16.192 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:16.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:16.255 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-03-29T02:43:16.912 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:16.928 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:16.929 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:16.932 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:16.932 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:18.540 INFO:teuthology.orchestra.run.smithi153.stdout:generic/602 [not run] kernel does not support encryption policy: '-c 1 -n 4 -v 2 -f 16' 2024-03-29T02:43:18.564 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/602 2024-03-29T02:43:18.564 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/602 2024-03-29T02:43:18.565 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:18.575 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:18.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:18.633 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-03-29T02:43:19.307 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:19.323 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:19.325 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:19.328 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:19.328 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:20.044 INFO:teuthology.orchestra.run.smithi153.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-29T02:43:20.057 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/603 2024-03-29T02:43:20.057 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/603 2024-03-29T02:43:20.057 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:20.067 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:20.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:20.113 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-03-29T02:43:20.795 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:20.809 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:20.811 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:20.814 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:28.626 INFO:teuthology.orchestra.run.smithi153.stdout:generic/604 7s 2024-03-29T02:43:28.650 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/604 2024-03-29T02:43:28.650 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:28.659 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:28.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:28.687 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-03-29T02:43:29.343 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:29.358 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:29.359 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:29.364 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:29.364 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:31.999 INFO:teuthology.orchestra.run.smithi153.stdout:generic/605 [not run] mount 172.21.15.153:6789:/scratch with dax=always failed 2024-03-29T02:43:32.013 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/605 2024-03-29T02:43:32.013 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/605 2024-03-29T02:43:32.013 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:32.026 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:32.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:32.074 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-03-29T02:43:32.750 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:32.765 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:32.766 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:32.770 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:32.770 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:33.668 INFO:teuthology.orchestra.run.smithi153.stdout:generic/606 [not run] mount 172.21.15.153:6789:/scratch with dax=always failed 2024-03-29T02:43:33.682 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/606 2024-03-29T02:43:33.682 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/606 2024-03-29T02:43:33.682 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:33.689 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:33.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:33.733 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-03-29T02:43:34.383 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:34.398 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:34.399 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:34.402 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:34.402 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:35.140 INFO:teuthology.orchestra.run.smithi153.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2024-03-29T02:43:35.152 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/607 2024-03-29T02:43:35.152 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/607 2024-03-29T02:43:35.152 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:35.163 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:35.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:35.272 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-03-29T02:43:36.122 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:36.136 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:36.137 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:36.140 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:36.141 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:37.016 INFO:teuthology.orchestra.run.smithi153.stdout:generic/608 [not run] mount 172.21.15.153:6789:/scratch with dax=always failed 2024-03-29T02:43:37.029 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/608 2024-03-29T02:43:37.029 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/608 2024-03-29T02:43:37.029 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:37.037 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:37.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:37.090 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-03-29T02:43:37.749 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:37.765 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:37.766 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:37.769 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:37.769 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:38.850 INFO:teuthology.orchestra.run.smithi153.stdout:generic/609 0s 2024-03-29T02:43:38.870 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/609 2024-03-29T02:43:38.870 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:38.881 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:39.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:39.019 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-03-29T02:43:39.832 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:39.852 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:39.854 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:39.856 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:39.856 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:40.779 INFO:teuthology.orchestra.run.smithi153.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-29T02:43:40.792 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/610 2024-03-29T02:43:40.792 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/610 2024-03-29T02:43:40.792 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:40.803 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:40.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:40.862 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-03-29T02:43:41.550 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:41.566 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:41.569 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:41.573 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:41.573 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:42.818 INFO:teuthology.orchestra.run.smithi153.stdout:generic/611 1s 2024-03-29T02:43:42.837 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/611 2024-03-29T02:43:42.837 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:42.847 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:42.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:42.879 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-03-29T02:43:43.546 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:43.561 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:43.562 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:43.564 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:43.565 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:44.434 INFO:teuthology.orchestra.run.smithi153.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2024-03-29T02:43:44.448 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/612 2024-03-29T02:43:44.448 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/612 2024-03-29T02:43:44.448 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:44.459 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:44.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:44.586 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-03-29T02:43:45.449 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:45.462 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:45.463 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:45.467 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:46.861 INFO:teuthology.orchestra.run.smithi153.stdout:generic/613 [not run] _get_encryption_nonce() isn't implemented on ceph 2024-03-29T02:43:46.881 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/613 2024-03-29T02:43:46.881 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/613 2024-03-29T02:43:46.881 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:46.892 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:47.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:47.127 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-03-29T02:43:47.837 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:47.854 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:47.856 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:47.860 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:47.860 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:48.811 INFO:teuthology.orchestra.run.smithi153.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2024-03-29T02:43:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/614 2024-03-29T02:43:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/614 2024-03-29T02:43:48.848 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:43:48.858 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:43:48.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:43:48.913 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-03-29T02:43:49.566 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:43:49.585 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:43:49.587 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:43:49.590 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:43:49.591 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:12.030 INFO:teuthology.orchestra.run.smithi153.stdout:generic/615 83s 2024-03-29T02:45:12.052 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/615 2024-03-29T02:45:12.053 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:12.065 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:12.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:12.100 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-03-29T02:45:12.737 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:12.753 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:12.754 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:12.757 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:12.758 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:13.480 INFO:teuthology.orchestra.run.smithi153.stdout:generic/616 [not run] kernel does not support IO_URING 2024-03-29T02:45:13.493 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/616 2024-03-29T02:45:13.493 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/616 2024-03-29T02:45:13.493 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:13.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:13.551 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-03-29T02:45:14.179 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:14.199 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:14.263 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:14.264 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:14.264 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:14.971 INFO:teuthology.orchestra.run.smithi153.stdout:generic/617 [not run] kernel does not support IO_URING 2024-03-29T02:45:14.986 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/617 2024-03-29T02:45:14.986 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/617 2024-03-29T02:45:14.986 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:14.997 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:15.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:15.043 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-03-29T02:45:15.685 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:15.703 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:15.704 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:15.707 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:15.707 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:16.926 INFO:teuthology.orchestra.run.smithi153.stdout:generic/618 1s 2024-03-29T02:45:16.959 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/618 2024-03-29T02:45:16.959 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:16.971 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:17.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:17.000 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-03-29T02:45:17.672 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:17.689 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:17.693 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:17.695 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:18.439 INFO:teuthology.orchestra.run.smithi153.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-29T02:45:18.453 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/619 2024-03-29T02:45:18.453 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/619 2024-03-29T02:45:18.453 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:18.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:18.521 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-03-29T02:45:19.168 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:19.185 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:19.186 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:19.192 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:19.193 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:19.938 INFO:teuthology.orchestra.run.smithi153.stdout:generic/620 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T02:45:19.950 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/620 2024-03-29T02:45:19.950 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/620 2024-03-29T02:45:19.950 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:19.957 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:20.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:20.009 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-03-29T02:45:20.646 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:20.664 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:20.665 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:20.668 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:20.668 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:22.580 INFO:teuthology.orchestra.run.smithi153.stdout:generic/621 [not run] kernel doesn't support renameat2 syscall 2024-03-29T02:45:22.594 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/621 2024-03-29T02:45:22.594 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/621 2024-03-29T02:45:22.594 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:22.608 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:22.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:22.717 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-03-29T02:45:23.533 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:23.552 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:23.554 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:23.558 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:23.558 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:24.458 INFO:teuthology.orchestra.run.smithi153.stdout:generic/622 [not run] ceph does not support shutdown 2024-03-29T02:45:24.490 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/622 2024-03-29T02:45:24.490 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/622 2024-03-29T02:45:24.490 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:24.501 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:24.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:24.545 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-03-29T02:45:25.183 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:25.198 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:25.199 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:25.203 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:25.203 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:26.084 INFO:teuthology.orchestra.run.smithi153.stdout:generic/623 [not run] ceph does not support shutdown 2024-03-29T02:45:26.107 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/623 2024-03-29T02:45:26.107 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/623 2024-03-29T02:45:26.107 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:26.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:26.160 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-03-29T02:45:26.813 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:26.828 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:26.830 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:26.834 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:26.834 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:28.065 INFO:teuthology.orchestra.run.smithi153.stdout:generic/624 [not run] fsverity utility required, skipped this test 2024-03-29T02:45:28.076 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/624 2024-03-29T02:45:28.076 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/624 2024-03-29T02:45:28.077 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:28.086 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:28.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:28.138 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-03-29T02:45:28.784 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:28.798 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:28.799 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:28.803 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:28.803 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:29.502 INFO:teuthology.orchestra.run.smithi153.stdout:generic/625 [not run] fsverity utility required, skipped this test 2024-03-29T02:45:29.515 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/625 2024-03-29T02:45:29.515 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/625 2024-03-29T02:45:29.515 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:29.523 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:29.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:29.566 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-03-29T02:45:30.168 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:30.186 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:30.189 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:30.193 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:30.193 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:30.970 INFO:teuthology.orchestra.run.smithi153.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2024-03-29T02:45:30.983 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/626 2024-03-29T02:45:30.983 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/626 2024-03-29T02:45:30.983 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:30.994 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:31.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:31.091 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-03-29T02:45:31.959 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:31.974 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:31.975 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:31.979 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:31.980 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:32.776 INFO:teuthology.orchestra.run.smithi153.stdout:generic/627 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T02:45:32.793 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/627 2024-03-29T02:45:32.794 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/627 2024-03-29T02:45:32.794 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:32.811 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:32.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:32.859 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-03-29T02:45:33.522 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:33.539 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:33.540 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:33.543 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:33.543 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:34.670 INFO:teuthology.orchestra.run.smithi153.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T02:45:34.688 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/628 2024-03-29T02:45:34.688 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/628 2024-03-29T02:45:34.688 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:34.704 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:35.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:35.006 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-03-29T02:45:35.689 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:35.706 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:35.708 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:35.712 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:35.712 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:36.473 INFO:teuthology.orchestra.run.smithi153.stdout:generic/629 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T02:45:36.489 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/629 2024-03-29T02:45:36.489 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/629 2024-03-29T02:45:36.489 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:36.499 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:36.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:36.542 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-03-29T02:45:37.193 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:37.208 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:37.209 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:37.213 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:37.214 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:38.193 INFO:teuthology.orchestra.run.smithi153.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-29T02:45:38.287 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/630 2024-03-29T02:45:38.287 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/630 2024-03-29T02:45:38.287 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:45:38.311 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:45:38.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:45:38.642 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-03-29T02:45:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:45:39.321 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:45:39.322 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:45:39.326 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:45:39.326 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:11.113 INFO:teuthology.orchestra.run.smithi153.stdout:generic/631 - output mismatch (see /tmp/tmp.0cGUU1Musyxfstests-dev/results//generic/631.out.bad) 2024-03-29T02:46:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: --- tests/generic/631.out 2024-03-28 21:53:24.396162654 +0000 2024-03-29T02:46:11.129 INFO:teuthology.orchestra.run.smithi153.stdout: +++ /tmp/tmp.0cGUU1Musyxfstests-dev/results//generic/631.out.bad 2024-03-29 02:46:11.094222444 +0000 2024-03-29T02:46:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: @@ -1,2 +1,3092 @@ 2024-03-29T02:46:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: QA output created by 631 2024-03-29T02:46:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.130 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: +: No such file or directory 2024-03-29T02:46:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.131 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.132 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.133 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.134 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.135 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.136 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.138 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.139 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.140 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.141 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.142 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.143 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.144 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: +: No such file or directory 2024-03-29T02:46:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.145 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.146 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.147 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.148 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.149 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: touch: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf' 2024-03-29T02:46:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: +: No such file or directory 2024-03-29T02:46:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.150 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: mount: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf'/tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.: No such file or directory 2024-03-29T02:46:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.152 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.153 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.154 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: mv: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted.cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf' 2024-03-29T02:46:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: +: No such file or directory 2024-03-29T02:46:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-29T02:46:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: +/tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.155 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.156 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: +cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.159 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.160 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.161 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: touch: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted.cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf' 2024-03-29T02:46:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: +: No such file or directory 2024-03-29T02:46:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.162 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.163 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.164 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.165 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.166 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.167 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.169 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.170 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.171 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.172 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.173 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.174 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.176 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.177 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.178 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.179 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.180 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.181 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.182 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: +: No such file or directory 2024-03-29T02:46:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.183 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.184 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.188 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.189 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.191 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.192 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: mv: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted.cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf' 2024-03-29T02:46:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: +: No such file or directory 2024-03-29T02:46:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf' 2024-03-29T02:46:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: +: No such file or directory 2024-03-29T02:46:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-29T02:46:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: +/tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.229 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.230 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.231 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.232 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.233 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.234 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.235 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.236 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.237 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.238 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.239 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.240 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.242 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.243 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-29T02:46:11.244 INFO:teuthology.orchestra.run.smithi153.stdout: +/tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.245 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.246 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.246 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.246 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.246 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.246 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.246 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.246 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.246 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.246 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.246 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.247 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.248 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.248 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.248 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.248 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.248 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.248 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.248 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.248 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.248 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.248 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.248 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.248 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.248 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.248 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.249 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.249 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.249 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.249 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.249 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.249 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.249 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.249 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.249 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.249 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.249 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.249 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.249 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.250 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.250 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.250 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.250 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.250 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.250 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.250 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.250 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.250 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.250 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.250 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.251 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.251 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.251 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.251 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.251 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.251 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.251 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.251 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.251 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.251 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.251 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.251 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.251 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.252 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.252 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.252 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.252 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.252 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.252 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.252 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.252 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.252 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.252 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.252 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.252 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.252 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.253 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.253 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.253 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.253 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.253 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.253 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.253 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.253 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.253 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.253 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.253 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.253 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.253 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.253 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.254 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.254 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.254 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.254 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.254 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.254 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.254 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.254 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.254 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.254 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.254 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.254 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.255 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.255 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.255 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.255 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.255 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.255 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.255 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.255 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.255 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.255 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.255 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.255 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.256 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.256 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.256 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.256 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.256 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.256 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.256 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.256 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.256 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.256 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.256 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.256 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.256 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.257 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.257 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.257 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.257 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.257 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.257 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.257 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.257 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.257 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.257 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.257 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.257 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.257 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.258 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.258 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.258 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.258 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.258 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.258 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.258 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.258 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.258 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.258 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.258 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.258 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.258 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.259 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.259 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.259 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.259 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.259 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.259 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.259 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.259 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.259 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.259 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.259 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.259 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.259 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.260 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.260 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.260 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.260 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.260 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.260 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.260 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.260 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.260 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.260 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.260 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.261 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.261 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.261 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.261 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.261 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2024-03-29T02:46:11.261 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.261 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.261 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.261 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.261 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.261 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.261 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.262 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.262 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.262 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.262 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.262 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.262 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.262 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.262 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.262 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.262 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.263 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.263 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.263 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.263 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.263 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.263 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.263 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.263 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.263 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.263 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.263 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.263 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.264 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.264 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.264 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.264 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.264 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.264 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.264 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.264 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.264 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.264 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.264 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.264 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.265 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.265 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.265 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.265 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.265 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.265 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.265 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.265 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.265 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.265 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.265 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.265 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.265 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.266 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.266 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.266 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.266 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.266 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.266 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.266 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.266 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.266 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.266 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.267 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.267 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.267 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.267 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.267 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.267 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.267 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.267 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.267 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.267 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.267 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.267 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.268 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.268 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.268 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.268 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.268 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.268 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.268 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.268 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.268 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.268 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.268 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.269 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.269 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.269 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.269 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.269 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.269 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.269 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.269 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.269 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.269 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.269 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.270 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.270 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.270 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.270 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.270 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.270 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2024-03-29T02:46:11.270 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.270 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.270 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.270 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.270 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.270 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.271 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.271 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.271 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.271 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.271 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.271 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.271 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.271 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.271 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.271 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.271 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.271 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.271 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.272 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.272 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.272 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.272 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.272 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.272 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.272 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.272 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.272 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.272 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.272 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.273 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.273 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.273 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.273 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.273 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.273 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.273 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.273 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.273 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.273 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.273 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.273 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.273 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.274 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.274 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.274 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.274 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.274 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.274 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.274 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.274 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.274 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.274 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.274 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directorytouch: 2024-03-29T02:46:11.274 INFO:teuthology.orchestra.run.smithi153.stdout: +cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.275 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.275 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.275 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.275 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.275 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.275 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.275 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.275 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.275 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.275 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.275 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.275 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.276 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.276 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.276 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-29T02:46:11.276 INFO:teuthology.orchestra.run.smithi153.stdout: +/tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.276 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.276 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.276 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.276 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.276 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.276 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.276 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.276 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.276 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.277 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.277 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.277 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.277 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.277 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.277 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.277 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.277 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.277 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.277 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.277 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.277 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.277 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.278 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.278 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.278 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.278 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.278 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.278 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.278 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.278 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.278 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.278 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.278 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.278 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.279 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.279 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.279 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.279 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.279 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.279 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.279 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.279 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.279 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.279 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.280 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.280 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2024-03-29T02:46:11.280 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.280 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.280 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.280 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.280 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.280 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.280 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.280 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.280 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.280 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.280 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.281 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.281 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.281 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.281 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.281 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.281 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.281 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.281 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.281 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.281 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.281 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.281 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.282 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.282 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.282 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.282 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.282 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.282 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.282 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.282 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.282 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.282 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.282 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.282 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.283 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.283 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.283 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.283 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf'umount: : No such file or directory/tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.283 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.283 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.283 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.283 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.283 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.283 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.283 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.283 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.284 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.284 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.284 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.284 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.284 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.284 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.284 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.284 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.284 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.284 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.284 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.286 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-29T02:46:11.286 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.286 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.286 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.286 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.286 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.286 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.286 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.286 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.286 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.286 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.286 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.287 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.287 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.287 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.287 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.287 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.287 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.287 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.287 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.287 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.287 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.287 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.287 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.287 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.288 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.288 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.288 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.288 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.288 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.288 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.288 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.288 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.288 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.288 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.289 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.289 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.289 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.289 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.289 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.289 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.289 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.289 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.289 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.289 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.289 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.289 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.290 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.290 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.290 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.290 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.290 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.290 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.290 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.290 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.290 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.290 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.290 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: mount: mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.291 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.291 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.291 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.291 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.291 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.291 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.291 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.291 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.291 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.291 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.291 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.291 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.292 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.292 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.292 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.292 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.292 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.292 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.292 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.292 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.292 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.292 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.292 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.292 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.293 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.293 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.293 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.293 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.293 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.293 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.293 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.293 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.293 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.293 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.293 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.293 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.294 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.294 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.294 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.294 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.294 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.294 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.294 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.294 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.294 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.294 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.294 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.295 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.295 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.295 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.295 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.295 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.295 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.295 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.295 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.295 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.295 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.295 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.296 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.296 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.296 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.296 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.296 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.296 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.296 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.296 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.296 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.296 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.296 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.297 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.297 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.297 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.297 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.297 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.297 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.297 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.297 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.297 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.297 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.297 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.297 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.298 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.298 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.298 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.298 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.298 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.298 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.298 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.298 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.298 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.298 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.298 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.298 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.299 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directorytouch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.299 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.299 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.299 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.299 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.299 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.299 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.299 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.299 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.299 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.299 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.299 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.299 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.300 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.300 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.300 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.300 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.300 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.300 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.300 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.300 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.300 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.300 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.300 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.300 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.301 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.301 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.301 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.301 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.301 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.301 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.301 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.301 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.302 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.302 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.302 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.302 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.302 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.302 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.302 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.302 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.302 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: touch: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf' 2024-03-29T02:46:11.302 INFO:teuthology.orchestra.run.smithi153.stdout: +: No such file or directory 2024-03-29T02:46:11.302 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.303 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.303 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.303 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.303 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.303 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.303 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.303 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.303 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.303 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.303 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.303 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.304 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.304 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.304 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.304 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.304 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.304 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.304 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.304 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.304 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2024-03-29T02:46:11.304 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.304 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf'cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-29T02:46:11.305 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.305 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.305 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.305 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.305 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.305 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.305 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.305 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.305 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.305 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.305 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.305 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.305 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.306 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.306 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.306 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.306 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.306 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.306 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.306 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.306 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.306 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.306 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.306 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.306 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.307 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.307 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.307 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.307 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.307 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.307 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.307 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.307 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.307 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.307 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.307 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.307 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.308 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.308 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.308 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.308 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.308 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.308 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.308 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.308 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.308 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.308 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.308 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.308 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.309 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.309 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.309 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.309 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.309 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.309 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.309 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.309 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.309 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.309 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.309 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.309 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.309 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.310 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.310 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.310 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.310 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.310 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.310 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.310 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.310 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.310 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.310 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.310 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.311 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.311 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.311 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.311 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.311 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.311 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.311 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.311 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.311 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.311 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.311 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.311 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.311 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.312 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.312 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.312 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.312 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directoryumount: 2024-03-29T02:46:11.312 INFO:teuthology.orchestra.run.smithi153.stdout: +/tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.312 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.312 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.312 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.312 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.312 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.312 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.312 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.312 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.312 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.313 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.313 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.313 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.313 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.313 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.313 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.313 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.313 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.313 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.313 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.313 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.313 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.313 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.314 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.314 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.314 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.314 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.314 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.314 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.314 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.314 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.314 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.314 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.314 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.315 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.315 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.315 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.315 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.315 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.315 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.315 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.315 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.315 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.315 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.315 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.316 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.316 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.316 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.316 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.316 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.316 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.316 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.316 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.316 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.316 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.316 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.316 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.317 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.317 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.317 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.317 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.317 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.317 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.317 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.317 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.317 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.317 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.317 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.317 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.318 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.318 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.318 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.318 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.318 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.318 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.318 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.318 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.318 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.318 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.318 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.318 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.319 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.319 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.319 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.319 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.319 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.319 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.319 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.319 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.319 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.319 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.319 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.319 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.319 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.320 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.320 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.320 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.320 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.320 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.320 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.320 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.320 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.320 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.320 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.320 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.321 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.321 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.321 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.321 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.321 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.321 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.321 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.321 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.321 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.321 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.321 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.322 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.322 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.322 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.322 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.322 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.322 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.322 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.322 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.322 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.322 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.322 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.322 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.322 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.323 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.323 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.323 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.323 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.323 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.323 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.323 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.323 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.323 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.323 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.323 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.323 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.324 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.324 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.324 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.324 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.324 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.324 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.324 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.324 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.324 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.324 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.324 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.324 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.325 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.325 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.325 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.325 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.325 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.325 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.325 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.325 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.325 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.325 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.325 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.325 INFO:teuthology.orchestra.run.smithi153.stdout: +/tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.325 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.326 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.326 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.326 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.326 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.326 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.326 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.326 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.326 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.326 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.326 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.326 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.326 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.326 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.327 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.327 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.327 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.327 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.327 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.327 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.327 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.327 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.327 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.327 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.327 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.327 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.328 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.328 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.328 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.328 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.328 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.328 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.328 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.328 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.328 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.328 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.328 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.328 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.329 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.329 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.329 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.329 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.329 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.329 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.329 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.329 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.329 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.329 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.329 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.330 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.330 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.330 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.330 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.330 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.330 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.330 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.330 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.330 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.330 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.330 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.331 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.331 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.331 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directorytouch: 2024-03-29T02:46:11.331 INFO:teuthology.orchestra.run.smithi153.stdout: +cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.331 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.331 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.331 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.331 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.331 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.331 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.331 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.331 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.332 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.332 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.332 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.332 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.332 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.332 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.332 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.332 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.332 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.332 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.332 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.333 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-29T02:46:11.333 INFO:teuthology.orchestra.run.smithi153.stdout: +/tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.333 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.333 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.333 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.333 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.333 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.333 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.333 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.333 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.333 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.333 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.334 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.334 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.334 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.334 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.334 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.334 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.334 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.334 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.334 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.334 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.335 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.335 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.335 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.335 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.335 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.335 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.335 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.335 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.335 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.335 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.335 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.335 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.336 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.336 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.336 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.336 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.336 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: mount: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf'/tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.: No such file or directory 2024-03-29T02:46:11.336 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.336 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.336 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.336 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.336 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.336 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.336 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.337 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.337 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.337 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.337 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.337 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.337 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.337 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.337 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.337 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.337 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.337 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.337 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.337 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.338 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.338 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.338 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.338 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.338 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.338 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.338 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.338 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.338 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.338 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.338 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.338 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.339 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.339 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.339 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.339 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.339 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.339 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.339 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.339 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.339 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf' 2024-03-29T02:46:11.339 INFO:teuthology.orchestra.run.smithi153.stdout: +: No such file or directory 2024-03-29T02:46:11.339 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.339 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.339 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.340 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.340 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.340 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.340 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.340 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.340 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.340 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.340 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.340 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.340 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.340 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.340 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.341 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.341 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.341 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.341 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.341 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.341 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.341 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.341 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.341 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.341 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.341 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.341 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.341 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.341 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.342 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.342 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.342 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.342 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.342 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.342 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.342 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.342 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.342 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.342 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.342 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.342 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.342 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.343 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.343 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.343 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.343 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.343 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.343 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.343 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.343 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.343 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.343 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.343 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.344 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.344 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.344 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.344 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.344 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.344 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.344 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.344 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.344 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.344 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.344 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.345 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.345 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.345 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.345 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.345 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.345 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.345 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.345 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.345 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.345 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.345 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.345 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.346 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.346 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.346 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.346 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.346 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.346 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.346 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.346 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.346 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.346 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.346 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.346 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf'umount: : No such file or directory/tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2024-03-29T02:46:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: + 2024-03-29T02:46:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf' 2024-03-29T02:46:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: +: No such file or directory 2024-03-29T02:46:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged1/etc/access.conf': No such file or directory 2024-03-29T02:46:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged1: not mounted. 2024-03-29T02:46:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged4/etc/access.conf': No such file or directory 2024-03-29T02:46:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged4: not mounted. 2024-03-29T02:46:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged2/etc/access.conf': No such file or directory 2024-03-29T02:46:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged2: not mounted. 2024-03-29T02:46:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged0/etc/access.conf': No such file or directory 2024-03-29T02:46:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: +mount: /tmp/tmp.qtMzJmHuchscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-29T02:46:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged0: not mounted. 2024-03-29T02:46:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: +mv: cannot stat '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged3/etc/access.conf': No such file or directory 2024-03-29T02:46:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged3: not mounted. 2024-03-29T02:46:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: +touch: cannot touch '/tmp/tmp.qtMzJmHuchscratch/merged5/etc/access.conf': No such file or directory 2024-03-29T02:46:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: +umount: /tmp/tmp.qtMzJmHuchscratch/merged5: not mounted. 2024-03-29T02:46:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: Silence is golden. 2024-03-29T02:46:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:11.396 INFO:teuthology.orchestra.run.smithi153.stdout:HINT: You _MAY_ be missing kernel fix: 2024-03-29T02:46:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2024-03-29T02:46:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:11.397 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/631 2024-03-29T02:46:11.397 INFO:teuthology.orchestra.run.smithi153.stdout:Failures: generic/631 2024-03-29T02:46:11.397 INFO:teuthology.orchestra.run.smithi153.stdout:Failed 1 of 1 tests 2024-03-29T02:46:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:11.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T02:46:11.398 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-29T02:46:11.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-29T02:46:11.399 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-03-29T02:46:12.071 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:46:12.084 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:46:12.086 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:46:12.095 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:46:12.095 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:15.530 INFO:teuthology.orchestra.run.smithi153.stdout:generic/632 3s 2024-03-29T02:46:15.552 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/632 2024-03-29T02:46:15.552 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:46:15.561 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:15.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:46:15.640 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-03-29T02:46:16.281 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:46:16.297 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:46:16.299 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:46:16.302 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:46:16.302 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:20.629 INFO:teuthology.orchestra.run.smithi153.stdout:generic/633 4s 2024-03-29T02:46:20.651 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/633 2024-03-29T02:46:20.651 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:46:20.664 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:20.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:46:20.809 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-03-29T02:46:21.630 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:46:21.647 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:46:21.649 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:46:21.652 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:46:21.652 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:23.631 INFO:teuthology.orchestra.run.smithi153.stdout:generic/634 2s 2024-03-29T02:46:23.658 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/634 2024-03-29T02:46:23.658 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:46:23.667 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:23.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:46:23.696 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-03-29T02:46:24.334 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:46:24.350 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:46:24.351 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:46:24.355 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:46:24.356 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:25.276 INFO:teuthology.orchestra.run.smithi153.stdout:generic/635 [not run] ceph does not support shutdown 2024-03-29T02:46:25.305 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/635 2024-03-29T02:46:25.305 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/635 2024-03-29T02:46:25.305 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:46:25.317 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:25.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:46:25.361 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-03-29T02:46:25.982 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:46:25.997 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:46:25.999 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:46:26.001 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:46:26.001 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:27.012 INFO:teuthology.orchestra.run.smithi153.stdout:generic/636 [not run] swapfiles are not supported 2024-03-29T02:46:27.027 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/636 2024-03-29T02:46:27.027 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/636 2024-03-29T02:46:27.027 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:46:27.037 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:27.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:46:27.091 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-03-29T02:46:27.752 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:46:27.768 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:46:27.769 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:46:27.774 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:46:27.774 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:29.402 INFO:teuthology.orchestra.run.smithi153.stdout:generic/637 1s 2024-03-29T02:46:29.420 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/637 2024-03-29T02:46:29.420 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:46:29.428 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:29.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:46:29.755 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-03-29T02:46:30.467 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:46:30.479 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:46:30.480 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:46:30.483 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:46:30.484 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:31.752 INFO:teuthology.orchestra.run.smithi153.stdout:generic/638 1s 2024-03-29T02:46:31.831 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/638 2024-03-29T02:46:31.832 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:46:31.843 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:31.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:46:31.913 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-03-29T02:46:32.668 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:46:32.684 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:46:32.686 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:46:32.690 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:46:32.691 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:34.470 INFO:teuthology.orchestra.run.smithi153.stdout:generic/639 1s 2024-03-29T02:46:34.492 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/639 2024-03-29T02:46:34.492 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:46:34.505 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:34.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:46:34.551 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-03-29T02:46:35.214 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:46:35.228 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:46:35.228 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:46:35.234 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:46:35.234 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:35.967 INFO:teuthology.orchestra.run.smithi153.stdout:generic/640 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T02:46:35.979 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/640 2024-03-29T02:46:35.979 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/640 2024-03-29T02:46:35.979 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:46:35.988 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:36.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:46:36.030 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-03-29T02:46:36.671 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:46:36.686 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:46:36.688 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:46:36.692 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:46:36.692 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:37.722 INFO:teuthology.orchestra.run.smithi153.stdout:generic/641 [not run] swapfiles are not supported 2024-03-29T02:46:37.733 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/641 2024-03-29T02:46:37.733 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/641 2024-03-29T02:46:37.734 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T02:46:37.742 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T02:46:37.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T02:46:37.792 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-03-29T02:46:38.436 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T02:46:38.450 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T02:46:38.452 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T02:46:38.455 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T02:46:38.455 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:00:17.878 INFO:teuthology.orchestra.run.smithi153.stdout:generic/642 817s 2024-03-29T03:00:17.930 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/642 2024-03-29T03:00:17.930 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:00:17.939 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:00:17.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:00:17.965 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-03-29T03:00:22.020 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:00:22.049 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:00:22.050 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:00:22.055 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:00:22.055 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:05:24.890 INFO:teuthology.orchestra.run.smithi153.stdout:generic/643 [not run] swapfiles are not supported 2024-03-29T03:05:24.905 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/643 2024-03-29T03:05:24.905 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/643 2024-03-29T03:05:24.905 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:05:24.915 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:05:24.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:05:24.972 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-03-29T03:05:25.631 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:05:25.647 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:05:25.649 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:05:25.655 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:05:25.655 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:05:26.529 INFO:teuthology.orchestra.run.smithi153.stdout:generic/644 1s 2024-03-29T03:05:26.554 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/644 2024-03-29T03:05:26.554 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:05:26.563 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:05:26.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:05:26.681 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-03-29T03:05:27.526 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:05:27.539 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:05:27.541 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:05:27.544 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:05:27.544 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:10:11.415 INFO:teuthology.orchestra.run.smithi153.stdout:generic/645 284s 2024-03-29T03:10:11.474 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/645 2024-03-29T03:10:11.474 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:10:11.485 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:10:11.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:10:11.552 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-03-29T03:10:12.602 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:10:12.620 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:10:12.622 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:10:12.627 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:10:12.627 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:10:14.526 INFO:teuthology.orchestra.run.smithi153.stdout:generic/646 [not run] ceph does not support shutdown 2024-03-29T03:10:14.552 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/646 2024-03-29T03:10:14.553 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/646 2024-03-29T03:10:14.553 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:10:16.715 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:10:16.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:10:16.766 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-03-29T03:10:17.436 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:10:17.451 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:10:17.453 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:10:17.457 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:10:17.457 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:10:18.604 INFO:teuthology.orchestra.run.smithi153.stdout:generic/647 1s 2024-03-29T03:10:18.622 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/647 2024-03-29T03:10:18.622 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:10:18.632 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:10:18.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:10:18.753 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-03-29T03:10:19.634 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:10:19.655 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:10:19.657 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:10:19.659 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:10:19.660 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:10:20.848 INFO:teuthology.orchestra.run.smithi153.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:10:20.869 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/648 2024-03-29T03:10:20.869 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/648 2024-03-29T03:10:20.869 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:10:20.879 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:10:21.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:10:21.209 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-03-29T03:10:21.898 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:10:21.918 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:10:21.920 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:10:21.924 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:10:21.924 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:10:22.774 INFO:teuthology.orchestra.run.smithi153.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2024-03-29T03:10:22.794 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/649 2024-03-29T03:10:22.794 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/649 2024-03-29T03:10:22.794 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:10:22.804 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:10:22.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:10:22.917 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-03-29T03:10:23.780 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:10:23.797 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:10:23.799 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:10:23.803 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:10:23.803 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:30.378 INFO:teuthology.orchestra.run.smithi153.stdout:generic/650 2226s 2024-03-29T03:47:30.436 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/650 2024-03-29T03:47:30.437 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:47:30.453 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:30.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:47:30.515 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-03-29T03:47:38.792 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:47:38.811 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:47:38.811 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:47:38.815 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:47:38.815 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:40.071 INFO:teuthology.orchestra.run.smithi153.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:47:40.094 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/651 2024-03-29T03:47:40.095 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/651 2024-03-29T03:47:40.095 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:47:40.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:40.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:47:40.364 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-03-29T03:47:41.177 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:47:41.194 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:47:41.196 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:47:41.199 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:47:41.199 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:43.898 INFO:teuthology.orchestra.run.smithi153.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:47:43.913 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/652 2024-03-29T03:47:43.913 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/652 2024-03-29T03:47:43.913 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:47:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:44.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:47:44.211 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-03-29T03:47:44.890 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:47:44.906 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:47:44.911 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:47:44.916 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:47:44.916 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:46.032 INFO:teuthology.orchestra.run.smithi153.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:47:46.047 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/653 2024-03-29T03:47:46.048 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/653 2024-03-29T03:47:46.048 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:47:46.063 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:46.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:47:46.363 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-03-29T03:47:47.062 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:47:47.077 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:47:47.078 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:47:47.083 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:47:47.083 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:48.556 INFO:teuthology.orchestra.run.smithi153.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:47:48.577 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/654 2024-03-29T03:47:48.577 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/654 2024-03-29T03:47:48.577 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:47:48.590 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:48.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:47:48.805 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-03-29T03:47:49.499 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:47:49.515 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:47:49.516 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:47:49.521 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:47:49.521 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:50.678 INFO:teuthology.orchestra.run.smithi153.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:47:50.698 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/655 2024-03-29T03:47:50.698 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/655 2024-03-29T03:47:50.698 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:47:50.711 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:50.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:47:50.984 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-03-29T03:47:51.845 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:47:51.865 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:47:51.867 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:47:51.871 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:47:51.871 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:53.920 INFO:teuthology.orchestra.run.smithi153.stdout:generic/656 1s 2024-03-29T03:47:53.937 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/656 2024-03-29T03:47:53.937 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:47:53.946 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:54.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:47:54.002 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-03-29T03:47:54.660 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:47:54.676 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:47:54.678 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:47:54.682 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:47:54.682 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:55.844 INFO:teuthology.orchestra.run.smithi153.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:47:55.859 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/657 2024-03-29T03:47:55.860 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/657 2024-03-29T03:47:55.860 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:47:55.871 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:56.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:47:56.206 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-03-29T03:47:56.889 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:47:56.905 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:47:56.907 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:47:56.911 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:47:56.911 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:58.029 INFO:teuthology.orchestra.run.smithi153.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:47:58.050 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/658 2024-03-29T03:47:58.050 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/658 2024-03-29T03:47:58.051 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:47:58.061 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:47:58.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:47:58.325 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-03-29T03:47:59.018 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:47:59.039 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:47:59.041 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:47:59.045 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:47:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:00.171 INFO:teuthology.orchestra.run.smithi153.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:00.194 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/659 2024-03-29T03:48:00.194 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/659 2024-03-29T03:48:00.194 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:00.208 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:00.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:00.491 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-03-29T03:48:01.242 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:01.258 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:01.259 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:01.263 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:02.560 INFO:teuthology.orchestra.run.smithi153.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:02.573 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/660 2024-03-29T03:48:02.573 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/660 2024-03-29T03:48:02.574 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:02.586 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:02.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:02.866 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-03-29T03:48:03.661 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:03.673 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:03.674 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:03.677 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:03.677 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:04.824 INFO:teuthology.orchestra.run.smithi153.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:04.840 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/661 2024-03-29T03:48:04.840 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/661 2024-03-29T03:48:04.840 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:04.851 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:05.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:05.156 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-03-29T03:48:05.876 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:05.892 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:05.894 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:05.896 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:05.896 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:06.997 INFO:teuthology.orchestra.run.smithi153.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:07.020 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/662 2024-03-29T03:48:07.020 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/662 2024-03-29T03:48:07.020 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:07.035 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:07.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:07.275 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-03-29T03:48:07.998 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:08.015 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:08.017 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:08.020 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:08.020 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:09.100 INFO:teuthology.orchestra.run.smithi153.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:09.111 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/663 2024-03-29T03:48:09.111 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/663 2024-03-29T03:48:09.111 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:09.124 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:09.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:09.451 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-03-29T03:48:10.166 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:10.182 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:10.184 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:10.187 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:10.187 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:11.304 INFO:teuthology.orchestra.run.smithi153.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:11.328 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/664 2024-03-29T03:48:11.330 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/664 2024-03-29T03:48:11.330 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:11.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:11.596 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-03-29T03:48:12.323 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:12.337 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:12.338 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:12.343 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:12.343 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:13.463 INFO:teuthology.orchestra.run.smithi153.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:13.488 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/665 2024-03-29T03:48:13.488 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/665 2024-03-29T03:48:13.488 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:13.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:13.743 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-03-29T03:48:14.482 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:14.499 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:14.501 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:14.506 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:14.506 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:15.620 INFO:teuthology.orchestra.run.smithi153.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:15.644 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/666 2024-03-29T03:48:15.645 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/666 2024-03-29T03:48:15.645 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:15.656 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:15.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:15.965 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-03-29T03:48:16.658 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:16.674 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:16.676 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:16.684 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:16.684 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:17.800 INFO:teuthology.orchestra.run.smithi153.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:17.815 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/667 2024-03-29T03:48:17.815 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/667 2024-03-29T03:48:17.815 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:17.834 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:18.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:18.068 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-03-29T03:48:18.767 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:18.784 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:18.786 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:18.789 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:18.790 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:19.920 INFO:teuthology.orchestra.run.smithi153.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:19.942 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/668 2024-03-29T03:48:19.942 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/668 2024-03-29T03:48:19.942 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:19.961 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:20.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:20.276 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-03-29T03:48:20.972 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:20.989 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:20.990 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:20.993 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:20.994 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:22.153 INFO:teuthology.orchestra.run.smithi153.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:22.176 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/669 2024-03-29T03:48:22.177 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/669 2024-03-29T03:48:22.177 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:22.193 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:22.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:22.427 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-03-29T03:48:23.162 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:23.179 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:23.180 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:23.183 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:23.183 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:24.284 INFO:teuthology.orchestra.run.smithi153.stdout:generic/670 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:24.304 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/670 2024-03-29T03:48:24.305 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/670 2024-03-29T03:48:24.305 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:24.320 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:24.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:24.595 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-03-29T03:48:25.301 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:25.314 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:25.317 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:25.322 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:25.322 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:26.431 INFO:teuthology.orchestra.run.smithi153.stdout:generic/671 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:26.447 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/671 2024-03-29T03:48:26.447 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/671 2024-03-29T03:48:26.447 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:26.459 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:26.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:26.727 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-03-29T03:48:27.407 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:27.426 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:27.429 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:27.431 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:27.431 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:28.529 INFO:teuthology.orchestra.run.smithi153.stdout:generic/672 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:28.544 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/672 2024-03-29T03:48:28.544 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/672 2024-03-29T03:48:28.544 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:28.564 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:28.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:28.875 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-03-29T03:48:29.565 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:29.579 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:29.580 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:29.583 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:29.583 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:31.312 INFO:teuthology.orchestra.run.smithi153.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:31.332 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/673 2024-03-29T03:48:31.333 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/673 2024-03-29T03:48:31.333 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:31.347 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:31.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:31.613 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-03-29T03:48:32.383 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:32.411 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:32.413 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:32.418 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:32.419 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:33.702 INFO:teuthology.orchestra.run.smithi153.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-29T03:48:33.798 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/674 2024-03-29T03:48:33.798 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/674 2024-03-29T03:48:33.798 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:33.811 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:34.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:34.187 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-03-29T03:48:34.950 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:34.964 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:34.966 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:34.971 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:34.971 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:36.260 INFO:teuthology.orchestra.run.smithi153.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T03:48:36.292 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/675 2024-03-29T03:48:36.292 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/675 2024-03-29T03:48:36.292 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T03:48:36.307 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T03:48:36.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T03:48:36.542 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-03-29T03:48:37.246 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T03:48:37.261 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T03:48:37.262 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T03:48:37.267 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T03:48:37.267 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:14.397 INFO:teuthology.orchestra.run.smithi153.stdout:generic/676 757s 2024-03-29T04:01:14.450 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/676 2024-03-29T04:01:14.450 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:14.460 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:14.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:14.609 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-03-29T04:01:16.093 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:16.108 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:16.109 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:16.112 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:16.112 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:16.909 INFO:teuthology.orchestra.run.smithi153.stdout:generic/677 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T04:01:16.922 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/677 2024-03-29T04:01:16.922 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/677 2024-03-29T04:01:16.922 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:16.930 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:16.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:16.974 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-03-29T04:01:17.629 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:17.643 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:17.645 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:17.648 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:18.410 INFO:teuthology.orchestra.run.smithi153.stdout:generic/678 [not run] kernel does not support IO_URING 2024-03-29T04:01:18.425 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/678 2024-03-29T04:01:18.426 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/678 2024-03-29T04:01:18.426 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:18.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:18.481 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-03-29T04:01:19.103 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:19.116 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:19.118 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:19.122 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:19.122 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:19.860 INFO:teuthology.orchestra.run.smithi153.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-29T04:01:19.871 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/679 2024-03-29T04:01:19.871 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/679 2024-03-29T04:01:19.871 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:19.882 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:19.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:19.937 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-03-29T04:01:20.577 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:20.592 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:20.593 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:20.597 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:20.598 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:32.025 INFO:teuthology.orchestra.run.smithi153.stdout:generic/680 12s 2024-03-29T04:01:32.043 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/680 2024-03-29T04:01:32.043 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:32.051 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:32.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:32.160 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-03-29T04:01:33.076 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:33.098 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:33.100 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:33.103 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:33.103 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:33.886 INFO:teuthology.orchestra.run.smithi153.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-29T04:01:33.901 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/681 2024-03-29T04:01:33.901 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/681 2024-03-29T04:01:33.901 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:33.912 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:33.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:33.980 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-03-29T04:01:34.720 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:34.737 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:34.738 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:34.742 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:34.742 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:35.502 INFO:teuthology.orchestra.run.smithi153.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-29T04:01:35.520 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/682 2024-03-29T04:01:35.522 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/682 2024-03-29T04:01:35.522 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:35.533 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:35.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:35.590 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-03-29T04:01:36.289 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:36.302 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:36.303 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:36.306 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:36.306 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:37.088 INFO:teuthology.orchestra.run.smithi153.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-29T04:01:37.103 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/683 2024-03-29T04:01:37.103 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/683 2024-03-29T04:01:37.103 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:37.115 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:37.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:37.173 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-03-29T04:01:37.810 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:37.824 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:37.825 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:37.830 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:37.830 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:42.257 INFO:teuthology.orchestra.run.smithi153.stdout:generic/684 4s 2024-03-29T04:01:42.281 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/684 2024-03-29T04:01:42.282 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:42.290 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:42.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:42.405 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-03-29T04:01:43.253 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:43.267 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:43.268 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:43.272 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:43.272 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:44.224 INFO:teuthology.orchestra.run.smithi153.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-29T04:01:44.237 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/685 2024-03-29T04:01:44.237 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/685 2024-03-29T04:01:44.237 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:44.248 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:44.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:44.314 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-03-29T04:01:44.977 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:44.992 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:44.994 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:44.997 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:44.997 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:46.174 INFO:teuthology.orchestra.run.smithi153.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-03-29T04:01:46.188 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/686 2024-03-29T04:01:46.188 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/686 2024-03-29T04:01:46.188 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:46.201 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:46.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:46.272 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-03-29T04:01:46.963 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:46.976 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:46.978 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:46.981 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:46.982 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:47.974 INFO:teuthology.orchestra.run.smithi153.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-29T04:01:47.991 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/687 2024-03-29T04:01:47.991 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/687 2024-03-29T04:01:47.991 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:48.084 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:48.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:48.148 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-03-29T04:01:48.806 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:48.825 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:48.828 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:48.829 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:49.687 INFO:teuthology.orchestra.run.smithi153.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-29T04:01:49.699 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/688 2024-03-29T04:01:49.700 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/688 2024-03-29T04:01:49.700 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:49.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:49.768 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-03-29T04:01:50.407 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:50.424 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:50.425 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:50.429 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:50.429 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:51.450 INFO:teuthology.orchestra.run.smithi153.stdout:generic/689 1s 2024-03-29T04:01:51.471 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/689 2024-03-29T04:01:51.472 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:51.483 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:51.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:51.540 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-03-29T04:01:52.172 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:52.189 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:52.190 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:52.197 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:52.197 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:52.965 INFO:teuthology.orchestra.run.smithi153.stdout:generic/690 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T04:01:52.977 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/690 2024-03-29T04:01:52.977 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/690 2024-03-29T04:01:52.977 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:53.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:53.049 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-03-29T04:01:53.711 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:53.728 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:53.729 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:53.734 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:53.734 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:54.417 INFO:teuthology.orchestra.run.smithi153.stdout:generic/691 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-29T04:01:54.432 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/691 2024-03-29T04:01:54.432 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/691 2024-03-29T04:01:54.433 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:54.443 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:54.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:54.489 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-03-29T04:01:55.131 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:55.146 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:55.147 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:55.150 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:55.151 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:55.860 INFO:teuthology.orchestra.run.smithi153.stdout:generic/692 [not run] fsverity utility required, skipped this test 2024-03-29T04:01:55.873 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/692 2024-03-29T04:01:55.874 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/692 2024-03-29T04:01:55.874 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:55.884 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:55.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:55.927 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-03-29T04:01:56.582 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:56.599 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:56.601 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:56.605 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:56.605 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:57.982 INFO:teuthology.orchestra.run.smithi153.stdout:generic/693 [not run] encryption policy '-c 1 -n 10 -v 2 -f 0' is unusable; probably missing kernel crypto API support 2024-03-29T04:01:58.031 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/693 2024-03-29T04:01:58.031 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/693 2024-03-29T04:01:58.031 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:01:58.042 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:01:58.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:01:58.079 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-03-29T04:01:58.714 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:01:58.729 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:01:58.730 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:01:58.734 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:01:58.734 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:17.650 INFO:teuthology.orchestra.run.smithi153.stdout:generic/694 18s 2024-03-29T04:02:17.673 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/694 2024-03-29T04:02:17.674 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:02:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:17.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:02:17.729 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-03-29T04:02:18.388 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:02:18.401 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:02:18.403 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:02:18.406 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:02:18.406 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:19.193 INFO:teuthology.orchestra.run.smithi153.stdout:generic/695 [not run] require 172.21.15.153:6789:/scratch to be valid block disk 2024-03-29T04:02:19.205 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/695 2024-03-29T04:02:19.205 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/695 2024-03-29T04:02:19.206 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:02:19.216 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:19.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:02:19.273 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-03-29T04:02:19.916 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:02:19.938 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:02:19.940 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:02:19.943 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:02:19.943 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:21.416 INFO:teuthology.orchestra.run.smithi153.stdout:generic/696 1s 2024-03-29T04:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/696 2024-03-29T04:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:02:21.479 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:21.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:02:21.852 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-03-29T04:02:22.721 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:02:22.735 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:02:22.737 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:02:22.740 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:02:22.740 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:23.818 INFO:teuthology.orchestra.run.smithi153.stdout:generic/697 0s 2024-03-29T04:02:23.842 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/697 2024-03-29T04:02:23.843 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:02:23.852 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:23.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:02:23.973 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-03-29T04:02:24.824 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:02:24.839 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:02:24.840 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:02:24.842 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:02:24.843 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:27.979 INFO:teuthology.orchestra.run.smithi153.stdout:generic/698 2s 2024-03-29T04:02:28.004 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/698 2024-03-29T04:02:28.006 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:02:28.016 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:28.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:02:28.044 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-03-29T04:02:28.714 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:02:28.733 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:02:28.735 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:02:28.737 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:02:28.737 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:30.168 INFO:teuthology.orchestra.run.smithi153.stdout:generic/699 [not run] overlayfs doesn't support idmappped layers 2024-03-29T04:02:30.187 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/699 2024-03-29T04:02:30.188 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/699 2024-03-29T04:02:30.189 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:02:30.205 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:30.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:02:30.650 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-03-29T04:02:31.321 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:02:31.337 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:02:31.339 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:02:31.343 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:02:31.343 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:32.771 INFO:teuthology.orchestra.run.smithi153.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2024-03-29T04:02:32.793 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/700 2024-03-29T04:02:32.793 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/700 2024-03-29T04:02:32.793 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:02:32.803 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:32.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:02:32.930 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-03-29T04:02:33.767 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:02:33.784 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:02:33.785 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:02:33.789 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:02:33.789 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:52.686 INFO:teuthology.orchestra.run.smithi153.stdout:generic/701 18s 2024-03-29T04:02:52.716 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/701 2024-03-29T04:02:52.716 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:02:52.727 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:55.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:02:55.998 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-03-29T04:02:56.919 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:02:56.938 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:02:56.939 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:02:56.943 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:02:56.943 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:58.162 INFO:teuthology.orchestra.run.smithi153.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T04:02:58.188 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/702 2024-03-29T04:02:58.188 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/702 2024-03-29T04:02:58.188 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:02:58.206 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:02:58.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:02:58.559 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-03-29T04:02:59.254 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:02:59.274 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:02:59.276 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:02:59.280 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:02:59.280 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:03:00.258 INFO:teuthology.orchestra.run.smithi153.stdout:generic/703 [not run] kernel does not support IO_URING 2024-03-29T04:03:00.271 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/703 2024-03-29T04:03:00.271 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/703 2024-03-29T04:03:00.271 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:03:00.285 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:03:00.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:03:00.331 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-03-29T04:03:00.980 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:03:00.996 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:03:00.997 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:03:01.002 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:03:01.002 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:03:01.833 INFO:teuthology.orchestra.run.smithi153.stdout:generic/704 [not run] require 172.21.15.153:6789:/test to be valid block disk 2024-03-29T04:03:01.848 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/704 2024-03-29T04:03:01.849 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/704 2024-03-29T04:03:01.849 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:03:01.860 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:03:01.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:03:01.905 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-03-29T04:03:02.587 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:03:02.604 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:03:02.605 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:03:02.608 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:03:02.608 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:03:03.526 INFO:teuthology.orchestra.run.smithi153.stdout:generic/705 [not run] ceph does not support shutdown 2024-03-29T04:03:03.555 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/705 2024-03-29T04:03:03.555 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/705 2024-03-29T04:03:03.555 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:03:03.568 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:03:03.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:03:03.618 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-03-29T04:03:04.287 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:03:04.303 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:03:04.306 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:03:04.309 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:03:04.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:03:06.823 INFO:teuthology.orchestra.run.smithi153.stdout:generic/706 2s 2024-03-29T04:03:06.840 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/706 2024-03-29T04:03:06.840 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:03:06.851 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:03:06.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:03:06.981 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-03-29T04:03:07.880 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:03:07.897 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:03:07.899 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:03:07.903 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:03:07.903 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:24:49.453 INFO:teuthology.orchestra.run.smithi153.stdout:generic/707 1301s 2024-03-29T04:24:49.518 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/707 2024-03-29T04:24:49.518 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:24:49.536 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:24:49.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:24:49.578 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2024-03-29T04:24:50.425 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:24:50.443 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:24:50.444 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:24:50.447 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:24:50.447 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:24:56.180 INFO:teuthology.orchestra.run.smithi153.stdout:generic/708 2s 2024-03-29T04:24:56.221 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/708 2024-03-29T04:24:56.221 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:24:56.231 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:24:56.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:24:56.356 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2024-03-29T04:24:57.228 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:24:57.243 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:24:57.244 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:24:57.247 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:24:57.247 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:24:58.074 INFO:teuthology.orchestra.run.smithi153.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-29T04:24:58.091 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/709 2024-03-29T04:24:58.091 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/709 2024-03-29T04:24:58.091 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:24:58.106 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:24:58.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:24:58.236 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2024-03-29T04:24:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:24:59.061 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:24:59.062 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:24:59.065 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:24:59.065 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:24:59.845 INFO:teuthology.orchestra.run.smithi153.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-29T04:24:59.856 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/710 2024-03-29T04:24:59.856 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/710 2024-03-29T04:24:59.856 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:24:59.867 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:24:59.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:24:59.970 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2024-03-29T04:25:00.757 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:00.789 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:00.791 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:00.794 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:00.794 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:01.568 INFO:teuthology.orchestra.run.smithi153.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-29T04:25:01.581 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/711 2024-03-29T04:25:01.582 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/711 2024-03-29T04:25:01.582 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:01.592 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:01.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:01.698 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2024-03-29T04:25:02.525 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:02.539 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:02.541 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:02.546 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:02.546 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:03.365 INFO:teuthology.orchestra.run.smithi153.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-29T04:25:03.379 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/712 2024-03-29T04:25:03.380 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/712 2024-03-29T04:25:03.380 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:03.393 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:03.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:03.511 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2024-03-29T04:25:04.398 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:04.414 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:04.417 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:04.421 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:04.421 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:05.206 INFO:teuthology.orchestra.run.smithi153.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2024-03-29T04:25:05.219 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/713 2024-03-29T04:25:05.220 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/713 2024-03-29T04:25:05.220 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:05.228 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:05.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:05.354 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2024-03-29T04:25:06.209 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:06.227 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:06.228 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:06.231 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:06.231 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:07.000 INFO:teuthology.orchestra.run.smithi153.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-29T04:25:07.013 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/714 2024-03-29T04:25:07.013 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/714 2024-03-29T04:25:07.014 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:07.021 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:07.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:07.144 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2024-03-29T04:25:08.004 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:08.023 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:08.025 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:08.029 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:08.030 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:10.350 INFO:teuthology.orchestra.run.smithi153.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2024-03-29T04:25:10.362 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/715 2024-03-29T04:25:10.362 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/715 2024-03-29T04:25:10.362 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:10.373 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:10.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:10.482 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2024-03-29T04:25:11.348 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:11.373 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:11.375 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:11.377 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:12.131 INFO:teuthology.orchestra.run.smithi153.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-29T04:25:12.144 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/716 2024-03-29T04:25:12.144 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/716 2024-03-29T04:25:12.144 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:12.155 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:12.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:12.260 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2024-03-29T04:25:13.135 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:13.149 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:13.151 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:13.156 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:13.156 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:13.905 INFO:teuthology.orchestra.run.smithi153.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-29T04:25:13.919 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/717 2024-03-29T04:25:13.920 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/717 2024-03-29T04:25:13.920 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:13.929 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:14.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:14.078 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2024-03-29T04:25:14.935 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:14.948 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:14.950 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:14.954 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:14.954 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:15.765 INFO:teuthology.orchestra.run.smithi153.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-29T04:25:15.779 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/718 2024-03-29T04:25:15.780 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/718 2024-03-29T04:25:15.780 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:15.791 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:15.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:15.898 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2024-03-29T04:25:16.756 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:16.771 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:16.773 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:16.777 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:16.777 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:17.514 INFO:teuthology.orchestra.run.smithi153.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-29T04:25:17.526 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/719 2024-03-29T04:25:17.527 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/719 2024-03-29T04:25:17.527 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:17.538 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:17.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:17.667 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2024-03-29T04:25:18.491 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:18.508 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:18.510 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:18.512 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:18.512 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:19.264 INFO:teuthology.orchestra.run.smithi153.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-29T04:25:19.277 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/720 2024-03-29T04:25:19.277 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/720 2024-03-29T04:25:19.277 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:19.286 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:19.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:19.398 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2024-03-29T04:25:20.234 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:20.254 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:20.256 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:20.260 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:20.260 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:20.980 INFO:teuthology.orchestra.run.smithi153.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-03-29T04:25:20.996 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/721 2024-03-29T04:25:20.996 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/721 2024-03-29T04:25:20.996 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:21.005 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:21.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:21.059 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2024-03-29T04:25:21.701 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:21.718 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:21.719 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:21.723 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:21.723 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:22.609 INFO:teuthology.orchestra.run.smithi153.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-29T04:25:22.620 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/722 2024-03-29T04:25:22.621 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/722 2024-03-29T04:25:22.621 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:22.633 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:22.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:22.743 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2024-03-29T04:25:23.607 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:23.623 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:23.625 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:23.629 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:23.629 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:24.407 INFO:teuthology.orchestra.run.smithi153.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-29T04:25:24.419 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/723 2024-03-29T04:25:24.419 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/723 2024-03-29T04:25:24.419 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:24.429 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:24.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:24.550 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2024-03-29T04:25:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:25.457 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:26.262 INFO:teuthology.orchestra.run.smithi153.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-29T04:25:26.276 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/724 2024-03-29T04:25:26.276 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/724 2024-03-29T04:25:26.276 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:26.284 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:26.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:26.375 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2024-03-29T04:25:27.214 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:27.234 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:27.235 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:27.239 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:27.239 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:28.036 INFO:teuthology.orchestra.run.smithi153.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-29T04:25:28.049 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/725 2024-03-29T04:25:28.049 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/725 2024-03-29T04:25:28.049 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:28.060 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:28.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:28.187 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2024-03-29T04:25:29.039 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:29.055 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:29.057 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:29.063 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:29.063 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:30.489 INFO:teuthology.orchestra.run.smithi153.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-29T04:25:30.503 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/726 2024-03-29T04:25:30.503 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/726 2024-03-29T04:25:30.503 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:30.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:30.636 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2024-03-29T04:25:31.497 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:31.516 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:31.517 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:31.521 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:31.521 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:32.428 INFO:teuthology.orchestra.run.smithi153.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-29T04:25:32.442 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/727 2024-03-29T04:25:32.442 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/727 2024-03-29T04:25:32.442 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:32.452 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:32.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:32.568 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2024-03-29T04:25:33.422 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:33.438 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:33.439 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:33.442 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:33.442 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:38.302 INFO:teuthology.orchestra.run.smithi153.stdout:generic/728 5s 2024-03-29T04:25:38.321 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/728 2024-03-29T04:25:38.321 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:38.333 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:38.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:38.449 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2024-03-29T04:25:39.287 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:39.304 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:39.307 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:39.307 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:40.510 INFO:teuthology.orchestra.run.smithi153.stdout:generic/729 1s 2024-03-29T04:25:40.535 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/729 2024-03-29T04:25:40.535 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:40.546 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:40.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:40.642 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2024-03-29T04:25:41.498 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:41.515 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:41.517 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:41.519 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:41.520 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:42.259 INFO:teuthology.orchestra.run.smithi153.stdout:generic/730 [not run] require 172.21.15.153:6789:/test to be valid block disk 2024-03-29T04:25:42.273 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/730 2024-03-29T04:25:42.273 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/730 2024-03-29T04:25:42.273 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:42.283 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:42.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:42.336 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2024-03-29T04:25:42.994 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:43.010 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:43.012 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:43.017 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:43.017 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:43.718 INFO:teuthology.orchestra.run.smithi153.stdout:generic/731 [not run] require 172.21.15.153:6789:/test to be valid block disk 2024-03-29T04:25:43.731 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/731 2024-03-29T04:25:43.731 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/731 2024-03-29T04:25:43.733 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:43.740 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:43.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:43.801 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2024-03-29T04:25:44.446 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:44.462 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:44.463 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:44.467 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:44.467 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:46.236 INFO:teuthology.orchestra.run.smithi153.stdout:generic/732 2s 2024-03-29T04:25:46.259 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/732 2024-03-29T04:25:46.259 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:46.268 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:46.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:46.319 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2024-03-29T04:25:46.961 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:46.980 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:46.982 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:46.987 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:46.987 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:48.119 INFO:teuthology.orchestra.run.smithi153.stdout:generic/733 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-29T04:25:48.147 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/733 2024-03-29T04:25:48.147 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/733 2024-03-29T04:25:48.147 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:48.161 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:48.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:48.535 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/734) 2024-03-29T04:25:49.233 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:49.261 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:49.262 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:49.267 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:49.267 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:50.271 INFO:teuthology.orchestra.run.smithi153.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph 2024-03-29T04:25:50.282 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/734 2024-03-29T04:25:50.282 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/734 2024-03-29T04:25:50.282 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:50.289 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:50.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:50.410 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/735) 2024-03-29T04:25:51.285 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:51.301 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:51.302 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:51.307 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:52.123 INFO:teuthology.orchestra.run.smithi153.stdout:generic/735 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-29T04:25:52.136 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/735 2024-03-29T04:25:52.136 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/735 2024-03-29T04:25:52.136 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:25:52.145 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:25:52.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:25:52.268 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/736) 2024-03-29T04:25:53.124 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:25:53.141 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:25:53.142 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:25:53.145 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:25:53.145 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:28:49.002 INFO:teuthology.orchestra.run.smithi153.stdout:generic/736 175s 2024-03-29T04:28:49.024 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/736 2024-03-29T04:28:49.024 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:28:49.036 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:28:49.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:28:49.150 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/737) 2024-03-29T04:28:49.987 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:28:50.002 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:28:50.004 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:28:50.007 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:28:50.007 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:28:50.994 INFO:teuthology.orchestra.run.smithi153.stdout:generic/737 [not run] ceph does not support shutdown 2024-03-29T04:28:51.028 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/737 2024-03-29T04:28:51.028 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/737 2024-03-29T04:28:51.028 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:28:51.036 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:28:51.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:28:51.080 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/738) 2024-03-29T04:28:51.746 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:28:51.762 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:28:51.763 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:28:51.768 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:28:51.768 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:28:52.517 INFO:teuthology.orchestra.run.smithi153.stdout:generic/738 [not run] ceph does not support freezing 2024-03-29T04:28:52.532 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/738 2024-03-29T04:28:52.532 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/738 2024-03-29T04:28:52.532 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:28:52.542 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:28:52.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:28:52.595 DEBUG:teuthology.orchestra.run.smithi153:> (cd /tmp/tmp.0cGUU1Musyxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/739) 2024-03-29T04:28:53.253 INFO:teuthology.orchestra.run.smithi153.stdout:FSTYP -- ceph 2024-03-29T04:28:53.265 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM -- Linux/x86_64 smithi153 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-29T04:28:53.266 INFO:teuthology.orchestra.run.smithi153.stdout:MKFS_OPTIONS -- 172.21.15.153:6789:/scratch 2024-03-29T04:28:53.269 INFO:teuthology.orchestra.run.smithi153.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA95gVmAUSBLxAAgaeSQEyxJX2zJbtGKmJhCg== -o context=system_u:object_r:root_t:s0 172.21.15.153:6789:/scratch /tmp/tmp.qtMzJmHuchscratch 2024-03-29T04:28:53.269 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:28:54.166 INFO:teuthology.orchestra.run.smithi153.stdout:generic/739 [not run] xfs_io set_encpolicy doesn't support -s 2024-03-29T04:28:54.181 INFO:teuthology.orchestra.run.smithi153.stdout:Ran: generic/739 2024-03-29T04:28:54.181 INFO:teuthology.orchestra.run.smithi153.stdout:Not run: generic/739 2024-03-29T04:28:54.181 INFO:teuthology.orchestra.run.smithi153.stdout:Passed all 1 tests 2024-03-29T04:28:54.194 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:28:54.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-29T04:28:54.242 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 6========================================================= 2024-03-29T04:28:54.243 DEBUG:teuthology.orchestra.run.smithi153:> sudo userdel --force --remove fsgqa 2024-03-29T04:28:55.226 DEBUG:teuthology.orchestra.run.smithi153:> sudo userdel --force --remove 123456-fsgqa 2024-03-29T04:28:55.905 DEBUG:teuthology.orchestra.run.smithi153:> sudo groupdel fsgqa 2024-03-29T04:28:57.428 INFO:teuthology.orchestra.run.smithi153.stderr:groupdel: group 'fsgqa' does not exist 2024-03-29T04:28:57.433 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-03-29T04:28:57.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:28:57.433 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.0cGUU1Musyxfstests-dev/results) 2024-03-29T04:28:57.524 INFO:teuthology.orchestra.run.smithi153.stdout: File: /tmp/tmp.0cGUU1Musyxfstests-dev/results 2024-03-29T04:28:57.524 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2024-03-29T04:28:57.525 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 801h/2049d Inode: 684143 Links: 3 2024-03-29T04:28:57.525 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-29T04:28:57.525 INFO:teuthology.orchestra.run.smithi153.stdout:Context: unconfined_u:object_r:user_tmp_t:s0 2024-03-29T04:28:57.525 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-28 21:57:21.374925672 +0000 2024-03-29T04:28:57.525 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-29 04:28:49.044077281 +0000 2024-03-29T04:28:57.525 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-29 04:28:49.044077281 +0000 2024-03-29T04:28:57.525 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-03-28 21:57:21.374925672 +0000 2024-03-29T04:28:57.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:28:57.529 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2024-03-29T04:28:57.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:28:57.633 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.0cGUU1Musyxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2024-03-29T04:29:03.569 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.0cGUU1Musyxfstests-dev to /var/log/ceph. 2024-03-29T04:29:03.569 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf /tmp/tmp.0cGUU1Musyxfstests-dev 2024-03-29T04:29:04.247 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-29T04:29:04.247 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-29T04:29:04.439 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-29T04:29:04.625 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-29T04:29:04.625 INFO:tasks.cephfs.mount:Terminating background process 2024-03-29T04:29:04.625 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-29T04:29:04.625 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:29:04.690 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-29T04:29:04.690 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:29:04.746 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:29:05.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.469+0000 7f991a800640 1 Processor -- start 2024-03-29T04:29:05.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.469+0000 7f991a800640 1 -- start start 2024-03-29T04:29:05.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.470+0000 7f991a800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f991406e440 0x7f991415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:05.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.470+0000 7f991a800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f99140ad830 0x7f99140b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:05.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.471+0000 7f991a800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99140b2e60 con 0x7f9914159a10 2024-03-29T04:29:05.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.471+0000 7f991a800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f99140adc70 con 0x7f99140ad830 2024-03-29T04:29:05.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.471+0000 7f991a800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9914159df0 con 0x7f991406e440 2024-03-29T04:29:05.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.471+0000 7f9912a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f991406e440 0x7f991415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:05.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.471+0000 7f9913e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f99140ad830 0x7f99140b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:05.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.471+0000 7f9912a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f991406e440 0x7f991415cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:35746/0 (socket says 172.21.15.153:35746) 2024-03-29T04:29:05.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.471+0000 7f9912a00640 1 -- 172.21.15.153:0/4035392467 learned_addr learned my addr 172.21.15.153:0/4035392467 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:05.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.471+0000 7f9913400640 1 --1- 172.21.15.153:0/4035392467 >> v1:172.21.15.165:6789/0 conn(0x7f9914159a10 0x7f991406dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:58118/0 (socket says 172.21.15.153:58118) 2024-03-29T04:29:05.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.472+0000 7f9912a00640 1 -- 172.21.15.153:0/4035392467 >> v2:172.21.15.153:3300/0 conn(0x7f99140ad830 msgr2=0x7f99140b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:05.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.472+0000 7f9912a00640 1 --2- 172.21.15.153:0/4035392467 >> v2:172.21.15.153:3300/0 conn(0x7f99140ad830 0x7f99140b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:05.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.472+0000 7f9912a00640 1 -- 172.21.15.153:0/4035392467 >> v1:172.21.15.165:6789/0 conn(0x7f9914159a10 legacy=0x7f991406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:05.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.472+0000 7f9912a00640 1 -- 172.21.15.153:0/4035392467 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99140adf10 con 0x7f991406e440 2024-03-29T04:29:05.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.473+0000 7f9912a00640 1 --2- 172.21.15.153:0/4035392467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f991406e440 0x7f991415cf00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f99140736e0 tx=0x7f990002fd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70612a5934c3843e server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:05.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.477+0000 7f9912000640 1 -- 172.21.15.153:0/4035392467 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99000308c0 con 0x7f991406e440 2024-03-29T04:29:05.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.477+0000 7f9912000640 1 -- 172.21.15.153:0/4035392467 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9900030a60 con 0x7f991406e440 2024-03-29T04:29:05.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.477+0000 7f9912000640 1 -- 172.21.15.153:0/4035392467 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900030e30 con 0x7f991406e440 2024-03-29T04:29:05.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.478+0000 7f991a800640 1 -- 172.21.15.153:0/4035392467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f991406e440 msgr2=0x7f991415cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:05.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.478+0000 7f991a800640 1 --2- 172.21.15.153:0/4035392467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f991406e440 0x7f991415cf00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f99140736e0 tx=0x7f990002fd20 comp rx=0 tx=0).stop 2024-03-29T04:29:05.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.480+0000 7f991a800640 1 -- 172.21.15.153:0/4035392467 shutdown_connections 2024-03-29T04:29:05.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.481+0000 7f991a800640 1 --2- 172.21.15.153:0/4035392467 >> v2:172.21.15.153:3300/0 conn(0x7f99140ad830 0x7f99140b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:05.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.481+0000 7f991a800640 1 --2- 172.21.15.153:0/4035392467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f991406e440 0x7f991415cf00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:05.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.481+0000 7f991a800640 1 -- 172.21.15.153:0/4035392467 >> 172.21.15.153:0/4035392467 conn(0x7f99140b1a30 msgr2=0x7f99140b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:05.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.481+0000 7f991a800640 1 -- 172.21.15.153:0/4035392467 shutdown_connections 2024-03-29T04:29:05.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.481+0000 7f991a800640 1 -- 172.21.15.153:0/4035392467 wait complete. 2024-03-29T04:29:05.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.484+0000 7f991a800640 1 Processor -- start 2024-03-29T04:29:05.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.485+0000 7f991a800640 1 -- start start 2024-03-29T04:29:05.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.485+0000 7f991a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991406e440 0x7f9914150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:05.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.485+0000 7f991a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99140ad830 0x7f99141e24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:05.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.485+0000 7f991a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914159a10 0x7f9914157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:05.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.486+0000 7f991a800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99140ae4d0 con 0x7f991406e440 2024-03-29T04:29:05.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.486+0000 7f991a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f99140b3100 con 0x7f99140ad830 2024-03-29T04:29:05.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.486+0000 7f991a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f99140b3b60 con 0x7f9914159a10 2024-03-29T04:29:05.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.486+0000 7f9912a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99140ad830 0x7f99141e24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:05.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.486+0000 7f9913e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914159a10 0x7f9914157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:05.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.486+0000 7f9913e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914159a10 0x7f9914157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:33492/0 (socket says 172.21.15.153:33492) 2024-03-29T04:29:05.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.486+0000 7f9913e00640 1 -- 172.21.15.153:0/404851575 learned_addr learned my addr 172.21.15.153:0/404851575 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:05.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.487+0000 7f9913e00640 1 -- 172.21.15.153:0/404851575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99140ad830 msgr2=0x7f99141e24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:05.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.487+0000 7f9913e00640 1 --2- 172.21.15.153:0/404851575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99140ad830 0x7f99141e24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:05.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.487+0000 7f9913e00640 1 -- 172.21.15.153:0/404851575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991406e440 msgr2=0x7f9914150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:05.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.487+0000 7f9913e00640 1 --2- 172.21.15.153:0/404851575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991406e440 0x7f9914150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:05.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.487+0000 7f9913e00640 1 -- 172.21.15.153:0/404851575 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9914157850 con 0x7f9914159a10 2024-03-29T04:29:05.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.487+0000 7f9913e00640 1 --2- 172.21.15.153:0/404851575 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914159a10 0x7f9914157000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f990c007e70 tx=0x7f990c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:05.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.488+0000 7f9912a00640 1 --2- 172.21.15.153:0/404851575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99140ad830 0x7f99141e24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:29:05.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.489+0000 7f990b400640 1 -- 172.21.15.153:0/404851575 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990c014620 con 0x7f9914159a10 2024-03-29T04:29:05.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.489+0000 7f990b400640 1 -- 172.21.15.153:0/404851575 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990c019070 con 0x7f9914159a10 2024-03-29T04:29:05.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.489+0000 7f990b400640 1 -- 172.21.15.153:0/404851575 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990c014a00 con 0x7f9914159a10 2024-03-29T04:29:05.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.489+0000 7f991a800640 1 -- 172.21.15.153:0/404851575 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9914157b30 con 0x7f9914159a10 2024-03-29T04:29:05.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.489+0000 7f991a800640 1 -- 172.21.15.153:0/404851575 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f991409bd30 con 0x7f9914159a10 2024-03-29T04:29:05.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.493+0000 7f990b400640 1 -- 172.21.15.153:0/404851575 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f990c014ba0 con 0x7f9914159a10 2024-03-29T04:29:05.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.494+0000 7f990b400640 1 --2- 172.21.15.153:0/404851575 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f98f406b550 0x7f98f406da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:05.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.495+0000 7f990b400640 1 -- 172.21.15.153:0/404851575 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f990c056a00 con 0x7f9914159a10 2024-03-29T04:29:05.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.495+0000 7f9913400640 1 --2- 172.21.15.153:0/404851575 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f98f406b550 0x7f98f406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.492+0000 7f991a800640 1 -- 172.21.15.153:0/404851575 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98ec005290 con 0x7f9914159a10 2024-03-29T04:29:05.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.504+0000 7f9913400640 1 --2- 172.21.15.153:0/404851575 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f98f406b550 0x7f98f406da10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9904007fd0 tx=0x7f99040079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:05.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.511+0000 7f990b400640 1 -- 172.21.15.153:0/404851575 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f990c059060 con 0x7f9914159a10 2024-03-29T04:29:05.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.839+0000 7f991a800640 1 -- 172.21.15.153:0/404851575 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98ec005850 con 0x7f9914159a10 2024-03-29T04:29:05.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.842+0000 7f990b400640 1 -- 172.21.15.153:0/404851575 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16717 (secure 0 0 0) 0x7f990c058960 con 0x7f9914159a10 2024-03-29T04:29:05.820 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:05.820 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":35,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:53:10.602850+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:53:06.943079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-28T21:53:08.054176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:29:05.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.845+0000 7f991a800640 1 -- 172.21.15.153:0/404851575 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f98f406b550 msgr2=0x7f98f406da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.845+0000 7f991a800640 1 --2- 172.21.15.153:0/404851575 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f98f406b550 0x7f98f406da10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9904007fd0 tx=0x7f99040079a0 comp rx=0 tx=0).stop 2024-03-29T04:29:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.845+0000 7f991a800640 1 -- 172.21.15.153:0/404851575 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914159a10 msgr2=0x7f9914157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.845+0000 7f991a800640 1 --2- 172.21.15.153:0/404851575 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914159a10 0x7f9914157000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f990c007e70 tx=0x7f990c00e4b0 comp rx=0 tx=0).stop 2024-03-29T04:29:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.846+0000 7f991a800640 1 -- 172.21.15.153:0/404851575 shutdown_connections 2024-03-29T04:29:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.846+0000 7f991a800640 1 --2- 172.21.15.153:0/404851575 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f98f406b550 0x7f98f406da10 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.846+0000 7f991a800640 1 --2- 172.21.15.153:0/404851575 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914159a10 0x7f9914157000 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.846+0000 7f991a800640 1 --2- 172.21.15.153:0/404851575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99140ad830 0x7f99141e24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.846+0000 7f991a800640 1 --2- 172.21.15.153:0/404851575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991406e440 0x7f9914150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.846+0000 7f991a800640 1 -- 172.21.15.153:0/404851575 >> 172.21.15.153:0/404851575 conn(0x7f99140b1a30 msgr2=0x7f991406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.846+0000 7f991a800640 1 -- 172.21.15.153:0/404851575 shutdown_connections 2024-03-29T04:29:05.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:05.846+0000 7f991a800640 1 -- 172.21.15.153:0/404851575 wait complete. 2024-03-29T04:29:05.850 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T21:53:06.943079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T21:53:08.054176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:29:05.850 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:29:06.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.252+0000 7faf1d800640 1 Processor -- start 2024-03-29T04:29:06.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.252+0000 7faf1d800640 1 -- start start 2024-03-29T04:29:06.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.254+0000 7faf1d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf1806ddb0 0x7faf1816d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:06.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.254+0000 7faf1d800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf180ace20 con 0x7faf18071490 2024-03-29T04:29:06.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.254+0000 7faf1d800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf180ad100 con 0x7faf181626a0 2024-03-29T04:29:06.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.254+0000 7faf1d800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faf180ad750 con 0x7faf1806ddb0 2024-03-29T04:29:06.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.254+0000 7faf16000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7faf18071490 0x7faf1806d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:52540/0 (socket says 172.21.15.153:52540) 2024-03-29T04:29:06.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.254+0000 7faf16000640 1 -- 172.21.15.153:0/3272283861 learned_addr learned my addr 172.21.15.153:0/3272283861 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:06.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.255+0000 7faf17400640 1 --2- 172.21.15.153:0/3272283861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf1806ddb0 0x7faf1816d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:06.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.255+0000 7faf15600640 1 -- 172.21.15.153:0/3272283861 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1162636072 0 0) 0x7faf180ace20 con 0x7faf18071490 2024-03-29T04:29:06.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.255+0000 7faf15600640 1 -- 172.21.15.153:0/3272283861 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faefc003520 con 0x7faf18071490 2024-03-29T04:29:06.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.256+0000 7faf17400640 1 -- 172.21.15.153:0/3272283861 >> v1:172.21.15.165:6789/0 conn(0x7faf181626a0 legacy=0x7faf18070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:06.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.256+0000 7faf17400640 1 -- 172.21.15.153:0/3272283861 >> v1:172.21.15.153:6789/0 conn(0x7faf18071490 legacy=0x7faf1806d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:06.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.256+0000 7faf17400640 1 -- 172.21.15.153:0/3272283861 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf180ad3e0 con 0x7faf1806ddb0 2024-03-29T04:29:06.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.257+0000 7faf17400640 1 --2- 172.21.15.153:0/3272283861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf1806ddb0 0x7faf1816d490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf180ad8d0 tx=0x7faf1002bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=651bd9ea7a91ad3e server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:06.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.262+0000 7faf15600640 1 -- 172.21.15.153:0/3272283861 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10039070 con 0x7faf1806ddb0 2024-03-29T04:29:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.262+0000 7faf15600640 1 -- 172.21.15.153:0/3272283861 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1002ccc0 con 0x7faf1806ddb0 2024-03-29T04:29:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.262+0000 7faf15600640 1 -- 172.21.15.153:0/3272283861 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10034660 con 0x7faf1806ddb0 2024-03-29T04:29:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.263+0000 7faf1d800640 1 -- 172.21.15.153:0/3272283861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf1806ddb0 msgr2=0x7faf1816d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.263+0000 7faf1d800640 1 --2- 172.21.15.153:0/3272283861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf1806ddb0 0x7faf1816d490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf180ad8d0 tx=0x7faf1002bf10 comp rx=0 tx=0).stop 2024-03-29T04:29:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.264+0000 7faf1d800640 1 -- 172.21.15.153:0/3272283861 shutdown_connections 2024-03-29T04:29:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.264+0000 7faf1d800640 1 --2- 172.21.15.153:0/3272283861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf1806ddb0 0x7faf1816d490 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.264+0000 7faf1d800640 1 -- 172.21.15.153:0/3272283861 >> 172.21.15.153:0/3272283861 conn(0x7faf180b19a0 msgr2=0x7faf180b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.264+0000 7faf1d800640 1 -- 172.21.15.153:0/3272283861 shutdown_connections 2024-03-29T04:29:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.264+0000 7faf1d800640 1 -- 172.21.15.153:0/3272283861 wait complete. 2024-03-29T04:29:06.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.266+0000 7faf1d800640 1 Processor -- start 2024-03-29T04:29:06.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.267+0000 7faf1d800640 1 -- start start 2024-03-29T04:29:06.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.268+0000 7faf1d800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf1806ddb0 0x7faf18163520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:06.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.268+0000 7faf1d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf18071490 0x7faf181655b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:06.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.268+0000 7faf1d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf181626a0 0x7faf1815a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:06.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.268+0000 7faf1d800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faf180aed70 con 0x7faf181626a0 2024-03-29T04:29:06.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.268+0000 7faf1d800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faf180aebf0 con 0x7faf1806ddb0 2024-03-29T04:29:06.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.268+0000 7faf1d800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faf1816d9d0 con 0x7faf18071490 2024-03-29T04:29:06.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.268+0000 7faf17400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf181626a0 0x7faf1815a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:06.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.268+0000 7faf16a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf1806ddb0 0x7faf18163520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:06.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.268+0000 7faf16a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf1806ddb0 0x7faf18163520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:35758/0 (socket says 172.21.15.153:35758) 2024-03-29T04:29:06.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.268+0000 7faf16a00640 1 -- 172.21.15.153:0/1687298803 learned_addr learned my addr 172.21.15.153:0/1687298803 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:06.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.268+0000 7faf16000640 1 --2- 172.21.15.153:0/1687298803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf18071490 0x7faf181655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:06.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.269+0000 7faf16a00640 1 -- 172.21.15.153:0/1687298803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf18071490 msgr2=0x7faf181655b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:06.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.269+0000 7faf16a00640 1 --2- 172.21.15.153:0/1687298803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf18071490 0x7faf181655b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:06.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.269+0000 7faf16a00640 1 -- 172.21.15.153:0/1687298803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf181626a0 msgr2=0x7faf1815a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:06.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.269+0000 7faf16a00640 1 --2- 172.21.15.153:0/1687298803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf181626a0 0x7faf1815a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:06.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.269+0000 7faf16a00640 1 -- 172.21.15.153:0/1687298803 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf18163c00 con 0x7faf1806ddb0 2024-03-29T04:29:06.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.270+0000 7faf16000640 1 --2- 172.21.15.153:0/1687298803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf18071490 0x7faf181655b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:29:06.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.270+0000 7faf16a00640 1 --2- 172.21.15.153:0/1687298803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf1806ddb0 0x7faf18163520 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faf0400c480 tx=0x7faf0400c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:06.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.278+0000 7faf0ea00640 1 -- 172.21.15.153:0/1687298803 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf040052d0 con 0x7faf1806ddb0 2024-03-29T04:29:06.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.278+0000 7faf0ea00640 1 -- 172.21.15.153:0/1687298803 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf04005470 con 0x7faf1806ddb0 2024-03-29T04:29:06.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.278+0000 7faf0ea00640 1 -- 172.21.15.153:0/1687298803 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04012870 con 0x7faf1806ddb0 2024-03-29T04:29:06.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.278+0000 7faf1d800640 1 -- 172.21.15.153:0/1687298803 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf18163ee0 con 0x7faf1806ddb0 2024-03-29T04:29:06.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.278+0000 7faf1d800640 1 -- 172.21.15.153:0/1687298803 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf1815be70 con 0x7faf1806ddb0 2024-03-29T04:29:06.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.279+0000 7faf1d800640 1 -- 172.21.15.153:0/1687298803 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf1815c070 con 0x7faf1806ddb0 2024-03-29T04:29:06.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.281+0000 7faf0ea00640 1 -- 172.21.15.153:0/1687298803 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7faf04012a10 con 0x7faf1806ddb0 2024-03-29T04:29:06.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.281+0000 7faf0ea00640 1 --2- 172.21.15.153:0/1687298803 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7faef806b520 0x7faef806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:06.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.282+0000 7faf16000640 1 --2- 172.21.15.153:0/1687298803 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7faef806b520 0x7faef806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:06.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.283+0000 7faf16000640 1 --2- 172.21.15.153:0/1687298803 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7faef806b520 0x7faef806d9e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7faf180b3330 tx=0x7faf08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:06.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.284+0000 7faf0ea00640 1 -- 172.21.15.153:0/1687298803 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7faf04056680 con 0x7faf1806ddb0 2024-03-29T04:29:06.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.292+0000 7faf0ea00640 1 -- 172.21.15.153:0/1687298803 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7faf1815c070 con 0x7faf1806ddb0 2024-03-29T04:29:06.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.608+0000 7faf1d800640 1 -- 172.21.15.153:0/1687298803 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faf18068ff0 con 0x7faf1806ddb0 2024-03-29T04:29:06.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.609+0000 7faf0ea00640 1 -- 172.21.15.153:0/1687298803 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7faf040585e0 con 0x7faf1806ddb0 2024-03-29T04:29:06.585 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-29T04:29:06.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.612+0000 7faf1d800640 1 -- 172.21.15.153:0/1687298803 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7faef806b520 msgr2=0x7faef806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:06.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.612+0000 7faf1d800640 1 --2- 172.21.15.153:0/1687298803 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7faef806b520 0x7faef806d9e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7faf180b3330 tx=0x7faf08009040 comp rx=0 tx=0).stop 2024-03-29T04:29:06.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.612+0000 7faf1d800640 1 -- 172.21.15.153:0/1687298803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf1806ddb0 msgr2=0x7faf18163520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:06.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.612+0000 7faf1d800640 1 --2- 172.21.15.153:0/1687298803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf1806ddb0 0x7faf18163520 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faf0400c480 tx=0x7faf0400c940 comp rx=0 tx=0).stop 2024-03-29T04:29:06.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.613+0000 7faf1d800640 1 -- 172.21.15.153:0/1687298803 shutdown_connections 2024-03-29T04:29:06.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.613+0000 7faf1d800640 1 --2- 172.21.15.153:0/1687298803 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7faef806b520 0x7faef806d9e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:06.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.613+0000 7faf1d800640 1 --2- 172.21.15.153:0/1687298803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf181626a0 0x7faf1815a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:06.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.613+0000 7faf1d800640 1 --2- 172.21.15.153:0/1687298803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf18071490 0x7faf181655b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:06.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.613+0000 7faf1d800640 1 --2- 172.21.15.153:0/1687298803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf1806ddb0 0x7faf18163520 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:06.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.613+0000 7faf1d800640 1 -- 172.21.15.153:0/1687298803 >> 172.21.15.153:0/1687298803 conn(0x7faf180b19a0 msgr2=0x7faf18070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:06.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.613+0000 7faf1d800640 1 -- 172.21.15.153:0/1687298803 shutdown_connections 2024-03-29T04:29:06.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.613+0000 7faf1d800640 1 -- 172.21.15.153:0/1687298803 wait complete. 2024-03-29T04:29:06.614 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:29:06.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.890+0000 7f1238e00640 1 Processor -- start 2024-03-29T04:29:06.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.891+0000 7f1238e00640 1 -- start start 2024-03-29T04:29:06.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.893+0000 7f1238e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12341626a0 0x7f1234070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:06.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.893+0000 7f1238e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f12340712c0 0x7f123406d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:06.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.893+0000 7f1238e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f123406dbe0 0x7f1234166100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:06.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.893+0000 7f1238e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f1234071720 con 0x7f12340712c0 2024-03-29T04:29:06.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.893+0000 7f1238e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f12340ad750 con 0x7f123406dbe0 2024-03-29T04:29:06.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.893+0000 7f1238e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f12340ace20 con 0x7f12341626a0 2024-03-29T04:29:06.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.894+0000 7f1231e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12341626a0 0x7f1234070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:06.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.894+0000 7f1231e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12341626a0 0x7f1234070d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:33518/0 (socket says 172.21.15.153:33518) 2024-03-29T04:29:06.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.894+0000 7f1231e00640 1 -- 172.21.15.153:0/367126305 learned_addr learned my addr 172.21.15.153:0/367126305 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:06.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.894+0000 7f1232800640 1 --2- 172.21.15.153:0/367126305 >> v2:172.21.15.165:3300/0 conn(0x7f123406dbe0 0x7f1234166100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:06.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.894+0000 7f1231400640 1 --2- 172.21.15.153:0/367126305 >> v2:172.21.15.153:3300/0 conn(0x7f12340712c0 0x7f123406d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:06.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.894+0000 7f1231e00640 1 -- 172.21.15.153:0/367126305 >> v2:172.21.15.165:3300/0 conn(0x7f123406dbe0 msgr2=0x7f1234166100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:06.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.895+0000 7f1231e00640 1 --2- 172.21.15.153:0/367126305 >> v2:172.21.15.165:3300/0 conn(0x7f123406dbe0 0x7f1234166100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.895+0000 7f1231e00640 1 -- 172.21.15.153:0/367126305 >> v2:172.21.15.153:3300/0 conn(0x7f12340712c0 msgr2=0x7f123406d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.895+0000 7f1231e00640 1 --2- 172.21.15.153:0/367126305 >> v2:172.21.15.153:3300/0 conn(0x7f12340712c0 0x7f123406d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.895+0000 7f1231e00640 1 -- 172.21.15.153:0/367126305 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12340ad100 con 0x7f12341626a0 2024-03-29T04:29:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.895+0000 7f1232800640 1 --2- 172.21.15.153:0/367126305 >> v2:172.21.15.165:3300/0 conn(0x7f123406dbe0 0x7f1234166100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:29:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.895+0000 7f1231400640 1 --2- 172.21.15.153:0/367126305 >> v2:172.21.15.153:3300/0 conn(0x7f12340712c0 0x7f123406d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:29:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.896+0000 7f1231e00640 1 --2- 172.21.15.153:0/367126305 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12341626a0 0x7f1234070d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f12340705d0 tx=0x7f122402b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed9e77c4471bb087 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.897+0000 7f1230a00640 1 -- 172.21.15.153:0/367126305 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224035020 con 0x7f12341626a0 2024-03-29T04:29:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.897+0000 7f1230a00640 1 -- 172.21.15.153:0/367126305 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1224031880 con 0x7f12341626a0 2024-03-29T04:29:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.897+0000 7f1230a00640 1 -- 172.21.15.153:0/367126305 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224031c50 con 0x7f12341626a0 2024-03-29T04:29:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.898+0000 7f1238e00640 1 -- 172.21.15.153:0/367126305 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12341626a0 msgr2=0x7f1234070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.898+0000 7f1238e00640 1 --2- 172.21.15.153:0/367126305 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12341626a0 0x7f1234070d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f12340705d0 tx=0x7f122402b920 comp rx=0 tx=0).stop 2024-03-29T04:29:06.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.898+0000 7f1238e00640 1 -- 172.21.15.153:0/367126305 shutdown_connections 2024-03-29T04:29:06.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.898+0000 7f1238e00640 1 --2- 172.21.15.153:0/367126305 >> v2:172.21.15.153:3300/0 conn(0x7f12340712c0 0x7f123406d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:06.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.898+0000 7f1238e00640 1 --2- 172.21.15.153:0/367126305 >> v2:172.21.15.165:3300/0 conn(0x7f123406dbe0 0x7f1234166100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:06.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.898+0000 7f1238e00640 1 --2- 172.21.15.153:0/367126305 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12341626a0 0x7f1234070d80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:06.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.898+0000 7f1238e00640 1 -- 172.21.15.153:0/367126305 >> 172.21.15.153:0/367126305 conn(0x7f12340b19a0 msgr2=0x7f12340b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:06.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.899+0000 7f1238e00640 1 -- 172.21.15.153:0/367126305 shutdown_connections 2024-03-29T04:29:06.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.899+0000 7f1238e00640 1 -- 172.21.15.153:0/367126305 wait complete. 2024-03-29T04:29:06.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.901+0000 7f1238e00640 1 Processor -- start 2024-03-29T04:29:06.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.901+0000 7f1238e00640 1 -- start start 2024-03-29T04:29:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.902+0000 7f1238e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f123406dbe0 0x7f1234156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.903+0000 7f1238e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12340712c0 0x7f12340b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.903+0000 7f1238e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12341626a0 0x7f12340af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.903+0000 7f1238e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f123406e070 con 0x7f12340712c0 2024-03-29T04:29:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.903+0000 7f1238e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f123406e440 con 0x7f123406dbe0 2024-03-29T04:29:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.903+0000 7f1238e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f123406e1f0 con 0x7f12341626a0 2024-03-29T04:29:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.903+0000 7f1231e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f123406dbe0 0x7f1234156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.903+0000 7f1231e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f123406dbe0 0x7f1234156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:35776/0 (socket says 172.21.15.153:35776) 2024-03-29T04:29:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.903+0000 7f1231e00640 1 -- 172.21.15.153:0/3573710213 learned_addr learned my addr 172.21.15.153:0/3573710213 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.903+0000 7f1231400640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12340712c0 0x7f12340b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.903+0000 7f1232800640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12341626a0 0x7f12340af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.904+0000 7f1232800640 1 -- 172.21.15.153:0/3573710213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f123406dbe0 msgr2=0x7f1234156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.904+0000 7f1232800640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f123406dbe0 0x7f1234156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.904+0000 7f1232800640 1 -- 172.21.15.153:0/3573710213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12340712c0 msgr2=0x7f12340b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.904+0000 7f1232800640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12340712c0 0x7f12340b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.904+0000 7f1232800640 1 -- 172.21.15.153:0/3573710213 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12340ae5f0 con 0x7f12341626a0 2024-03-29T04:29:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.904+0000 7f1231400640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12340712c0 0x7f12340b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:29:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.904+0000 7f1231e00640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f123406dbe0 0x7f1234156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:29:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.904+0000 7f1232800640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12341626a0 0x7f12340af6b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f122c00eed0 tx=0x7f122c00b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.905+0000 7f122a000640 1 -- 172.21.15.153:0/3573710213 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c018030 con 0x7f12341626a0 2024-03-29T04:29:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.905+0000 7f122a000640 1 -- 172.21.15.153:0/3573710213 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f122c00bd20 con 0x7f12341626a0 2024-03-29T04:29:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.905+0000 7f122a000640 1 -- 172.21.15.153:0/3573710213 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c003bb0 con 0x7f12341626a0 2024-03-29T04:29:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.905+0000 7f1238e00640 1 -- 172.21.15.153:0/3573710213 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12340ae8d0 con 0x7f12341626a0 2024-03-29T04:29:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.905+0000 7f1238e00640 1 -- 172.21.15.153:0/3573710213 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f12340aee90 con 0x7f12341626a0 2024-03-29T04:29:06.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.907+0000 7f1238e00640 1 -- 172.21.15.153:0/3573710213 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1234068ff0 con 0x7f12341626a0 2024-03-29T04:29:06.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.909+0000 7f122a000640 1 -- 172.21.15.153:0/3573710213 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f122c01b070 con 0x7f12341626a0 2024-03-29T04:29:06.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.910+0000 7f122a000640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f121406b4d0 0x7f121406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:06.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.910+0000 7f122a000640 1 -- 172.21.15.153:0/3573710213 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f122c08a6b0 con 0x7f12341626a0 2024-03-29T04:29:06.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.911+0000 7f1231e00640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f121406b4d0 0x7f121406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:06.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.912+0000 7f1231e00640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f121406b4d0 0x7f121406d990 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f122402b960 tx=0x7f122403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:06.914+0000 7f122a000640 1 -- 172.21.15.153:0/3573710213 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f122c059490 con 0x7f12341626a0 2024-03-29T04:29:07.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.226+0000 7f1238e00640 1 -- 172.21.15.153:0/3573710213 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1234165e70 con 0x7f12341626a0 2024-03-29T04:29:07.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.227+0000 7f122a000640 1 -- 172.21.15.153:0/3573710213 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) ==== 104+0+11 (secure 0 0 0) 0x7f122c058d90 con 0x7f12341626a0 2024-03-29T04:29:07.204 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-03-29T04:29:07.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.229+0000 7f1238e00640 1 -- 172.21.15.153:0/3573710213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f121406b4d0 msgr2=0x7f121406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:07.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.229+0000 7f1238e00640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f121406b4d0 0x7f121406d990 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f122402b960 tx=0x7f122403c040 comp rx=0 tx=0).stop 2024-03-29T04:29:07.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.229+0000 7f1238e00640 1 -- 172.21.15.153:0/3573710213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12341626a0 msgr2=0x7f12340af6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:07.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.229+0000 7f1238e00640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12341626a0 0x7f12340af6b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f122c00eed0 tx=0x7f122c00b480 comp rx=0 tx=0).stop 2024-03-29T04:29:07.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.230+0000 7f1238e00640 1 -- 172.21.15.153:0/3573710213 shutdown_connections 2024-03-29T04:29:07.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.230+0000 7f1238e00640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f121406b4d0 0x7f121406d990 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:07.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.230+0000 7f1238e00640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12341626a0 0x7f12340af6b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:07.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.230+0000 7f1238e00640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12340712c0 0x7f12340b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:07.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.230+0000 7f1238e00640 1 --2- 172.21.15.153:0/3573710213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f123406dbe0 0x7f1234156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:07.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.230+0000 7f1238e00640 1 -- 172.21.15.153:0/3573710213 >> 172.21.15.153:0/3573710213 conn(0x7f12340b19a0 msgr2=0x7f12340b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:07.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.230+0000 7f1238e00640 1 -- 172.21.15.153:0/3573710213 shutdown_connections 2024-03-29T04:29:07.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.230+0000 7f1238e00640 1 -- 172.21.15.153:0/3573710213 wait complete. 2024-03-29T04:29:07.233 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:29:07.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.500+0000 7f7aa1a00640 1 Processor -- start 2024-03-29T04:29:07.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.501+0000 7f7aa1a00640 1 -- start start 2024-03-29T04:29:07.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.502+0000 7f7aa1a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7a9c06ddb0 0x7f7a9c16d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:07.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.502+0000 7f7aa1a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c0ace20 con 0x7f7a9c071490 2024-03-29T04:29:07.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.502+0000 7f7aa1a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c0ad100 con 0x7f7a9c1626a0 2024-03-29T04:29:07.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.502+0000 7f7aa1a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7a9c06e200 con 0x7f7a9c06ddb0 2024-03-29T04:29:07.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.502+0000 7f7a9a000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7a9c071490 0x7f7a9c06d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:52546/0 (socket says 172.21.15.153:52546) 2024-03-29T04:29:07.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.502+0000 7f7a9a000640 1 -- 172.21.15.153:0/3931547404 learned_addr learned my addr 172.21.15.153:0/3931547404 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:07.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.503+0000 7f7a9b400640 1 --2- 172.21.15.153:0/3931547404 >> v2:172.21.15.165:3300/0 conn(0x7f7a9c06ddb0 0x7f7a9c16d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:07.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.504+0000 7f7a9b400640 1 -- 172.21.15.153:0/3931547404 >> v1:172.21.15.165:6789/0 conn(0x7f7a9c1626a0 legacy=0x7f7a9c070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:07.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.504+0000 7f7a9b400640 1 -- 172.21.15.153:0/3931547404 >> v1:172.21.15.153:6789/0 conn(0x7f7a9c071490 legacy=0x7f7a9c06d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:07.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.504+0000 7f7a9b400640 1 -- 172.21.15.153:0/3931547404 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c0ad3e0 con 0x7f7a9c06ddb0 2024-03-29T04:29:07.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.505+0000 7f7a9b400640 1 --2- 172.21.15.153:0/3931547404 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a9c06ddb0 0x7f7a9c16d490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a94009d90 tx=0x7f7a9402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ee49e83eb35ccaf server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:07.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.506+0000 7f7a99600640 1 -- 172.21.15.153:0/3931547404 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a94039070 con 0x7f7a9c06ddb0 2024-03-29T04:29:07.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.507+0000 7f7a99600640 1 -- 172.21.15.153:0/3931547404 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a9402cd00 con 0x7f7a9c06ddb0 2024-03-29T04:29:07.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.507+0000 7f7a99600640 1 -- 172.21.15.153:0/3931547404 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a94034660 con 0x7f7a9c06ddb0 2024-03-29T04:29:07.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.508+0000 7f7aa1a00640 1 -- 172.21.15.153:0/3931547404 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a9c06ddb0 msgr2=0x7f7a9c16d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:07.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.508+0000 7f7aa1a00640 1 --2- 172.21.15.153:0/3931547404 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a9c06ddb0 0x7f7a9c16d490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a94009d90 tx=0x7f7a9402bf50 comp rx=0 tx=0).stop 2024-03-29T04:29:07.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.508+0000 7f7aa1a00640 1 -- 172.21.15.153:0/3931547404 shutdown_connections 2024-03-29T04:29:07.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.508+0000 7f7aa1a00640 1 --2- 172.21.15.153:0/3931547404 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a9c06ddb0 0x7f7a9c16d490 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:07.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.508+0000 7f7aa1a00640 1 -- 172.21.15.153:0/3931547404 >> 172.21.15.153:0/3931547404 conn(0x7f7a9c0b19a0 msgr2=0x7f7a9c0b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:07.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.508+0000 7f7aa1a00640 1 -- 172.21.15.153:0/3931547404 shutdown_connections 2024-03-29T04:29:07.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.509+0000 7f7aa1a00640 1 -- 172.21.15.153:0/3931547404 wait complete. 2024-03-29T04:29:07.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.511+0000 7f7aa1a00640 1 Processor -- start 2024-03-29T04:29:07.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.511+0000 7f7aa1a00640 1 -- start start 2024-03-29T04:29:07.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.512+0000 7f7aa1a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a9c06ddb0 0x7f7a9c15d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:07.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.512+0000 7f7aa1a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a9c071490 0x7f7a9c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:07.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.513+0000 7f7aa1a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a9c1626a0 0x7f7a9c0b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:07.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.513+0000 7f7aa1a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c0aebf0 con 0x7f7a9c071490 2024-03-29T04:29:07.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.513+0000 7f7aa1a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c0ad750 con 0x7f7a9c06ddb0 2024-03-29T04:29:07.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.513+0000 7f7aa1a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7a9c0aed70 con 0x7f7a9c1626a0 2024-03-29T04:29:07.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.513+0000 7f7a9b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a9c1626a0 0x7f7a9c0b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:07.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.513+0000 7f7a9b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a9c1626a0 0x7f7a9c0b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:33540/0 (socket says 172.21.15.153:33540) 2024-03-29T04:29:07.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.513+0000 7f7a9b400640 1 -- 172.21.15.153:0/4036461574 learned_addr learned my addr 172.21.15.153:0/4036461574 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:07.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.513+0000 7f7a9a000640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a9c071490 0x7f7a9c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:07.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.513+0000 7f7a9aa00640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a9c06ddb0 0x7f7a9c15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:07.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.514+0000 7f7a9b400640 1 -- 172.21.15.153:0/4036461574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a9c06ddb0 msgr2=0x7f7a9c15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:07.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.514+0000 7f7a9b400640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a9c06ddb0 0x7f7a9c15d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:07.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.514+0000 7f7a9b400640 1 -- 172.21.15.153:0/4036461574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a9c071490 msgr2=0x7f7a9c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:07.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.514+0000 7f7a9b400640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a9c071490 0x7f7a9c09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:07.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.514+0000 7f7a9b400640 1 -- 172.21.15.153:0/4036461574 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c1ed0a0 con 0x7f7a9c1626a0 2024-03-29T04:29:07.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.514+0000 7f7a9a000640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a9c071490 0x7f7a9c09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:29:07.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.515+0000 7f7a9b400640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a9c1626a0 0x7f7a9c0b0400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7a94009eb0 tx=0x7f7a94004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:07.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.516+0000 7f7a92a00640 1 -- 172.21.15.153:0/4036461574 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a94039050 con 0x7f7a9c1626a0 2024-03-29T04:29:07.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.516+0000 7f7a92a00640 1 -- 172.21.15.153:0/4036461574 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a94045070 con 0x7f7a9c1626a0 2024-03-29T04:29:07.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.516+0000 7f7aa1a00640 1 -- 172.21.15.153:0/4036461574 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9c1ed380 con 0x7f7a9c1626a0 2024-03-29T04:29:07.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.516+0000 7f7a92a00640 1 -- 172.21.15.153:0/4036461574 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9403e830 con 0x7f7a9c1626a0 2024-03-29T04:29:07.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.516+0000 7f7aa1a00640 1 -- 172.21.15.153:0/4036461574 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9c1ed940 con 0x7f7a9c1626a0 2024-03-29T04:29:07.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.519+0000 7f7aa1a00640 1 -- 172.21.15.153:0/4036461574 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a9c068ff0 con 0x7f7a9c1626a0 2024-03-29T04:29:07.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.522+0000 7f7a92a00640 1 -- 172.21.15.153:0/4036461574 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f7a9403e9d0 con 0x7f7a9c1626a0 2024-03-29T04:29:07.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.524+0000 7f7a92a00640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7a7c06b5a0 0x7f7a7c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:07.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.524+0000 7f7a92a00640 1 -- 172.21.15.153:0/4036461574 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f7a940ad020 con 0x7f7a9c1626a0 2024-03-29T04:29:07.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.525+0000 7f7a9aa00640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7a7c06b5a0 0x7f7a7c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:07.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.526+0000 7f7a9aa00640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7a7c06b5a0 0x7f7a7c06da60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c007fd0 tx=0x7f7a8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:07.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.533+0000 7f7a92a00640 1 -- 172.21.15.153:0/4036461574 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7a9407bfa0 con 0x7f7a9c1626a0 2024-03-29T04:29:07.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.869+0000 7f7aa1a00640 1 -- 172.21.15.153:0/4036461574 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7a9c06e710 con 0x7f7a9c1626a0 2024-03-29T04:29:07.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.870+0000 7f7a92a00640 1 -- 172.21.15.153:0/4036461574 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) ==== 100+0+11 (secure 0 0 0) 0x7f7a9407b8a0 con 0x7f7a9c1626a0 2024-03-29T04:29:07.846 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-03-29T04:29:07.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.873+0000 7f7aa1a00640 1 -- 172.21.15.153:0/4036461574 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7a7c06b5a0 msgr2=0x7f7a7c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:07.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.873+0000 7f7aa1a00640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7a7c06b5a0 0x7f7a7c06da60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c007fd0 tx=0x7f7a8c009040 comp rx=0 tx=0).stop 2024-03-29T04:29:07.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.873+0000 7f7aa1a00640 1 -- 172.21.15.153:0/4036461574 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a9c1626a0 msgr2=0x7f7a9c0b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:07.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.873+0000 7f7aa1a00640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a9c1626a0 0x7f7a9c0b0400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7a94009eb0 tx=0x7f7a94004a40 comp rx=0 tx=0).stop 2024-03-29T04:29:07.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.873+0000 7f7aa1a00640 1 -- 172.21.15.153:0/4036461574 shutdown_connections 2024-03-29T04:29:07.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.873+0000 7f7aa1a00640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7a7c06b5a0 0x7f7a7c06da60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:07.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.873+0000 7f7aa1a00640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a9c1626a0 0x7f7a9c0b0400 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:07.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.873+0000 7f7aa1a00640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a9c071490 0x7f7a9c09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:07.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.873+0000 7f7aa1a00640 1 --2- 172.21.15.153:0/4036461574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a9c06ddb0 0x7f7a9c15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:07.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.873+0000 7f7aa1a00640 1 -- 172.21.15.153:0/4036461574 >> 172.21.15.153:0/4036461574 conn(0x7f7a9c0b19a0 msgr2=0x7f7a9c0b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:07.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.873+0000 7f7aa1a00640 1 -- 172.21.15.153:0/4036461574 shutdown_connections 2024-03-29T04:29:07.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:07.873+0000 7f7aa1a00640 1 -- 172.21.15.153:0/4036461574 wait complete. 2024-03-29T04:29:07.871 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-29T04:29:08.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.141+0000 7fe178000640 1 Processor -- start 2024-03-29T04:29:08.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.141+0000 7fe178000640 1 -- start start 2024-03-29T04:29:08.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.143+0000 7fe178000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1700cd0b0 0x7fe1700c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:08.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.143+0000 7fe178000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe17006b880 0x7fe170157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:08.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.143+0000 7fe178000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17015eab0 con 0x7fe1700cb360 2024-03-29T04:29:08.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.143+0000 7fe178000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe17015ed90 con 0x7fe17006b880 2024-03-29T04:29:08.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.143+0000 7fe178000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe17015f070 con 0x7fe1700cd0b0 2024-03-29T04:29:08.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.144+0000 7fe174c00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe1700cb360 0x7fe17006b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:52552/0 (socket says 172.21.15.153:52552) 2024-03-29T04:29:08.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.144+0000 7fe174c00640 1 -- 172.21.15.153:0/2501015104 learned_addr learned my addr 172.21.15.153:0/2501015104 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:08.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.144+0000 7fe176000640 1 --2- 172.21.15.153:0/2501015104 >> v2:172.21.15.165:3300/0 conn(0x7fe17006b880 0x7fe170157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:08.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.144+0000 7fe175600640 1 --2- 172.21.15.153:0/2501015104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1700cd0b0 0x7fe1700c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:08.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.144+0000 7fe16fe00640 1 -- 172.21.15.153:0/2501015104 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2101026071 0 0) 0x7fe17015eab0 con 0x7fe1700cb360 2024-03-29T04:29:08.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.144+0000 7fe16fe00640 1 -- 172.21.15.153:0/2501015104 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe158003520 con 0x7fe1700cb360 2024-03-29T04:29:08.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe16fe00640 1 -- 172.21.15.153:0/2501015104 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3251667118 0 0) 0x7fe158003520 con 0x7fe1700cb360 2024-03-29T04:29:08.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe16fe00640 1 -- 172.21.15.153:0/2501015104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1700cd0b0 msgr2=0x7fe1700c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:08.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe16fe00640 1 --2- 172.21.15.153:0/2501015104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1700cd0b0 0x7fe1700c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:08.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe16fe00640 1 -- 172.21.15.153:0/2501015104 >> v2:172.21.15.165:3300/0 conn(0x7fe17006b880 msgr2=0x7fe170157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:08.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe16fe00640 1 --2- 172.21.15.153:0/2501015104 >> v2:172.21.15.165:3300/0 conn(0x7fe17006b880 0x7fe170157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:08.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe16fe00640 1 -- 172.21.15.153:0/2501015104 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17015f350 con 0x7fe1700cb360 2024-03-29T04:29:08.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe16fe00640 1 -- 172.21.15.153:0/2501015104 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fe15c001670 con 0x7fe1700cb360 2024-03-29T04:29:08.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe16fe00640 1 -- 172.21.15.153:0/2501015104 >> v1:172.21.15.153:6789/0 conn(0x7fe1700cb360 legacy=0x7fe17006b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:08.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe16fe00640 1 --2- 172.21.15.153:0/2501015104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1580039b0 0x7fe158003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:08.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe16fe00640 1 --2- 172.21.15.153:0/2501015104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe158004800 0x7fe158004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:08.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe16fe00640 1 --2- 172.21.15.153:0/2501015104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1580051c0 0x7fe15800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:08.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe16fe00640 1 -- 172.21.15.153:0/2501015104 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe17015ed90 con 0x7fe158004800 2024-03-29T04:29:08.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe16fe00640 1 -- 172.21.15.153:0/2501015104 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe17015f070 con 0x7fe1580039b0 2024-03-29T04:29:08.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe16fe00640 1 -- 172.21.15.153:0/2501015104 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe15800bf00 con 0x7fe1580051c0 2024-03-29T04:29:08.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.145+0000 7fe176000640 1 --2- 172.21.15.153:0/2501015104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1580051c0 0x7fe15800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:08.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.146+0000 7fe175600640 1 --2- 172.21.15.153:0/2501015104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1580039b0 0x7fe158003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:08.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.146+0000 7fe174c00640 1 --2- 172.21.15.153:0/2501015104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe158004800 0x7fe158004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:08.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.146+0000 7fe176000640 1 -- 172.21.15.153:0/2501015104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1580039b0 msgr2=0x7fe158003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:08.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.146+0000 7fe176000640 1 --2- 172.21.15.153:0/2501015104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1580039b0 0x7fe158003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:08.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.146+0000 7fe176000640 1 -- 172.21.15.153:0/2501015104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe158004800 msgr2=0x7fe158004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:08.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.146+0000 7fe176000640 1 --2- 172.21.15.153:0/2501015104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe158004800 0x7fe158004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:08.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.146+0000 7fe176000640 1 -- 172.21.15.153:0/2501015104 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17015f350 con 0x7fe1580051c0 2024-03-29T04:29:08.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.146+0000 7fe175600640 1 --2- 172.21.15.153:0/2501015104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1580039b0 0x7fe158003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:08.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.146+0000 7fe174c00640 1 --2- 172.21.15.153:0/2501015104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe158004800 0x7fe158004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:29:08.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.148+0000 7fe176000640 1 --2- 172.21.15.153:0/2501015104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1580051c0 0x7fe15800b9c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe1700b6f00 tx=0x7fe158005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=454626346bd53655 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:08.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.148+0000 7fe16fe00640 1 -- 172.21.15.153:0/2501015104 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168039070 con 0x7fe1580051c0 2024-03-29T04:29:08.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.148+0000 7fe16fe00640 1 -- 172.21.15.153:0/2501015104 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16802cbd0 con 0x7fe1580051c0 2024-03-29T04:29:08.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.148+0000 7fe16fe00640 1 -- 172.21.15.153:0/2501015104 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168009c10 con 0x7fe1580051c0 2024-03-29T04:29:08.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.149+0000 7fe178000640 1 -- 172.21.15.153:0/2501015104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1580051c0 msgr2=0x7fe15800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:08.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.149+0000 7fe178000640 1 --2- 172.21.15.153:0/2501015104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1580051c0 0x7fe15800b9c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe1700b6f00 tx=0x7fe158005830 comp rx=0 tx=0).stop 2024-03-29T04:29:08.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.149+0000 7fe176000640 1 -- 172.21.15.153:0/2501015104 reap_dead start 2024-03-29T04:29:08.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.151+0000 7fe178000640 1 -- 172.21.15.153:0/2501015104 shutdown_connections 2024-03-29T04:29:08.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.151+0000 7fe178000640 1 -- 172.21.15.153:0/2501015104 >> 172.21.15.153:0/2501015104 conn(0x7fe1700cd790 msgr2=0x7fe1700cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:08.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.152+0000 7fe178000640 1 -- 172.21.15.153:0/2501015104 shutdown_connections 2024-03-29T04:29:08.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.152+0000 7fe178000640 1 -- 172.21.15.153:0/2501015104 wait complete. 2024-03-29T04:29:08.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.154+0000 7fe178000640 1 Processor -- start 2024-03-29T04:29:08.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.155+0000 7fe178000640 1 -- start start 2024-03-29T04:29:08.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.156+0000 7fe178000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1580051c0 0x7fe17014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:08.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.156+0000 7fe178000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1700b6400 0x7fe1700aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:08.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.156+0000 7fe178000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1700af410 0x7fe1700b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:08.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.156+0000 7fe178000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe170158670 con 0x7fe1700af410 2024-03-29T04:29:08.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.156+0000 7fe178000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe1701584f0 con 0x7fe1700b6400 2024-03-29T04:29:08.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.156+0000 7fe178000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe1701587f0 con 0x7fe1580051c0 2024-03-29T04:29:08.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.156+0000 7fe175600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1580051c0 0x7fe17014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:08.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.156+0000 7fe175600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1580051c0 0x7fe17014e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:33566/0 (socket says 172.21.15.153:33566) 2024-03-29T04:29:08.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.157+0000 7fe175600640 1 -- 172.21.15.153:0/1968193060 learned_addr learned my addr 172.21.15.153:0/1968193060 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:08.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.157+0000 7fe174c00640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1700b6400 0x7fe1700aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:08.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.157+0000 7fe176000640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1700af410 0x7fe1700b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:08.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.157+0000 7fe175600640 1 -- 172.21.15.153:0/1968193060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1700b6400 msgr2=0x7fe1700aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:08.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.157+0000 7fe175600640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1700b6400 0x7fe1700aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:08.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.157+0000 7fe175600640 1 -- 172.21.15.153:0/1968193060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1700af410 msgr2=0x7fe1700b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:08.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.157+0000 7fe175600640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1700af410 0x7fe1700b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:08.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.157+0000 7fe175600640 1 -- 172.21.15.153:0/1968193060 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1700c8030 con 0x7fe1580051c0 2024-03-29T04:29:08.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.158+0000 7fe176000640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1700af410 0x7fe1700b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:29:08.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.158+0000 7fe175600640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1580051c0 0x7fe17014e6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe1640107f0 tx=0x7fe164010cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:08.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.159+0000 7fe16d600640 1 -- 172.21.15.153:0/1968193060 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16400f040 con 0x7fe1580051c0 2024-03-29T04:29:08.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.159+0000 7fe16d600640 1 -- 172.21.15.153:0/1968193060 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16400eb60 con 0x7fe1580051c0 2024-03-29T04:29:08.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.159+0000 7fe16d600640 1 -- 172.21.15.153:0/1968193060 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16401c400 con 0x7fe1580051c0 2024-03-29T04:29:08.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.159+0000 7fe178000640 1 -- 172.21.15.153:0/1968193060 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1700c8310 con 0x7fe1580051c0 2024-03-29T04:29:08.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.159+0000 7fe178000640 1 -- 172.21.15.153:0/1968193060 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe170157b60 con 0x7fe1580051c0 2024-03-29T04:29:08.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.161+0000 7fe178000640 1 -- 172.21.15.153:0/1968193060 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1700cd5b0 con 0x7fe1580051c0 2024-03-29T04:29:08.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.168+0000 7fe16d600640 1 -- 172.21.15.153:0/1968193060 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe164005990 con 0x7fe1580051c0 2024-03-29T04:29:08.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.170+0000 7fe16d600640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe15006b5d0 0x7fe15006da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:08.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.170+0000 7fe16d600640 1 -- 172.21.15.153:0/1968193060 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fe16408a7f0 con 0x7fe1580051c0 2024-03-29T04:29:08.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.171+0000 7fe16d600640 1 -- 172.21.15.153:0/1968193060 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe1700cd5b0 con 0x7fe1580051c0 2024-03-29T04:29:08.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.171+0000 7fe174c00640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe15006b5d0 0x7fe15006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:08.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.174+0000 7fe174c00640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe15006b5d0 0x7fe15006da90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe17015e540 tx=0x7fe15c000f50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:08.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.512+0000 7fe178000640 1 -- 172.21.15.153:0/1968193060 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe1700cc930 con 0x7fe1580051c0 2024-03-29T04:29:08.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.513+0000 7fe16d600640 1 -- 172.21.15.153:0/1968193060 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) ==== 80+0+0 (secure 0 0 0) 0x7fe1700cc930 con 0x7fe1580051c0 2024-03-29T04:29:08.490 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2024-03-29T04:29:08.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.517+0000 7fe178000640 1 -- 172.21.15.153:0/1968193060 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe15006b5d0 msgr2=0x7fe15006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:08.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.517+0000 7fe178000640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe15006b5d0 0x7fe15006da90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe17015e540 tx=0x7fe15c000f50 comp rx=0 tx=0).stop 2024-03-29T04:29:08.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.517+0000 7fe178000640 1 -- 172.21.15.153:0/1968193060 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1580051c0 msgr2=0x7fe17014e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:08.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.517+0000 7fe178000640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1580051c0 0x7fe17014e6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe1640107f0 tx=0x7fe164010cb0 comp rx=0 tx=0).stop 2024-03-29T04:29:08.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.517+0000 7fe178000640 1 -- 172.21.15.153:0/1968193060 shutdown_connections 2024-03-29T04:29:08.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.517+0000 7fe178000640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe15006b5d0 0x7fe15006da90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:08.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.517+0000 7fe178000640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1700af410 0x7fe1700b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:08.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.517+0000 7fe178000640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1700b6400 0x7fe1700aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:08.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.517+0000 7fe178000640 1 --2- 172.21.15.153:0/1968193060 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1580051c0 0x7fe17014e6d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:08.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.517+0000 7fe178000640 1 -- 172.21.15.153:0/1968193060 >> 172.21.15.153:0/1968193060 conn(0x7fe1700cd790 msgr2=0x7fe170071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:08.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.517+0000 7fe178000640 1 -- 172.21.15.153:0/1968193060 shutdown_connections 2024-03-29T04:29:08.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:08.517+0000 7fe178000640 1 -- 172.21.15.153:0/1968193060 wait complete. 2024-03-29T04:29:08.524 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-29T04:29:08.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:29:08.524 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-29T04:29:08.639 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-03-29T04:29:08.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:29:08.639 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-29T04:29:08.709 INFO:tasks.cephfs.mount:Terminating background process 2024-03-29T04:29:08.709 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-29T04:29:08.709 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:29:08.768 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053430,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249180k,nr_inodes=812295,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-29T04:29:08.768 INFO:tasks.cephfs.mount:Terminating background process 2024-03-29T04:29:08.768 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-29T04:29:08.768 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:29:08.819 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053430,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249180k,nr_inodes=812295,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-29T04:29:08.819 INFO:tasks.cephfs.mount:Terminating background process 2024-03-29T04:29:08.820 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-29T04:29:08.820 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:29:08.867 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053430,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249180k,nr_inodes=812295,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-29T04:29:08.867 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:29:09.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.147+0000 7f6101a00640 1 Processor -- start 2024-03-29T04:29:09.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.148+0000 7f6101a00640 1 -- start start 2024-03-29T04:29:09.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.149+0000 7f6101a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f60fc15e2b0 0x7f60fc0b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:09.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.150+0000 7f6101a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60fc0b4830 0x7f60fc0ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:09.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.150+0000 7f6101a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60fc15e690 con 0x7f60fc0add40 2024-03-29T04:29:09.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.150+0000 7f6101a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f60fc0b4070 con 0x7f60fc15e2b0 2024-03-29T04:29:09.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.150+0000 7f6101a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f60fc071090 con 0x7f60fc0b4830 2024-03-29T04:29:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.150+0000 7f60faa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f60fc15e2b0 0x7f60fc0b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.150+0000 7f60fb400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f60fc0add40 0x7f60fc0b2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:52558/0 (socket says 172.21.15.153:52558) 2024-03-29T04:29:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.150+0000 7f60fb400640 1 -- 172.21.15.153:0/479798117 learned_addr learned my addr 172.21.15.153:0/479798117 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.151+0000 7f60fa000640 1 --2- 172.21.15.153:0/479798117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60fc0b4830 0x7f60fc0ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.151+0000 7f60faa00640 1 -- 172.21.15.153:0/479798117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60fc0b4830 msgr2=0x7f60fc0ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.151+0000 7f60faa00640 1 --2- 172.21.15.153:0/479798117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60fc0b4830 0x7f60fc0ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.151+0000 7f60faa00640 1 -- 172.21.15.153:0/479798117 >> v1:172.21.15.153:6789/0 conn(0x7f60fc0add40 legacy=0x7f60fc0b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.151+0000 7f60faa00640 1 -- 172.21.15.153:0/479798117 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60fc0ae530 con 0x7f60fc15e2b0 2024-03-29T04:29:09.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.153+0000 7f60faa00640 1 --2- 172.21.15.153:0/479798117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60fc15e2b0 0x7f60fc0b42f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0097a0 tx=0x7f60ec02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15b5fe08e79a6186 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:09.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.153+0000 7f60f9600640 1 -- 172.21.15.153:0/479798117 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec035020 con 0x7f60fc15e2b0 2024-03-29T04:29:09.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.154+0000 7f60f9600640 1 -- 172.21.15.153:0/479798117 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ec031830 con 0x7f60fc15e2b0 2024-03-29T04:29:09.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.155+0000 7f60f9600640 1 -- 172.21.15.153:0/479798117 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec031c40 con 0x7f60fc15e2b0 2024-03-29T04:29:09.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.155+0000 7f6101a00640 1 -- 172.21.15.153:0/479798117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60fc15e2b0 msgr2=0x7f60fc0b42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:09.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.155+0000 7f6101a00640 1 --2- 172.21.15.153:0/479798117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60fc15e2b0 0x7f60fc0b42f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0097a0 tx=0x7f60ec02b8d0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.156+0000 7f6101a00640 1 -- 172.21.15.153:0/479798117 shutdown_connections 2024-03-29T04:29:09.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.156+0000 7f6101a00640 1 --2- 172.21.15.153:0/479798117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60fc0b4830 0x7f60fc0ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.156+0000 7f6101a00640 1 --2- 172.21.15.153:0/479798117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60fc15e2b0 0x7f60fc0b42f0 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0097a0 tx=0x7f60ec02b8d0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.156+0000 7f6101a00640 1 -- 172.21.15.153:0/479798117 >> 172.21.15.153:0/479798117 conn(0x7f60fc0b1a30 msgr2=0x7f60fc0b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:09.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.158+0000 7f6101a00640 1 -- 172.21.15.153:0/479798117 shutdown_connections 2024-03-29T04:29:09.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.158+0000 7f6101a00640 1 -- 172.21.15.153:0/479798117 wait complete. 2024-03-29T04:29:09.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.161+0000 7f6101a00640 1 Processor -- start 2024-03-29T04:29:09.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.161+0000 7f6101a00640 1 -- start start 2024-03-29T04:29:09.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.162+0000 7f6101a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60fc0add40 0x7f60fc160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:09.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.162+0000 7f6101a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60fc0b4830 0x7f60fc09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:09.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.162+0000 7f6101a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60fc09af90 0x7f60fc14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:09.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.162+0000 7f6101a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc0aeaf0 con 0x7f60fc09af90 2024-03-29T04:29:09.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.162+0000 7f6101a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc0aedd0 con 0x7f60fc0add40 2024-03-29T04:29:09.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.162+0000 7f6101a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f60fc0ae190 con 0x7f60fc0b4830 2024-03-29T04:29:09.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.162+0000 7f60fb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60fc09af90 0x7f60fc14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:09.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.163+0000 7f60fb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60fc09af90 0x7f60fc14ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60370/0 (socket says 172.21.15.153:60370) 2024-03-29T04:29:09.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.163+0000 7f60fb400640 1 -- 172.21.15.153:0/4212259255 learned_addr learned my addr 172.21.15.153:0/4212259255 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:09.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.163+0000 7f60fa000640 1 --2- 172.21.15.153:0/4212259255 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60fc0b4830 0x7f60fc09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:09.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.163+0000 7f60faa00640 1 --2- 172.21.15.153:0/4212259255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60fc0add40 0x7f60fc160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:09.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.163+0000 7f60fb400640 1 -- 172.21.15.153:0/4212259255 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60fc0b4830 msgr2=0x7f60fc09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:09.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.163+0000 7f60fb400640 1 --2- 172.21.15.153:0/4212259255 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60fc0b4830 0x7f60fc09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.163+0000 7f60fb400640 1 -- 172.21.15.153:0/4212259255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60fc0add40 msgr2=0x7f60fc160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:09.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.163+0000 7f60fb400640 1 --2- 172.21.15.153:0/4212259255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60fc0add40 0x7f60fc160af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.163+0000 7f60fb400640 1 -- 172.21.15.153:0/4212259255 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60fc15fa50 con 0x7f60fc09af90 2024-03-29T04:29:09.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.163+0000 7f60fb400640 1 --2- 172.21.15.153:0/4212259255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60fc09af90 0x7f60fc14ae90 secure :-1 s=READY pgs=3346 cs=0 l=1 rev1=1 crypto rx=0x7f60e800c3c0 tx=0x7f60e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:09.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.164+0000 7f60f2a00640 1 -- 172.21.15.153:0/4212259255 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e8017070 con 0x7f60fc09af90 2024-03-29T04:29:09.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.164+0000 7f60f2a00640 1 -- 172.21.15.153:0/4212259255 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e8005ce0 con 0x7f60fc09af90 2024-03-29T04:29:09.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.164+0000 7f60f2a00640 1 -- 172.21.15.153:0/4212259255 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e80072f0 con 0x7f60fc09af90 2024-03-29T04:29:09.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.164+0000 7f6101a00640 1 -- 172.21.15.153:0/4212259255 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60fc15fd30 con 0x7f60fc09af90 2024-03-29T04:29:09.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.164+0000 7f6101a00640 1 -- 172.21.15.153:0/4212259255 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60fc1602f0 con 0x7f60fc09af90 2024-03-29T04:29:09.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.166+0000 7f6101a00640 1 -- 172.21.15.153:0/4212259255 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60fc068ff0 con 0x7f60fc09af90 2024-03-29T04:29:09.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.167+0000 7f60f2a00640 1 -- 172.21.15.153:0/4212259255 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f60e801a070 con 0x7f60fc09af90 2024-03-29T04:29:09.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.169+0000 7f60f2a00640 1 --2- 172.21.15.153:0/4212259255 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f60dc06b520 0x7f60dc06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:09.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.169+0000 7f60f2a00640 1 -- 172.21.15.153:0/4212259255 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f60e80897d0 con 0x7f60fc09af90 2024-03-29T04:29:09.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.169+0000 7f60faa00640 1 --2- 172.21.15.153:0/4212259255 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f60dc06b520 0x7f60dc06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:09.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.170+0000 7f60faa00640 1 --2- 172.21.15.153:0/4212259255 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f60dc06b520 0x7f60dc06d9e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f60ec036000 tx=0x7f60ec008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:09.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.177+0000 7f60f2a00640 1 -- 172.21.15.153:0/4212259255 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f60e8021020 con 0x7f60fc09af90 2024-03-29T04:29:09.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.537+0000 7f6101a00640 1 -- 172.21.15.153:0/4212259255 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60fc0af700 con 0x7f60fc09af90 2024-03-29T04:29:09.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.549+0000 7f60f2a00640 1 -- 172.21.15.153:0/4212259255 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5190 (secure 0 0 0) 0x7f60e8058170 con 0x7f60fc09af90 2024-03-29T04:29:09.527 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:09.527 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3849778471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3849778471},{"type":"v1","addr":"172.21.15.165:6835","nonce":3849778471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/2718440878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2718440878},{"type":"v1","addr":"172.21.15.165:6833","nonce":2718440878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/974086107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":974086107},{"type":"v1","addr":"172.21.15.153:6836","nonce":974086107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T21:53:09.040388+0000","modified":"2024-03-28T21:53:12.151355+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6837/1209499946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1209499946},{"type":"v1","addr":"172.21.15.153:6837","nonce":1209499946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5070,"qdb_cluster":[5070]},"id":2}]} 2024-03-29T04:29:09.527 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 17 2024-03-29T04:29:09.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.554+0000 7f6101a00640 1 -- 172.21.15.153:0/4212259255 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f60dc06b520 msgr2=0x7f60dc06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:09.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.554+0000 7f6101a00640 1 --2- 172.21.15.153:0/4212259255 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f60dc06b520 0x7f60dc06d9e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f60ec036000 tx=0x7f60ec008030 comp rx=0 tx=0).stop 2024-03-29T04:29:09.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.554+0000 7f6101a00640 1 -- 172.21.15.153:0/4212259255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60fc09af90 msgr2=0x7f60fc14ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:09.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.554+0000 7f6101a00640 1 --2- 172.21.15.153:0/4212259255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60fc09af90 0x7f60fc14ae90 secure :-1 s=READY pgs=3346 cs=0 l=1 rev1=1 crypto rx=0x7f60e800c3c0 tx=0x7f60e800c880 comp rx=0 tx=0).stop 2024-03-29T04:29:09.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.554+0000 7f6101a00640 1 -- 172.21.15.153:0/4212259255 shutdown_connections 2024-03-29T04:29:09.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.554+0000 7f6101a00640 1 --2- 172.21.15.153:0/4212259255 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f60dc06b520 0x7f60dc06d9e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.554+0000 7f6101a00640 1 --2- 172.21.15.153:0/4212259255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60fc09af90 0x7f60fc14ae90 unknown :-1 s=CLOSED pgs=3346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.554+0000 7f6101a00640 1 --2- 172.21.15.153:0/4212259255 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60fc0b4830 0x7f60fc09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.554+0000 7f6101a00640 1 --2- 172.21.15.153:0/4212259255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60fc0add40 0x7f60fc160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.554+0000 7f6101a00640 1 -- 172.21.15.153:0/4212259255 >> 172.21.15.153:0/4212259255 conn(0x7f60fc0b1a30 msgr2=0x7f60fc15d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:09.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.554+0000 7f6101a00640 1 -- 172.21.15.153:0/4212259255 shutdown_connections 2024-03-29T04:29:09.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.554+0000 7f6101a00640 1 -- 172.21.15.153:0/4212259255 wait complete. 2024-03-29T04:29:09.554 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:29:09.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.838+0000 7f7c51800640 1 Processor -- start 2024-03-29T04:29:09.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.839+0000 7f7c51800640 1 -- start start 2024-03-29T04:29:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.841+0000 7f7c51800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7c4c15e2b0 0x7f7c4c0b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.841+0000 7f7c51800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c4c15e690 con 0x7f7c4c0b4830 2024-03-29T04:29:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.841+0000 7f7c51800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c4c0ae530 con 0x7f7c4c0adf10 2024-03-29T04:29:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.841+0000 7f7c51800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7c4c0b4070 con 0x7f7c4c15e2b0 2024-03-29T04:29:09.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.841+0000 7f7c4b400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f7c4c0adf10 0x7f7c4c071520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:58154/0 (socket says 172.21.15.153:58154) 2024-03-29T04:29:09.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.841+0000 7f7c4b400640 1 -- 172.21.15.153:0/729485780 learned_addr learned my addr 172.21.15.153:0/729485780 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:09.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4aa00640 1 --2- 172.21.15.153:0/729485780 >> v2:172.21.15.153:3300/0 conn(0x7f7c4c15e2b0 0x7f7c4c0b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:09.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 -- 172.21.15.153:0/729485780 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1821329876 0 0) 0x7f7c4c0ae530 con 0x7f7c4c0adf10 2024-03-29T04:29:09.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 -- 172.21.15.153:0/729485780 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c30003520 con 0x7f7c4c0adf10 2024-03-29T04:29:09.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 -- 172.21.15.153:0/729485780 <== mon.1 v1:172.21.15.165:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3677063456 0 0) 0x7f7c30003520 con 0x7f7c4c0adf10 2024-03-29T04:29:09.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 -- 172.21.15.153:0/729485780 >> v2:172.21.15.153:3300/0 conn(0x7f7c4c15e2b0 msgr2=0x7f7c4c0b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 --2- 172.21.15.153:0/729485780 >> v2:172.21.15.153:3300/0 conn(0x7f7c4c15e2b0 0x7f7c4c0b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 -- 172.21.15.153:0/729485780 >> v1:172.21.15.153:6789/0 conn(0x7f7c4c0b4830 legacy=0x7f7c4c0ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 -- 172.21.15.153:0/729485780 --> v1:172.21.15.165:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c0ae810 con 0x7f7c4c0adf10 2024-03-29T04:29:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 -- 172.21.15.153:0/729485780 <== mon.1 v1:172.21.15.165:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f7c440019f0 con 0x7f7c4c0adf10 2024-03-29T04:29:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 -- 172.21.15.153:0/729485780 >> v1:172.21.15.165:6789/0 conn(0x7f7c4c0adf10 legacy=0x7f7c4c071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 --2- 172.21.15.153:0/729485780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c300039b0 0x7f7c30003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 --2- 172.21.15.153:0/729485780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c30004800 0x7f7c30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 --2- 172.21.15.153:0/729485780 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c300051c0 0x7f7c3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 -- 172.21.15.153:0/729485780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c0b4070 con 0x7f7c300039b0 2024-03-29T04:29:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 -- 172.21.15.153:0/729485780 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3000c040 con 0x7f7c300051c0 2024-03-29T04:29:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.842+0000 7f7c4a000640 1 -- 172.21.15.153:0/729485780 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7c3000c240 con 0x7f7c30004800 2024-03-29T04:29:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.843+0000 7f7c43e00640 1 --2- 172.21.15.153:0/729485780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c30004800 0x7f7c30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:09.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.843+0000 7f7c4aa00640 1 --2- 172.21.15.153:0/729485780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c300039b0 0x7f7c30003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:09.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.843+0000 7f7c4aa00640 1 -- 172.21.15.153:0/729485780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c30004800 msgr2=0x7f7c30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.843+0000 7f7c4aa00640 1 --2- 172.21.15.153:0/729485780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c30004800 0x7f7c30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.843+0000 7f7c4aa00640 1 -- 172.21.15.153:0/729485780 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c300051c0 msgr2=0x7f7c3000b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-29T04:29:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.844+0000 7f7c4aa00640 1 --2- 172.21.15.153:0/729485780 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c300051c0 0x7f7c3000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.844+0000 7f7c4aa00640 1 -- 172.21.15.153:0/729485780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c30003520 con 0x7f7c300039b0 2024-03-29T04:29:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.845+0000 7f7c4aa00640 1 --2- 172.21.15.153:0/729485780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c300039b0 0x7f7c30003db0 secure :-1 s=READY pgs=3347 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009aa0 tx=0x7f7c30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda25dc5c6eef17a server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.846+0000 7f7c4b400640 1 -- 172.21.15.153:0/729485780 reap_dead start 2024-03-29T04:29:09.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.848+0000 7f7c4a000640 1 -- 172.21.15.153:0/729485780 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c039070 con 0x7f7c300039b0 2024-03-29T04:29:09.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.848+0000 7f7c4a000640 1 -- 172.21.15.153:0/729485780 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3c02c710 con 0x7f7c300039b0 2024-03-29T04:29:09.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.849+0000 7f7c51800640 1 -- 172.21.15.153:0/729485780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c300039b0 msgr2=0x7f7c30003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:09.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.849+0000 7f7c51800640 1 --2- 172.21.15.153:0/729485780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c300039b0 0x7f7c30003db0 secure :-1 s=READY pgs=3347 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009aa0 tx=0x7f7c30005830 comp rx=0 tx=0).stop 2024-03-29T04:29:09.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.849+0000 7f7c51800640 1 -- 172.21.15.153:0/729485780 shutdown_connections 2024-03-29T04:29:09.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.849+0000 7f7c51800640 1 --2- 172.21.15.153:0/729485780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c300039b0 0x7f7c30003db0 unknown :-1 s=CLOSED pgs=3347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.849+0000 7f7c51800640 1 -- 172.21.15.153:0/729485780 >> 172.21.15.153:0/729485780 conn(0x7f7c4c0b1a30 msgr2=0x7f7c4c0b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:09.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.849+0000 7f7c51800640 1 -- 172.21.15.153:0/729485780 shutdown_connections 2024-03-29T04:29:09.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.849+0000 7f7c51800640 1 -- 172.21.15.153:0/729485780 wait complete. 2024-03-29T04:29:09.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.852+0000 7f7c51800640 1 Processor -- start 2024-03-29T04:29:09.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.852+0000 7f7c51800640 1 -- start start 2024-03-29T04:29:09.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.854+0000 7f7c51800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c300039b0 0x7f7c4c160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:09.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.855+0000 7f7c51800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c4c161140 0x7f7c4c071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:09.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.855+0000 7f7c51800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c4c071960 0x7f7c4c1fb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:09.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.855+0000 7f7c51800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c0aedd0 con 0x7f7c4c161140 2024-03-29T04:29:09.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.855+0000 7f7c51800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c0b42f0 con 0x7f7c4c071960 2024-03-29T04:29:09.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.855+0000 7f7c51800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4c0b4470 con 0x7f7c300039b0 2024-03-29T04:29:09.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.855+0000 7f7c4aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c300039b0 0x7f7c4c160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:09.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.855+0000 7f7c4aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c300039b0 0x7f7c4c160c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:33590/0 (socket says 172.21.15.153:33590) 2024-03-29T04:29:09.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.855+0000 7f7c4aa00640 1 -- 172.21.15.153:0/71183139 learned_addr learned my addr 172.21.15.153:0/71183139 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:09.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.855+0000 7f7c4b400640 1 --2- 172.21.15.153:0/71183139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c4c071960 0x7f7c4c1fb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:09.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.856+0000 7f7c4aa00640 1 -- 172.21.15.153:0/71183139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c4c071960 msgr2=0x7f7c4c1fb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:09.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.856+0000 7f7c4aa00640 1 --2- 172.21.15.153:0/71183139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c4c071960 0x7f7c4c1fb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.856+0000 7f7c4aa00640 1 -- 172.21.15.153:0/71183139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c4c161140 msgr2=0x7f7c4c071420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-29T04:29:09.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.856+0000 7f7c4aa00640 1 --2- 172.21.15.153:0/71183139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c4c161140 0x7f7c4c071420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:09.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.856+0000 7f7c4aa00640 1 -- 172.21.15.153:0/71183139 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c1607c0 con 0x7f7c300039b0 2024-03-29T04:29:09.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.856+0000 7f7c4aa00640 1 --2- 172.21.15.153:0/71183139 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c300039b0 0x7f7c4c160c00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009b90 tx=0x7f7c3c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:09.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.859+0000 7f7c42a00640 1 -- 172.21.15.153:0/71183139 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c044020 con 0x7f7c300039b0 2024-03-29T04:29:09.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.859+0000 7f7c42a00640 1 -- 172.21.15.153:0/71183139 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3c035ab0 con 0x7f7c300039b0 2024-03-29T04:29:09.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.859+0000 7f7c42a00640 1 -- 172.21.15.153:0/71183139 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c039040 con 0x7f7c300039b0 2024-03-29T04:29:09.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.859+0000 7f7c51800640 1 -- 172.21.15.153:0/71183139 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c09bb40 con 0x7f7c300039b0 2024-03-29T04:29:09.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.859+0000 7f7c51800640 1 -- 172.21.15.153:0/71183139 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c09c100 con 0x7f7c300039b0 2024-03-29T04:29:09.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.861+0000 7f7c51800640 1 -- 172.21.15.153:0/71183139 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4c068ff0 con 0x7f7c300039b0 2024-03-29T04:29:09.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.862+0000 7f7c42a00640 1 -- 172.21.15.153:0/71183139 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f7c3c047020 con 0x7f7c300039b0 2024-03-29T04:29:09.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.863+0000 7f7c42a00640 1 --2- 172.21.15.153:0/71183139 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7c2806b5d0 0x7f7c2806da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:09.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.864+0000 7f7c42a00640 1 -- 172.21.15.153:0/71183139 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f7c3c0ac470 con 0x7f7c300039b0 2024-03-29T04:29:09.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.865+0000 7f7c43e00640 1 --2- 172.21.15.153:0/71183139 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7c2806b5d0 0x7f7c2806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:09.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.867+0000 7f7c43e00640 1 --2- 172.21.15.153:0/71183139 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7c2806b5d0 0x7f7c2806da90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c1588b0 tx=0x7f7c34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:09.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:09.873+0000 7f7c42a00640 1 -- 172.21.15.153:0/71183139 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7c3c04e020 con 0x7f7c300039b0 2024-03-29T04:29:10.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.209+0000 7f7c51800640 1 -- 172.21.15.153:0/71183139 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c4c1609e0 con 0x7f7c300039b0 2024-03-29T04:29:10.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.211+0000 7f7c42a00640 1 -- 172.21.15.153:0/71183139 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16717 (secure 0 0 0) 0x7f7c3c07ae30 con 0x7f7c300039b0 2024-03-29T04:29:10.188 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:10.188 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":35,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:53:10.602850+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:53:06.943079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-28T21:53:08.054176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:29:10.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.214+0000 7f7c51800640 1 -- 172.21.15.153:0/71183139 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7c2806b5d0 msgr2=0x7f7c2806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:10.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.214+0000 7f7c51800640 1 --2- 172.21.15.153:0/71183139 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7c2806b5d0 0x7f7c2806da90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c1588b0 tx=0x7f7c34009040 comp rx=0 tx=0).stop 2024-03-29T04:29:10.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.214+0000 7f7c51800640 1 -- 172.21.15.153:0/71183139 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c300039b0 msgr2=0x7f7c4c160c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:10.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.214+0000 7f7c51800640 1 --2- 172.21.15.153:0/71183139 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c300039b0 0x7f7c4c160c00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009b90 tx=0x7f7c3c004730 comp rx=0 tx=0).stop 2024-03-29T04:29:10.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.215+0000 7f7c51800640 1 -- 172.21.15.153:0/71183139 shutdown_connections 2024-03-29T04:29:10.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.215+0000 7f7c51800640 1 --2- 172.21.15.153:0/71183139 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7c2806b5d0 0x7f7c2806da90 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:10.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.215+0000 7f7c51800640 1 --2- 172.21.15.153:0/71183139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c4c071960 0x7f7c4c1fb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:10.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.215+0000 7f7c51800640 1 --2- 172.21.15.153:0/71183139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c4c161140 0x7f7c4c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:10.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.215+0000 7f7c51800640 1 --2- 172.21.15.153:0/71183139 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c300039b0 0x7f7c4c160c00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:10.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.215+0000 7f7c51800640 1 -- 172.21.15.153:0/71183139 >> 172.21.15.153:0/71183139 conn(0x7f7c4c0b1a30 msgr2=0x7f7c4c0ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:10.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.215+0000 7f7c51800640 1 -- 172.21.15.153:0/71183139 shutdown_connections 2024-03-29T04:29:10.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.215+0000 7f7c51800640 1 -- 172.21.15.153:0/71183139 wait complete. 2024-03-29T04:29:10.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T21:51:49.534687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T21:53:06.943079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T21:53:08.054176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:29:10.217 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:29:10.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.510+0000 7fcfe8600640 1 Processor -- start 2024-03-29T04:29:10.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.511+0000 7fcfe8600640 1 -- start start 2024-03-29T04:29:10.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.512+0000 7fcfe8600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe00d0190 0x7fcfe015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:10.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.513+0000 7fcfe8600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcfe015a400 0x7fcfe00d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:10.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.513+0000 7fcfe8600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe00d0ab0 con 0x7fcfe006bc90 2024-03-29T04:29:10.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.513+0000 7fcfe8600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcfe015aa00 con 0x7fcfe015a400 2024-03-29T04:29:10.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.513+0000 7fcfe8600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcfe015e450 con 0x7fcfe00d0190 2024-03-29T04:29:10.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.513+0000 7fcfe5200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcfe015a400 0x7fcfe00d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:10.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.513+0000 7fcfe5c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe00d0190 0x7fcfe015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:10.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.513+0000 7fcfe5c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe00d0190 0x7fcfe015dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:33600/0 (socket says 172.21.15.153:33600) 2024-03-29T04:29:10.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.513+0000 7fcfe5c00640 1 -- 172.21.15.153:0/3109890227 learned_addr learned my addr 172.21.15.153:0/3109890227 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:10.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.513+0000 7fcfe6600640 1 --1- 172.21.15.153:0/3109890227 >> v1:172.21.15.165:6789/0 conn(0x7fcfe006bc90 0x7fcfe015ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:58166/0 (socket says 172.21.15.153:58166) 2024-03-29T04:29:10.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.514+0000 7fcfdfe00640 1 -- 172.21.15.153:0/3109890227 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3662410569 0 0) 0x7fcfe00d0ab0 con 0x7fcfe006bc90 2024-03-29T04:29:10.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.514+0000 7fcfe5c00640 1 -- 172.21.15.153:0/3109890227 >> v2:172.21.15.153:3300/0 conn(0x7fcfe015a400 msgr2=0x7fcfe00d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:10.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.516+0000 7fcfe5c00640 1 --2- 172.21.15.153:0/3109890227 >> v2:172.21.15.153:3300/0 conn(0x7fcfe015a400 0x7fcfe00d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:10.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.516+0000 7fcfe5c00640 1 -- 172.21.15.153:0/3109890227 >> v1:172.21.15.165:6789/0 conn(0x7fcfe006bc90 legacy=0x7fcfe015ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:10.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.516+0000 7fcfe5c00640 1 -- 172.21.15.153:0/3109890227 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe015e730 con 0x7fcfe00d0190 2024-03-29T04:29:10.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.516+0000 7fcfe5200640 1 --2- 172.21.15.153:0/3109890227 >> v2:172.21.15.153:3300/0 conn(0x7fcfe015a400 0x7fcfe00d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:29:10.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.522+0000 7fcfe5c00640 1 --2- 172.21.15.153:0/3109890227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe00d0190 0x7fcfe015dd50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009870 tx=0x7fcfcc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea755653511b2f9f server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:10.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.522+0000 7fcfdfe00640 1 -- 172.21.15.153:0/3109890227 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc034070 con 0x7fcfe00d0190 2024-03-29T04:29:10.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.523+0000 7fcfdfe00640 1 -- 172.21.15.153:0/3109890227 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfcc030840 con 0x7fcfe00d0190 2024-03-29T04:29:10.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.523+0000 7fcfdfe00640 1 -- 172.21.15.153:0/3109890227 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc030c10 con 0x7fcfe00d0190 2024-03-29T04:29:10.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.524+0000 7fcfe8600640 1 -- 172.21.15.153:0/3109890227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe00d0190 msgr2=0x7fcfe015dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:10.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.524+0000 7fcfe8600640 1 --2- 172.21.15.153:0/3109890227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe00d0190 0x7fcfe015dd50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009870 tx=0x7fcfcc02b980 comp rx=0 tx=0).stop 2024-03-29T04:29:10.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.524+0000 7fcfe8600640 1 -- 172.21.15.153:0/3109890227 shutdown_connections 2024-03-29T04:29:10.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.524+0000 7fcfe8600640 1 --2- 172.21.15.153:0/3109890227 >> v2:172.21.15.153:3300/0 conn(0x7fcfe015a400 0x7fcfe00d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:10.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.524+0000 7fcfe8600640 1 --2- 172.21.15.153:0/3109890227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe00d0190 0x7fcfe015dd50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:10.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.524+0000 7fcfe8600640 1 -- 172.21.15.153:0/3109890227 >> 172.21.15.153:0/3109890227 conn(0x7fcfe006b170 msgr2=0x7fcfe006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:10.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.525+0000 7fcfe8600640 1 -- 172.21.15.153:0/3109890227 shutdown_connections 2024-03-29T04:29:10.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.525+0000 7fcfe8600640 1 -- 172.21.15.153:0/3109890227 wait complete. 2024-03-29T04:29:10.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.528+0000 7fcfe8600640 1 Processor -- start 2024-03-29T04:29:10.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.529+0000 7fcfe8600640 1 -- start start 2024-03-29T04:29:10.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.530+0000 7fcfe8600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe006bc90 0x7fcfe014f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:10.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.530+0000 7fcfe8600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfe00d0190 0x7fcfe0152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:10.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.530+0000 7fcfe8600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe015a400 0x7fcfe009bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:10.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.530+0000 7fcfe8600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe015b5a0 con 0x7fcfe006bc90 2024-03-29T04:29:10.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.530+0000 7fcfe8600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe0071b00 con 0x7fcfe00d0190 2024-03-29T04:29:10.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.530+0000 7fcfe8600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcfe015b720 con 0x7fcfe015a400 2024-03-29T04:29:10.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.531+0000 7fcfe5c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe006bc90 0x7fcfe014f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:10.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.531+0000 7fcfe5c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe006bc90 0x7fcfe014f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60398/0 (socket says 172.21.15.153:60398) 2024-03-29T04:29:10.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.531+0000 7fcfe5c00640 1 -- 172.21.15.153:0/1399861877 learned_addr learned my addr 172.21.15.153:0/1399861877 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:10.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.531+0000 7fcfe6600640 1 --2- 172.21.15.153:0/1399861877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe015a400 0x7fcfe009bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:10.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.531+0000 7fcfe5c00640 1 -- 172.21.15.153:0/1399861877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe015a400 msgr2=0x7fcfe009bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:10.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.531+0000 7fcfe5c00640 1 --2- 172.21.15.153:0/1399861877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe015a400 0x7fcfe009bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:10.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.531+0000 7fcfe5c00640 1 -- 172.21.15.153:0/1399861877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfe00d0190 msgr2=0x7fcfe0152bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-29T04:29:10.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.531+0000 7fcfe5c00640 1 --2- 172.21.15.153:0/1399861877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfe00d0190 0x7fcfe0152bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:10.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.531+0000 7fcfe5c00640 1 -- 172.21.15.153:0/1399861877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe014f990 con 0x7fcfe006bc90 2024-03-29T04:29:10.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.531+0000 7fcfe6600640 1 --2- 172.21.15.153:0/1399861877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe015a400 0x7fcfe009bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:10.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.532+0000 7fcfe5c00640 1 --2- 172.21.15.153:0/1399861877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe006bc90 0x7fcfe014f450 secure :-1 s=READY pgs=3348 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc02b9c0 tx=0x7fcfcc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:10.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.533+0000 7fcfdd600640 1 -- 172.21.15.153:0/1399861877 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc048070 con 0x7fcfe006bc90 2024-03-29T04:29:10.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.533+0000 7fcfdd600640 1 -- 172.21.15.153:0/1399861877 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfcc030640 con 0x7fcfe006bc90 2024-03-29T04:29:10.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.533+0000 7fcfdd600640 1 -- 172.21.15.153:0/1399861877 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc034040 con 0x7fcfe006bc90 2024-03-29T04:29:10.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.533+0000 7fcfe8600640 1 -- 172.21.15.153:0/1399861877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe01e5710 con 0x7fcfe006bc90 2024-03-29T04:29:10.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.533+0000 7fcfe8600640 1 -- 172.21.15.153:0/1399861877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe01e5cd0 con 0x7fcfe006bc90 2024-03-29T04:29:10.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.535+0000 7fcfe8600640 1 -- 172.21.15.153:0/1399861877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe0068ff0 con 0x7fcfe006bc90 2024-03-29T04:29:10.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.536+0000 7fcfdd600640 1 -- 172.21.15.153:0/1399861877 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fcfcc04b070 con 0x7fcfe006bc90 2024-03-29T04:29:10.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.538+0000 7fcfdd600640 1 --2- 172.21.15.153:0/1399861877 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcfc006b5a0 0x7fcfc006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:10.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.538+0000 7fcfdd600640 1 -- 172.21.15.153:0/1399861877 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fcfcc0ac1d0 con 0x7fcfe006bc90 2024-03-29T04:29:10.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.540+0000 7fcfe5200640 1 --2- 172.21.15.153:0/1399861877 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcfc006b5a0 0x7fcfc006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:10.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.542+0000 7fcfe5200640 1 --2- 172.21.15.153:0/1399861877 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcfc006b5a0 0x7fcfc006da60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcfe009e0d0 tx=0x7fcfd4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:10.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.570+0000 7fcfdd600640 1 -- 172.21.15.153:0/1399861877 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcfcc07b030 con 0x7fcfe006bc90 2024-03-29T04:29:10.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.898+0000 7fcfe8600640 1 -- 172.21.15.153:0/1399861877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcfe00d0780 con 0x7fcfe006bc90 2024-03-29T04:29:10.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.917+0000 7fcfdd600640 1 -- 172.21.15.153:0/1399861877 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7fcfcc07a930 con 0x7fcfe006bc90 2024-03-29T04:29:10.894 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-03-29T04:29:10.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.921+0000 7fcfe8600640 1 -- 172.21.15.153:0/1399861877 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcfc006b5a0 msgr2=0x7fcfc006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:10.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.921+0000 7fcfe8600640 1 --2- 172.21.15.153:0/1399861877 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcfc006b5a0 0x7fcfc006da60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcfe009e0d0 tx=0x7fcfd4009190 comp rx=0 tx=0).stop 2024-03-29T04:29:10.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.921+0000 7fcfe8600640 1 -- 172.21.15.153:0/1399861877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe006bc90 msgr2=0x7fcfe014f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:10.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.921+0000 7fcfe8600640 1 --2- 172.21.15.153:0/1399861877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe006bc90 0x7fcfe014f450 secure :-1 s=READY pgs=3348 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc02b9c0 tx=0x7fcfcc004730 comp rx=0 tx=0).stop 2024-03-29T04:29:10.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.921+0000 7fcfe8600640 1 -- 172.21.15.153:0/1399861877 shutdown_connections 2024-03-29T04:29:10.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.921+0000 7fcfe8600640 1 --2- 172.21.15.153:0/1399861877 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcfc006b5a0 0x7fcfc006da60 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:10.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.921+0000 7fcfe8600640 1 --2- 172.21.15.153:0/1399861877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe015a400 0x7fcfe009bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:10.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.921+0000 7fcfe8600640 1 --2- 172.21.15.153:0/1399861877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfe00d0190 0x7fcfe0152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:10.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.921+0000 7fcfe8600640 1 --2- 172.21.15.153:0/1399861877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe006bc90 0x7fcfe014f450 unknown :-1 s=CLOSED pgs=3348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:10.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.921+0000 7fcfe8600640 1 -- 172.21.15.153:0/1399861877 >> 172.21.15.153:0/1399861877 conn(0x7fcfe006b170 msgr2=0x7fcfe015ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:10.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.921+0000 7fcfe8600640 1 -- 172.21.15.153:0/1399861877 shutdown_connections 2024-03-29T04:29:10.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:10.921+0000 7fcfe8600640 1 -- 172.21.15.153:0/1399861877 wait complete. 2024-03-29T04:29:10.923 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:29:11.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.192+0000 7fcbcb200640 1 Processor -- start 2024-03-29T04:29:11.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.192+0000 7fcbcb200640 1 -- start start 2024-03-29T04:29:11.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.194+0000 7fcbcb200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcbc41626a0 0x7fcbc4070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:11.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.194+0000 7fcbcb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc40712c0 0x7fcbc406d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:11.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.194+0000 7fcbcb200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcbc406dbe0 0x7fcbc4166100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:11.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.194+0000 7fcbcb200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcbc4071720 con 0x7fcbc406dbe0 2024-03-29T04:29:11.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.194+0000 7fcbcb200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fcbc40ad750 con 0x7fcbc41626a0 2024-03-29T04:29:11.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.194+0000 7fcbcb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcbc40ace20 con 0x7fcbc40712c0 2024-03-29T04:29:11.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.194+0000 7fcbc3e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcbc41626a0 0x7fcbc4070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:11.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.194+0000 7fcbc9200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcbc406dbe0 0x7fcbc4166100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:11.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.195+0000 7fcbc3e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcbc41626a0 0x7fcbc4070d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:35874/0 (socket says 172.21.15.153:35874) 2024-03-29T04:29:11.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.195+0000 7fcbc3e00640 1 -- 172.21.15.153:0/2069018868 learned_addr learned my addr 172.21.15.153:0/2069018868 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:11.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.195+0000 7fcbc3400640 1 --2- 172.21.15.153:0/2069018868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc40712c0 0x7fcbc406d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:11.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.195+0000 7fcbc9200640 1 -- 172.21.15.153:0/2069018868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc40712c0 msgr2=0x7fcbc406d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:11.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.195+0000 7fcbc9200640 1 --2- 172.21.15.153:0/2069018868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc40712c0 0x7fcbc406d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.195+0000 7fcbc9200640 1 -- 172.21.15.153:0/2069018868 >> v2:172.21.15.165:3300/0 conn(0x7fcbc41626a0 msgr2=0x7fcbc4070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:11.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.195+0000 7fcbc9200640 1 --2- 172.21.15.153:0/2069018868 >> v2:172.21.15.165:3300/0 conn(0x7fcbc41626a0 0x7fcbc4070d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.195+0000 7fcbc9200640 1 -- 172.21.15.153:0/2069018868 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc40ad100 con 0x7fcbc406dbe0 2024-03-29T04:29:11.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.196+0000 7fcbc9200640 1 --2- 172.21.15.153:0/2069018868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbc406dbe0 0x7fcbc4166100 secure :-1 s=READY pgs=3349 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4073230 tx=0x7fcbbc02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450662a83855c9f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:11.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.197+0000 7fcbc2a00640 1 -- 172.21.15.153:0/2069018868 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc039070 con 0x7fcbc406dbe0 2024-03-29T04:29:11.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.197+0000 7fcbc2a00640 1 -- 172.21.15.153:0/2069018868 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbbc02cbd0 con 0x7fcbc406dbe0 2024-03-29T04:29:11.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.197+0000 7fcbc2a00640 1 -- 172.21.15.153:0/2069018868 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc034440 con 0x7fcbc406dbe0 2024-03-29T04:29:11.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.197+0000 7fcbcb200640 1 -- 172.21.15.153:0/2069018868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbc406dbe0 msgr2=0x7fcbc4166100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:11.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.197+0000 7fcbcb200640 1 --2- 172.21.15.153:0/2069018868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbc406dbe0 0x7fcbc4166100 secure :-1 s=READY pgs=3349 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4073230 tx=0x7fcbbc02be20 comp rx=0 tx=0).stop 2024-03-29T04:29:11.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.198+0000 7fcbcb200640 1 -- 172.21.15.153:0/2069018868 shutdown_connections 2024-03-29T04:29:11.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.198+0000 7fcbcb200640 1 --2- 172.21.15.153:0/2069018868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbc406dbe0 0x7fcbc4166100 unknown :-1 s=CLOSED pgs=3349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.198+0000 7fcbcb200640 1 --2- 172.21.15.153:0/2069018868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc40712c0 0x7fcbc406d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.198+0000 7fcbcb200640 1 --2- 172.21.15.153:0/2069018868 >> v2:172.21.15.165:3300/0 conn(0x7fcbc41626a0 0x7fcbc4070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.198+0000 7fcbcb200640 1 -- 172.21.15.153:0/2069018868 >> 172.21.15.153:0/2069018868 conn(0x7fcbc40b19a0 msgr2=0x7fcbc40b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:11.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.198+0000 7fcbcb200640 1 -- 172.21.15.153:0/2069018868 shutdown_connections 2024-03-29T04:29:11.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.198+0000 7fcbcb200640 1 -- 172.21.15.153:0/2069018868 wait complete. 2024-03-29T04:29:11.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.201+0000 7fcbcb200640 1 Processor -- start 2024-03-29T04:29:11.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.201+0000 7fcbcb200640 1 -- start start 2024-03-29T04:29:11.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.202+0000 7fcbcb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc406dbe0 0x7fcbc406cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:11.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.202+0000 7fcbcb200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbc40712c0 0x7fcbc409b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:11.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.203+0000 7fcbcb200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbc41626a0 0x7fcbc409bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:11.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.204+0000 7fcbcb200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc406e070 con 0x7fcbc41626a0 2024-03-29T04:29:11.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.204+0000 7fcbcb200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc406e440 con 0x7fcbc40712c0 2024-03-29T04:29:11.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.204+0000 7fcbcb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcbc406e1f0 con 0x7fcbc406dbe0 2024-03-29T04:29:11.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.204+0000 7fcbc3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc406dbe0 0x7fcbc406cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:11.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.204+0000 7fcbc3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc406dbe0 0x7fcbc406cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:33610/0 (socket says 172.21.15.153:33610) 2024-03-29T04:29:11.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.204+0000 7fcbc3e00640 1 -- 172.21.15.153:0/2348285545 learned_addr learned my addr 172.21.15.153:0/2348285545 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:11.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.205+0000 7fcbc3e00640 1 -- 172.21.15.153:0/2348285545 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbc40712c0 msgr2=0x7fcbc409b8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-29T04:29:11.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.205+0000 7fcbc3e00640 1 --2- 172.21.15.153:0/2348285545 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbc40712c0 0x7fcbc409b8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.205+0000 7fcbc3e00640 1 -- 172.21.15.153:0/2348285545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbc41626a0 msgr2=0x7fcbc409bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:11.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.205+0000 7fcbc3e00640 1 --2- 172.21.15.153:0/2348285545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbc41626a0 0x7fcbc409bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.205+0000 7fcbc3e00640 1 -- 172.21.15.153:0/2348285545 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc415a130 con 0x7fcbc406dbe0 2024-03-29T04:29:11.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.206+0000 7fcbc3e00640 1 --2- 172.21.15.153:0/2348285545 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc406dbe0 0x7fcbc406cd70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8009fd0 tx=0x7fcbb800ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:11.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.206+0000 7fcbb7e00640 1 -- 172.21.15.153:0/2348285545 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8017070 con 0x7fcbc406dbe0 2024-03-29T04:29:11.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.206+0000 7fcbb7e00640 1 -- 172.21.15.153:0/2348285545 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb800c940 con 0x7fcbc406dbe0 2024-03-29T04:29:11.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.207+0000 7fcbb7e00640 1 -- 172.21.15.153:0/2348285545 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb800cd10 con 0x7fcbc406dbe0 2024-03-29T04:29:11.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.210+0000 7fcbcb200640 1 -- 172.21.15.153:0/2348285545 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc409c500 con 0x7fcbc406dbe0 2024-03-29T04:29:11.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.210+0000 7fcbcb200640 1 -- 172.21.15.153:0/2348285545 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc409cac0 con 0x7fcbc406dbe0 2024-03-29T04:29:11.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.214+0000 7fcbb7e00640 1 -- 172.21.15.153:0/2348285545 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fcbb801a070 con 0x7fcbc406dbe0 2024-03-29T04:29:11.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.214+0000 7fcbcb200640 1 -- 172.21.15.153:0/2348285545 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc4068ff0 con 0x7fcbc406dbe0 2024-03-29T04:29:11.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.216+0000 7fcbb7e00640 1 --2- 172.21.15.153:0/2348285545 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcba406b5a0 0x7fcba406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:11.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.216+0000 7fcbb7e00640 1 -- 172.21.15.153:0/2348285545 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fcbb808a120 con 0x7fcbc406dbe0 2024-03-29T04:29:11.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.218+0000 7fcbc3400640 1 --2- 172.21.15.153:0/2348285545 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcba406b5a0 0x7fcba406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:11.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.219+0000 7fcbc3400640 1 --2- 172.21.15.153:0/2348285545 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcba406b5a0 0x7fcba406da60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcbc415da10 tx=0x7fcbb0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:11.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.225+0000 7fcbb7e00640 1 -- 172.21.15.153:0/2348285545 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcbb8059010 con 0x7fcbc406dbe0 2024-03-29T04:29:11.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.530+0000 7fcbcb200640 1 -- 172.21.15.153:0/2348285545 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcbc4165e70 con 0x7fcbc406dbe0 2024-03-29T04:29:11.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.532+0000 7fcbb7e00640 1 -- 172.21.15.153:0/2348285545 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) ==== 104+0+11 (secure 0 0 0) 0x7fcbb8058910 con 0x7fcbc406dbe0 2024-03-29T04:29:11.509 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-03-29T04:29:11.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.537+0000 7fcbcb200640 1 -- 172.21.15.153:0/2348285545 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcba406b5a0 msgr2=0x7fcba406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:11.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.537+0000 7fcbcb200640 1 --2- 172.21.15.153:0/2348285545 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcba406b5a0 0x7fcba406da60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcbc415da10 tx=0x7fcbb0009190 comp rx=0 tx=0).stop 2024-03-29T04:29:11.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.537+0000 7fcbcb200640 1 -- 172.21.15.153:0/2348285545 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc406dbe0 msgr2=0x7fcbc406cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:11.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.537+0000 7fcbcb200640 1 --2- 172.21.15.153:0/2348285545 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc406dbe0 0x7fcbc406cd70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8009fd0 tx=0x7fcbb800ed40 comp rx=0 tx=0).stop 2024-03-29T04:29:11.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.537+0000 7fcbcb200640 1 -- 172.21.15.153:0/2348285545 shutdown_connections 2024-03-29T04:29:11.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.537+0000 7fcbcb200640 1 --2- 172.21.15.153:0/2348285545 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcba406b5a0 0x7fcba406da60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.537+0000 7fcbcb200640 1 --2- 172.21.15.153:0/2348285545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbc41626a0 0x7fcbc409bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.537+0000 7fcbcb200640 1 --2- 172.21.15.153:0/2348285545 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbc40712c0 0x7fcbc409b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.537+0000 7fcbcb200640 1 --2- 172.21.15.153:0/2348285545 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc406dbe0 0x7fcbc406cd70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.537+0000 7fcbcb200640 1 -- 172.21.15.153:0/2348285545 >> 172.21.15.153:0/2348285545 conn(0x7fcbc40b19a0 msgr2=0x7fcbc41653c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:11.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.539+0000 7fcbcb200640 1 -- 172.21.15.153:0/2348285545 shutdown_connections 2024-03-29T04:29:11.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.540+0000 7fcbcb200640 1 -- 172.21.15.153:0/2348285545 wait complete. 2024-03-29T04:29:11.540 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:29:11.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.837+0000 7fe28f800640 1 Processor -- start 2024-03-29T04:29:11.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.837+0000 7fe28f800640 1 -- start start 2024-03-29T04:29:11.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.839+0000 7fe28f800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe2880d0190 0x7fe28815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:11.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.839+0000 7fe28f800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe28815a400 0x7fe2880d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.839+0000 7fe28f800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2880d0ab0 con 0x7fe2880b46f0 2024-03-29T04:29:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.840+0000 7fe28ce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe2880d0190 0x7fe28815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.840+0000 7fe28ce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe2880d0190 0x7fe28815dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:35880/0 (socket says 172.21.15.153:35880) 2024-03-29T04:29:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.840+0000 7fe28ce00640 1 -- 172.21.15.153:0/3744563251 learned_addr learned my addr 172.21.15.153:0/3744563251 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.840+0000 7fe28f800640 1 -- 172.21.15.153:0/3744563251 --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe28815aa00 con 0x7fe2880d0190 2024-03-29T04:29:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.840+0000 7fe28f800640 1 -- 172.21.15.153:0/3744563251 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe28815e450 con 0x7fe28815a400 2024-03-29T04:29:11.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.841+0000 7fe287400640 1 -- 172.21.15.153:0/3744563251 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4057764663 0 0) 0x7fe2880d0ab0 con 0x7fe2880b46f0 2024-03-29T04:29:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.841+0000 7fe287400640 1 -- 172.21.15.153:0/3744563251 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe270005730 con 0x7fe2880b46f0 2024-03-29T04:29:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.841+0000 7fe287e00640 1 --2- 172.21.15.153:0/3744563251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe28815a400 0x7fe2880d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.841+0000 7fe28ce00640 1 -- 172.21.15.153:0/3744563251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe28815a400 msgr2=0x7fe2880d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.841+0000 7fe28ce00640 1 --2- 172.21.15.153:0/3744563251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe28815a400 0x7fe2880d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.841+0000 7fe28ce00640 1 -- 172.21.15.153:0/3744563251 >> v1:172.21.15.153:6789/0 conn(0x7fe2880b46f0 legacy=0x7fe28815ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:11.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.841+0000 7fe28ce00640 1 -- 172.21.15.153:0/3744563251 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28815e730 con 0x7fe2880d0190 2024-03-29T04:29:11.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.843+0000 7fe28ce00640 1 --2- 172.21.15.153:0/3744563251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2880d0190 0x7fe28815dd50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00c370 tx=0x7fe27c02b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2b9cfb93f04bca4 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:11.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.843+0000 7fe287400640 1 -- 172.21.15.153:0/3744563251 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c034020 con 0x7fe2880d0190 2024-03-29T04:29:11.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.844+0000 7fe287400640 1 -- 172.21.15.153:0/3744563251 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c008df0 con 0x7fe2880d0190 2024-03-29T04:29:11.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.844+0000 7fe287400640 1 -- 172.21.15.153:0/3744563251 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00a2f0 con 0x7fe2880d0190 2024-03-29T04:29:11.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.845+0000 7fe28f800640 1 -- 172.21.15.153:0/3744563251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2880d0190 msgr2=0x7fe28815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:11.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.845+0000 7fe28f800640 1 --2- 172.21.15.153:0/3744563251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2880d0190 0x7fe28815dd50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00c370 tx=0x7fe27c02b9b0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.846+0000 7fe28f800640 1 -- 172.21.15.153:0/3744563251 shutdown_connections 2024-03-29T04:29:11.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.846+0000 7fe28f800640 1 --2- 172.21.15.153:0/3744563251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe28815a400 0x7fe2880d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.846+0000 7fe28f800640 1 --2- 172.21.15.153:0/3744563251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2880d0190 0x7fe28815dd50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.846+0000 7fe28f800640 1 -- 172.21.15.153:0/3744563251 >> 172.21.15.153:0/3744563251 conn(0x7fe28806b170 msgr2=0x7fe28806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:11.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.847+0000 7fe28f800640 1 -- 172.21.15.153:0/3744563251 shutdown_connections 2024-03-29T04:29:11.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.847+0000 7fe28f800640 1 -- 172.21.15.153:0/3744563251 wait complete. 2024-03-29T04:29:11.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.850+0000 7fe28f800640 1 Processor -- start 2024-03-29T04:29:11.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.850+0000 7fe28f800640 1 -- start start 2024-03-29T04:29:11.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.852+0000 7fe28f800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2880b46f0 0x7fe288158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:11.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.852+0000 7fe28f800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2880d0190 0x7fe2880b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:11.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.852+0000 7fe28f800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe28815a400 0x7fe28813e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:11.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.853+0000 7fe28ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2880b46f0 0x7fe288158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:11.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.853+0000 7fe28ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2880b46f0 0x7fe288158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:33630/0 (socket says 172.21.15.153:33630) 2024-03-29T04:29:11.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.853+0000 7fe287e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2880d0190 0x7fe2880b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:11.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.853+0000 7fe287e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2880d0190 0x7fe2880b1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:35896/0 (socket says 172.21.15.153:35896) 2024-03-29T04:29:11.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.853+0000 7fe28d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe28815a400 0x7fe28813e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:11.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.853+0000 7fe28d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe28815a400 0x7fe28813e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60434/0 (socket says 172.21.15.153:60434) 2024-03-29T04:29:11.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.853+0000 7fe28f800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe28815b5a0 con 0x7fe28815a400 2024-03-29T04:29:11.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.853+0000 7fe28f800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe288071b00 con 0x7fe2880d0190 2024-03-29T04:29:11.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.853+0000 7fe28f800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe28815b720 con 0x7fe2880b46f0 2024-03-29T04:29:11.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.853+0000 7fe28ce00640 1 -- 172.21.15.153:0/3140262818 learned_addr learned my addr 172.21.15.153:0/3140262818 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:11.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.854+0000 7fe28d800640 1 -- 172.21.15.153:0/3140262818 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2880b46f0 msgr2=0x7fe288158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:11.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.854+0000 7fe28d800640 1 --2- 172.21.15.153:0/3140262818 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2880b46f0 0x7fe288158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.854+0000 7fe28d800640 1 -- 172.21.15.153:0/3140262818 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2880d0190 msgr2=0x7fe2880b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:11.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.854+0000 7fe28d800640 1 --2- 172.21.15.153:0/3140262818 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2880d0190 0x7fe2880b1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:11.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.854+0000 7fe28d800640 1 -- 172.21.15.153:0/3140262818 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2880b1fd0 con 0x7fe28815a400 2024-03-29T04:29:11.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.854+0000 7fe287e00640 1 --2- 172.21.15.153:0/3140262818 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2880d0190 0x7fe2880b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-03-29T04:29:11.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.855+0000 7fe28d800640 1 --2- 172.21.15.153:0/3140262818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe28815a400 0x7fe28813e690 secure :-1 s=READY pgs=3351 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c730 tx=0x7fe28000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:11.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.855+0000 7fe284c00640 1 -- 172.21.15.153:0/3140262818 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280003b70 con 0x7fe28815a400 2024-03-29T04:29:11.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.855+0000 7fe28f800640 1 -- 172.21.15.153:0/3140262818 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2880b22b0 con 0x7fe28815a400 2024-03-29T04:29:11.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.856+0000 7fe28f800640 1 -- 172.21.15.153:0/3140262818 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28813f530 con 0x7fe28815a400 2024-03-29T04:29:11.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.856+0000 7fe284c00640 1 -- 172.21.15.153:0/3140262818 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe280003d30 con 0x7fe28815a400 2024-03-29T04:29:11.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.856+0000 7fe284c00640 1 -- 172.21.15.153:0/3140262818 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280005310 con 0x7fe28815a400 2024-03-29T04:29:11.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.857+0000 7fe28f800640 1 -- 172.21.15.153:0/3140262818 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe264005290 con 0x7fe28815a400 2024-03-29T04:29:11.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.859+0000 7fe284c00640 1 -- 172.21.15.153:0/3140262818 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe2800054b0 con 0x7fe28815a400 2024-03-29T04:29:11.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.860+0000 7fe284c00640 1 --2- 172.21.15.153:0/3140262818 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe26806b4d0 0x7fe26806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:11.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.861+0000 7fe284c00640 1 -- 172.21.15.153:0/3140262818 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fe28008a180 con 0x7fe28815a400 2024-03-29T04:29:11.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.862+0000 7fe28ce00640 1 --2- 172.21.15.153:0/3140262818 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe26806b4d0 0x7fe26806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:11.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.864+0000 7fe28ce00640 1 --2- 172.21.15.153:0/3140262818 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe26806b4d0 0x7fe26806d990 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe27c02b9f0 tx=0x7fe27c00a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:11.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:11.869+0000 7fe284c00640 1 -- 172.21.15.153:0/3140262818 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe280058ee0 con 0x7fe28815a400 2024-03-29T04:29:12.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.184+0000 7fe28f800640 1 -- 172.21.15.153:0/3140262818 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe264005d90 con 0x7fe28815a400 2024-03-29T04:29:12.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.185+0000 7fe284c00640 1 -- 172.21.15.153:0/3140262818 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) ==== 100+0+11 (secure 0 0 0) 0x7fe2800587e0 con 0x7fe28815a400 2024-03-29T04:29:12.161 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-03-29T04:29:12.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.188+0000 7fe28f800640 1 -- 172.21.15.153:0/3140262818 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe26806b4d0 msgr2=0x7fe26806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:12.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.188+0000 7fe28f800640 1 --2- 172.21.15.153:0/3140262818 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe26806b4d0 0x7fe26806d990 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe27c02b9f0 tx=0x7fe27c00a000 comp rx=0 tx=0).stop 2024-03-29T04:29:12.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.188+0000 7fe28f800640 1 -- 172.21.15.153:0/3140262818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe28815a400 msgr2=0x7fe28813e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:12.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.188+0000 7fe28f800640 1 --2- 172.21.15.153:0/3140262818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe28815a400 0x7fe28813e690 secure :-1 s=READY pgs=3351 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c730 tx=0x7fe28000cbf0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.189+0000 7fe28f800640 1 -- 172.21.15.153:0/3140262818 shutdown_connections 2024-03-29T04:29:12.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.189+0000 7fe28f800640 1 --2- 172.21.15.153:0/3140262818 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe26806b4d0 0x7fe26806d990 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.189+0000 7fe28f800640 1 --2- 172.21.15.153:0/3140262818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe28815a400 0x7fe28813e690 unknown :-1 s=CLOSED pgs=3351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.189+0000 7fe28f800640 1 --2- 172.21.15.153:0/3140262818 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2880d0190 0x7fe2880b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.189+0000 7fe28f800640 1 --2- 172.21.15.153:0/3140262818 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2880b46f0 0x7fe288158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.189+0000 7fe28f800640 1 -- 172.21.15.153:0/3140262818 >> 172.21.15.153:0/3140262818 conn(0x7fe28806b170 msgr2=0x7fe2880d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:12.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.191+0000 7fe28f800640 1 -- 172.21.15.153:0/3140262818 shutdown_connections 2024-03-29T04:29:12.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.192+0000 7fe28f800640 1 -- 172.21.15.153:0/3140262818 wait complete. 2024-03-29T04:29:12.193 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:29:12.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.460+0000 7fc3b1200640 1 Processor -- start 2024-03-29T04:29:12.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.461+0000 7fc3b1200640 1 -- start start 2024-03-29T04:29:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.463+0000 7fc3b1200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3ac159a10 0x7fc3ac15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.463+0000 7fc3b1200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3ac0ad830 0x7fc3ac06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.463+0000 7fc3b1200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ac0b2e60 con 0x7fc3ac06e270 2024-03-29T04:29:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.463+0000 7fc3b1200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fc3ac0adc70 con 0x7fc3ac0ad830 2024-03-29T04:29:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.463+0000 7fc3b1200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc3ac159df0 con 0x7fc3ac159a10 2024-03-29T04:29:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.463+0000 7fc3a9400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3ac0ad830 0x7fc3ac06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.463+0000 7fc3a9400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3ac0ad830 0x7fc3ac06dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60446/0 (socket says 172.21.15.153:60446) 2024-03-29T04:29:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.463+0000 7fc3a9400640 1 -- 172.21.15.153:0/3028620612 learned_addr learned my addr 172.21.15.153:0/3028620612 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:12.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.464+0000 7fc3a9e00640 1 --2- 172.21.15.153:0/3028620612 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3ac159a10 0x7fc3ac15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:12.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.464+0000 7fc3a9400640 1 -- 172.21.15.153:0/3028620612 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3ac159a10 msgr2=0x7fc3ac15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.464+0000 7fc3a9400640 1 --2- 172.21.15.153:0/3028620612 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3ac159a10 0x7fc3ac15cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.464+0000 7fc3a9400640 1 -- 172.21.15.153:0/3028620612 >> v1:172.21.15.153:6789/0 conn(0x7fc3ac06e270 legacy=0x7fc3ac15fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:12.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.465+0000 7fc3a9400640 1 -- 172.21.15.153:0/3028620612 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ac0adf10 con 0x7fc3ac0ad830 2024-03-29T04:29:12.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.468+0000 7fc3a9400640 1 --2- 172.21.15.153:0/3028620612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3ac0ad830 0x7fc3ac06dd30 secure :-1 s=READY pgs=3352 cs=0 l=1 rev1=1 crypto rx=0x7fc398009870 tx=0x7fc39802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af630d376267f9a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:12.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.472+0000 7fc3a8a00640 1 -- 172.21.15.153:0/3028620612 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3980317c0 con 0x7fc3ac0ad830 2024-03-29T04:29:12.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.472+0000 7fc3a8a00640 1 -- 172.21.15.153:0/3028620612 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc398037070 con 0x7fc3ac0ad830 2024-03-29T04:29:12.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.472+0000 7fc3a8a00640 1 -- 172.21.15.153:0/3028620612 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398031b80 con 0x7fc3ac0ad830 2024-03-29T04:29:12.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.474+0000 7fc3b1200640 1 -- 172.21.15.153:0/3028620612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3ac0ad830 msgr2=0x7fc3ac06dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:12.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.474+0000 7fc3b1200640 1 --2- 172.21.15.153:0/3028620612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3ac0ad830 0x7fc3ac06dd30 secure :-1 s=READY pgs=3352 cs=0 l=1 rev1=1 crypto rx=0x7fc398009870 tx=0x7fc39802b860 comp rx=0 tx=0).stop 2024-03-29T04:29:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.477+0000 7fc3b1200640 1 -- 172.21.15.153:0/3028620612 shutdown_connections 2024-03-29T04:29:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.477+0000 7fc3b1200640 1 --2- 172.21.15.153:0/3028620612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3ac0ad830 0x7fc3ac06dd30 unknown :-1 s=CLOSED pgs=3352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.477+0000 7fc3b1200640 1 --2- 172.21.15.153:0/3028620612 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3ac159a10 0x7fc3ac15cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.477+0000 7fc3b1200640 1 -- 172.21.15.153:0/3028620612 >> 172.21.15.153:0/3028620612 conn(0x7fc3ac0b1a30 msgr2=0x7fc3ac0b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.478+0000 7fc3b1200640 1 -- 172.21.15.153:0/3028620612 shutdown_connections 2024-03-29T04:29:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.478+0000 7fc3b1200640 1 -- 172.21.15.153:0/3028620612 wait complete. 2024-03-29T04:29:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.481+0000 7fc3b1200640 1 Processor -- start 2024-03-29T04:29:12.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.481+0000 7fc3b1200640 1 -- start start 2024-03-29T04:29:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.484+0000 7fc3b1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3ac06e270 0x7fc3ac09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.484+0000 7fc3b1200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3ac0ad830 0x7fc3ac201230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.484+0000 7fc3b1200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3ac159a10 0x7fc3ac16b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.484+0000 7fc3b1200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ac0ae4d0 con 0x7fc3ac06e270 2024-03-29T04:29:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.484+0000 7fc3b1200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ac0b3100 con 0x7fc3ac0ad830 2024-03-29T04:29:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.484+0000 7fc3b1200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc3ac0b4630 con 0x7fc3ac159a10 2024-03-29T04:29:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.485+0000 7fc3a9400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3ac0ad830 0x7fc3ac201230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.485+0000 7fc3a9400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3ac0ad830 0x7fc3ac201230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:35906/0 (socket says 172.21.15.153:35906) 2024-03-29T04:29:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.485+0000 7fc3a9400640 1 -- 172.21.15.153:0/2249578170 learned_addr learned my addr 172.21.15.153:0/2249578170 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.485+0000 7fc3a9e00640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3ac06e270 0x7fc3ac09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.485+0000 7fc3a9400640 1 -- 172.21.15.153:0/2249578170 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3ac159a10 msgr2=0x7fc3ac16b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.484+0000 7fc3aa800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3ac159a10 0x7fc3ac16b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.486+0000 7fc3a9400640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3ac159a10 0x7fc3ac16b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.486+0000 7fc3a9400640 1 -- 172.21.15.153:0/2249578170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3ac06e270 msgr2=0x7fc3ac09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.486+0000 7fc3a9400640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3ac06e270 0x7fc3ac09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.486+0000 7fc3a9400640 1 -- 172.21.15.153:0/2249578170 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ac0cc920 con 0x7fc3ac0ad830 2024-03-29T04:29:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.486+0000 7fc3a9e00640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3ac06e270 0x7fc3ac09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.486+0000 7fc3aa800640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3ac159a10 0x7fc3ac16b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.486+0000 7fc3a9400640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3ac0ad830 0x7fc3ac201230 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc398000c00 tx=0x7fc3980046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.487+0000 7fc3a2000640 1 -- 172.21.15.153:0/2249578170 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398032650 con 0x7fc3ac0ad830 2024-03-29T04:29:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.487+0000 7fc3a2000640 1 -- 172.21.15.153:0/2249578170 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3980327f0 con 0x7fc3ac0ad830 2024-03-29T04:29:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.487+0000 7fc3a2000640 1 -- 172.21.15.153:0/2249578170 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398032ba0 con 0x7fc3ac0ad830 2024-03-29T04:29:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.487+0000 7fc3b1200640 1 -- 172.21.15.153:0/2249578170 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ac16b7d0 con 0x7fc3ac0ad830 2024-03-29T04:29:12.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.487+0000 7fc3b1200640 1 -- 172.21.15.153:0/2249578170 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3ac09b310 con 0x7fc3ac0ad830 2024-03-29T04:29:12.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.491+0000 7fc397400640 1 -- 172.21.15.153:0/2249578170 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc380005290 con 0x7fc3ac0ad830 2024-03-29T04:29:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.494+0000 7fc3a2000640 1 -- 172.21.15.153:0/2249578170 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc39804c060 con 0x7fc3ac0ad830 2024-03-29T04:29:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.496+0000 7fc3a2000640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc38c06b5a0 0x7fc38c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:12.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.496+0000 7fc3a2000640 1 -- 172.21.15.153:0/2249578170 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fc3980ac030 con 0x7fc3ac0ad830 2024-03-29T04:29:12.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.497+0000 7fc3a9e00640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc38c06b5a0 0x7fc38c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:12.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.498+0000 7fc3a9e00640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc38c06b5a0 0x7fc38c06da60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009a20 tx=0x7fc39c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:12.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.501+0000 7fc3a2000640 1 -- 172.21.15.153:0/2249578170 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc398040070 con 0x7fc3ac0ad830 2024-03-29T04:29:12.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.874+0000 7fc397400640 1 -- 172.21.15.153:0/2249578170 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc380005580 con 0x7fc3ac0ad830 2024-03-29T04:29:12.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.883+0000 7fc3a2000640 1 -- 172.21.15.153:0/2249578170 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5190 (secure 0 0 0) 0x7fc39807a960 con 0x7fc3ac0ad830 2024-03-29T04:29:12.860 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:12.860 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3849778471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3849778471},{"type":"v1","addr":"172.21.15.165:6835","nonce":3849778471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/2718440878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2718440878},{"type":"v1","addr":"172.21.15.165:6833","nonce":2718440878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/974086107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":974086107},{"type":"v1","addr":"172.21.15.153:6836","nonce":974086107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T21:53:09.040388+0000","modified":"2024-03-28T21:53:12.151355+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6837/1209499946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1209499946},{"type":"v1","addr":"172.21.15.153:6837","nonce":1209499946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5070,"qdb_cluster":[5070]},"id":2}]} 2024-03-29T04:29:12.860 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 17 2024-03-29T04:29:12.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.887+0000 7fc397400640 1 -- 172.21.15.153:0/2249578170 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc38c06b5a0 msgr2=0x7fc38c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:12.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.887+0000 7fc397400640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc38c06b5a0 0x7fc38c06da60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009a20 tx=0x7fc39c008040 comp rx=0 tx=0).stop 2024-03-29T04:29:12.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.887+0000 7fc397400640 1 -- 172.21.15.153:0/2249578170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3ac0ad830 msgr2=0x7fc3ac201230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:12.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.887+0000 7fc397400640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3ac0ad830 0x7fc3ac201230 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc398000c00 tx=0x7fc3980046c0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.887+0000 7fc397400640 1 -- 172.21.15.153:0/2249578170 shutdown_connections 2024-03-29T04:29:12.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.887+0000 7fc397400640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc38c06b5a0 0x7fc38c06da60 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.887+0000 7fc397400640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3ac159a10 0x7fc3ac16b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.887+0000 7fc397400640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3ac0ad830 0x7fc3ac201230 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.887+0000 7fc397400640 1 --2- 172.21.15.153:0/2249578170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3ac06e270 0x7fc3ac09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:12.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.887+0000 7fc397400640 1 -- 172.21.15.153:0/2249578170 >> 172.21.15.153:0/2249578170 conn(0x7fc3ac0b1a30 msgr2=0x7fc3ac06cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:12.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.888+0000 7fc397400640 1 -- 172.21.15.153:0/2249578170 shutdown_connections 2024-03-29T04:29:12.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:12.888+0000 7fc397400640 1 -- 172.21.15.153:0/2249578170 wait complete. 2024-03-29T04:29:12.893 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:29:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.168+0000 7f0411e00640 1 Processor -- start 2024-03-29T04:29:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.168+0000 7f0411e00640 1 -- start start 2024-03-29T04:29:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.170+0000 7f0411e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f040c0b2520 0x7f040c06e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.170+0000 7f0411e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f040c0b2d30 0x7f040c0b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.170+0000 7f0411e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f040c15e1b0 con 0x7f040c0b4dd0 2024-03-29T04:29:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.170+0000 7f0411e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f040c15eae0 con 0x7f040c0b2520 2024-03-29T04:29:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.170+0000 7f0411e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f040c06e960 con 0x7f040c0b2d30 2024-03-29T04:29:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.171+0000 7f040a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f040c0b2d30 0x7f040c0b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.171+0000 7f040aa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f040c0b2520 0x7f040c06e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.171+0000 7f040a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f040c0b2d30 0x7f040c0b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:55490/0 (socket says 172.21.15.153:55490) 2024-03-29T04:29:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.171+0000 7f040aa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f040c0b2520 0x7f040c06e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:52080/0 (socket says 172.21.15.153:52080) 2024-03-29T04:29:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.171+0000 7f040a000640 1 -- 172.21.15.153:0/57139488 learned_addr learned my addr 172.21.15.153:0/57139488 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.171+0000 7f040aa00640 1 -- 172.21.15.153:0/57139488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f040c0b2d30 msgr2=0x7f040c0b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.171+0000 7f040aa00640 1 --2- 172.21.15.153:0/57139488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f040c0b2d30 0x7f040c0b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.171+0000 7f040aa00640 1 -- 172.21.15.153:0/57139488 >> v1:172.21.15.153:6789/0 conn(0x7f040c0b4dd0 legacy=0x7f040c072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.171+0000 7f040aa00640 1 -- 172.21.15.153:0/57139488 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c15e490 con 0x7f040c0b2520 2024-03-29T04:29:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.171+0000 7f040a000640 1 --2- 172.21.15.153:0/57139488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f040c0b2d30 0x7f040c0b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:29:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.173+0000 7f040aa00640 1 --2- 172.21.15.153:0/57139488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f040c0b2520 0x7f040c06e420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0097a0 tx=0x7f03fc02b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6972f4d44e84f5b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.173+0000 7f0409600640 1 -- 172.21.15.153:0/57139488 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc034070 con 0x7f040c0b2520 2024-03-29T04:29:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.173+0000 7f0409600640 1 -- 172.21.15.153:0/57139488 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03fc030800 con 0x7f040c0b2520 2024-03-29T04:29:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.173+0000 7f0409600640 1 -- 172.21.15.153:0/57139488 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc030bd0 con 0x7f040c0b2520 2024-03-29T04:29:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.174+0000 7f0411e00640 1 -- 172.21.15.153:0/57139488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f040c0b2520 msgr2=0x7f040c06e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.174+0000 7f0411e00640 1 --2- 172.21.15.153:0/57139488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f040c0b2520 0x7f040c06e420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0097a0 tx=0x7f03fc02b940 comp rx=0 tx=0).stop 2024-03-29T04:29:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.174+0000 7f0411e00640 1 -- 172.21.15.153:0/57139488 shutdown_connections 2024-03-29T04:29:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.174+0000 7f0411e00640 1 --2- 172.21.15.153:0/57139488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f040c0b2d30 0x7f040c0b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.174+0000 7f0411e00640 1 --2- 172.21.15.153:0/57139488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f040c0b2520 0x7f040c06e420 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.174+0000 7f0411e00640 1 -- 172.21.15.153:0/57139488 >> 172.21.15.153:0/57139488 conn(0x7f040c0b1a30 msgr2=0x7f040c0b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.175+0000 7f0411e00640 1 -- 172.21.15.153:0/57139488 shutdown_connections 2024-03-29T04:29:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.175+0000 7f0411e00640 1 -- 172.21.15.153:0/57139488 wait complete. 2024-03-29T04:29:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.177+0000 7f0411e00640 1 Processor -- start 2024-03-29T04:29:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.177+0000 7f0411e00640 1 -- start start 2024-03-29T04:29:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.178+0000 7f0411e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f040c0b2520 0x7f040c0b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.178+0000 7f0411e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f040c0b2d30 0x7f040c142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.178+0000 7f0411e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f040c0b4dd0 0x7f040c09baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.178+0000 7f0411e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f040c072930 con 0x7f040c0b4dd0 2024-03-29T04:29:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.178+0000 7f0411e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f040c0b43e0 con 0x7f040c0b2520 2024-03-29T04:29:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.178+0000 7f0411e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f040c072ab0 con 0x7f040c0b2d30 2024-03-29T04:29:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.179+0000 7f040aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f040c0b2520 0x7f040c0b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.179+0000 7f040b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f040c0b4dd0 0x7f040c09baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.179+0000 7f040aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f040c0b2520 0x7f040c0b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:52082/0 (socket says 172.21.15.153:52082) 2024-03-29T04:29:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.179+0000 7f040aa00640 1 -- 172.21.15.153:0/1565705835 learned_addr learned my addr 172.21.15.153:0/1565705835 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.179+0000 7f040a000640 1 --2- 172.21.15.153:0/1565705835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f040c0b2d30 0x7f040c142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.180+0000 7f040aa00640 1 -- 172.21.15.153:0/1565705835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f040c0b2d30 msgr2=0x7f040c142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.180+0000 7f040aa00640 1 --2- 172.21.15.153:0/1565705835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f040c0b2d30 0x7f040c142ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.180+0000 7f040aa00640 1 -- 172.21.15.153:0/1565705835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f040c0b4dd0 msgr2=0x7f040c09baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.180+0000 7f040aa00640 1 --2- 172.21.15.153:0/1565705835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f040c0b4dd0 0x7f040c09baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.180+0000 7f040aa00640 1 -- 172.21.15.153:0/1565705835 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c146ed0 con 0x7f040c0b2520 2024-03-29T04:29:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.180+0000 7f040aa00640 1 --2- 172.21.15.153:0/1565705835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f040c0b2520 0x7f040c0b0ff0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f03fc02bf50 tx=0x7f03fc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.181+0000 7f0403400640 1 -- 172.21.15.153:0/1565705835 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc034040 con 0x7f040c0b2520 2024-03-29T04:29:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.181+0000 7f0403400640 1 -- 172.21.15.153:0/1565705835 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03fc030600 con 0x7f040c0b2520 2024-03-29T04:29:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.181+0000 7f0403400640 1 -- 172.21.15.153:0/1565705835 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc006e10 con 0x7f040c0b2520 2024-03-29T04:29:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.181+0000 7f0411e00640 1 -- 172.21.15.153:0/1565705835 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040c1471b0 con 0x7f040c0b2520 2024-03-29T04:29:13.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.181+0000 7f0411e00640 1 -- 172.21.15.153:0/1565705835 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040c144510 con 0x7f040c0b2520 2024-03-29T04:29:13.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.182+0000 7f0411e00640 1 -- 172.21.15.153:0/1565705835 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040c144020 con 0x7f040c0b2520 2024-03-29T04:29:13.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.184+0000 7f0403400640 1 -- 172.21.15.153:0/1565705835 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f03fc037070 con 0x7f040c0b2520 2024-03-29T04:29:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.185+0000 7f0403400640 1 --2- 172.21.15.153:0/1565705835 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f03ec06b550 0x7f03ec06da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.186+0000 7f0403400640 1 -- 172.21.15.153:0/1565705835 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f03fc0acbd0 con 0x7f040c0b2520 2024-03-29T04:29:13.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.186+0000 7f040a000640 1 --2- 172.21.15.153:0/1565705835 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f03ec06b550 0x7f03ec06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:13.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.187+0000 7f040a000640 1 --2- 172.21.15.153:0/1565705835 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f03ec06b550 0x7f03ec06da10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009630 tx=0x7f03f8009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.191+0000 7f0403400640 1 -- 172.21.15.153:0/1565705835 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f03fc07b470 con 0x7f040c0b2520 2024-03-29T04:29:13.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.507+0000 7f0411e00640 1 -- 172.21.15.153:0/1565705835 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f040c0b3f10 con 0x7f040c0b2520 2024-03-29T04:29:13.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.509+0000 7f0403400640 1 -- 172.21.15.153:0/1565705835 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16717 (secure 0 0 0) 0x7f03fc07f510 con 0x7f040c0b2520 2024-03-29T04:29:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:13.486 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":35,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:53:10.602850+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:53:06.943079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-28T21:53:08.054176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:29:13.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.512+0000 7f0411e00640 1 -- 172.21.15.153:0/1565705835 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f03ec06b550 msgr2=0x7f03ec06da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:13.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.512+0000 7f0411e00640 1 --2- 172.21.15.153:0/1565705835 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f03ec06b550 0x7f03ec06da10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009630 tx=0x7f03f8009240 comp rx=0 tx=0).stop 2024-03-29T04:29:13.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.512+0000 7f0411e00640 1 -- 172.21.15.153:0/1565705835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f040c0b2520 msgr2=0x7f040c0b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.512+0000 7f0411e00640 1 --2- 172.21.15.153:0/1565705835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f040c0b2520 0x7f040c0b0ff0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f03fc02bf50 tx=0x7f03fc0046c0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.512+0000 7f0411e00640 1 -- 172.21.15.153:0/1565705835 shutdown_connections 2024-03-29T04:29:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.512+0000 7f0411e00640 1 --2- 172.21.15.153:0/1565705835 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f03ec06b550 0x7f03ec06da10 secure :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009630 tx=0x7f03f8009240 comp rx=0 tx=0).stop 2024-03-29T04:29:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.512+0000 7f0411e00640 1 --2- 172.21.15.153:0/1565705835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f040c0b4dd0 0x7f040c09baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.512+0000 7f0411e00640 1 --2- 172.21.15.153:0/1565705835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f040c0b2d30 0x7f040c142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.512+0000 7f0411e00640 1 --2- 172.21.15.153:0/1565705835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f040c0b2520 0x7f040c0b0ff0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.512+0000 7f0411e00640 1 -- 172.21.15.153:0/1565705835 >> 172.21.15.153:0/1565705835 conn(0x7f040c0b1a30 msgr2=0x7f040c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.513+0000 7f0411e00640 1 -- 172.21.15.153:0/1565705835 shutdown_connections 2024-03-29T04:29:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.513+0000 7f0411e00640 1 -- 172.21.15.153:0/1565705835 wait complete. 2024-03-29T04:29:13.524 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-29T04:29:13.524 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:29:13.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.797+0000 7f46bc600640 1 Processor -- start 2024-03-29T04:29:13.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.797+0000 7f46bc600640 1 -- start start 2024-03-29T04:29:13.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.798+0000 7f46bc600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f46b406dd30 0x7f46b406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:13.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.798+0000 7f46bc600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46b4071cb0 0x7f46b4072130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:13.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.798+0000 7f46bc600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b40ad800 0x7f46b40adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:13.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.798+0000 7f46bc600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f46b406e650 con 0x7f46b4071cb0 2024-03-29T04:29:13.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.798+0000 7f46bc600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f46b40727d0 con 0x7f46b406dd30 2024-03-29T04:29:13.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.799+0000 7f46bc600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f46b40b2dd0 con 0x7f46b40ad800 2024-03-29T04:29:13.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.799+0000 7f46b9200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46b4071cb0 0x7f46b4072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:13.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.799+0000 7f46b9200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46b4071cb0 0x7f46b4072130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58826/0 (socket says 172.21.15.153:58826) 2024-03-29T04:29:13.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.799+0000 7f46b9200640 1 -- 172.21.15.153:0/1709785056 learned_addr learned my addr 172.21.15.153:0/1709785056 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:13.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.799+0000 7f46b9200640 1 -- 172.21.15.153:0/1709785056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b40ad800 msgr2=0x7f46b40adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:13.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.799+0000 7f46b9c00640 1 --2- 172.21.15.153:0/1709785056 >> v2:172.21.15.165:3300/0 conn(0x7f46b406dd30 0x7f46b406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:13.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.800+0000 7f46ba600640 1 --2- 172.21.15.153:0/1709785056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b40ad800 0x7f46b40adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:13.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.800+0000 7f46b9200640 1 --2- 172.21.15.153:0/1709785056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b40ad800 0x7f46b40adc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.800+0000 7f46b9200640 1 -- 172.21.15.153:0/1709785056 >> v2:172.21.15.165:3300/0 conn(0x7f46b406dd30 msgr2=0x7f46b406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:13.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.800+0000 7f46b9200640 1 --2- 172.21.15.153:0/1709785056 >> v2:172.21.15.165:3300/0 conn(0x7f46b406dd30 0x7f46b406e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.800+0000 7f46b9200640 1 -- 172.21.15.153:0/1709785056 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b40b30b0 con 0x7f46b4071cb0 2024-03-29T04:29:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.800+0000 7f46b9c00640 1 --2- 172.21.15.153:0/1709785056 >> v2:172.21.15.165:3300/0 conn(0x7f46b406dd30 0x7f46b406e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.802+0000 7f46b9200640 1 --2- 172.21.15.153:0/1709785056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b4071cb0 0x7f46b4072130 secure :-1 s=READY pgs=3354 cs=0 l=1 rev1=1 crypto rx=0x7f46b40cfc50 tx=0x7f46a802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbfd0775721c4f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.803+0000 7f46b3e00640 1 -- 172.21.15.153:0/1709785056 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8035020 con 0x7f46b4071cb0 2024-03-29T04:29:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.803+0000 7f46b3e00640 1 -- 172.21.15.153:0/1709785056 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a8031870 con 0x7f46b4071cb0 2024-03-29T04:29:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.803+0000 7f46b3e00640 1 -- 172.21.15.153:0/1709785056 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8031c40 con 0x7f46b4071cb0 2024-03-29T04:29:13.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.804+0000 7f46bc600640 1 -- 172.21.15.153:0/1709785056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b4071cb0 msgr2=0x7f46b4072130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:13.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.804+0000 7f46bc600640 1 --2- 172.21.15.153:0/1709785056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b4071cb0 0x7f46b4072130 secure :-1 s=READY pgs=3354 cs=0 l=1 rev1=1 crypto rx=0x7f46b40cfc50 tx=0x7f46a802b910 comp rx=0 tx=0).stop 2024-03-29T04:29:13.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.805+0000 7f46bc600640 1 -- 172.21.15.153:0/1709785056 shutdown_connections 2024-03-29T04:29:13.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.805+0000 7f46bc600640 1 --2- 172.21.15.153:0/1709785056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b4071cb0 0x7f46b4072130 unknown :-1 s=CLOSED pgs=3354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.805+0000 7f46bc600640 1 --2- 172.21.15.153:0/1709785056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b40ad800 0x7f46b40adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.805+0000 7f46bc600640 1 --2- 172.21.15.153:0/1709785056 >> v2:172.21.15.165:3300/0 conn(0x7f46b406dd30 0x7f46b406e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.805+0000 7f46bc600640 1 -- 172.21.15.153:0/1709785056 >> 172.21.15.153:0/1709785056 conn(0x7f46b40b1a30 msgr2=0x7f46b40b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:13.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.806+0000 7f46bc600640 1 -- 172.21.15.153:0/1709785056 shutdown_connections 2024-03-29T04:29:13.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.806+0000 7f46bc600640 1 -- 172.21.15.153:0/1709785056 wait complete. 2024-03-29T04:29:13.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.809+0000 7f46bc600640 1 Processor -- start 2024-03-29T04:29:13.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.809+0000 7f46bc600640 1 -- start start 2024-03-29T04:29:13.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.811+0000 7f46bc600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b406dd30 0x7f46b40c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:13.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.811+0000 7f46bc600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46b4071cb0 0x7f46b41f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:13.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.811+0000 7f46bc600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b40ad800 0x7f46b40add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:13.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.811+0000 7f46bc600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4071120 con 0x7f46b40ad800 2024-03-29T04:29:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.811+0000 7f46bc600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4070fa0 con 0x7f46b4071cb0 2024-03-29T04:29:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.811+0000 7f46bc600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f46b41629a0 con 0x7f46b406dd30 2024-03-29T04:29:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.812+0000 7f46b9c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b406dd30 0x7f46b40c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.812+0000 7f46ba600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b40ad800 0x7f46b40add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.812+0000 7f46b9c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b406dd30 0x7f46b40c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:55510/0 (socket says 172.21.15.153:55510) 2024-03-29T04:29:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.812+0000 7f46b9c00640 1 -- 172.21.15.153:0/3999092337 learned_addr learned my addr 172.21.15.153:0/3999092337 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.812+0000 7f46b9200640 1 --2- 172.21.15.153:0/3999092337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46b4071cb0 0x7f46b41f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:13.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.812+0000 7f46ba600640 1 -- 172.21.15.153:0/3999092337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b406dd30 msgr2=0x7f46b40c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:13.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.813+0000 7f46ba600640 1 --2- 172.21.15.153:0/3999092337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b406dd30 0x7f46b40c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.813+0000 7f46ba600640 1 -- 172.21.15.153:0/3999092337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46b4071cb0 msgr2=0x7f46b41f87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:13.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.813+0000 7f46ba600640 1 --2- 172.21.15.153:0/3999092337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46b4071cb0 0x7f46b41f87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:13.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.813+0000 7f46ba600640 1 -- 172.21.15.153:0/3999092337 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b40c4fd0 con 0x7f46b40ad800 2024-03-29T04:29:13.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.813+0000 7f46ba600640 1 --2- 172.21.15.153:0/3999092337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b40ad800 0x7f46b40add20 secure :-1 s=READY pgs=3355 cs=0 l=1 rev1=1 crypto rx=0x7f46a000afd0 tx=0x7f46a000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:13.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.814+0000 7f46b1600640 1 -- 172.21.15.153:0/3999092337 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0015070 con 0x7f46b40ad800 2024-03-29T04:29:13.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.814+0000 7f46b1600640 1 -- 172.21.15.153:0/3999092337 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a0004240 con 0x7f46b40ad800 2024-03-29T04:29:13.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.814+0000 7f46b1600640 1 -- 172.21.15.153:0/3999092337 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0003610 con 0x7f46b40ad800 2024-03-29T04:29:13.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.814+0000 7f46bc600640 1 -- 172.21.15.153:0/3999092337 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b40c52b0 con 0x7f46b40ad800 2024-03-29T04:29:13.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.815+0000 7f46bc600640 1 -- 172.21.15.153:0/3999092337 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b40c5870 con 0x7f46b40ad800 2024-03-29T04:29:13.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.816+0000 7f46bc600640 1 -- 172.21.15.153:0/3999092337 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b4068ff0 con 0x7f46b40ad800 2024-03-29T04:29:13.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.817+0000 7f46b1600640 1 -- 172.21.15.153:0/3999092337 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f46a00037b0 con 0x7f46b40ad800 2024-03-29T04:29:13.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.819+0000 7f46b1600640 1 --2- 172.21.15.153:0/3999092337 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f469406b5a0 0x7f469406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:13.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.819+0000 7f46b1600640 1 -- 172.21.15.153:0/3999092337 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f46a0037020 con 0x7f46b40ad800 2024-03-29T04:29:13.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.820+0000 7f46b9c00640 1 --2- 172.21.15.153:0/3999092337 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f469406b5a0 0x7f469406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:13.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.821+0000 7f46b9c00640 1 --2- 172.21.15.153:0/3999092337 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f469406b5a0 0x7f469406da60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f46ac007130 tx=0x7f46ac007880 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:13.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:13.824+0000 7f46b1600640 1 -- 172.21.15.153:0/3999092337 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f46a00581a0 con 0x7f46b40ad800 2024-03-29T04:29:14.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.188+0000 7f46bc600640 1 -- 172.21.15.153:0/3999092337 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46b40b5010 con 0x7f46b40ad800 2024-03-29T04:29:14.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.189+0000 7f46b1600640 1 -- 172.21.15.153:0/3999092337 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5190 (secure 0 0 0) 0x7f46a005c240 con 0x7f46b40ad800 2024-03-29T04:29:14.165 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:14.166 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3849778471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3849778471},{"type":"v1","addr":"172.21.15.165:6835","nonce":3849778471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/2718440878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2718440878},{"type":"v1","addr":"172.21.15.165:6833","nonce":2718440878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/974086107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":974086107},{"type":"v1","addr":"172.21.15.153:6836","nonce":974086107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T21:53:09.040388+0000","modified":"2024-03-28T21:53:12.151355+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6837/1209499946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1209499946},{"type":"v1","addr":"172.21.15.153:6837","nonce":1209499946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5070,"qdb_cluster":[5070]},"id":2}]} 2024-03-29T04:29:14.166 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 17 2024-03-29T04:29:14.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.192+0000 7f46bc600640 1 -- 172.21.15.153:0/3999092337 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f469406b5a0 msgr2=0x7f469406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:14.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.192+0000 7f46bc600640 1 --2- 172.21.15.153:0/3999092337 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f469406b5a0 0x7f469406da60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f46ac007130 tx=0x7f46ac007880 comp rx=0 tx=0).stop 2024-03-29T04:29:14.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.192+0000 7f46bc600640 1 -- 172.21.15.153:0/3999092337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b40ad800 msgr2=0x7f46b40add20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:14.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.192+0000 7f46bc600640 1 --2- 172.21.15.153:0/3999092337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b40ad800 0x7f46b40add20 secure :-1 s=READY pgs=3355 cs=0 l=1 rev1=1 crypto rx=0x7f46a000afd0 tx=0x7f46a000c950 comp rx=0 tx=0).stop 2024-03-29T04:29:14.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.192+0000 7f46bc600640 1 -- 172.21.15.153:0/3999092337 shutdown_connections 2024-03-29T04:29:14.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.192+0000 7f46bc600640 1 --2- 172.21.15.153:0/3999092337 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f469406b5a0 0x7f469406da60 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:14.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.192+0000 7f46bc600640 1 --2- 172.21.15.153:0/3999092337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b40ad800 0x7f46b40add20 unknown :-1 s=CLOSED pgs=3355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:14.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.192+0000 7f46bc600640 1 --2- 172.21.15.153:0/3999092337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46b4071cb0 0x7f46b41f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:14.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.192+0000 7f46bc600640 1 --2- 172.21.15.153:0/3999092337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b406dd30 0x7f46b40c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:14.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.192+0000 7f46bc600640 1 -- 172.21.15.153:0/3999092337 >> 172.21.15.153:0/3999092337 conn(0x7f46b40b1a30 msgr2=0x7f46b40b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:14.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.192+0000 7f46bc600640 1 -- 172.21.15.153:0/3999092337 shutdown_connections 2024-03-29T04:29:14.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.193+0000 7f46bc600640 1 -- 172.21.15.153:0/3999092337 wait complete. 2024-03-29T04:29:14.192 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:29:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.475+0000 7f7c67a00640 1 Processor -- start 2024-03-29T04:29:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.476+0000 7f7c67a00640 1 -- start start 2024-03-29T04:29:14.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.477+0000 7f7c67a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7c600b3a60 0x7f7c600d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.477+0000 7f7c67a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7c600d2900 0x7f7c600cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.477+0000 7f7c67a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c600ceca0 con 0x7f7c60161990 2024-03-29T04:29:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.477+0000 7f7c67a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f7c600d4810 con 0x7f7c600b3a60 2024-03-29T04:29:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.477+0000 7f7c67a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7c600d4af0 con 0x7f7c600d2900 2024-03-29T04:29:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.478+0000 7f7c65000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7c60161990 0x7f7c600d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:48460/0 (socket says 172.21.15.153:48460) 2024-03-29T04:29:14.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.478+0000 7f7c65000640 1 -- 172.21.15.153:0/671235208 learned_addr learned my addr 172.21.15.153:0/671235208 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:14.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.478+0000 7f7c65a00640 1 --2- 172.21.15.153:0/671235208 >> v2:172.21.15.165:3300/0 conn(0x7f7c600d2900 0x7f7c600cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:14.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.478+0000 7f7c5fe00640 1 --2- 172.21.15.153:0/671235208 >> v2:172.21.15.153:3300/0 conn(0x7f7c600b3a60 0x7f7c600d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:14.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.478+0000 7f7c5f400640 1 -- 172.21.15.153:0/671235208 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 243770056 0 0) 0x7f7c54001110 con 0x7f7c60161990 2024-03-29T04:29:14.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.478+0000 7f7c5f400640 1 -- 172.21.15.153:0/671235208 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c48003520 con 0x7f7c60161990 2024-03-29T04:29:14.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.478+0000 7f7c5fe00640 1 -- 172.21.15.153:0/671235208 >> v2:172.21.15.165:3300/0 conn(0x7f7c600d2900 msgr2=0x7f7c600cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:14.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.478+0000 7f7c5fe00640 1 --2- 172.21.15.153:0/671235208 >> v2:172.21.15.165:3300/0 conn(0x7f7c600d2900 0x7f7c600cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:14.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.478+0000 7f7c5fe00640 1 -- 172.21.15.153:0/671235208 >> v1:172.21.15.153:6789/0 conn(0x7f7c60161990 legacy=0x7f7c600d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:14.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.478+0000 7f7c5fe00640 1 -- 172.21.15.153:0/671235208 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c600d4dd0 con 0x7f7c600b3a60 2024-03-29T04:29:14.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.480+0000 7f7c5fe00640 1 --2- 172.21.15.153:0/671235208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c600b3a60 0x7f7c600d23c0 secure :-1 s=READY pgs=3357 cs=0 l=1 rev1=1 crypto rx=0x7f7c60163220 tx=0x7f7c4c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df489b21326271b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:14.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.480+0000 7f7c5f400640 1 -- 172.21.15.153:0/671235208 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c035020 con 0x7f7c600b3a60 2024-03-29T04:29:14.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.480+0000 7f7c5f400640 1 -- 172.21.15.153:0/671235208 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4c031830 con 0x7f7c600b3a60 2024-03-29T04:29:14.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.480+0000 7f7c5f400640 1 -- 172.21.15.153:0/671235208 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c031c00 con 0x7f7c600b3a60 2024-03-29T04:29:14.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.481+0000 7f7c67a00640 1 -- 172.21.15.153:0/671235208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c600b3a60 msgr2=0x7f7c600d23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:14.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.481+0000 7f7c67a00640 1 --2- 172.21.15.153:0/671235208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c600b3a60 0x7f7c600d23c0 secure :-1 s=READY pgs=3357 cs=0 l=1 rev1=1 crypto rx=0x7f7c60163220 tx=0x7f7c4c02b8d0 comp rx=0 tx=0).stop 2024-03-29T04:29:14.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.481+0000 7f7c67a00640 1 -- 172.21.15.153:0/671235208 shutdown_connections 2024-03-29T04:29:14.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.481+0000 7f7c67a00640 1 --2- 172.21.15.153:0/671235208 >> v2:172.21.15.165:3300/0 conn(0x7f7c600d2900 0x7f7c600cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:14.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.481+0000 7f7c67a00640 1 --2- 172.21.15.153:0/671235208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c600b3a60 0x7f7c600d23c0 unknown :-1 s=CLOSED pgs=3357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:14.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.481+0000 7f7c67a00640 1 -- 172.21.15.153:0/671235208 >> 172.21.15.153:0/671235208 conn(0x7f7c6009d430 msgr2=0x7f7c600d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:14.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.482+0000 7f7c67a00640 1 -- 172.21.15.153:0/671235208 shutdown_connections 2024-03-29T04:29:14.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.482+0000 7f7c67a00640 1 -- 172.21.15.153:0/671235208 wait complete. 2024-03-29T04:29:14.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.484+0000 7f7c67a00640 1 Processor -- start 2024-03-29T04:29:14.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.484+0000 7f7c67a00640 1 -- start start 2024-03-29T04:29:14.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.485+0000 7f7c67a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c600b3a60 0x7f7c60152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:14.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.485+0000 7f7c67a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c600d2900 0x7f7c601e6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:14.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.485+0000 7f7c67a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c60161990 0x7f7c6014ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:14.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.485+0000 7f7c67a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7c600b3ec0 con 0x7f7c60161990 2024-03-29T04:29:14.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.486+0000 7f7c67a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7c600cf200 con 0x7f7c600d2900 2024-03-29T04:29:14.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.486+0000 7f7c67a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7c600b4040 con 0x7f7c600b3a60 2024-03-29T04:29:14.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.486+0000 7f7c5fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c600d2900 0x7f7c601e6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:14.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.486+0000 7f7c5fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c600d2900 0x7f7c601e6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:52118/0 (socket says 172.21.15.153:52118) 2024-03-29T04:29:14.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.486+0000 7f7c5fe00640 1 -- 172.21.15.153:0/3836739299 learned_addr learned my addr 172.21.15.153:0/3836739299 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:14.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.486+0000 7f7c65a00640 1 --2- 172.21.15.153:0/3836739299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c60161990 0x7f7c6014ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:14.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.486+0000 7f7c65000640 1 --2- 172.21.15.153:0/3836739299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c600b3a60 0x7f7c60152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:14.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.487+0000 7f7c65000640 1 -- 172.21.15.153:0/3836739299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c600d2900 msgr2=0x7f7c601e6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:14.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.487+0000 7f7c65000640 1 --2- 172.21.15.153:0/3836739299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c600d2900 0x7f7c601e6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:14.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.487+0000 7f7c65000640 1 -- 172.21.15.153:0/3836739299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c60161990 msgr2=0x7f7c6014ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:14.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.487+0000 7f7c65000640 1 --2- 172.21.15.153:0/3836739299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c60161990 0x7f7c6014ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:14.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.487+0000 7f7c65000640 1 -- 172.21.15.153:0/3836739299 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c601f8360 con 0x7f7c600b3a60 2024-03-29T04:29:14.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.487+0000 7f7c65000640 1 --2- 172.21.15.153:0/3836739299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c600b3a60 0x7f7c60152250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400c390 tx=0x7f7c5400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:14.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.488+0000 7f7c5cc00640 1 -- 172.21.15.153:0/3836739299 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54017070 con 0x7f7c600b3a60 2024-03-29T04:29:14.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.488+0000 7f7c5cc00640 1 -- 172.21.15.153:0/3836739299 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c54005ce0 con 0x7f7c600b3a60 2024-03-29T04:29:14.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.488+0000 7f7c5cc00640 1 -- 172.21.15.153:0/3836739299 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c540072f0 con 0x7f7c600b3a60 2024-03-29T04:29:14.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.488+0000 7f7c67a00640 1 -- 172.21.15.153:0/3836739299 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c601e6fc0 con 0x7f7c600b3a60 2024-03-29T04:29:14.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.489+0000 7f7c67a00640 1 -- 172.21.15.153:0/3836739299 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c601fbf20 con 0x7f7c600b3a60 2024-03-29T04:29:14.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.490+0000 7f7c67a00640 1 -- 172.21.15.153:0/3836739299 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c60068ff0 con 0x7f7c600b3a60 2024-03-29T04:29:14.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.492+0000 7f7c5cc00640 1 -- 172.21.15.153:0/3836739299 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f7c5401a070 con 0x7f7c600b3a60 2024-03-29T04:29:14.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.493+0000 7f7c5cc00640 1 --2- 172.21.15.153:0/3836739299 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7c4006b5a0 0x7f7c4006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:14.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.494+0000 7f7c5cc00640 1 -- 172.21.15.153:0/3836739299 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f7c54089690 con 0x7f7c600b3a60 2024-03-29T04:29:14.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.494+0000 7f7c5fe00640 1 --2- 172.21.15.153:0/3836739299 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7c4006b5a0 0x7f7c4006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.497+0000 7f7c5fe00640 1 --2- 172.21.15.153:0/3836739299 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7c4006b5a0 0x7f7c4006da60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7c601fba00 tx=0x7f7c4c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.499+0000 7f7c5cc00640 1 -- 172.21.15.153:0/3836739299 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7c600ceca0 con 0x7f7c600b3a60 2024-03-29T04:29:14.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.874+0000 7f7c67a00640 1 -- 172.21.15.153:0/3836739299 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c6009d8d0 con 0x7f7c600b3a60 2024-03-29T04:29:14.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.876+0000 7f7c5cc00640 1 -- 172.21.15.153:0/3836739299 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5190 (secure 0 0 0) 0x7f7c54057e10 con 0x7f7c600b3a60 2024-03-29T04:29:14.852 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:14.852 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3849778471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3849778471},{"type":"v1","addr":"172.21.15.165:6835","nonce":3849778471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/2718440878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2718440878},{"type":"v1","addr":"172.21.15.165:6833","nonce":2718440878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/974086107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":974086107},{"type":"v1","addr":"172.21.15.153:6836","nonce":974086107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T21:53:09.040388+0000","modified":"2024-03-28T21:53:12.151355+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6837/1209499946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1209499946},{"type":"v1","addr":"172.21.15.153:6837","nonce":1209499946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5070,"qdb_cluster":[5070]},"id":2}]} 2024-03-29T04:29:14.853 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 17 2024-03-29T04:29:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.880+0000 7f7c67a00640 1 -- 172.21.15.153:0/3836739299 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7c4006b5a0 msgr2=0x7f7c4006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.880+0000 7f7c67a00640 1 --2- 172.21.15.153:0/3836739299 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7c4006b5a0 0x7f7c4006da60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7c601fba00 tx=0x7f7c4c03c040 comp rx=0 tx=0).stop 2024-03-29T04:29:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.880+0000 7f7c67a00640 1 -- 172.21.15.153:0/3836739299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c600b3a60 msgr2=0x7f7c60152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.880+0000 7f7c67a00640 1 --2- 172.21.15.153:0/3836739299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c600b3a60 0x7f7c60152250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400c390 tx=0x7f7c5400c850 comp rx=0 tx=0).stop 2024-03-29T04:29:14.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.882+0000 7f7c67a00640 1 -- 172.21.15.153:0/3836739299 shutdown_connections 2024-03-29T04:29:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.882+0000 7f7c67a00640 1 --2- 172.21.15.153:0/3836739299 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f7c4006b5a0 0x7f7c4006da60 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.882+0000 7f7c67a00640 1 --2- 172.21.15.153:0/3836739299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c60161990 0x7f7c6014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.882+0000 7f7c67a00640 1 --2- 172.21.15.153:0/3836739299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c600d2900 0x7f7c601e6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.882+0000 7f7c67a00640 1 --2- 172.21.15.153:0/3836739299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c600b3a60 0x7f7c60152250 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.882+0000 7f7c67a00640 1 -- 172.21.15.153:0/3836739299 >> 172.21.15.153:0/3836739299 conn(0x7f7c6009d430 msgr2=0x7f7c600b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.882+0000 7f7c67a00640 1 -- 172.21.15.153:0/3836739299 shutdown_connections 2024-03-29T04:29:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:14.882+0000 7f7c67a00640 1 -- 172.21.15.153:0/3836739299 wait complete. 2024-03-29T04:29:14.884 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:29:15.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.142+0000 7f258fe00640 1 Processor -- start 2024-03-29T04:29:15.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.142+0000 7f258fe00640 1 -- start start 2024-03-29T04:29:15.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.143+0000 7f258fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2588162800 0x7f25880d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:15.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.143+0000 7f258fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f25880d0a30 0x7f258806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:15.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.144+0000 7f258fe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f258806d900 0x7f258806dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:15.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.144+0000 7f258fe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f25880d0e70 con 0x7f258806d900 2024-03-29T04:29:15.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.144+0000 7f258fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f258806e2b0 con 0x7f25880d0a30 2024-03-29T04:29:15.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.144+0000 7f258fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f258806c320 con 0x7f2588162800 2024-03-29T04:29:15.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.144+0000 7f258ca00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f25880d0a30 0x7f258806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:15.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.144+0000 7f258ca00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f25880d0a30 0x7f258806d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:52126/0 (socket says 172.21.15.153:52126) 2024-03-29T04:29:15.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.144+0000 7f258ca00640 1 -- 172.21.15.153:0/2597853489 learned_addr learned my addr 172.21.15.153:0/2597853489 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:15.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.144+0000 7f258d400640 1 --2- 172.21.15.153:0/2597853489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2588162800 0x7f25880d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:15.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.145+0000 7f258de00640 1 --2- 172.21.15.153:0/2597853489 >> v2:172.21.15.153:3300/0 conn(0x7f258806d900 0x7f258806dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:15.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.145+0000 7f258d400640 1 -- 172.21.15.153:0/2597853489 >> v2:172.21.15.165:3300/0 conn(0x7f25880d0a30 msgr2=0x7f258806d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:15.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.145+0000 7f258d400640 1 --2- 172.21.15.153:0/2597853489 >> v2:172.21.15.165:3300/0 conn(0x7f25880d0a30 0x7f258806d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.145+0000 7f258d400640 1 -- 172.21.15.153:0/2597853489 >> v2:172.21.15.153:3300/0 conn(0x7f258806d900 msgr2=0x7f258806dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:15.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.145+0000 7f258d400640 1 --2- 172.21.15.153:0/2597853489 >> v2:172.21.15.153:3300/0 conn(0x7f258806d900 0x7f258806dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.145+0000 7f258d400640 1 -- 172.21.15.153:0/2597853489 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258806c600 con 0x7f2588162800 2024-03-29T04:29:15.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.147+0000 7f258d400640 1 --2- 172.21.15.153:0/2597853489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2588162800 0x7f25880d04f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f25880751f0 tx=0x7f257c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9733fecf50a831b server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:15.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.148+0000 7f2587e00640 1 -- 172.21.15.153:0/2597853489 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c0315a0 con 0x7f2588162800 2024-03-29T04:29:15.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.148+0000 7f2587e00640 1 -- 172.21.15.153:0/2597853489 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257c037070 con 0x7f2588162800 2024-03-29T04:29:15.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.148+0000 7f2587e00640 1 -- 172.21.15.153:0/2597853489 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c031960 con 0x7f2588162800 2024-03-29T04:29:15.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.149+0000 7f258fe00640 1 -- 172.21.15.153:0/2597853489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2588162800 msgr2=0x7f25880d04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:15.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.149+0000 7f258fe00640 1 --2- 172.21.15.153:0/2597853489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2588162800 0x7f25880d04f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f25880751f0 tx=0x7f257c02b840 comp rx=0 tx=0).stop 2024-03-29T04:29:15.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.149+0000 7f258fe00640 1 -- 172.21.15.153:0/2597853489 shutdown_connections 2024-03-29T04:29:15.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.149+0000 7f258fe00640 1 --2- 172.21.15.153:0/2597853489 >> v2:172.21.15.153:3300/0 conn(0x7f258806d900 0x7f258806dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.149+0000 7f258fe00640 1 --2- 172.21.15.153:0/2597853489 >> v2:172.21.15.165:3300/0 conn(0x7f25880d0a30 0x7f258806d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.149+0000 7f258fe00640 1 --2- 172.21.15.153:0/2597853489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2588162800 0x7f25880d04f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.149+0000 7f258fe00640 1 -- 172.21.15.153:0/2597853489 >> 172.21.15.153:0/2597853489 conn(0x7f25880d1ea0 msgr2=0x7f25880d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:15.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.149+0000 7f258fe00640 1 -- 172.21.15.153:0/2597853489 shutdown_connections 2024-03-29T04:29:15.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.149+0000 7f258fe00640 1 -- 172.21.15.153:0/2597853489 wait complete. 2024-03-29T04:29:15.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.152+0000 7f258fe00640 1 Processor -- start 2024-03-29T04:29:15.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.152+0000 7f258fe00640 1 -- start start 2024-03-29T04:29:15.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.154+0000 7f258fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f258806d900 0x7f25881faff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.154+0000 7f258fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25880d0a30 0x7f25880b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.154+0000 7f258fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2588162800 0x7f25880ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.154+0000 7f258fe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f258806cea0 con 0x7f25880d0a30 2024-03-29T04:29:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.154+0000 7f258fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f258806cbc0 con 0x7f258806d900 2024-03-29T04:29:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.154+0000 7f258fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2588162be0 con 0x7f2588162800 2024-03-29T04:29:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.154+0000 7f258d400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f258806d900 0x7f25881faff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.154+0000 7f258d400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f258806d900 0x7f25881faff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:52142/0 (socket says 172.21.15.153:52142) 2024-03-29T04:29:15.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.154+0000 7f258d400640 1 -- 172.21.15.153:0/2228452975 learned_addr learned my addr 172.21.15.153:0/2228452975 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:15.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.154+0000 7f258ca00640 1 --2- 172.21.15.153:0/2228452975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25880d0a30 0x7f25880b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:15.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.154+0000 7f258de00640 1 --2- 172.21.15.153:0/2228452975 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2588162800 0x7f25880ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:15.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.155+0000 7f258d400640 1 -- 172.21.15.153:0/2228452975 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2588162800 msgr2=0x7f25880ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:15.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.155+0000 7f258d400640 1 --2- 172.21.15.153:0/2228452975 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2588162800 0x7f25880ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.155+0000 7f258d400640 1 -- 172.21.15.153:0/2228452975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25880d0a30 msgr2=0x7f25880b7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:15.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.155+0000 7f258d400640 1 --2- 172.21.15.153:0/2228452975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25880d0a30 0x7f25880b7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.155+0000 7f258d400640 1 -- 172.21.15.153:0/2228452975 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25880b57f0 con 0x7f258806d900 2024-03-29T04:29:15.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.156+0000 7f258d400640 1 --2- 172.21.15.153:0/2228452975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f258806d900 0x7f25881faff0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f257c009890 tx=0x7f257c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:15.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.156+0000 7f2585600640 1 -- 172.21.15.153:0/2228452975 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c032840 con 0x7f258806d900 2024-03-29T04:29:15.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.156+0000 7f2585600640 1 -- 172.21.15.153:0/2228452975 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257c0329e0 con 0x7f258806d900 2024-03-29T04:29:15.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.156+0000 7f2585600640 1 -- 172.21.15.153:0/2228452975 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c032840 con 0x7f258806d900 2024-03-29T04:29:15.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.157+0000 7f258fe00640 1 -- 172.21.15.153:0/2228452975 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25880b5ad0 con 0x7f258806d900 2024-03-29T04:29:15.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.157+0000 7f258fe00640 1 -- 172.21.15.153:0/2228452975 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25880b6090 con 0x7f258806d900 2024-03-29T04:29:15.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.159+0000 7f258fe00640 1 -- 172.21.15.153:0/2228452975 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25880681c0 con 0x7f258806d900 2024-03-29T04:29:15.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.160+0000 7f2585600640 1 -- 172.21.15.153:0/2228452975 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f257c032b90 con 0x7f258806d900 2024-03-29T04:29:15.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.162+0000 7f2585600640 1 --2- 172.21.15.153:0/2228452975 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f256c06b6d0 0x7f256c06db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:15.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.162+0000 7f2585600640 1 -- 172.21.15.153:0/2228452975 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f257c02f030 con 0x7f258806d900 2024-03-29T04:29:15.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.163+0000 7f258ca00640 1 --2- 172.21.15.153:0/2228452975 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f256c06b6d0 0x7f256c06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:15.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.164+0000 7f258ca00640 1 --2- 172.21.15.153:0/2228452975 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f256c06b6d0 0x7f256c06db90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f25880a0160 tx=0x7f2578008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:15.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.169+0000 7f2585600640 1 -- 172.21.15.153:0/2228452975 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f257c040070 con 0x7f258806d900 2024-03-29T04:29:15.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.479+0000 7f258fe00640 1 -- 172.21.15.153:0/2228452975 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25880b3500 con 0x7f258806d900 2024-03-29T04:29:15.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.483+0000 7f2585600640 1 -- 172.21.15.153:0/2228452975 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16717 (secure 0 0 0) 0x7f257c07a8b0 con 0x7f258806d900 2024-03-29T04:29:15.461 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:15.461 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":35,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-28T21:53:10.602850+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-28T21:53:06.943079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-28T21:53:08.054176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:29:15.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.487+0000 7f258fe00640 1 -- 172.21.15.153:0/2228452975 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f256c06b6d0 msgr2=0x7f256c06db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:15.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.487+0000 7f258fe00640 1 --2- 172.21.15.153:0/2228452975 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f256c06b6d0 0x7f256c06db90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f25880a0160 tx=0x7f2578008040 comp rx=0 tx=0).stop 2024-03-29T04:29:15.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.487+0000 7f258fe00640 1 -- 172.21.15.153:0/2228452975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f258806d900 msgr2=0x7f25881faff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:15.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.487+0000 7f258fe00640 1 --2- 172.21.15.153:0/2228452975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f258806d900 0x7f25881faff0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f257c009890 tx=0x7f257c0046c0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.487+0000 7f258fe00640 1 -- 172.21.15.153:0/2228452975 shutdown_connections 2024-03-29T04:29:15.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.487+0000 7f258fe00640 1 --2- 172.21.15.153:0/2228452975 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f256c06b6d0 0x7f256c06db90 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.487+0000 7f258fe00640 1 --2- 172.21.15.153:0/2228452975 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2588162800 0x7f25880ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.487+0000 7f258fe00640 1 --2- 172.21.15.153:0/2228452975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25880d0a30 0x7f25880b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.487+0000 7f258fe00640 1 --2- 172.21.15.153:0/2228452975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f258806d900 0x7f25881faff0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.487+0000 7f258fe00640 1 -- 172.21.15.153:0/2228452975 >> 172.21.15.153:0/2228452975 conn(0x7f25880d1ea0 msgr2=0x7f25880b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:15.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.487+0000 7f258fe00640 1 -- 172.21.15.153:0/2228452975 shutdown_connections 2024-03-29T04:29:15.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.487+0000 7f258fe00640 1 -- 172.21.15.153:0/2228452975 wait complete. 2024-03-29T04:29:15.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-29T04:29:15.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.771+0000 7f5dfd400640 1 Processor -- start 2024-03-29T04:29:15.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.772+0000 7f5dfd400640 1 -- start start 2024-03-29T04:29:15.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.774+0000 7f5dfd400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5df80b38e0 0x7f5df80d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:15.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.774+0000 7f5dfd400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df80d28e0 con 0x7f5df8161b40 2024-03-29T04:29:15.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.774+0000 7f5dfd400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df80d2bc0 con 0x7f5df8161760 2024-03-29T04:29:15.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.774+0000 7f5dfd400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f5df80d2ea0 con 0x7f5df80b38e0 2024-03-29T04:29:15.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.774+0000 7f5df5e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5df80b38e0 0x7f5df80d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:15.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.774+0000 7f5df5e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5df80b38e0 0x7f5df80d09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58878/0 (socket says 172.21.15.153:58878) 2024-03-29T04:29:15.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.774+0000 7f5df5e00640 1 -- 172.21.15.153:0/2024103312 learned_addr learned my addr 172.21.15.153:0/2024103312 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:15.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.775+0000 7f5df5e00640 1 -- 172.21.15.153:0/2024103312 >> v1:172.21.15.165:6789/0 conn(0x7f5df8161760 legacy=0x7f5df80d4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:15.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.775+0000 7f5df5e00640 1 -- 172.21.15.153:0/2024103312 >> v1:172.21.15.153:6789/0 conn(0x7f5df8161b40 legacy=0x7f5df80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:15.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.775+0000 7f5df5e00640 1 -- 172.21.15.153:0/2024103312 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df80cec70 con 0x7f5df80b38e0 2024-03-29T04:29:15.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.776+0000 7f5df5e00640 1 --2- 172.21.15.153:0/2024103312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df80b38e0 0x7f5df80d09a0 secure :-1 s=READY pgs=3359 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009870 tx=0x7f5de402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249393ea175a2875 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:15.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.776+0000 7f5df5400640 1 -- 172.21.15.153:0/2024103312 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4035020 con 0x7f5df80b38e0 2024-03-29T04:29:15.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.777+0000 7f5df5400640 1 -- 172.21.15.153:0/2024103312 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de4031870 con 0x7f5df80b38e0 2024-03-29T04:29:15.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.777+0000 7f5df5400640 1 -- 172.21.15.153:0/2024103312 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4031c40 con 0x7f5df80b38e0 2024-03-29T04:29:15.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.778+0000 7f5dfd400640 1 -- 172.21.15.153:0/2024103312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df80b38e0 msgr2=0x7f5df80d09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:15.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.778+0000 7f5dfd400640 1 --2- 172.21.15.153:0/2024103312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df80b38e0 0x7f5df80d09a0 secure :-1 s=READY pgs=3359 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009870 tx=0x7f5de402b910 comp rx=0 tx=0).stop 2024-03-29T04:29:15.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.778+0000 7f5dfd400640 1 -- 172.21.15.153:0/2024103312 shutdown_connections 2024-03-29T04:29:15.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.778+0000 7f5dfd400640 1 --2- 172.21.15.153:0/2024103312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df80b38e0 0x7f5df80d09a0 unknown :-1 s=CLOSED pgs=3359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.778+0000 7f5dfd400640 1 -- 172.21.15.153:0/2024103312 >> 172.21.15.153:0/2024103312 conn(0x7f5df809d430 msgr2=0x7f5df80d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:15.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.778+0000 7f5dfd400640 1 -- 172.21.15.153:0/2024103312 shutdown_connections 2024-03-29T04:29:15.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.778+0000 7f5dfd400640 1 -- 172.21.15.153:0/2024103312 wait complete. 2024-03-29T04:29:15.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.781+0000 7f5dfd400640 1 Processor -- start 2024-03-29T04:29:15.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.781+0000 7f5dfd400640 1 -- start start 2024-03-29T04:29:15.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.782+0000 7f5dfd400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df80b38e0 0x7f5df80b9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:15.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.783+0000 7f5dfd400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5df8161760 0x7f5df81e7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:15.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.783+0000 7f5dfd400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5df8161b40 0x7f5df81e7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.783+0000 7f5dfd400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80d0ee0 con 0x7f5df80b38e0 2024-03-29T04:29:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.783+0000 7f5dfd400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80b5200 con 0x7f5df8161b40 2024-03-29T04:29:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.783+0000 7f5dfd400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5df80d1060 con 0x7f5df8161760 2024-03-29T04:29:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.783+0000 7f5df6800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df80b38e0 0x7f5df80b9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.783+0000 7f5df6800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df80b38e0 0x7f5df80b9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58884/0 (socket says 172.21.15.153:58884) 2024-03-29T04:29:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.783+0000 7f5df6800640 1 -- 172.21.15.153:0/1425372187 learned_addr learned my addr 172.21.15.153:0/1425372187 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.783+0000 7f5df7200640 1 --2- 172.21.15.153:0/1425372187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5df8161b40 0x7f5df81e7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.784+0000 7f5df6800640 1 -- 172.21.15.153:0/1425372187 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5df8161760 msgr2=0x7f5df81e7680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-29T04:29:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.784+0000 7f5df6800640 1 --2- 172.21.15.153:0/1425372187 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5df8161760 0x7f5df81e7680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.784+0000 7f5df6800640 1 -- 172.21.15.153:0/1425372187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5df8161b40 msgr2=0x7f5df81e7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.784+0000 7f5df6800640 1 --2- 172.21.15.153:0/1425372187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5df8161b40 0x7f5df81e7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.784+0000 7f5df6800640 1 -- 172.21.15.153:0/1425372187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df80ccd30 con 0x7f5df80b38e0 2024-03-29T04:29:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.784+0000 7f5df7200640 1 --2- 172.21.15.153:0/1425372187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5df8161b40 0x7f5df81e7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:15.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.784+0000 7f5df6800640 1 --2- 172.21.15.153:0/1425372187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df80b38e0 0x7f5df80b9590 secure :-1 s=READY pgs=3360 cs=0 l=1 rev1=1 crypto rx=0x7f5de800c460 tx=0x7f5de800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:15.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.785+0000 7f5deea00640 1 -- 172.21.15.153:0/1425372187 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de8016020 con 0x7f5df80b38e0 2024-03-29T04:29:15.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.785+0000 7f5deea00640 1 -- 172.21.15.153:0/1425372187 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de8012870 con 0x7f5df80b38e0 2024-03-29T04:29:15.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.785+0000 7f5deea00640 1 -- 172.21.15.153:0/1425372187 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de8012c60 con 0x7f5df80b38e0 2024-03-29T04:29:15.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.785+0000 7f5dfd400640 1 -- 172.21.15.153:0/1425372187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df80ccfd0 con 0x7f5df80b38e0 2024-03-29T04:29:15.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.785+0000 7f5dfd400640 1 -- 172.21.15.153:0/1425372187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df80cd590 con 0x7f5df80b38e0 2024-03-29T04:29:15.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.787+0000 7f5dfd400640 1 -- 172.21.15.153:0/1425372187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5df80cd9c0 con 0x7f5df80b38e0 2024-03-29T04:29:15.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.790+0000 7f5deea00640 1 -- 172.21.15.153:0/1425372187 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f5de8019020 con 0x7f5df80b38e0 2024-03-29T04:29:15.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.791+0000 7f5deea00640 1 --2- 172.21.15.153:0/1425372187 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5dd806b550 0x7f5dd806da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:15.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.791+0000 7f5deea00640 1 -- 172.21.15.153:0/1425372187 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f5de808ac90 con 0x7f5df80b38e0 2024-03-29T04:29:15.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.793+0000 7f5df5e00640 1 --2- 172.21.15.153:0/1425372187 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5dd806b550 0x7f5dd806da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:15.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.798+0000 7f5deea00640 1 -- 172.21.15.153:0/1425372187 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5de8020020 con 0x7f5df80b38e0 2024-03-29T04:29:15.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:15.798+0000 7f5df5e00640 1 --2- 172.21.15.153:0/1425372187 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5dd806b550 0x7f5dd806da10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5de4036000 tx=0x7f5de4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:16.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.174+0000 7f5dfd400640 1 -- 172.21.15.153:0/1425372187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5df8068ff0 con 0x7f5df80b38e0 2024-03-29T04:29:16.159 INFO:tasks.ceph.mon.a.smithi153.stderr:2024-03-29T04:29:16.183+0000 7f3dbd600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-29T04:29:16.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.187+0000 7f5deea00640 1 -- 172.21.15.153:0/1425372187 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f5de8022300 con 0x7f5df80b38e0 2024-03-29T04:29:16.170 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-29T04:29:16.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.201+0000 7f5dfd400640 1 -- 172.21.15.153:0/1425372187 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5dd806b550 msgr2=0x7f5dd806da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:16.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.201+0000 7f5dfd400640 1 --2- 172.21.15.153:0/1425372187 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5dd806b550 0x7f5dd806da10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5de4036000 tx=0x7f5de4008030 comp rx=0 tx=0).stop 2024-03-29T04:29:16.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.201+0000 7f5dfd400640 1 -- 172.21.15.153:0/1425372187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df80b38e0 msgr2=0x7f5df80b9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:16.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.201+0000 7f5dfd400640 1 --2- 172.21.15.153:0/1425372187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df80b38e0 0x7f5df80b9590 secure :-1 s=READY pgs=3360 cs=0 l=1 rev1=1 crypto rx=0x7f5de800c460 tx=0x7f5de800c920 comp rx=0 tx=0).stop 2024-03-29T04:29:16.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.204+0000 7f5dfd400640 1 -- 172.21.15.153:0/1425372187 shutdown_connections 2024-03-29T04:29:16.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.204+0000 7f5dfd400640 1 --2- 172.21.15.153:0/1425372187 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f5dd806b550 0x7f5dd806da10 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:16.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.204+0000 7f5dfd400640 1 --2- 172.21.15.153:0/1425372187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5df8161b40 0x7f5df81e7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:16.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.204+0000 7f5dfd400640 1 --2- 172.21.15.153:0/1425372187 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5df8161760 0x7f5df81e7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:16.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.204+0000 7f5dfd400640 1 --2- 172.21.15.153:0/1425372187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df80b38e0 0x7f5df80b9590 unknown :-1 s=CLOSED pgs=3360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:16.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.204+0000 7f5dfd400640 1 -- 172.21.15.153:0/1425372187 >> 172.21.15.153:0/1425372187 conn(0x7f5df809d430 msgr2=0x7f5df80d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:16.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.205+0000 7f5dfd400640 1 -- 172.21.15.153:0/1425372187 shutdown_connections 2024-03-29T04:29:16.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.205+0000 7f5dfd400640 1 -- 172.21.15.153:0/1425372187 wait complete. 2024-03-29T04:29:16.209 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-29T04:29:16.377 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2024-03-29T04:29:16.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.410+0000 7f3c53200640 1 Processor -- start 2024-03-29T04:29:16.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.410+0000 7f3c53200640 1 -- start start 2024-03-29T04:29:16.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.411+0000 7f3c53200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3c4c1627b0 0x7f3c4c0d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:16.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.411+0000 7f3c53200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3c4c0d4ae0 0x7f3c4c0d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:16.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.412+0000 7f3c53200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4c0d0110 con 0x7f3c4c0b42e0 2024-03-29T04:29:16.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.412+0000 7f3c53200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f3c4c0b3e50 con 0x7f3c4c0d4ae0 2024-03-29T04:29:16.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.412+0000 7f3c53200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3c4c0d03f0 con 0x7f3c4c1627b0 2024-03-29T04:29:16.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.412+0000 7f3c51400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3c4c0d4ae0 0x7f3c4c0d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:16.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.412+0000 7f3c51400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3c4c0d4ae0 0x7f3c4c0d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58910/0 (socket says 172.21.15.153:58910) 2024-03-29T04:29:16.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.412+0000 7f3c51400640 1 -- 172.21.15.153:0/3732537082 learned_addr learned my addr 172.21.15.153:0/3732537082 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:16.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.412+0000 7f3c52800640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3c4c0b42e0 0x7f3c4c0b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:48474/0 (socket says 172.21.15.153:48474) 2024-03-29T04:29:16.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.412+0000 7f3c51e00640 1 --2- 172.21.15.153:0/3732537082 >> v2:172.21.15.165:3300/0 conn(0x7f3c4c1627b0 0x7f3c4c0d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:16.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.412+0000 7f3c51400640 1 -- 172.21.15.153:0/3732537082 >> v2:172.21.15.165:3300/0 conn(0x7f3c4c1627b0 msgr2=0x7f3c4c0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:16.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.412+0000 7f3c51400640 1 --2- 172.21.15.153:0/3732537082 >> v2:172.21.15.165:3300/0 conn(0x7f3c4c1627b0 0x7f3c4c0d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:16.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.412+0000 7f3c51400640 1 -- 172.21.15.153:0/3732537082 >> v1:172.21.15.153:6789/0 conn(0x7f3c4c0b42e0 legacy=0x7f3c4c0b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:16.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.412+0000 7f3c51400640 1 -- 172.21.15.153:0/3732537082 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c0d06d0 con 0x7f3c4c0d4ae0 2024-03-29T04:29:16.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.412+0000 7f3c50a00640 1 -- 172.21.15.153:0/3732537082 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1381362346 0 0) 0x7f3c4c0d0110 con 0x7f3c4c0b42e0 2024-03-29T04:29:16.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.413+0000 7f3c51400640 1 --2- 172.21.15.153:0/3732537082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0d4ae0 0x7f3c4c0d0f10 secure :-1 s=READY pgs=3365 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c08d940 tx=0x7f3c3c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f992c58a3f8cf34 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:16.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.414+0000 7f3c50a00640 1 -- 172.21.15.153:0/3732537082 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c035020 con 0x7f3c4c0d4ae0 2024-03-29T04:29:16.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.414+0000 7f3c50a00640 1 -- 172.21.15.153:0/3732537082 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3c031870 con 0x7f3c4c0d4ae0 2024-03-29T04:29:16.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.414+0000 7f3c50a00640 1 -- 172.21.15.153:0/3732537082 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c031c40 con 0x7f3c4c0d4ae0 2024-03-29T04:29:16.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.414+0000 7f3c53200640 1 -- 172.21.15.153:0/3732537082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0d4ae0 msgr2=0x7f3c4c0d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:16.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.414+0000 7f3c53200640 1 --2- 172.21.15.153:0/3732537082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0d4ae0 0x7f3c4c0d0f10 secure :-1 s=READY pgs=3365 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c08d940 tx=0x7f3c3c02b910 comp rx=0 tx=0).stop 2024-03-29T04:29:16.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.414+0000 7f3c53200640 1 -- 172.21.15.153:0/3732537082 shutdown_connections 2024-03-29T04:29:16.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.414+0000 7f3c53200640 1 --2- 172.21.15.153:0/3732537082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0d4ae0 0x7f3c4c0d0f10 unknown :-1 s=CLOSED pgs=3365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:16.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.414+0000 7f3c53200640 1 --2- 172.21.15.153:0/3732537082 >> v2:172.21.15.165:3300/0 conn(0x7f3c4c1627b0 0x7f3c4c0d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:16.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.414+0000 7f3c53200640 1 -- 172.21.15.153:0/3732537082 >> 172.21.15.153:0/3732537082 conn(0x7f3c4c09d500 msgr2=0x7f3c4c0d41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:16.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.414+0000 7f3c53200640 1 -- 172.21.15.153:0/3732537082 shutdown_connections 2024-03-29T04:29:16.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.414+0000 7f3c53200640 1 -- 172.21.15.153:0/3732537082 wait complete. 2024-03-29T04:29:16.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.416+0000 7f3c53200640 1 Processor -- start 2024-03-29T04:29:16.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.416+0000 7f3c53200640 1 -- start start 2024-03-29T04:29:16.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.417+0000 7f3c53200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0b42e0 0x7f3c4c1565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.417+0000 7f3c53200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c4c0d4ae0 0x7f3c4c0ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.417+0000 7f3c53200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c4c1627b0 0x7f3c4c0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.417+0000 7f3c53200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c162b90 con 0x7f3c4c0b42e0 2024-03-29T04:29:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.417+0000 7f3c53200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c0b3800 con 0x7f3c4c0d4ae0 2024-03-29T04:29:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.417+0000 7f3c53200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3c4c162d10 con 0x7f3c4c1627b0 2024-03-29T04:29:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.417+0000 7f3c51e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0b42e0 0x7f3c4c1565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.417+0000 7f3c51e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0b42e0 0x7f3c4c1565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58912/0 (socket says 172.21.15.153:58912) 2024-03-29T04:29:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.417+0000 7f3c51e00640 1 -- 172.21.15.153:0/3016519997 learned_addr learned my addr 172.21.15.153:0/3016519997 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.417+0000 7f3c51e00640 1 -- 172.21.15.153:0/3016519997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c4c1627b0 msgr2=0x7f3c4c0b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.417+0000 7f3c51e00640 1 --2- 172.21.15.153:0/3016519997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c4c1627b0 0x7f3c4c0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.418+0000 7f3c51e00640 1 -- 172.21.15.153:0/3016519997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c4c0d4ae0 msgr2=0x7f3c4c0ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.418+0000 7f3c51e00640 1 --2- 172.21.15.153:0/3016519997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c4c0d4ae0 0x7f3c4c0ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.418+0000 7f3c51e00640 1 -- 172.21.15.153:0/3016519997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c0c8c50 con 0x7f3c4c0b42e0 2024-03-29T04:29:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.418+0000 7f3c51e00640 1 --2- 172.21.15.153:0/3016519997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0b42e0 0x7f3c4c1565f0 secure :-1 s=READY pgs=3366 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000c7f0 tx=0x7f3c4000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.418+0000 7f3c46000640 1 -- 172.21.15.153:0/3016519997 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c40015070 con 0x7f3c4c0b42e0 2024-03-29T04:29:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.418+0000 7f3c46000640 1 -- 172.21.15.153:0/3016519997 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c40004220 con 0x7f3c4c0b42e0 2024-03-29T04:29:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.418+0000 7f3c53200640 1 -- 172.21.15.153:0/3016519997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4c0c9610 con 0x7f3c4c0b42e0 2024-03-29T04:29:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.418+0000 7f3c46000640 1 -- 172.21.15.153:0/3016519997 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c40007620 con 0x7f3c4c0b42e0 2024-03-29T04:29:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.418+0000 7f3c53200640 1 -- 172.21.15.153:0/3016519997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c4c0c9bd0 con 0x7f3c4c0b42e0 2024-03-29T04:29:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.419+0000 7f3c53200640 1 -- 172.21.15.153:0/3016519997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c4c068ff0 con 0x7f3c4c0b42e0 2024-03-29T04:29:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.420+0000 7f3c46000640 1 -- 172.21.15.153:0/3016519997 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f3c400079d0 con 0x7f3c4c0b42e0 2024-03-29T04:29:16.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.421+0000 7f3c46000640 1 --2- 172.21.15.153:0/3016519997 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3c3006b500 0x7f3c3006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:16.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.421+0000 7f3c46000640 1 -- 172.21.15.153:0/3016519997 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5795+0+0 (secure 0 0 0) 0x7f3c4008a2c0 con 0x7f3c4c0b42e0 2024-03-29T04:29:16.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.421+0000 7f3c51400640 1 --2- 172.21.15.153:0/3016519997 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3c3006b500 0x7f3c3006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:16.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.422+0000 7f3c51400640 1 --2- 172.21.15.153:0/3016519997 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3c3006b500 0x7f3c3006d9c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c036000 tx=0x7f3c3c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:16.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.425+0000 7f3c46000640 1 -- 172.21.15.153:0/3016519997 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3c40059050 con 0x7f3c4c0b42e0 2024-03-29T04:29:16.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:16.643+0000 7f3c53200640 1 -- 172.21.15.153:0/3016519997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3c4c0b5550 con 0x7f3c4c0b42e0 2024-03-29T04:29:17.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.338+0000 7f3c46000640 1 -- 172.21.15.153:0/3016519997 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f3c40058950 con 0x7f3c4c0b42e0 2024-03-29T04:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.343+0000 7f3c53200640 1 -- 172.21.15.153:0/3016519997 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3c3006b500 msgr2=0x7f3c3006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.343+0000 7f3c53200640 1 --2- 172.21.15.153:0/3016519997 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3c3006b500 0x7f3c3006d9c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c036000 tx=0x7f3c3c030000 comp rx=0 tx=0).stop 2024-03-29T04:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.343+0000 7f3c53200640 1 -- 172.21.15.153:0/3016519997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0b42e0 msgr2=0x7f3c4c1565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.343+0000 7f3c53200640 1 --2- 172.21.15.153:0/3016519997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0b42e0 0x7f3c4c1565f0 secure :-1 s=READY pgs=3366 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000c7f0 tx=0x7f3c4000ccb0 comp rx=0 tx=0).stop 2024-03-29T04:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.343+0000 7f3c53200640 1 -- 172.21.15.153:0/3016519997 shutdown_connections 2024-03-29T04:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.343+0000 7f3c53200640 1 --2- 172.21.15.153:0/3016519997 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f3c3006b500 0x7f3c3006d9c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.343+0000 7f3c53200640 1 --2- 172.21.15.153:0/3016519997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c4c1627b0 0x7f3c4c0b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.343+0000 7f3c53200640 1 --2- 172.21.15.153:0/3016519997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c4c0d4ae0 0x7f3c4c0ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:17.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.343+0000 7f3c53200640 1 --2- 172.21.15.153:0/3016519997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0b42e0 0x7f3c4c1565f0 unknown :-1 s=CLOSED pgs=3366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:17.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.343+0000 7f3c53200640 1 -- 172.21.15.153:0/3016519997 >> 172.21.15.153:0/3016519997 conn(0x7f3c4c09d500 msgr2=0x7f3c4c0b4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:17.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.344+0000 7f3c53200640 1 -- 172.21.15.153:0/3016519997 shutdown_connections 2024-03-29T04:29:17.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.344+0000 7f3c53200640 1 -- 172.21.15.153:0/3016519997 wait complete. 2024-03-29T04:29:17.344 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-29T04:29:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.576+0000 7f5613e00640 1 Processor -- start 2024-03-29T04:29:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.576+0000 7f5613e00640 1 -- start start 2024-03-29T04:29:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.577+0000 7f5613e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f560c0cc270 0x7f560c166bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.577+0000 7f5613e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f560c071fc0 0x7f560c072420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.577+0000 7f5613e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f560c167130 con 0x7f560c070e30 2024-03-29T04:29:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.577+0000 7f5613e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f560c072960 con 0x7f560c071fc0 2024-03-29T04:29:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.577+0000 7f5613e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f560c163b80 con 0x7f560c0cc270 2024-03-29T04:29:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.578+0000 7f5610a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f560c071fc0 0x7f560c072420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.578+0000 7f5611400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f560c0cc270 0x7f560c166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.578+0000 7f5610a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f560c071fc0 0x7f560c072420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:52184/0 (socket says 172.21.15.153:52184) 2024-03-29T04:29:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.578+0000 7f5610a00640 1 -- 172.21.15.153:0/3624968515 learned_addr learned my addr 172.21.15.153:0/3624968515 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.579+0000 7f5610a00640 1 -- 172.21.15.153:0/3624968515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f560c0cc270 msgr2=0x7f560c166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.579+0000 7f5610a00640 1 --2- 172.21.15.153:0/3624968515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f560c0cc270 0x7f560c166bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.579+0000 7f5610a00640 1 -- 172.21.15.153:0/3624968515 >> v1:172.21.15.165:6789/0 conn(0x7f560c070e30 legacy=0x7f560c071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.579+0000 7f5610a00640 1 -- 172.21.15.153:0/3624968515 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560c163000 con 0x7f560c071fc0 2024-03-29T04:29:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.579+0000 7f560be00640 1 -- 172.21.15.153:0/3624968515 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3348843801 0 0) 0x7f5604001490 con 0x7f560c070e30 2024-03-29T04:29:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.580+0000 7f5610a00640 1 --2- 172.21.15.153:0/3624968515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f560c071fc0 0x7f560c072420 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f560c163d00 tx=0x7f55f802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff701a0033f831 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.581+0000 7f560be00640 1 -- 172.21.15.153:0/3624968515 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8035020 con 0x7f560c071fc0 2024-03-29T04:29:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.581+0000 7f560be00640 1 -- 172.21.15.153:0/3624968515 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f8031640 con 0x7f560c071fc0 2024-03-29T04:29:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.581+0000 7f560be00640 1 -- 172.21.15.153:0/3624968515 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f802d040 con 0x7f560c071fc0 2024-03-29T04:29:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.582+0000 7f5613e00640 1 -- 172.21.15.153:0/3624968515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f560c071fc0 msgr2=0x7f560c072420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.582+0000 7f5613e00640 1 --2- 172.21.15.153:0/3624968515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f560c071fc0 0x7f560c072420 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f560c163d00 tx=0x7f55f802b8f0 comp rx=0 tx=0).stop 2024-03-29T04:29:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.582+0000 7f5613e00640 1 -- 172.21.15.153:0/3624968515 shutdown_connections 2024-03-29T04:29:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.582+0000 7f5613e00640 1 --2- 172.21.15.153:0/3624968515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f560c071fc0 0x7f560c072420 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.582+0000 7f5613e00640 1 --2- 172.21.15.153:0/3624968515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f560c0cc270 0x7f560c166bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.582+0000 7f5613e00640 1 -- 172.21.15.153:0/3624968515 >> 172.21.15.153:0/3624968515 conn(0x7f560c06b170 msgr2=0x7f560c06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.582+0000 7f5613e00640 1 -- 172.21.15.153:0/3624968515 shutdown_connections 2024-03-29T04:29:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.582+0000 7f5613e00640 1 -- 172.21.15.153:0/3624968515 wait complete. 2024-03-29T04:29:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.584+0000 7f5613e00640 1 Processor -- start 2024-03-29T04:29:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.584+0000 7f5613e00640 1 -- start start 2024-03-29T04:29:17.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5613e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f560c070e30 0x7f560c146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:17.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5613e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f560c071fc0 0x7f560c0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:17.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5613e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f560c0cc270 0x7f560c0b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:17.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5613e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f560c1638a0 con 0x7f560c0cc270 2024-03-29T04:29:17.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5613e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f560c1635c0 con 0x7f560c071fc0 2024-03-29T04:29:17.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5613e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f560c0b4190 con 0x7f560c070e30 2024-03-29T04:29:17.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5611e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f560c0cc270 0x7f560c0b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:17.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5611e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f560c0cc270 0x7f560c0b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58916/0 (socket says 172.21.15.153:58916) 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5611e00640 1 -- 172.21.15.153:0/968804920 learned_addr learned my addr 172.21.15.153:0/968804920 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5610a00640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f560c071fc0 0x7f560c0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5611400640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f560c070e30 0x7f560c146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5611e00640 1 -- 172.21.15.153:0/968804920 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f560c070e30 msgr2=0x7f560c146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5611e00640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f560c070e30 0x7f560c146e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5611e00640 1 -- 172.21.15.153:0/968804920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f560c071fc0 msgr2=0x7f560c0b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5611e00640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f560c071fc0 0x7f560c0b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5611e00640 1 -- 172.21.15.153:0/968804920 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560c1ec270 con 0x7f560c0cc270 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.585+0000 7f5611400640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f560c070e30 0x7f560c146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.586+0000 7f5611e00640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f560c0cc270 0x7f560c0b0ff0 secure :-1 s=READY pgs=3367 cs=0 l=1 rev1=1 crypto rx=0x7f560400c7f0 tx=0x7f560400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.586+0000 7f5609600640 1 -- 172.21.15.153:0/968804920 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604003da0 con 0x7f560c0cc270 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.586+0000 7f5609600640 1 -- 172.21.15.153:0/968804920 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5604005070 con 0x7f560c0cc270 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.586+0000 7f5613e00640 1 -- 172.21.15.153:0/968804920 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f560c1ec550 con 0x7f560c0cc270 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.586+0000 7f5609600640 1 -- 172.21.15.153:0/968804920 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604005460 con 0x7f560c0cc270 2024-03-29T04:29:17.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.586+0000 7f5613e00640 1 -- 172.21.15.153:0/968804920 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f560c147820 con 0x7f560c0cc270 2024-03-29T04:29:17.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.587+0000 7f5613e00640 1 -- 172.21.15.153:0/968804920 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f560c0690d0 con 0x7f560c0cc270 2024-03-29T04:29:17.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.588+0000 7f5609600640 1 -- 172.21.15.153:0/968804920 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f5604005600 con 0x7f560c0cc270 2024-03-29T04:29:17.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.589+0000 7f5609600640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f55ec06b500 0x7f55ec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:17.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.589+0000 7f5609600640 1 -- 172.21.15.153:0/968804920 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5795+0+0 (secure 0 0 0) 0x7f560408a1d0 con 0x7f560c0cc270 2024-03-29T04:29:17.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.589+0000 7f5611400640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f55ec06b500 0x7f55ec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:17.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.590+0000 7f5611400640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f55ec06b500 0x7f55ec06d9c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5600009a20 tx=0x7f5600008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:17.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.594+0000 7f5609600640 1 -- 172.21.15.153:0/968804920 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f560c167130 con 0x7f560c0cc270 2024-03-29T04:29:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:17.775+0000 7f5613e00640 1 -- 172.21.15.153:0/968804920 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f560c15b560 con 0x7f560c0cc270 2024-03-29T04:29:18.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.359+0000 7f5609600640 1 -- 172.21.15.153:0/968804920 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) ==== 181+0+0 (secure 0 0 0) 0x7f5604058fe0 con 0x7f560c0cc270 2024-03-29T04:29:18.336 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2024-03-29T04:29:18.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.363+0000 7f5613e00640 1 -- 172.21.15.153:0/968804920 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f55ec06b500 msgr2=0x7f55ec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:18.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.363+0000 7f5613e00640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f55ec06b500 0x7f55ec06d9c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5600009a20 tx=0x7f5600008040 comp rx=0 tx=0).stop 2024-03-29T04:29:18.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.363+0000 7f5613e00640 1 -- 172.21.15.153:0/968804920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f560c0cc270 msgr2=0x7f560c0b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:18.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.363+0000 7f5613e00640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f560c0cc270 0x7f560c0b0ff0 secure :-1 s=READY pgs=3367 cs=0 l=1 rev1=1 crypto rx=0x7f560400c7f0 tx=0x7f560400ccb0 comp rx=0 tx=0).stop 2024-03-29T04:29:18.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.363+0000 7f5613e00640 1 -- 172.21.15.153:0/968804920 shutdown_connections 2024-03-29T04:29:18.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.363+0000 7f5613e00640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f55ec06b500 0x7f55ec06d9c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:18.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.363+0000 7f5613e00640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f560c0cc270 0x7f560c0b0ff0 unknown :-1 s=CLOSED pgs=3367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:18.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.363+0000 7f5613e00640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f560c071fc0 0x7f560c0b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:18.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.363+0000 7f5613e00640 1 --2- 172.21.15.153:0/968804920 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f560c070e30 0x7f560c146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:18.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.363+0000 7f5613e00640 1 -- 172.21.15.153:0/968804920 >> 172.21.15.153:0/968804920 conn(0x7f560c06b170 msgr2=0x7f560c0ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:18.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.363+0000 7f5613e00640 1 -- 172.21.15.153:0/968804920 shutdown_connections 2024-03-29T04:29:18.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.363+0000 7f5613e00640 1 -- 172.21.15.153:0/968804920 wait complete. 2024-03-29T04:29:18.371 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-29T04:29:18.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.670+0000 7f9c45000640 1 Processor -- start 2024-03-29T04:29:18.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.670+0000 7f9c45000640 1 -- start start 2024-03-29T04:29:18.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.672+0000 7f9c45000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9c400cc270 0x7f9c40166bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:18.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.672+0000 7f9c45000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c40167130 con 0x7f9c4006e450 2024-03-29T04:29:18.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.672+0000 7f9c45000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c40071c50 con 0x7f9c40071fc0 2024-03-29T04:29:18.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.672+0000 7f9c45000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9c40163b80 con 0x7f9c400cc270 2024-03-29T04:29:18.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.672+0000 7f9c3e800640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9c4006e450 0x7f9c40071540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:48480/0 (socket says 172.21.15.153:48480) 2024-03-29T04:29:18.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.672+0000 7f9c3e800640 1 -- 172.21.15.153:0/3323929610 learned_addr learned my addr 172.21.15.153:0/3323929610 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:18.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.672+0000 7f9c3de00640 1 --2- 172.21.15.153:0/3323929610 >> v2:172.21.15.165:3300/0 conn(0x7f9c400cc270 0x7f9c40166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:18.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.673+0000 7f9c3d400640 1 -- 172.21.15.153:0/3323929610 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1702633521 0 0) 0x7f9c38001490 con 0x7f9c4006e450 2024-03-29T04:29:18.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.673+0000 7f9c3d400640 1 -- 172.21.15.153:0/3323929610 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c24003520 con 0x7f9c4006e450 2024-03-29T04:29:18.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.673+0000 7f9c3de00640 1 -- 172.21.15.153:0/3323929610 >> v1:172.21.15.165:6789/0 conn(0x7f9c40071fc0 legacy=0x7f9c40070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:18.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.673+0000 7f9c3de00640 1 -- 172.21.15.153:0/3323929610 >> v1:172.21.15.153:6789/0 conn(0x7f9c4006e450 legacy=0x7f9c40071540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:18.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.673+0000 7f9c3d400640 1 -- 172.21.15.153:0/3323929610 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424384656 0 0) 0x7f9c40071c50 con 0x7f9c40071fc0 2024-03-29T04:29:18.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.673+0000 7f9c3de00640 1 -- 172.21.15.153:0/3323929610 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c40163000 con 0x7f9c400cc270 2024-03-29T04:29:18.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.675+0000 7f9c3de00640 1 --2- 172.21.15.153:0/3323929610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c400cc270 0x7f9c40166bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9c300097a0 tx=0x7f9c3002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb696f09a04f0452 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:18.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.675+0000 7f9c3d400640 1 -- 172.21.15.153:0/3323929610 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30035020 con 0x7f9c400cc270 2024-03-29T04:29:18.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.675+0000 7f9c3d400640 1 -- 172.21.15.153:0/3323929610 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c30031830 con 0x7f9c400cc270 2024-03-29T04:29:18.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.675+0000 7f9c3d400640 1 -- 172.21.15.153:0/3323929610 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30031be0 con 0x7f9c400cc270 2024-03-29T04:29:18.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.676+0000 7f9c45000640 1 -- 172.21.15.153:0/3323929610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c400cc270 msgr2=0x7f9c40166bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:18.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.676+0000 7f9c45000640 1 --2- 172.21.15.153:0/3323929610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c400cc270 0x7f9c40166bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9c300097a0 tx=0x7f9c3002b8f0 comp rx=0 tx=0).stop 2024-03-29T04:29:18.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.677+0000 7f9c45000640 1 -- 172.21.15.153:0/3323929610 shutdown_connections 2024-03-29T04:29:18.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.677+0000 7f9c45000640 1 --2- 172.21.15.153:0/3323929610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c400cc270 0x7f9c40166bf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:18.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.677+0000 7f9c45000640 1 -- 172.21.15.153:0/3323929610 >> 172.21.15.153:0/3323929610 conn(0x7f9c4006b170 msgr2=0x7f9c4006b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:18.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.677+0000 7f9c45000640 1 -- 172.21.15.153:0/3323929610 shutdown_connections 2024-03-29T04:29:18.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.677+0000 7f9c45000640 1 -- 172.21.15.153:0/3323929610 wait complete. 2024-03-29T04:29:18.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.679+0000 7f9c45000640 1 Processor -- start 2024-03-29T04:29:18.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.679+0000 7f9c45000640 1 -- start start 2024-03-29T04:29:18.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.680+0000 7f9c45000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c4006e450 0x7f9c4015d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:18.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.680+0000 7f9c45000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c40071fc0 0x7f9c40146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:18.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.680+0000 7f9c45000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c400cc270 0x7f9c4015eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:18.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.680+0000 7f9c45000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c401638a0 con 0x7f9c400cc270 2024-03-29T04:29:18.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.680+0000 7f9c45000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9c401635c0 con 0x7f9c40071fc0 2024-03-29T04:29:18.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.680+0000 7f9c45000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9c400b4190 con 0x7f9c4006e450 2024-03-29T04:29:18.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.681+0000 7f9c37e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c40071fc0 0x7f9c40146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:18.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.681+0000 7f9c37e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c40071fc0 0x7f9c40146d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:52206/0 (socket says 172.21.15.153:52206) 2024-03-29T04:29:18.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.681+0000 7f9c37e00640 1 -- 172.21.15.153:0/259302869 learned_addr learned my addr 172.21.15.153:0/259302869 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:18.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.681+0000 7f9c3e800640 1 --2- 172.21.15.153:0/259302869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c400cc270 0x7f9c4015eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:18.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.681+0000 7f9c3de00640 1 --2- 172.21.15.153:0/259302869 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c4006e450 0x7f9c4015d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:18.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.681+0000 7f9c37e00640 1 -- 172.21.15.153:0/259302869 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c4006e450 msgr2=0x7f9c4015d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:18.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.681+0000 7f9c37e00640 1 --2- 172.21.15.153:0/259302869 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c4006e450 0x7f9c4015d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:18.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.681+0000 7f9c37e00640 1 -- 172.21.15.153:0/259302869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c400cc270 msgr2=0x7f9c4015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:18.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.681+0000 7f9c37e00640 1 --2- 172.21.15.153:0/259302869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c400cc270 0x7f9c4015eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:18.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.681+0000 7f9c37e00640 1 -- 172.21.15.153:0/259302869 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c400b2110 con 0x7f9c40071fc0 2024-03-29T04:29:18.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.682+0000 7f9c37e00640 1 --2- 172.21.15.153:0/259302869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c40071fc0 0x7f9c40146d70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800c450 tx=0x7f9c2800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:18.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.682+0000 7f9c36000640 1 -- 172.21.15.153:0/259302869 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28005480 con 0x7f9c40071fc0 2024-03-29T04:29:18.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.682+0000 7f9c36000640 1 -- 172.21.15.153:0/259302869 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c28003610 con 0x7f9c40071fc0 2024-03-29T04:29:18.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.682+0000 7f9c36000640 1 -- 172.21.15.153:0/259302869 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28003a00 con 0x7f9c40071fc0 2024-03-29T04:29:18.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.682+0000 7f9c45000640 1 -- 172.21.15.153:0/259302869 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c401ec480 con 0x7f9c40071fc0 2024-03-29T04:29:18.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.683+0000 7f9c45000640 1 -- 172.21.15.153:0/259302869 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c401eca40 con 0x7f9c40071fc0 2024-03-29T04:29:18.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.684+0000 7f9c45000640 1 -- 172.21.15.153:0/259302869 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c401ecc40 con 0x7f9c40071fc0 2024-03-29T04:29:18.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.686+0000 7f9c36000640 1 -- 172.21.15.153:0/259302869 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f9c28003ba0 con 0x7f9c40071fc0 2024-03-29T04:29:18.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.686+0000 7f9c36000640 1 --2- 172.21.15.153:0/259302869 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9c1c06b670 0x7f9c1c06db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:18.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.687+0000 7f9c36000640 1 -- 172.21.15.153:0/259302869 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5357+0+0 (secure 0 0 0) 0x7f9c28089b50 con 0x7f9c40071fc0 2024-03-29T04:29:18.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.687+0000 7f9c3de00640 1 --2- 172.21.15.153:0/259302869 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9c1c06b670 0x7f9c1c06db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:18.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.688+0000 7f9c3de00640 1 --2- 172.21.15.153:0/259302869 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9c1c06b670 0x7f9c1c06db30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9c30036000 tx=0x7f9c30008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:18.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.696+0000 7f9c36000640 1 -- 172.21.15.153:0/259302869 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9c401ecc40 con 0x7f9c40071fc0 2024-03-29T04:29:18.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:18.993+0000 7f9c45000640 1 -- 172.21.15.153:0/259302869 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9c400cfae0 con 0x7f9c40071fc0 2024-03-29T04:29:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.388+0000 7f9c36000640 1 -- 172.21.15.153:0/259302869 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) ==== 169+0+0 (secure 0 0 0) 0x7f9c28058570 con 0x7f9c40071fc0 2024-03-29T04:29:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2024-03-29T04:29:19.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.396+0000 7f9c45000640 1 -- 172.21.15.153:0/259302869 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9c1c06b670 msgr2=0x7f9c1c06db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:19.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.396+0000 7f9c45000640 1 --2- 172.21.15.153:0/259302869 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9c1c06b670 0x7f9c1c06db30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9c30036000 tx=0x7f9c30008030 comp rx=0 tx=0).stop 2024-03-29T04:29:19.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.396+0000 7f9c45000640 1 -- 172.21.15.153:0/259302869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c40071fc0 msgr2=0x7f9c40146d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:19.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.396+0000 7f9c45000640 1 --2- 172.21.15.153:0/259302869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c40071fc0 0x7f9c40146d70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800c450 tx=0x7f9c2800c910 comp rx=0 tx=0).stop 2024-03-29T04:29:19.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.397+0000 7f9c45000640 1 -- 172.21.15.153:0/259302869 shutdown_connections 2024-03-29T04:29:19.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.397+0000 7f9c45000640 1 --2- 172.21.15.153:0/259302869 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f9c1c06b670 0x7f9c1c06db30 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:19.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.397+0000 7f9c45000640 1 --2- 172.21.15.153:0/259302869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c400cc270 0x7f9c4015eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:19.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.397+0000 7f9c45000640 1 --2- 172.21.15.153:0/259302869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c40071fc0 0x7f9c40146d70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:19.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.397+0000 7f9c45000640 1 --2- 172.21.15.153:0/259302869 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c4006e450 0x7f9c4015d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:19.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.397+0000 7f9c45000640 1 -- 172.21.15.153:0/259302869 >> 172.21.15.153:0/259302869 conn(0x7f9c4006b170 msgr2=0x7f9c4015b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:19.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.397+0000 7f9c45000640 1 -- 172.21.15.153:0/259302869 shutdown_connections 2024-03-29T04:29:19.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.397+0000 7f9c45000640 1 -- 172.21.15.153:0/259302869 wait complete. 2024-03-29T04:29:19.403 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-29T04:29:19.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.713+0000 7f842ce00640 1 Processor -- start 2024-03-29T04:29:19.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.714+0000 7f842ce00640 1 -- start start 2024-03-29T04:29:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.716+0000 7f842ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8428145580 0x7f84280cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.716+0000 7f842ce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f84280ceb30 0x7f842806b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.716+0000 7f842ce00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f842806bad0 0x7f8428147e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.716+0000 7f842ce00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f8428166f00 con 0x7f842806bad0 2024-03-29T04:29:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.716+0000 7f842ce00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f84281662f0 con 0x7f84280ceb30 2024-03-29T04:29:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.716+0000 7f842ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f84281665d0 con 0x7f8428145580 2024-03-29T04:29:19.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.717+0000 7f8425400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f84280ceb30 0x7f842806b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:19.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.717+0000 7f8426800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f842806bad0 0x7f8428147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:19.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.717+0000 7f8425400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f84280ceb30 0x7f842806b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:52216/0 (socket says 172.21.15.153:52216) 2024-03-29T04:29:19.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.717+0000 7f8425400640 1 -- 172.21.15.153:0/3707947753 learned_addr learned my addr 172.21.15.153:0/3707947753 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:19.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.717+0000 7f8425e00640 1 --2- 172.21.15.153:0/3707947753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8428145580 0x7f84280cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:19.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.717+0000 7f8426800640 1 -- 172.21.15.153:0/3707947753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8428145580 msgr2=0x7f84280cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:19.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.717+0000 7f8426800640 1 --2- 172.21.15.153:0/3707947753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8428145580 0x7f84280cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:19.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.717+0000 7f8426800640 1 -- 172.21.15.153:0/3707947753 >> v2:172.21.15.165:3300/0 conn(0x7f84280ceb30 msgr2=0x7f842806b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:19.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.717+0000 7f8426800640 1 --2- 172.21.15.153:0/3707947753 >> v2:172.21.15.165:3300/0 conn(0x7f84280ceb30 0x7f842806b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:19.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.717+0000 7f8426800640 1 -- 172.21.15.153:0/3707947753 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84281668b0 con 0x7f842806bad0 2024-03-29T04:29:19.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.718+0000 7f8425400640 1 --2- 172.21.15.153:0/3707947753 >> v2:172.21.15.165:3300/0 conn(0x7f84280ceb30 0x7f842806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:29:19.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.719+0000 7f8426800640 1 --2- 172.21.15.153:0/3707947753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842806bad0 0x7f8428147e20 secure :-1 s=READY pgs=3369 cs=0 l=1 rev1=1 crypto rx=0x7f84280b28e0 tx=0x7f842002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6f000d631e54e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:19.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.720+0000 7f8424a00640 1 -- 172.21.15.153:0/3707947753 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420039070 con 0x7f842806bad0 2024-03-29T04:29:19.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.720+0000 7f8424a00640 1 -- 172.21.15.153:0/3707947753 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842002cbd0 con 0x7f842806bad0 2024-03-29T04:29:19.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.720+0000 7f8424a00640 1 -- 172.21.15.153:0/3707947753 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420034440 con 0x7f842806bad0 2024-03-29T04:29:19.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.721+0000 7f842ce00640 1 -- 172.21.15.153:0/3707947753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842806bad0 msgr2=0x7f8428147e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.721+0000 7f842ce00640 1 --2- 172.21.15.153:0/3707947753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842806bad0 0x7f8428147e20 secure :-1 s=READY pgs=3369 cs=0 l=1 rev1=1 crypto rx=0x7f84280b28e0 tx=0x7f842002be20 comp rx=0 tx=0).stop 2024-03-29T04:29:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.721+0000 7f842ce00640 1 -- 172.21.15.153:0/3707947753 shutdown_connections 2024-03-29T04:29:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.721+0000 7f842ce00640 1 --2- 172.21.15.153:0/3707947753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842806bad0 0x7f8428147e20 unknown :-1 s=CLOSED pgs=3369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.721+0000 7f842ce00640 1 --2- 172.21.15.153:0/3707947753 >> v2:172.21.15.165:3300/0 conn(0x7f84280ceb30 0x7f842806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.721+0000 7f842ce00640 1 --2- 172.21.15.153:0/3707947753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8428145580 0x7f84280cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.721+0000 7f842ce00640 1 -- 172.21.15.153:0/3707947753 >> 172.21.15.153:0/3707947753 conn(0x7f84280b1cb0 msgr2=0x7f84280b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.722+0000 7f842ce00640 1 -- 172.21.15.153:0/3707947753 shutdown_connections 2024-03-29T04:29:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.722+0000 7f842ce00640 1 -- 172.21.15.153:0/3707947753 wait complete. 2024-03-29T04:29:19.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.724+0000 7f842ce00640 1 Processor -- start 2024-03-29T04:29:19.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.725+0000 7f842ce00640 1 -- start start 2024-03-29T04:29:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.726+0000 7f842ce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842806bad0 0x7f8428071d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.726+0000 7f842ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84280ceb30 0x7f842815e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.726+0000 7f842ce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8428145580 0x7f84280726f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.726+0000 7f842ce00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8428145ae0 con 0x7f842806bad0 2024-03-29T04:29:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.726+0000 7f842ce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8428145960 con 0x7f8428145580 2024-03-29T04:29:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.726+0000 7f842ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f84280cf830 con 0x7f84280ceb30 2024-03-29T04:29:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.727+0000 7f8426800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8428145580 0x7f84280726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.727+0000 7f8426800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8428145580 0x7f84280726f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:52228/0 (socket says 172.21.15.153:52228) 2024-03-29T04:29:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.727+0000 7f8426800640 1 -- 172.21.15.153:0/3854889352 learned_addr learned my addr 172.21.15.153:0/3854889352 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.727+0000 7f8425e00640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842806bad0 0x7f8428071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.727+0000 7f8425400640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84280ceb30 0x7f842815e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.728+0000 7f8425e00640 1 -- 172.21.15.153:0/3854889352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84280ceb30 msgr2=0x7f842815e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.728+0000 7f8425e00640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84280ceb30 0x7f842815e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.728+0000 7f8425e00640 1 -- 172.21.15.153:0/3854889352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8428145580 msgr2=0x7f84280726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.728+0000 7f8425e00640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8428145580 0x7f84280726f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.728+0000 7f8425e00640 1 -- 172.21.15.153:0/3854889352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842815ee10 con 0x7f842806bad0 2024-03-29T04:29:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.728+0000 7f8426800640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8428145580 0x7f84280726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:29:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.728+0000 7f8425e00640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842806bad0 0x7f8428071d10 secure :-1 s=READY pgs=3370 cs=0 l=1 rev1=1 crypto rx=0x7f841000d840 tx=0x7f841000dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.728+0000 7f841e000640 1 -- 172.21.15.153:0/3854889352 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841000b6c0 con 0x7f842806bad0 2024-03-29T04:29:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.729+0000 7f842ce00640 1 -- 172.21.15.153:0/3854889352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842815f0e0 con 0x7f842806bad0 2024-03-29T04:29:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.729+0000 7f842ce00640 1 -- 172.21.15.153:0/3854889352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842815f6a0 con 0x7f842806bad0 2024-03-29T04:29:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.729+0000 7f841e000640 1 -- 172.21.15.153:0/3854889352 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8410019070 con 0x7f842806bad0 2024-03-29T04:29:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.729+0000 7f841e000640 1 -- 172.21.15.153:0/3854889352 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841000bac0 con 0x7f842806bad0 2024-03-29T04:29:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.730+0000 7f842ce00640 1 -- 172.21.15.153:0/3854889352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8400005290 con 0x7f842806bad0 2024-03-29T04:29:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.731+0000 7f841e000640 1 -- 172.21.15.153:0/3854889352 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f841000bc60 con 0x7f842806bad0 2024-03-29T04:29:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.733+0000 7f841e000640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f840406b4d0 0x7f840406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.733+0000 7f841e000640 1 -- 172.21.15.153:0/3854889352 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f841008a1f0 con 0x7f842806bad0 2024-03-29T04:29:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.735+0000 7f8425400640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f840406b4d0 0x7f840406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.739+0000 7f8425400640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f840406b4d0 0x7f840406d990 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8428071830 tx=0x7f8418008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:19.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:19.746+0000 7f841e000640 1 -- 172.21.15.153:0/3854889352 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8410059360 con 0x7f842806bad0 2024-03-29T04:29:20.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.145+0000 7f842ce00640 1 -- 172.21.15.153:0/3854889352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f8400005d90 con 0x7f842806bad0 2024-03-29T04:29:20.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.153+0000 7f841e000640 1 -- 172.21.15.153:0/3854889352 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f8410058c60 con 0x7f842806bad0 2024-03-29T04:29:20.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.157+0000 7f842ce00640 1 -- 172.21.15.153:0/3854889352 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f840406b4d0 msgr2=0x7f840406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:20.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.157+0000 7f842ce00640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f840406b4d0 0x7f840406d990 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8428071830 tx=0x7f8418008040 comp rx=0 tx=0).stop 2024-03-29T04:29:20.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.157+0000 7f842ce00640 1 -- 172.21.15.153:0/3854889352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842806bad0 msgr2=0x7f8428071d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:20.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.157+0000 7f842ce00640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842806bad0 0x7f8428071d10 secure :-1 s=READY pgs=3370 cs=0 l=1 rev1=1 crypto rx=0x7f841000d840 tx=0x7f841000dd00 comp rx=0 tx=0).stop 2024-03-29T04:29:20.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.162+0000 7f842ce00640 1 -- 172.21.15.153:0/3854889352 shutdown_connections 2024-03-29T04:29:20.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.162+0000 7f842ce00640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f840406b4d0 0x7f840406d990 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:20.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.162+0000 7f842ce00640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8428145580 0x7f84280726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:20.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.162+0000 7f842ce00640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84280ceb30 0x7f842815e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:20.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.162+0000 7f842ce00640 1 --2- 172.21.15.153:0/3854889352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842806bad0 0x7f8428071d10 unknown :-1 s=CLOSED pgs=3370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:20.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.162+0000 7f842ce00640 1 -- 172.21.15.153:0/3854889352 >> 172.21.15.153:0/3854889352 conn(0x7f84280b1cb0 msgr2=0x7f84280b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:20.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.163+0000 7f842ce00640 1 -- 172.21.15.153:0/3854889352 shutdown_connections 2024-03-29T04:29:20.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.164+0000 7f842ce00640 1 -- 172.21.15.153:0/3854889352 wait complete. 2024-03-29T04:29:20.167 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-03-29T04:29:20.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.508+0000 7fa26a600640 1 Processor -- start 2024-03-29T04:29:20.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.509+0000 7fa26a600640 1 -- start start 2024-03-29T04:29:20.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.512+0000 7fa26a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa26406dd30 0x7fa26406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:20.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.513+0000 7fa26a600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa26406e650 con 0x7fa2640b4ba0 2024-03-29T04:29:20.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.513+0000 7fa26a600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2640727d0 con 0x7fa264071cb0 2024-03-29T04:29:20.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.513+0000 7fa26a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa2640b2dd0 con 0x7fa26406dd30 2024-03-29T04:29:20.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.515+0000 7fa263400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa26406dd30 0x7fa26406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:20.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.515+0000 7fa263400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa26406dd30 0x7fa26406e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:55644/0 (socket says 172.21.15.153:55644) 2024-03-29T04:29:20.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.515+0000 7fa263400640 1 -- 172.21.15.153:0/473062892 learned_addr learned my addr 172.21.15.153:0/473062892 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:20.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.518+0000 7fa263400640 1 -- 172.21.15.153:0/473062892 >> v1:172.21.15.165:6789/0 conn(0x7fa264071cb0 legacy=0x7fa2640ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:20.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.518+0000 7fa263400640 1 -- 172.21.15.153:0/473062892 >> v1:172.21.15.153:6789/0 conn(0x7fa2640b4ba0 legacy=0x7fa2640adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:20.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.520+0000 7fa263400640 1 -- 172.21.15.153:0/473062892 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2640b30b0 con 0x7fa26406dd30 2024-03-29T04:29:20.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.526+0000 7fa263400640 1 --2- 172.21.15.153:0/473062892 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa26406dd30 0x7fa26406e110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009e80 tx=0x7fa25c02bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ba38f3acf930678 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:20.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.527+0000 7fa262000640 1 -- 172.21.15.153:0/473062892 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c02cb70 con 0x7fa26406dd30 2024-03-29T04:29:20.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.527+0000 7fa262000640 1 -- 172.21.15.153:0/473062892 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25c02cd10 con 0x7fa26406dd30 2024-03-29T04:29:20.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.527+0000 7fa262000640 1 -- 172.21.15.153:0/473062892 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c034610 con 0x7fa26406dd30 2024-03-29T04:29:20.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.528+0000 7fa26a600640 1 -- 172.21.15.153:0/473062892 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa26406dd30 msgr2=0x7fa26406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:20.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.528+0000 7fa26a600640 1 --2- 172.21.15.153:0/473062892 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa26406dd30 0x7fa26406e110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009e80 tx=0x7fa25c02bfd0 comp rx=0 tx=0).stop 2024-03-29T04:29:20.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.529+0000 7fa26a600640 1 -- 172.21.15.153:0/473062892 shutdown_connections 2024-03-29T04:29:20.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.529+0000 7fa26a600640 1 --2- 172.21.15.153:0/473062892 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa26406dd30 0x7fa26406e110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:20.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.529+0000 7fa26a600640 1 -- 172.21.15.153:0/473062892 >> 172.21.15.153:0/473062892 conn(0x7fa2640b1a30 msgr2=0x7fa2640b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:20.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.530+0000 7fa26a600640 1 -- 172.21.15.153:0/473062892 shutdown_connections 2024-03-29T04:29:20.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.530+0000 7fa26a600640 1 -- 172.21.15.153:0/473062892 wait complete. 2024-03-29T04:29:20.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.535+0000 7fa26a600640 1 Processor -- start 2024-03-29T04:29:20.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.535+0000 7fa26a600640 1 -- start start 2024-03-29T04:29:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.537+0000 7fa26a600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa26406dd30 0x7fa26414c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.537+0000 7fa26a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa264071cb0 0x7fa26414f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.537+0000 7fa26a600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2640b4ba0 0x7fa26414f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:20.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.538+0000 7fa263400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa26406dd30 0x7fa26414c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.538+0000 7fa263400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa26406dd30 0x7fa26414c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58958/0 (socket says 172.21.15.153:58958) 2024-03-29T04:29:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.538+0000 7fa262a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa264071cb0 0x7fa26414f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.538+0000 7fa262a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa264071cb0 0x7fa26414f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:55654/0 (socket says 172.21.15.153:55654) 2024-03-29T04:29:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.539+0000 7fa263400640 1 -- 172.21.15.153:0/1203201017 learned_addr learned my addr 172.21.15.153:0/1203201017 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.539+0000 7fa263e00640 1 --2- 172.21.15.153:0/1203201017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2640b4ba0 0x7fa26414f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.539+0000 7fa26a600640 1 -- 172.21.15.153:0/1203201017 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa264070fa0 con 0x7fa26406dd30 2024-03-29T04:29:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.539+0000 7fa26a600640 1 -- 172.21.15.153:0/1203201017 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa2640ae620 con 0x7fa2640b4ba0 2024-03-29T04:29:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.539+0000 7fa26a600640 1 -- 172.21.15.153:0/1203201017 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa264071120 con 0x7fa264071cb0 2024-03-29T04:29:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.542+0000 7fa262a00640 1 -- 172.21.15.153:0/1203201017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2640b4ba0 msgr2=0x7fa26414f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.542+0000 7fa262a00640 1 --2- 172.21.15.153:0/1203201017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2640b4ba0 0x7fa26414f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.542+0000 7fa262a00640 1 -- 172.21.15.153:0/1203201017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa26406dd30 msgr2=0x7fa26414c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.542+0000 7fa262a00640 1 --2- 172.21.15.153:0/1203201017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa26406dd30 0x7fa26414c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.542+0000 7fa262a00640 1 -- 172.21.15.153:0/1203201017 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26415f6e0 con 0x7fa264071cb0 2024-03-29T04:29:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.544+0000 7fa262a00640 1 --2- 172.21.15.153:0/1203201017 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa264071cb0 0x7fa26414f0e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c3c0 tx=0x7fa25400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:20.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.546+0000 7fa25b400640 1 -- 172.21.15.153:0/1203201017 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254017070 con 0x7fa264071cb0 2024-03-29T04:29:20.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.546+0000 7fa25b400640 1 -- 172.21.15.153:0/1203201017 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2540052d0 con 0x7fa264071cb0 2024-03-29T04:29:20.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.546+0000 7fa25b400640 1 -- 172.21.15.153:0/1203201017 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254003830 con 0x7fa264071cb0 2024-03-29T04:29:20.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.547+0000 7fa26a600640 1 -- 172.21.15.153:0/1203201017 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa26415f990 con 0x7fa264071cb0 2024-03-29T04:29:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.547+0000 7fa26a600640 1 -- 172.21.15.153:0/1203201017 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa26409c700 con 0x7fa264071cb0 2024-03-29T04:29:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.552+0000 7fa25b400640 1 -- 172.21.15.153:0/1203201017 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa25401a070 con 0x7fa264071cb0 2024-03-29T04:29:20.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.554+0000 7fa26a600640 1 -- 172.21.15.153:0/1203201017 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa264068ff0 con 0x7fa264071cb0 2024-03-29T04:29:20.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.555+0000 7fa25b400640 1 --2- 172.21.15.153:0/1203201017 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa24406b5a0 0x7fa24406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:20.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.556+0000 7fa263400640 1 --2- 172.21.15.153:0/1203201017 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa24406b5a0 0x7fa24406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:20.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.557+0000 7fa25b400640 1 -- 172.21.15.153:0/1203201017 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fa2540892e0 con 0x7fa264071cb0 2024-03-29T04:29:20.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.558+0000 7fa263400640 1 --2- 172.21.15.153:0/1203201017 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa24406b5a0 0x7fa24406da60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa25c02c010 tx=0x7fa25c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:20.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:20.568+0000 7fa25b400640 1 -- 172.21.15.153:0/1203201017 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa254057d60 con 0x7fa264071cb0 2024-03-29T04:29:21.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:21.117+0000 7fa26a600640 1 -- 172.21.15.153:0/1203201017 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7fa2640b5010 con 0x7fa264071cb0 2024-03-29T04:29:21.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:21.410+0000 7fa25b400640 1 -- 172.21.15.153:0/1203201017 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v12003) ==== 144+0+0 (secure 0 0 0) 0x7fa25405be00 con 0x7fa264071cb0 2024-03-29T04:29:21.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:21.414+0000 7fa26a600640 1 -- 172.21.15.153:0/1203201017 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa24406b5a0 msgr2=0x7fa24406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:21.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:21.414+0000 7fa26a600640 1 --2- 172.21.15.153:0/1203201017 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa24406b5a0 0x7fa24406da60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa25c02c010 tx=0x7fa25c030000 comp rx=0 tx=0).stop 2024-03-29T04:29:21.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:21.414+0000 7fa26a600640 1 -- 172.21.15.153:0/1203201017 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa264071cb0 msgr2=0x7fa26414f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:21.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:21.414+0000 7fa26a600640 1 --2- 172.21.15.153:0/1203201017 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa264071cb0 0x7fa26414f0e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c3c0 tx=0x7fa25400c880 comp rx=0 tx=0).stop 2024-03-29T04:29:21.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:21.415+0000 7fa26a600640 1 -- 172.21.15.153:0/1203201017 shutdown_connections 2024-03-29T04:29:21.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:21.415+0000 7fa26a600640 1 --2- 172.21.15.153:0/1203201017 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa24406b5a0 0x7fa24406da60 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:21.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:21.415+0000 7fa26a600640 1 --2- 172.21.15.153:0/1203201017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2640b4ba0 0x7fa26414f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:21.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:21.415+0000 7fa26a600640 1 --2- 172.21.15.153:0/1203201017 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa264071cb0 0x7fa26414f0e0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c3c0 tx=0x7fa25400c880 comp rx=0 tx=0).stop 2024-03-29T04:29:21.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:21.415+0000 7fa26a600640 1 --2- 172.21.15.153:0/1203201017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa26406dd30 0x7fa26414c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:21.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:21.415+0000 7fa26a600640 1 -- 172.21.15.153:0/1203201017 >> 172.21.15.153:0/1203201017 conn(0x7fa2640b1a30 msgr2=0x7fa26406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:21.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:21.418+0000 7fa26a600640 1 -- 172.21.15.153:0/1203201017 shutdown_connections 2024-03-29T04:29:21.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:21.418+0000 7fa26a600640 1 -- 172.21.15.153:0/1203201017 wait complete. 2024-03-29T04:29:21.461 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2024-03-29T04:29:21.461 INFO:tasks.cephfs_test_runner: 2024-03-29T04:29:21.461 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-29T04:29:21.461 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-29T04:29:21.461 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-29T04:29:21.461 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-29T04:29:21.461 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-03-29T04:29:21.461 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner:AssertionError: 6 != 0 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner: 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner:Ran 1 test in 23803.505s 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner: 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner: 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-29T04:29:21.462 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-29T04:29:21.463 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-03-29T04:29:21.463 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-03-29T04:29:21.463 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-03-29T04:29:21.463 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-03-29T04:29:21.463 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-03-29T04:29:21.463 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-03-29T04:29:21.463 INFO:tasks.cephfs_test_runner:AssertionError: 6 != 0 2024-03-29T04:29:21.463 INFO:tasks.cephfs_test_runner: 2024-03-29T04:29:21.463 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-29T04:29:21.768 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ad327ec86d4545df8fb5dad6611ad84b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-29T04:29:21.770 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-29T04:29:21.780 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-29T04:29:21.795 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-29T04:29:21.796 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-29T04:29:21.796 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:29:21.881 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053430,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249180k,nr_inodes=812295,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-29T04:29:21.881 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-29T04:29:21.882 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:29:21.960 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053430,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249180k,nr_inodes=812295,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-29T04:29:21.960 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-29T04:29:21.960 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:29:22.045 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053430,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249180k,nr_inodes=812295,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-29T04:29:22.045 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-03-29T04:29:22.045 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:29:22.122 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053430,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249180k,nr_inodes=812295,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-29T04:29:22.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:29:22.123 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-03-29T04:29:22.261 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-29T04:29:22.261 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-29T04:29:22.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:29:22.262 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-29T04:29:22.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:29:22.401 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-29T04:29:22.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:29:22.543 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-03-29T04:29:22.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:29:22.760 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-03-29T04:29:22.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:29:22.844 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-03-29T04:29:23.018 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-03-29T04:29:23.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:29:23.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:29:23.026 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-03-29T04:29:23.151 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-29T04:29:23.151 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-29T04:29:23.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:29:23.153 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-29T04:29:23.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:29:23.292 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-29T04:29:23.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:29:23.431 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link delete ceph-brx 2024-03-29T04:29:23.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:29:23.578 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-03-29T04:29:23.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:29:23.664 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link delete ceph-brx 2024-03-29T04:29:23.883 INFO:teuthology.orchestra.run.smithi165.stderr:Cannot find device "ceph-brx" 2024-03-29T04:29:23.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:29:23.889 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-29T04:29:23.903 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-29T04:29:23.903 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:29:24.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.261+0000 7f4852a00640 1 Processor -- start 2024-03-29T04:29:24.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.261+0000 7f4852a00640 1 -- start start 2024-03-29T04:29:24.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.263+0000 7f4852a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f484404ff80 0x7f4844052c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:24.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.263+0000 7f4852a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48440e3640 con 0x7f48440e3260 2024-03-29T04:29:24.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.263+0000 7f4852a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4844053930 con 0x7f48440531b0 2024-03-29T04:29:24.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.263+0000 7f4852a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f4844053c10 con 0x7f484404ff80 2024-03-29T04:29:24.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.264+0000 7f4850a00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f48440531b0 0x7f4844037bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:50944/0 (socket says 172.21.15.153:50944) 2024-03-29T04:29:24.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.264+0000 7f4850a00640 1 -- 172.21.15.153:0/2091242836 learned_addr learned my addr 172.21.15.153:0/2091242836 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:24.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.264+0000 7f484b400640 1 --2- 172.21.15.153:0/2091242836 >> v2:172.21.15.153:3300/0 conn(0x7f484404ff80 0x7f4844052c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:24.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.264+0000 7f484aa00640 1 -- 172.21.15.153:0/2091242836 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708424121 0 0) 0x7f4844053930 con 0x7f48440531b0 2024-03-29T04:29:24.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.264+0000 7f484aa00640 1 -- 172.21.15.153:0/2091242836 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4834003520 con 0x7f48440531b0 2024-03-29T04:29:24.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.265+0000 7f484aa00640 1 -- 172.21.15.153:0/2091242836 <== mon.1 v1:172.21.15.165:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 441223402 0 0) 0x7f4834003520 con 0x7f48440531b0 2024-03-29T04:29:24.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.265+0000 7f484aa00640 1 -- 172.21.15.153:0/2091242836 >> v2:172.21.15.153:3300/0 conn(0x7f484404ff80 msgr2=0x7f4844052c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:24.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.265+0000 7f484aa00640 1 --2- 172.21.15.153:0/2091242836 >> v2:172.21.15.153:3300/0 conn(0x7f484404ff80 0x7f4844052c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:24.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.265+0000 7f484aa00640 1 -- 172.21.15.153:0/2091242836 >> v1:172.21.15.153:6789/0 conn(0x7f48440e3260 legacy=0x7f484404f870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-29T04:29:24.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.267+0000 7f484aa00640 1 -- 172.21.15.153:0/2091242836 --> v1:172.21.15.165:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4844053ef0 con 0x7f48440531b0 2024-03-29T04:29:24.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.267+0000 7f484aa00640 1 -- 172.21.15.153:0/2091242836 <== mon.1 v1:172.21.15.165:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f4838001650 con 0x7f48440531b0 2024-03-29T04:29:24.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.267+0000 7f484b400640 1 --2- 172.21.15.153:0/2091242836 >> v2:172.21.15.153:3300/0 conn(0x7f484404ff80 0x7f4844052c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:24.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.267+0000 7f484aa00640 1 -- 172.21.15.153:0/2091242836 >> v1:172.21.15.165:6789/0 conn(0x7f48440531b0 legacy=0x7f4844037bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:24.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.267+0000 7f484aa00640 1 --2- 172.21.15.153:0/2091242836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48340039d0 0x7f4834003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:24.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.267+0000 7f484aa00640 1 --2- 172.21.15.153:0/2091242836 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4834004800 0x7f4834004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:24.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.267+0000 7f484aa00640 1 --2- 172.21.15.153:0/2091242836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4834005370 0x7f483400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:24.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.267+0000 7f484aa00640 1 -- 172.21.15.153:0/2091242836 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4844053c10 con 0x7f4834005370 2024-03-29T04:29:24.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.267+0000 7f484aa00640 1 -- 172.21.15.153:0/2091242836 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f483400c240 con 0x7f48340039d0 2024-03-29T04:29:24.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.267+0000 7f484aa00640 1 -- 172.21.15.153:0/2091242836 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f483400c440 con 0x7f4834004800 2024-03-29T04:29:24.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.268+0000 7f4850a00640 1 --2- 172.21.15.153:0/2091242836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4834005370 0x7f483400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:24.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.268+0000 7f484b400640 1 --2- 172.21.15.153:0/2091242836 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4834004800 0x7f4834004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:24.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.268+0000 7f4850a00640 1 -- 172.21.15.153:0/2091242836 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4834004800 msgr2=0x7f4834004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:24.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.268+0000 7f4850a00640 1 --2- 172.21.15.153:0/2091242836 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4834004800 0x7f4834004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:24.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.268+0000 7f4850a00640 1 -- 172.21.15.153:0/2091242836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48340039d0 msgr2=0x7f4834003df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-29T04:29:24.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.269+0000 7f484be00640 1 --2- 172.21.15.153:0/2091242836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48340039d0 0x7f4834003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:24.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.269+0000 7f4850a00640 1 --2- 172.21.15.153:0/2091242836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48340039d0 0x7f4834003df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:24.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.269+0000 7f4850a00640 1 -- 172.21.15.153:0/2091242836 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4834003520 con 0x7f4834005370 2024-03-29T04:29:24.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.270+0000 7f4850a00640 1 -- 172.21.15.153:0/2091242836 reap_dead start 2024-03-29T04:29:24.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.271+0000 7f4850a00640 1 --2- 172.21.15.153:0/2091242836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4834005370 0x7f483400b9c0 secure :-1 s=READY pgs=3373 cs=0 l=1 rev1=1 crypto rx=0x7f4838007f90 tx=0x7f4834005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8738e26b32508a2d server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:24.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.271+0000 7f484aa00640 1 -- 172.21.15.153:0/2091242836 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838007be0 con 0x7f4834005370 2024-03-29T04:29:24.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.271+0000 7f484aa00640 1 -- 172.21.15.153:0/2091242836 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4838041030 con 0x7f4834005370 2024-03-29T04:29:24.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.271+0000 7f484aa00640 1 -- 172.21.15.153:0/2091242836 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838004d00 con 0x7f4834005370 2024-03-29T04:29:24.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.272+0000 7f4852a00640 1 -- 172.21.15.153:0/2091242836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4834005370 msgr2=0x7f483400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:24.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.272+0000 7f4852a00640 1 --2- 172.21.15.153:0/2091242836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4834005370 0x7f483400b9c0 secure :-1 s=READY pgs=3373 cs=0 l=1 rev1=1 crypto rx=0x7f4838007f90 tx=0x7f4834005830 comp rx=0 tx=0).stop 2024-03-29T04:29:24.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.273+0000 7f4852a00640 1 -- 172.21.15.153:0/2091242836 shutdown_connections 2024-03-29T04:29:24.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.273+0000 7f4852a00640 1 --2- 172.21.15.153:0/2091242836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4834005370 0x7f483400b9c0 unknown :-1 s=CLOSED pgs=3373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:24.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.273+0000 7f4852a00640 1 -- 172.21.15.153:0/2091242836 >> 172.21.15.153:0/2091242836 conn(0x7f4844009fb0 msgr2=0x7f484400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:24.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.273+0000 7f4852a00640 1 -- 172.21.15.153:0/2091242836 shutdown_connections 2024-03-29T04:29:24.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.273+0000 7f4852a00640 1 -- 172.21.15.153:0/2091242836 wait complete. 2024-03-29T04:29:24.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.276+0000 7f4852a00640 1 Processor -- start 2024-03-29T04:29:24.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.276+0000 7f4852a00640 1 -- start start 2024-03-29T04:29:24.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.277+0000 7f4852a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4834005370 0x7f484404cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:24.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.277+0000 7f4852a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f484404e4e0 0x7f48440dca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:24.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.277+0000 7f4852a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48440dcfd0 0x7f48440dbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:24.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.277+0000 7f4852a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f48440535c0 con 0x7f48440dcfd0 2024-03-29T04:29:24.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.277+0000 7f4852a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f48440544b0 con 0x7f4834005370 2024-03-29T04:29:24.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.277+0000 7f4852a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4844052c70 con 0x7f484404e4e0 2024-03-29T04:29:24.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.278+0000 7f4850a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48440dcfd0 0x7f48440dbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:24.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.278+0000 7f4850a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48440dcfd0 0x7f48440dbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47302/0 (socket says 172.21.15.153:47302) 2024-03-29T04:29:24.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.278+0000 7f4850a00640 1 -- 172.21.15.153:0/3376223300 learned_addr learned my addr 172.21.15.153:0/3376223300 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:24.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.278+0000 7f484b400640 1 --2- 172.21.15.153:0/3376223300 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f484404e4e0 0x7f48440dca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:24.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.279+0000 7f4850a00640 1 -- 172.21.15.153:0/3376223300 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f484404e4e0 msgr2=0x7f48440dca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:24.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.279+0000 7f4850a00640 1 --2- 172.21.15.153:0/3376223300 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f484404e4e0 0x7f48440dca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:24.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.279+0000 7f4850a00640 1 -- 172.21.15.153:0/3376223300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4834005370 msgr2=0x7f484404cdd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-29T04:29:24.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.279+0000 7f4850a00640 1 --2- 172.21.15.153:0/3376223300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4834005370 0x7f484404cdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:24.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.279+0000 7f4850a00640 1 -- 172.21.15.153:0/3376223300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48440e6600 con 0x7f48440dcfd0 2024-03-29T04:29:24.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.279+0000 7f4850a00640 1 --2- 172.21.15.153:0/3376223300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48440dcfd0 0x7f48440dbad0 secure :-1 s=READY pgs=3374 cs=0 l=1 rev1=1 crypto rx=0x7f48380149e0 tx=0x7f4844053b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:24.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.280+0000 7f483fe00640 1 -- 172.21.15.153:0/3376223300 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838007bc0 con 0x7f48440dcfd0 2024-03-29T04:29:24.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.280+0000 7f483fe00640 1 -- 172.21.15.153:0/3376223300 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4838005cd0 con 0x7f48440dcfd0 2024-03-29T04:29:24.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.280+0000 7f483fe00640 1 -- 172.21.15.153:0/3376223300 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483803d9b0 con 0x7f48440dcfd0 2024-03-29T04:29:24.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.280+0000 7f4852a00640 1 -- 172.21.15.153:0/3376223300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f484404d440 con 0x7f48440dcfd0 2024-03-29T04:29:24.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.280+0000 7f4852a00640 1 -- 172.21.15.153:0/3376223300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f484404da00 con 0x7f48440dcfd0 2024-03-29T04:29:24.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.282+0000 7f4852a00640 1 -- 172.21.15.153:0/3376223300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4844005390 con 0x7f48440dcfd0 2024-03-29T04:29:24.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.284+0000 7f483fe00640 1 -- 172.21.15.153:0/3376223300 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f483803db50 con 0x7f48440dcfd0 2024-03-29T04:29:24.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.285+0000 7f483fe00640 1 --2- 172.21.15.153:0/3376223300 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f482c06b500 0x7f482c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:24.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.286+0000 7f484be00640 1 --2- 172.21.15.153:0/3376223300 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f482c06b500 0x7f482c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:24.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.287+0000 7f484be00640 1 --2- 172.21.15.153:0/3376223300 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f482c06b500 0x7f482c06d9c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f484c073df0 tx=0x7f484c067e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:24.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.288+0000 7f483fe00640 1 -- 172.21.15.153:0/3376223300 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f48380bba00 con 0x7f48440dcfd0 2024-03-29T04:29:24.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.293+0000 7f483fe00640 1 -- 172.21.15.153:0/3376223300 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f483808ab70 con 0x7f48440dcfd0 2024-03-29T04:29:24.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.689+0000 7f4852a00640 1 -- 172.21.15.153:0/3376223300 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48440e14a0 con 0x7f482c06b500 2024-03-29T04:29:24.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.692+0000 7f483fe00640 1 -- 172.21.15.153:0/3376223300 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13832 (secure 0 0 0) 0x7f48440e14a0 con 0x7f482c06b500 2024-03-29T04:29:24.668 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:24.668 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-03-29T04:29:24.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.697+0000 7f4852a00640 1 -- 172.21.15.153:0/3376223300 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f482c06b500 msgr2=0x7f482c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:24.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.697+0000 7f4852a00640 1 --2- 172.21.15.153:0/3376223300 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f482c06b500 0x7f482c06d9c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f484c073df0 tx=0x7f484c067e90 comp rx=0 tx=0).stop 2024-03-29T04:29:24.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.697+0000 7f4852a00640 1 -- 172.21.15.153:0/3376223300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48440dcfd0 msgr2=0x7f48440dbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:24.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.697+0000 7f4852a00640 1 --2- 172.21.15.153:0/3376223300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48440dcfd0 0x7f48440dbad0 secure :-1 s=READY pgs=3374 cs=0 l=1 rev1=1 crypto rx=0x7f48380149e0 tx=0x7f4844053b00 comp rx=0 tx=0).stop 2024-03-29T04:29:24.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.697+0000 7f4852a00640 1 -- 172.21.15.153:0/3376223300 shutdown_connections 2024-03-29T04:29:24.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.697+0000 7f4852a00640 1 --2- 172.21.15.153:0/3376223300 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f482c06b500 0x7f482c06d9c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.697+0000 7f4852a00640 1 --2- 172.21.15.153:0/3376223300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48440dcfd0 0x7f48440dbad0 unknown :-1 s=CLOSED pgs=3374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.697+0000 7f4852a00640 1 --2- 172.21.15.153:0/3376223300 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f484404e4e0 0x7f48440dca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.697+0000 7f4852a00640 1 --2- 172.21.15.153:0/3376223300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4834005370 0x7f484404cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.697+0000 7f4852a00640 1 -- 172.21.15.153:0/3376223300 >> 172.21.15.153:0/3376223300 conn(0x7f4844009fb0 msgr2=0x7f4844006640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:24.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.699+0000 7f4852a00640 1 -- 172.21.15.153:0/3376223300 shutdown_connections 2024-03-29T04:29:24.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:24.700+0000 7f4852a00640 1 -- 172.21.15.153:0/3376223300 wait complete. 2024-03-29T04:29:24.710 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":11955,"stamp":"2024-03-29T04:29:23.958494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":176809140,"kb_used_data":165276152,"kb_used_omap":55746,"kb_used_meta":11298173,"kb_avail":578165580,"statfs":{"total":773094113280,"available":592041553920,"internally_reserved":0,"allocated":169242779648,"data_stored":169197807765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57084633,"internal_metadata":11569329447},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":128,"apply_latency_ms":128,"commit_latency_ns":128000000,"apply_latency_ns":128000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-143975121112,"num_objects":-112036,"num_object_clones":0,"num_object_copies":-224072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-112036,"num_whiteouts":0,"num_read":-688941,"num_read_kb":-345227895,"num_write":-2526473,"num_write_kb":-547455753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-21545,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.751974"},"pg_stats":[{"pgid":"1.0","version":"35'161","reported_seq":449,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-29T04:29:18.369854+0000","last_change":"2024-03-28T21:51:51.547812+0000","last_active":"2024-03-29T04:29:18.369854+0000","last_peered":"2024-03-29T04:29:18.369854+0000","last_clean":"2024-03-29T04:29:18.369854+0000","last_became_active":"2024-03-28T21:51:51.545783+0000","last_became_peered":"2024-03-28T21:51:51.545783+0000","last_unstale":"2024-03-29T04:29:18.369854+0000","last_undegraded":"2024-03-29T04:29:18.369854+0000","last_fullsized":"2024-03-29T04:29:18.369854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_clean_scrub_stamp":"2024-03-28T21:51:50.185942+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:08:34.531035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129546909,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26947056,"kb_used_data":25361316,"kb_used_omap":5372,"kb_used_meta":1580355,"kb_avail":67424784,"statfs":{"total":96636764160,"available":69042978816,"internally_reserved":0,"allocated":25969987584,"data_stored":25963330118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5501459,"internal_metadata":1618284013},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129546917,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4427624,"kb_used_data":2839968,"kb_used_omap":4531,"kb_used_meta":1583116,"kb_avail":89944216,"statfs":{"total":96636764160,"available":92102877184,"internally_reserved":0,"allocated":2908127232,"data_stored":2907209686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4640277,"internal_metadata":1621111275},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129546911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26669980,"kb_used_data":25513488,"kb_used_omap":7010,"kb_used_meta":1149469,"kb_avail":67701860,"statfs":{"total":96636764160,"available":69326704640,"internally_reserved":0,"allocated":26125811712,"data_stored":26118779887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7178678,"internal_metadata":1177056842},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129546908,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29898180,"kb_used_data":28638580,"kb_used_omap":9219,"kb_used_meta":1246268,"kb_avail":64473660,"statfs":{"total":96636764160,"available":66021027840,"internally_reserved":0,"allocated":29325905920,"data_stored":29318203925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9441271,"internal_metadata":1276178441},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129546864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26932492,"kb_used_data":25651736,"kb_used_omap":11564,"kb_used_meta":1262419,"kb_avail":67439348,"statfs":{"total":96636764160,"available":69057892352,"internally_reserved":0,"allocated":26267377664,"data_stored":26260332646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11842450,"internal_metadata":1292717166},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129546888,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16647272,"kb_used_data":14870184,"kb_used_omap":3626,"kb_used_meta":1642069,"kb_avail":77724568,"statfs":{"total":96636764160,"available":79589957632,"internally_reserved":0,"allocated":15227068416,"data_stored":15222934649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3713583,"internal_metadata":1681479121},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129546877,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26137668,"kb_used_data":24556408,"kb_used_omap":9461,"kb_used_meta":1535050,"kb_avail":68234172,"statfs":{"total":96636764160,"available":69871792128,"internally_reserved":0,"allocated":25145761792,"data_stored":25139087297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9688902,"internal_metadata":1571891386},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129546901,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19148868,"kb_used_data":17844472,"kb_used_omap":4958,"kb_used_meta":1299425,"kb_avail":75222972,"statfs":{"total":96636764160,"available":77028323328,"internally_reserved":0,"allocated":18272739328,"data_stored":18267929557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5078013,"internal_metadata":1330611203},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:29:24.711 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:29:25.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.042+0000 7f64bb800640 1 Processor -- start 2024-03-29T04:29:25.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.042+0000 7f64bb800640 1 -- start start 2024-03-29T04:29:25.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.044+0000 7f64bb800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f64b415cf00 0x7f64b40ad830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:25.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.045+0000 7f64bb800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b415d340 con 0x7f64b4159a10 2024-03-29T04:29:25.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.045+0000 7f64bb800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b40b2e60 con 0x7f64b406e440 2024-03-29T04:29:25.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.045+0000 7f64bb800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f64b4159df0 con 0x7f64b415cf00 2024-03-29T04:29:25.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.045+0000 7f64b8e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f64b4159a10 0x7f64b406dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:39000/0 (socket says 172.21.15.153:39000) 2024-03-29T04:29:25.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.045+0000 7f64b8e00640 1 -- 172.21.15.153:0/478975857 learned_addr learned my addr 172.21.15.153:0/478975857 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:25.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.046+0000 7f64b3400640 1 -- 172.21.15.153:0/478975857 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973239968 0 0) 0x7f64b415d340 con 0x7f64b4159a10 2024-03-29T04:29:25.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.046+0000 7f64b3400640 1 -- 172.21.15.153:0/478975857 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6498003520 con 0x7f64b4159a10 2024-03-29T04:29:25.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.046+0000 7f64b3400640 1 -- 172.21.15.153:0/478975857 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1638845172 0 0) 0x7f6498003520 con 0x7f64b4159a10 2024-03-29T04:29:25.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.046+0000 7f64b3400640 1 -- 172.21.15.153:0/478975857 >> v2:172.21.15.165:3300/0 conn(0x7f64b415cf00 msgr2=0x7f64b40ad830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-29T04:29:25.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.046+0000 7f64b3400640 1 --2- 172.21.15.153:0/478975857 >> v2:172.21.15.165:3300/0 conn(0x7f64b415cf00 0x7f64b40ad830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.046+0000 7f64b3400640 1 -- 172.21.15.153:0/478975857 >> v1:172.21.15.165:6789/0 conn(0x7f64b406e440 legacy=0x7f64b40b3620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-29T04:29:25.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.046+0000 7f64b3400640 1 -- 172.21.15.153:0/478975857 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b40adf10 con 0x7f64b4159a10 2024-03-29T04:29:25.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.046+0000 7f64b3400640 1 -- 172.21.15.153:0/478975857 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7f64ac0019f0 con 0x7f64b4159a10 2024-03-29T04:29:25.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.046+0000 7f64b3400640 1 -- 172.21.15.153:0/478975857 >> v1:172.21.15.153:6789/0 conn(0x7f64b4159a10 legacy=0x7f64b406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:25.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.046+0000 7f64b3400640 1 --2- 172.21.15.153:0/478975857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6498003a00 0x7f6498003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:25.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.046+0000 7f64b3400640 1 --2- 172.21.15.153:0/478975857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6498004800 0x7f6498004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:25.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.047+0000 7f64b3400640 1 --2- 172.21.15.153:0/478975857 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64980051c0 0x7f64980145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:25.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.047+0000 7f64b3400640 1 -- 172.21.15.153:0/478975857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64b4159df0 con 0x7f6498003a00 2024-03-29T04:29:25.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.047+0000 7f64b3400640 1 -- 172.21.15.153:0/478975857 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6498014b00 con 0x7f6498004800 2024-03-29T04:29:25.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.047+0000 7f64b3400640 1 -- 172.21.15.153:0/478975857 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6498014cd0 con 0x7f64980051c0 2024-03-29T04:29:25.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.047+0000 7f64b8e00640 1 --2- 172.21.15.153:0/478975857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6498003a00 0x7f6498003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:25.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.049+0000 7f64b9800640 1 --2- 172.21.15.153:0/478975857 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64980051c0 0x7f64980145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:25.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.049+0000 7f64b3e00640 1 --2- 172.21.15.153:0/478975857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6498004800 0x7f6498004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:25.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.049+0000 7f64b8e00640 1 -- 172.21.15.153:0/478975857 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64980051c0 msgr2=0x7f64980145c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:25.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.049+0000 7f64b8e00640 1 --2- 172.21.15.153:0/478975857 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64980051c0 0x7f64980145c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.049+0000 7f64b8e00640 1 -- 172.21.15.153:0/478975857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6498004800 msgr2=0x7f6498004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:25.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.049+0000 7f64b8e00640 1 --2- 172.21.15.153:0/478975857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6498004800 0x7f6498004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.049+0000 7f64b8e00640 1 -- 172.21.15.153:0/478975857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6498003520 con 0x7f6498003a00 2024-03-29T04:29:25.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.050+0000 7f64b9800640 1 -- 172.21.15.153:0/478975857 reap_dead start 2024-03-29T04:29:25.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.051+0000 7f64b8e00640 1 --2- 172.21.15.153:0/478975857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6498003a00 0x7f6498003e00 secure :-1 s=READY pgs=3376 cs=0 l=1 rev1=1 crypto rx=0x7f64ac01b7d0 tx=0x7f6498005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1142a2f416de72f server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:25.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.052+0000 7f64b3400640 1 -- 172.21.15.153:0/478975857 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac01b3f0 con 0x7f6498003a00 2024-03-29T04:29:25.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.052+0000 7f64b3400640 1 -- 172.21.15.153:0/478975857 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac044600 con 0x7f6498003a00 2024-03-29T04:29:25.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.052+0000 7f64b3400640 1 -- 172.21.15.153:0/478975857 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac0449f0 con 0x7f6498003a00 2024-03-29T04:29:25.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.053+0000 7f64bb800640 1 -- 172.21.15.153:0/478975857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6498003a00 msgr2=0x7f6498003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:25.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.055+0000 7f64bb800640 1 --2- 172.21.15.153:0/478975857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6498003a00 0x7f6498003e00 secure :-1 s=READY pgs=3376 cs=0 l=1 rev1=1 crypto rx=0x7f64ac01b7d0 tx=0x7f6498005830 comp rx=0 tx=0).stop 2024-03-29T04:29:25.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.055+0000 7f64bb800640 1 -- 172.21.15.153:0/478975857 shutdown_connections 2024-03-29T04:29:25.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.055+0000 7f64bb800640 1 --2- 172.21.15.153:0/478975857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6498003a00 0x7f6498003e00 secure :-1 s=CLOSED pgs=3376 cs=0 l=1 rev1=1 crypto rx=0x7f64ac01b7d0 tx=0x7f6498005830 comp rx=0 tx=0).stop 2024-03-29T04:29:25.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.055+0000 7f64bb800640 1 -- 172.21.15.153:0/478975857 >> 172.21.15.153:0/478975857 conn(0x7f64b40b1a30 msgr2=0x7f64b40b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:25.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.056+0000 7f64bb800640 1 -- 172.21.15.153:0/478975857 shutdown_connections 2024-03-29T04:29:25.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.057+0000 7f64bb800640 1 -- 172.21.15.153:0/478975857 wait complete. 2024-03-29T04:29:25.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.059+0000 7f64bb800640 1 Processor -- start 2024-03-29T04:29:25.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.059+0000 7f64bb800640 1 -- start start 2024-03-29T04:29:25.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.061+0000 7f64bb800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64b41465c0 0x7f64b409b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:25.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.061+0000 7f64bb800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64b409c1e0 0x7f64b4158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:25.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.061+0000 7f64bb800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64b409c660 0x7f64b4158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:25.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.061+0000 7f64bb800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64b40ae4d0 con 0x7f64b41465c0 2024-03-29T04:29:25.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.061+0000 7f64bb800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f64b40b3100 con 0x7f64b409c660 2024-03-29T04:29:25.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.061+0000 7f64bb800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f64b40ad830 con 0x7f64b409c1e0 2024-03-29T04:29:25.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.063+0000 7f64b8e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64b41465c0 0x7f64b409b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:25.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.063+0000 7f64b8e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64b41465c0 0x7f64b409b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47320/0 (socket says 172.21.15.153:47320) 2024-03-29T04:29:25.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.063+0000 7f64b8e00640 1 -- 172.21.15.153:0/945899166 learned_addr learned my addr 172.21.15.153:0/945899166 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:25.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.064+0000 7f64b8e00640 1 -- 172.21.15.153:0/945899166 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64b409c1e0 msgr2=0x7f64b4158130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-29T04:29:25.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.064+0000 7f64b3e00640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64b409c1e0 0x7f64b4158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:25.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.064+0000 7f64b9800640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64b409c660 0x7f64b4158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:25.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.065+0000 7f64b8e00640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64b409c1e0 0x7f64b4158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.065+0000 7f64b8e00640 1 -- 172.21.15.153:0/945899166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64b409c660 msgr2=0x7f64b4158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:25.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.065+0000 7f64b8e00640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64b409c660 0x7f64b4158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.065+0000 7f64b8e00640 1 -- 172.21.15.153:0/945899166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b409cc30 con 0x7f64b41465c0 2024-03-29T04:29:25.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.065+0000 7f64b9800640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64b409c660 0x7f64b4158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:25.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.065+0000 7f64b3e00640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64b409c1e0 0x7f64b4158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:25.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.066+0000 7f64b8e00640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64b41465c0 0x7f64b409b5d0 secure :-1 s=READY pgs=3377 cs=0 l=1 rev1=1 crypto rx=0x7f64ac01b8f0 tx=0x7f64b40ae0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:25.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.067+0000 7f64b0c00640 1 -- 172.21.15.153:0/945899166 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac052070 con 0x7f64b41465c0 2024-03-29T04:29:25.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.067+0000 7f64b0c00640 1 -- 172.21.15.153:0/945899166 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac004d70 con 0x7f64b41465c0 2024-03-29T04:29:25.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.067+0000 7f64b0c00640 1 -- 172.21.15.153:0/945899166 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac01b3f0 con 0x7f64b41465c0 2024-03-29T04:29:25.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.067+0000 7f64bb800640 1 -- 172.21.15.153:0/945899166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b409cf10 con 0x7f64b41465c0 2024-03-29T04:29:25.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.069+0000 7f64bb800640 1 -- 172.21.15.153:0/945899166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b409add0 con 0x7f64b41465c0 2024-03-29T04:29:25.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.075+0000 7f64b0c00640 1 -- 172.21.15.153:0/945899166 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f64ac055070 con 0x7f64b41465c0 2024-03-29T04:29:25.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.076+0000 7f64b0c00640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f649406b4d0 0x7f649406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:25.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.077+0000 7f64b0c00640 1 -- 172.21.15.153:0/945899166 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f64ac0bd680 con 0x7f64b41465c0 2024-03-29T04:29:25.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.077+0000 7f64bb800640 1 -- 172.21.15.153:0/945899166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b4068ff0 con 0x7f64b41465c0 2024-03-29T04:29:25.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.087+0000 7f64b3e00640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f649406b4d0 0x7f649406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:25.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.088+0000 7f64b0c00640 1 -- 172.21.15.153:0/945899166 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f64ac08c760 con 0x7f64b41465c0 2024-03-29T04:29:25.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.089+0000 7f64b3e00640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f649406b4d0 0x7f649406d990 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f64a4006fd0 tx=0x7f64a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:25.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.436+0000 7f64bb800640 1 -- 172.21.15.153:0/945899166 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64b415c4b0 con 0x7f649406b4d0 2024-03-29T04:29:25.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.439+0000 7f64b0c00640 1 -- 172.21.15.153:0/945899166 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13832 (secure 0 0 0) 0x7f64b415c4b0 con 0x7f649406b4d0 2024-03-29T04:29:25.415 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:25.415 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-03-29T04:29:25.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.443+0000 7f64bb800640 1 -- 172.21.15.153:0/945899166 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f649406b4d0 msgr2=0x7f649406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:25.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.443+0000 7f64bb800640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f649406b4d0 0x7f649406d990 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f64a4006fd0 tx=0x7f64a4008040 comp rx=0 tx=0).stop 2024-03-29T04:29:25.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.443+0000 7f64bb800640 1 -- 172.21.15.153:0/945899166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64b41465c0 msgr2=0x7f64b409b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:25.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.443+0000 7f64bb800640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64b41465c0 0x7f64b409b5d0 secure :-1 s=READY pgs=3377 cs=0 l=1 rev1=1 crypto rx=0x7f64ac01b8f0 tx=0x7f64b40ae0e0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.443+0000 7f64bb800640 1 -- 172.21.15.153:0/945899166 shutdown_connections 2024-03-29T04:29:25.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.443+0000 7f64bb800640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f649406b4d0 0x7f649406d990 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.443+0000 7f64bb800640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64b409c660 0x7f64b4158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.443+0000 7f64bb800640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64b409c1e0 0x7f64b4158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.443+0000 7f64bb800640 1 --2- 172.21.15.153:0/945899166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64b41465c0 0x7f64b409b5d0 unknown :-1 s=CLOSED pgs=3377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.443+0000 7f64bb800640 1 -- 172.21.15.153:0/945899166 >> 172.21.15.153:0/945899166 conn(0x7f64b40b1a30 msgr2=0x7f64b40722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:25.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.444+0000 7f64bb800640 1 -- 172.21.15.153:0/945899166 shutdown_connections 2024-03-29T04:29:25.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.444+0000 7f64bb800640 1 -- 172.21.15.153:0/945899166 wait complete. 2024-03-29T04:29:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":11955,"stamp":"2024-03-29T04:29:23.958494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":176809140,"kb_used_data":165276152,"kb_used_omap":55746,"kb_used_meta":11298173,"kb_avail":578165580,"statfs":{"total":773094113280,"available":592041553920,"internally_reserved":0,"allocated":169242779648,"data_stored":169197807765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57084633,"internal_metadata":11569329447},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":128,"apply_latency_ms":128,"commit_latency_ns":128000000,"apply_latency_ns":128000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-143975121112,"num_objects":-112036,"num_object_clones":0,"num_object_copies":-224072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-112036,"num_whiteouts":0,"num_read":-688941,"num_read_kb":-345227895,"num_write":-2526473,"num_write_kb":-547455753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-21545,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.751974"},"pg_stats":[{"pgid":"1.0","version":"35'161","reported_seq":449,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-29T04:29:18.369854+0000","last_change":"2024-03-28T21:51:51.547812+0000","last_active":"2024-03-29T04:29:18.369854+0000","last_peered":"2024-03-29T04:29:18.369854+0000","last_clean":"2024-03-29T04:29:18.369854+0000","last_became_active":"2024-03-28T21:51:51.545783+0000","last_became_peered":"2024-03-28T21:51:51.545783+0000","last_unstale":"2024-03-29T04:29:18.369854+0000","last_undegraded":"2024-03-29T04:29:18.369854+0000","last_fullsized":"2024-03-29T04:29:18.369854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_clean_scrub_stamp":"2024-03-28T21:51:50.185942+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:08:34.531035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129546909,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26947056,"kb_used_data":25361316,"kb_used_omap":5372,"kb_used_meta":1580355,"kb_avail":67424784,"statfs":{"total":96636764160,"available":69042978816,"internally_reserved":0,"allocated":25969987584,"data_stored":25963330118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5501459,"internal_metadata":1618284013},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129546917,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4427624,"kb_used_data":2839968,"kb_used_omap":4531,"kb_used_meta":1583116,"kb_avail":89944216,"statfs":{"total":96636764160,"available":92102877184,"internally_reserved":0,"allocated":2908127232,"data_stored":2907209686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4640277,"internal_metadata":1621111275},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129546911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26669980,"kb_used_data":25513488,"kb_used_omap":7010,"kb_used_meta":1149469,"kb_avail":67701860,"statfs":{"total":96636764160,"available":69326704640,"internally_reserved":0,"allocated":26125811712,"data_stored":26118779887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7178678,"internal_metadata":1177056842},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129546908,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29898180,"kb_used_data":28638580,"kb_used_omap":9219,"kb_used_meta":1246268,"kb_avail":64473660,"statfs":{"total":96636764160,"available":66021027840,"internally_reserved":0,"allocated":29325905920,"data_stored":29318203925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9441271,"internal_metadata":1276178441},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129546864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26932492,"kb_used_data":25651736,"kb_used_omap":11564,"kb_used_meta":1262419,"kb_avail":67439348,"statfs":{"total":96636764160,"available":69057892352,"internally_reserved":0,"allocated":26267377664,"data_stored":26260332646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11842450,"internal_metadata":1292717166},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129546888,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16647272,"kb_used_data":14870184,"kb_used_omap":3626,"kb_used_meta":1642069,"kb_avail":77724568,"statfs":{"total":96636764160,"available":79589957632,"internally_reserved":0,"allocated":15227068416,"data_stored":15222934649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3713583,"internal_metadata":1681479121},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129546877,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26137668,"kb_used_data":24556408,"kb_used_omap":9461,"kb_used_meta":1535050,"kb_avail":68234172,"statfs":{"total":96636764160,"available":69871792128,"internally_reserved":0,"allocated":25145761792,"data_stored":25139087297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9688902,"internal_metadata":1571891386},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129546901,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19148868,"kb_used_data":17844472,"kb_used_omap":4958,"kb_used_meta":1299425,"kb_avail":75222972,"statfs":{"total":96636764160,"available":77028323328,"internally_reserved":0,"allocated":18272739328,"data_stored":18267929557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5078013,"internal_metadata":1330611203},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:29:25.451 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-29T04:29:25.451 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:29:25.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.769+0000 7f391e400640 1 Processor -- start 2024-03-29T04:29:25.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.770+0000 7f391e400640 1 -- start start 2024-03-29T04:29:25.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.772+0000 7f391e400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f391806dd30 0x7f391806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:25.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.772+0000 7f391e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3918071cb0 0x7f3918072130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:25.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.772+0000 7f391e400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391806e650 con 0x7f39180ad800 2024-03-29T04:29:25.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.772+0000 7f391e400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f39180727d0 con 0x7f391806dd30 2024-03-29T04:29:25.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.772+0000 7f391e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f39180b2dd0 con 0x7f3918071cb0 2024-03-29T04:29:25.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.772+0000 7f3917e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f39180ad800 0x7f39180adc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:50948/0 (socket says 172.21.15.153:50948) 2024-03-29T04:29:25.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.772+0000 7f3917e00640 1 -- 172.21.15.153:0/916822052 learned_addr learned my addr 172.21.15.153:0/916822052 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:25.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.772+0000 7f3916a00640 1 --2- 172.21.15.153:0/916822052 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3918071cb0 0x7f3918072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:25.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.774+0000 7f3916a00640 1 -- 172.21.15.153:0/916822052 >> v2:172.21.15.165:3300/0 conn(0x7f391806dd30 msgr2=0x7f391806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:25.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.774+0000 7f3917400640 1 --2- 172.21.15.153:0/916822052 >> v2:172.21.15.165:3300/0 conn(0x7f391806dd30 0x7f391806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:25.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.774+0000 7f3916a00640 1 --2- 172.21.15.153:0/916822052 >> v2:172.21.15.165:3300/0 conn(0x7f391806dd30 0x7f391806e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.774+0000 7f3916a00640 1 -- 172.21.15.153:0/916822052 >> v1:172.21.15.165:6789/0 conn(0x7f39180ad800 legacy=0x7f39180adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:25.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.774+0000 7f3916a00640 1 -- 172.21.15.153:0/916822052 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39180b30b0 con 0x7f3918071cb0 2024-03-29T04:29:25.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.774+0000 7f3917400640 1 --2- 172.21.15.153:0/916822052 >> v2:172.21.15.165:3300/0 conn(0x7f391806dd30 0x7f391806e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:25.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.777+0000 7f3916a00640 1 --2- 172.21.15.153:0/916822052 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3918071cb0 0x7f3918072130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f39080097a0 tx=0x7f390802b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92128ddc37f7389e server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:25.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.778+0000 7f3916000640 1 -- 172.21.15.153:0/916822052 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908037070 con 0x7f3918071cb0 2024-03-29T04:29:25.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.778+0000 7f3916000640 1 -- 172.21.15.153:0/916822052 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3908030710 con 0x7f3918071cb0 2024-03-29T04:29:25.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.778+0000 7f3916000640 1 -- 172.21.15.153:0/916822052 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908030ae0 con 0x7f3918071cb0 2024-03-29T04:29:25.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.780+0000 7f391e400640 1 -- 172.21.15.153:0/916822052 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3918071cb0 msgr2=0x7f3918072130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:25.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.780+0000 7f391e400640 1 --2- 172.21.15.153:0/916822052 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3918071cb0 0x7f3918072130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f39080097a0 tx=0x7f390802b710 comp rx=0 tx=0).stop 2024-03-29T04:29:25.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.780+0000 7f391e400640 1 -- 172.21.15.153:0/916822052 shutdown_connections 2024-03-29T04:29:25.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.780+0000 7f391e400640 1 --2- 172.21.15.153:0/916822052 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3918071cb0 0x7f3918072130 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.780+0000 7f391e400640 1 --2- 172.21.15.153:0/916822052 >> v2:172.21.15.165:3300/0 conn(0x7f391806dd30 0x7f391806e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.780+0000 7f391e400640 1 -- 172.21.15.153:0/916822052 >> 172.21.15.153:0/916822052 conn(0x7f39180b1a30 msgr2=0x7f39180b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:25.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.780+0000 7f391e400640 1 -- 172.21.15.153:0/916822052 shutdown_connections 2024-03-29T04:29:25.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.780+0000 7f391e400640 1 -- 172.21.15.153:0/916822052 wait complete. 2024-03-29T04:29:25.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.784+0000 7f391e400640 1 Processor -- start 2024-03-29T04:29:25.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.784+0000 7f391e400640 1 -- start start 2024-03-29T04:29:25.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.786+0000 7f391e400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f391806dd30 0x7f391815cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:25.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.786+0000 7f391e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3918071cb0 0x7f391814f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:25.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.786+0000 7f391e400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39180ad800 0x7f391814f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:25.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.786+0000 7f391e400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3918071120 con 0x7f39180ad800 2024-03-29T04:29:25.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.786+0000 7f391e400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3918070fa0 con 0x7f391806dd30 2024-03-29T04:29:25.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.786+0000 7f391e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f39181629a0 con 0x7f3918071cb0 2024-03-29T04:29:25.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.787+0000 7f3917e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39180ad800 0x7f391814f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:25.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.787+0000 7f3917e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39180ad800 0x7f391814f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47330/0 (socket says 172.21.15.153:47330) 2024-03-29T04:29:25.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.787+0000 7f3917e00640 1 -- 172.21.15.153:0/898715471 learned_addr learned my addr 172.21.15.153:0/898715471 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:25.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.788+0000 7f3917e00640 1 -- 172.21.15.153:0/898715471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3918071cb0 msgr2=0x7f391814f090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-29T04:29:25.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.788+0000 7f3917e00640 1 --2- 172.21.15.153:0/898715471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3918071cb0 0x7f391814f090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.788+0000 7f3917e00640 1 -- 172.21.15.153:0/898715471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f391806dd30 msgr2=0x7f391815cc80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-29T04:29:25.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.789+0000 7f3917e00640 1 --2- 172.21.15.153:0/898715471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f391806dd30 0x7f391815cc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:25.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.789+0000 7f3917e00640 1 -- 172.21.15.153:0/898715471 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391814fb10 con 0x7f39180ad800 2024-03-29T04:29:25.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.789+0000 7f3917e00640 1 --2- 172.21.15.153:0/898715471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39180ad800 0x7f391814f5d0 secure :-1 s=READY pgs=3378 cs=0 l=1 rev1=1 crypto rx=0x7f390000c780 tx=0x7f390000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:25.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.790+0000 7f390f400640 1 -- 172.21.15.153:0/898715471 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3900018070 con 0x7f39180ad800 2024-03-29T04:29:25.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.790+0000 7f390f400640 1 -- 172.21.15.153:0/898715471 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39000072d0 con 0x7f39180ad800 2024-03-29T04:29:25.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.790+0000 7f390f400640 1 -- 172.21.15.153:0/898715471 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39000047e0 con 0x7f39180ad800 2024-03-29T04:29:25.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.790+0000 7f391e400640 1 -- 172.21.15.153:0/898715471 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f391815ecc0 con 0x7f39180ad800 2024-03-29T04:29:25.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.791+0000 7f391e400640 1 -- 172.21.15.153:0/898715471 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f391815f280 con 0x7f39180ad800 2024-03-29T04:29:25.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.794+0000 7f391e400640 1 -- 172.21.15.153:0/898715471 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3918068ff0 con 0x7f39180ad800 2024-03-29T04:29:25.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.796+0000 7f390f400640 1 -- 172.21.15.153:0/898715471 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f390001b070 con 0x7f39180ad800 2024-03-29T04:29:25.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.798+0000 7f390f400640 1 --2- 172.21.15.153:0/898715471 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f38f406b520 0x7f38f406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:25.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.798+0000 7f390f400640 1 -- 172.21.15.153:0/898715471 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f3900089350 con 0x7f39180ad800 2024-03-29T04:29:25.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.800+0000 7f3917400640 1 --2- 172.21.15.153:0/898715471 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f38f406b520 0x7f38f406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:25.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.801+0000 7f3917400640 1 --2- 172.21.15.153:0/898715471 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f38f406b520 0x7f38f406d9e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3910007dd0 tx=0x7f3910007300 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:25.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:25.807+0000 7f390f400640 1 -- 172.21.15.153:0/898715471 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3900057ea0 con 0x7f39180ad800 2024-03-29T04:29:26.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.166+0000 7f391e400640 1 -- 172.21.15.153:0/898715471 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3918071340 con 0x7f38f406b520 2024-03-29T04:29:26.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.168+0000 7f390f400640 1 -- 172.21.15.153:0/898715471 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13804 (secure 0 0 0) 0x7f3918071340 con 0x7f38f406b520 2024-03-29T04:29:26.143 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:26.144 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-03-29T04:29:26.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.171+0000 7f391e400640 1 -- 172.21.15.153:0/898715471 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f38f406b520 msgr2=0x7f38f406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:26.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.171+0000 7f391e400640 1 --2- 172.21.15.153:0/898715471 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f38f406b520 0x7f38f406d9e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3910007dd0 tx=0x7f3910007300 comp rx=0 tx=0).stop 2024-03-29T04:29:26.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.171+0000 7f391e400640 1 -- 172.21.15.153:0/898715471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39180ad800 msgr2=0x7f391814f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:26.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.171+0000 7f391e400640 1 --2- 172.21.15.153:0/898715471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39180ad800 0x7f391814f5d0 secure :-1 s=READY pgs=3378 cs=0 l=1 rev1=1 crypto rx=0x7f390000c780 tx=0x7f390000cc40 comp rx=0 tx=0).stop 2024-03-29T04:29:26.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.171+0000 7f391e400640 1 -- 172.21.15.153:0/898715471 shutdown_connections 2024-03-29T04:29:26.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.171+0000 7f391e400640 1 --2- 172.21.15.153:0/898715471 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f38f406b520 0x7f38f406d9e0 secure :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3910007dd0 tx=0x7f3910007300 comp rx=0 tx=0).stop 2024-03-29T04:29:26.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.171+0000 7f391e400640 1 --2- 172.21.15.153:0/898715471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39180ad800 0x7f391814f5d0 unknown :-1 s=CLOSED pgs=3378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:26.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.171+0000 7f391e400640 1 --2- 172.21.15.153:0/898715471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3918071cb0 0x7f391814f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:26.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.171+0000 7f391e400640 1 --2- 172.21.15.153:0/898715471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f391806dd30 0x7f391815cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:26.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.171+0000 7f391e400640 1 -- 172.21.15.153:0/898715471 >> 172.21.15.153:0/898715471 conn(0x7f39180b1a30 msgr2=0x7f3918163080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:26.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.172+0000 7f391e400640 1 -- 172.21.15.153:0/898715471 shutdown_connections 2024-03-29T04:29:26.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.173+0000 7f391e400640 1 -- 172.21.15.153:0/898715471 wait complete. 2024-03-29T04:29:26.177 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":11956,"stamp":"2024-03-29T04:29:25.958847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":81720768,"kb_used_data":69942820,"kb_used_omap":55746,"kb_used_meta":11400893,"kb_avail":673253952,"statfs":{"total":773094113280,"available":689412046848,"internally_reserved":0,"allocated":71621447680,"data_stored":71601239926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57084633,"internal_metadata":11674514727},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":343,"apply_latency_ms":343,"commit_latency_ns":343000000,"apply_latency_ns":343000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-143974275812,"num_objects":-112033,"num_object_clones":0,"num_object_copies":-224066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-112033,"num_whiteouts":0,"num_read":-688941,"num_read_kb":-345227895,"num_write":-2526476,"num_write_kb":-547455753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-21545,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.005253"},"pg_stats":[{"pgid":"1.0","version":"35'161","reported_seq":451,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-03-29T04:29:19.766409+0000","last_change":"2024-03-28T21:51:51.547812+0000","last_active":"2024-03-29T04:29:19.766409+0000","last_peered":"2024-03-29T04:29:19.766409+0000","last_clean":"2024-03-29T04:29:19.766409+0000","last_became_active":"2024-03-28T21:51:51.545783+0000","last_became_peered":"2024-03-28T21:51:51.545783+0000","last_unstale":"2024-03-29T04:29:19.766409+0000","last_undegraded":"2024-03-29T04:29:19.766409+0000","last_fullsized":"2024-03-29T04:29:19.766409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_clean_scrub_stamp":"2024-03-28T21:51:50.185942+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:08:34.531035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129546910,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4087416,"kb_used_data":2327356,"kb_used_omap":5372,"kb_used_meta":1598403,"kb_avail":90284424,"statfs":{"total":96636764160,"available":92451250176,"internally_reserved":0,"allocated":2383212544,"data_stored":2382356004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5501459,"internal_metadata":1636765165},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129546917,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4427624,"kb_used_data":2839968,"kb_used_omap":4531,"kb_used_meta":1583116,"kb_avail":89944216,"statfs":{"total":96636764160,"available":92102877184,"internally_reserved":0,"allocated":2908127232,"data_stored":2907209686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4640277,"internal_metadata":1621111275},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129546912,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11318576,"kb_used_data":10071696,"kb_used_omap":7010,"kb_used_meta":1167517,"kb_avail":83053264,"statfs":{"total":96636764160,"available":85046542336,"internally_reserved":0,"allocated":10313416704,"data_stored":10310609002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7178678,"internal_metadata":1195537994},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129546909,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5708092,"kb_used_data":4381268,"kb_used_omap":9219,"kb_used_meta":1268476,"kb_avail":88663748,"statfs":{"total":96636764160,"available":90791677952,"internally_reserved":0,"allocated":4486418432,"data_stored":4485071300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9441271,"internal_metadata":1298919433},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":66,"apply_latency_ms":66,"commit_latency_ns":66000000,"apply_latency_ns":66000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129546864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26932492,"kb_used_data":25651736,"kb_used_omap":11564,"kb_used_meta":1262419,"kb_avail":67439348,"statfs":{"total":96636764160,"available":69057892352,"internally_reserved":0,"allocated":26267377664,"data_stored":26260332646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11842450,"internal_metadata":1292717166},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129546889,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1668340,"kb_used_data":428,"kb_used_omap":3626,"kb_used_meta":1664277,"kb_avail":92703500,"statfs":{"total":96636764160,"available":94928384000,"internally_reserved":0,"allocated":438272,"data_stored":172165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3713583,"internal_metadata":1704220113},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":55,"apply_latency_ms":55,"commit_latency_ns":55000000,"apply_latency_ns":55000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129546877,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26137668,"kb_used_data":24556408,"kb_used_omap":9461,"kb_used_meta":1535050,"kb_avail":68234172,"statfs":{"total":96636764160,"available":69871792128,"internally_reserved":0,"allocated":25145761792,"data_stored":25139087297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9688902,"internal_metadata":1571891386},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129546902,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1440560,"kb_used_data":113960,"kb_used_omap":4958,"kb_used_meta":1321633,"kb_avail":92931280,"statfs":{"total":96636764160,"available":95161630720,"internally_reserved":0,"allocated":116695040,"data_stored":116401826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5078013,"internal_metadata":1353352195},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:29:26.178 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:29:26.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.499+0000 7feb6ec00640 1 Processor -- start 2024-03-29T04:29:26.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.500+0000 7feb6ec00640 1 -- start start 2024-03-29T04:29:26.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.502+0000 7feb6ec00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7feb68072130 0x7feb680b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:26.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.503+0000 7feb6ec00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb680727d0 con 0x7feb68071cb0 2024-03-29T04:29:26.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.503+0000 7feb6ec00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb680b2dd0 con 0x7feb6806dd30 2024-03-29T04:29:26.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.503+0000 7feb6ec00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7feb680b30b0 con 0x7feb68072130 2024-03-29T04:29:26.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.503+0000 7feb67e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7feb6806dd30 0x7feb6806e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.153:50950/0 (socket says 172.21.15.153:50950) 2024-03-29T04:29:26.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.503+0000 7feb67e00640 1 -- 172.21.15.153:0/4075458287 learned_addr learned my addr 172.21.15.153:0/4075458287 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:26.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.503+0000 7feb6cc00640 1 --2- 172.21.15.153:0/4075458287 >> v2:172.21.15.153:3300/0 conn(0x7feb68072130 0x7feb680b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:26.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.504+0000 7feb6cc00640 1 -- 172.21.15.153:0/4075458287 >> v1:172.21.15.165:6789/0 conn(0x7feb6806dd30 legacy=0x7feb6806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:26.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.504+0000 7feb6cc00640 1 -- 172.21.15.153:0/4075458287 >> v1:172.21.15.153:6789/0 conn(0x7feb68071cb0 legacy=0x7feb680b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:26.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.504+0000 7feb6cc00640 1 -- 172.21.15.153:0/4075458287 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb680b3390 con 0x7feb68072130 2024-03-29T04:29:26.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.505+0000 7feb6cc00640 1 --2- 172.21.15.153:0/4075458287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb68072130 0x7feb680b42a0 secure :-1 s=READY pgs=3380 cs=0 l=1 rev1=1 crypto rx=0x7feb60009d90 tx=0x7feb6002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d686ed730ea19ad server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:26.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.506+0000 7feb66a00640 1 -- 172.21.15.153:0/4075458287 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb60039070 con 0x7feb68072130 2024-03-29T04:29:26.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.506+0000 7feb66a00640 1 -- 172.21.15.153:0/4075458287 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb6002ccf0 con 0x7feb68072130 2024-03-29T04:29:26.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.506+0000 7feb66a00640 1 -- 172.21.15.153:0/4075458287 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb60034660 con 0x7feb68072130 2024-03-29T04:29:26.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.507+0000 7feb6ec00640 1 -- 172.21.15.153:0/4075458287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb68072130 msgr2=0x7feb680b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:26.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.507+0000 7feb6ec00640 1 --2- 172.21.15.153:0/4075458287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb68072130 0x7feb680b42a0 secure :-1 s=READY pgs=3380 cs=0 l=1 rev1=1 crypto rx=0x7feb60009d90 tx=0x7feb6002bf40 comp rx=0 tx=0).stop 2024-03-29T04:29:26.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.507+0000 7feb6ec00640 1 -- 172.21.15.153:0/4075458287 shutdown_connections 2024-03-29T04:29:26.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.507+0000 7feb6ec00640 1 --2- 172.21.15.153:0/4075458287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb68072130 0x7feb680b42a0 unknown :-1 s=CLOSED pgs=3380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:26.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.507+0000 7feb6ec00640 1 -- 172.21.15.153:0/4075458287 >> 172.21.15.153:0/4075458287 conn(0x7feb680b1a30 msgr2=0x7feb680b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:26.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.507+0000 7feb6ec00640 1 -- 172.21.15.153:0/4075458287 shutdown_connections 2024-03-29T04:29:26.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.507+0000 7feb6ec00640 1 -- 172.21.15.153:0/4075458287 wait complete. 2024-03-29T04:29:26.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.510+0000 7feb6ec00640 1 Processor -- start 2024-03-29T04:29:26.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.510+0000 7feb6ec00640 1 -- start start 2024-03-29T04:29:26.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.511+0000 7feb6ec00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb6806dd30 0x7feb6814fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:26.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.511+0000 7feb6ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb68071cb0 0x7feb6809c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:26.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.511+0000 7feb6ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb68072130 0x7feb68159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:26.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.511+0000 7feb6ec00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feb68162b20 con 0x7feb6806dd30 2024-03-29T04:29:26.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.511+0000 7feb6ec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feb681629a0 con 0x7feb68071cb0 2024-03-29T04:29:26.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.511+0000 7feb6ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feb680b47e0 con 0x7feb68072130 2024-03-29T04:29:26.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.511+0000 7feb67e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb6806dd30 0x7feb6814fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:26.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.512+0000 7feb67e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb6806dd30 0x7feb6814fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47344/0 (socket says 172.21.15.153:47344) 2024-03-29T04:29:26.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.512+0000 7feb67e00640 1 -- 172.21.15.153:0/1636410301 learned_addr learned my addr 172.21.15.153:0/1636410301 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:26.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.512+0000 7feb6cc00640 1 --2- 172.21.15.153:0/1636410301 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb68072130 0x7feb68159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:26.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.512+0000 7feb67e00640 1 -- 172.21.15.153:0/1636410301 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb68072130 msgr2=0x7feb68159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:26.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.512+0000 7feb67e00640 1 --2- 172.21.15.153:0/1636410301 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb68072130 0x7feb68159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:26.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.512+0000 7feb67e00640 1 -- 172.21.15.153:0/1636410301 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb68071cb0 msgr2=0x7feb6809c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:26.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.512+0000 7feb67e00640 1 --2- 172.21.15.153:0/1636410301 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb68071cb0 0x7feb6809c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:26.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.512+0000 7feb67e00640 1 -- 172.21.15.153:0/1636410301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6815d9f0 con 0x7feb6806dd30 2024-03-29T04:29:26.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.513+0000 7feb6cc00640 1 --2- 172.21.15.153:0/1636410301 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb68072130 0x7feb68159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:26.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.513+0000 7feb67e00640 1 --2- 172.21.15.153:0/1636410301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb6806dd30 0x7feb6814fcb0 secure :-1 s=READY pgs=3381 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c4a0 tx=0x7feb5400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:26.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.513+0000 7feb5fe00640 1 -- 172.21.15.153:0/1636410301 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb54017070 con 0x7feb6806dd30 2024-03-29T04:29:26.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.513+0000 7feb5fe00640 1 -- 172.21.15.153:0/1636410301 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb54005ce0 con 0x7feb6806dd30 2024-03-29T04:29:26.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.513+0000 7feb5fe00640 1 -- 172.21.15.153:0/1636410301 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb54007270 con 0x7feb6806dd30 2024-03-29T04:29:26.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.513+0000 7feb6ec00640 1 -- 172.21.15.153:0/1636410301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6809d0f0 con 0x7feb6806dd30 2024-03-29T04:29:26.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.513+0000 7feb6ec00640 1 -- 172.21.15.153:0/1636410301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb6809d6b0 con 0x7feb6806dd30 2024-03-29T04:29:26.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.515+0000 7feb6ec00640 1 -- 172.21.15.153:0/1636410301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb68068ff0 con 0x7feb6806dd30 2024-03-29T04:29:26.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.517+0000 7feb5fe00640 1 -- 172.21.15.153:0/1636410301 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7feb5401a070 con 0x7feb6806dd30 2024-03-29T04:29:26.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.518+0000 7feb5fe00640 1 --2- 172.21.15.153:0/1636410301 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7feb4806b4d0 0x7feb4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:26.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.519+0000 7feb5fe00640 1 -- 172.21.15.153:0/1636410301 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7feb54089230 con 0x7feb6806dd30 2024-03-29T04:29:26.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.519+0000 7feb67400640 1 --2- 172.21.15.153:0/1636410301 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7feb4806b4d0 0x7feb4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:26.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.520+0000 7feb67400640 1 --2- 172.21.15.153:0/1636410301 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7feb4806b4d0 0x7feb4806d990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7feb58000f60 tx=0x7feb580079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:26.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.527+0000 7feb5fe00640 1 -- 172.21.15.153:0/1636410301 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7feb54057c30 con 0x7feb6806dd30 2024-03-29T04:29:26.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.857+0000 7feb6ec00640 1 -- 172.21.15.153:0/1636410301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb680b3c30 con 0x7feb6806dd30 2024-03-29T04:29:26.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.859+0000 7feb5fe00640 1 -- 172.21.15.153:0/1636410301 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+13070 (secure 0 0 0) 0x7feb5405bcd0 con 0x7feb6806dd30 2024-03-29T04:29:26.834 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:26.835 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":38,"fsid":"2549e48d-ef7b-419c-89c4-4d0726d7d873","created":"2024-03-28T21:51:36.373287+0000","modified":"2024-03-29T04:29:19.364267+0000","last_up_change":"2024-03-28T21:51:48.177621+0000","last_in_change":"2024-03-28T21:51:39.963809+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T21:51:49.534687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"deb956d8-9e6d-42b7-9498-49ec835254eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6817","nonce":3758921042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6819","nonce":3758921042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6823","nonce":3758921042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3758921042},{"type":"v1","addr":"172.21.15.153:6821","nonce":3758921042}]},"public_addr":"172.21.15.153:6817/3758921042","cluster_addr":"172.21.15.153:6819/3758921042","heartbeat_back_addr":"172.21.15.153:6823/3758921042","heartbeat_front_addr":"172.21.15.153:6821/3758921042","state":["exists","up"]},{"osd":1,"uuid":"923897c9-f6ee-4b7f-82fe-e6452ed4d3ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6809","nonce":2932352417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6811","nonce":2932352417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6815","nonce":2932352417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2932352417},{"type":"v1","addr":"172.21.15.153:6813","nonce":2932352417}]},"public_addr":"172.21.15.153:6809/2932352417","cluster_addr":"172.21.15.153:6811/2932352417","heartbeat_back_addr":"172.21.15.153:6815/2932352417","heartbeat_front_addr":"172.21.15.153:6813/2932352417","state":["exists","up"]},{"osd":2,"uuid":"89b94640-452b-47a3-baec-82445e427d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6801","nonce":328922913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6803","nonce":328922913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6807","nonce":328922913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":328922913},{"type":"v1","addr":"172.21.15.153:6805","nonce":328922913}]},"public_addr":"172.21.15.153:6801/328922913","cluster_addr":"172.21.15.153:6803/328922913","heartbeat_back_addr":"172.21.15.153:6807/328922913","heartbeat_front_addr":"172.21.15.153:6805/328922913","state":["exists","up"]},{"osd":3,"uuid":"7aad7ea5-d427-40d3-a20f-693f094c884d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6825","nonce":3058330116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6827","nonce":3058330116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6831","nonce":3058330116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3058330116},{"type":"v1","addr":"172.21.15.153:6829","nonce":3058330116}]},"public_addr":"172.21.15.153:6825/3058330116","cluster_addr":"172.21.15.153:6827/3058330116","heartbeat_back_addr":"172.21.15.153:6831/3058330116","heartbeat_front_addr":"172.21.15.153:6829/3058330116","state":["exists","up"]},{"osd":4,"uuid":"ad0ddb33-3bee-49f0-84e6-796a1f5c688a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6809","nonce":2527321544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6811","nonce":2527321544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6815","nonce":2527321544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":2527321544},{"type":"v1","addr":"172.21.15.165:6813","nonce":2527321544}]},"public_addr":"172.21.15.165:6809/2527321544","cluster_addr":"172.21.15.165:6811/2527321544","heartbeat_back_addr":"172.21.15.165:6815/2527321544","heartbeat_front_addr":"172.21.15.165:6813/2527321544","state":["exists","up"]},{"osd":5,"uuid":"ac813b43-7eb2-4e48-908c-36aeb30f6520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6822","nonce":3492880445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6826","nonce":3492880445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6831","nonce":3492880445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3492880445},{"type":"v1","addr":"172.21.15.165:6829","nonce":3492880445}]},"public_addr":"172.21.15.165:6822/3492880445","cluster_addr":"172.21.15.165:6826/3492880445","heartbeat_back_addr":"172.21.15.165:6831/3492880445","heartbeat_front_addr":"172.21.15.165:6829/3492880445","state":["exists","up"]},{"osd":6,"uuid":"d2e32c14-63e8-419e-92c3-c6faf1801849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6801","nonce":3469035609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6803","nonce":3469035609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6807","nonce":3469035609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":3469035609},{"type":"v1","addr":"172.21.15.165:6805","nonce":3469035609}]},"public_addr":"172.21.15.165:6801/3469035609","cluster_addr":"172.21.15.165:6803/3469035609","heartbeat_back_addr":"172.21.15.165:6807/3469035609","heartbeat_front_addr":"172.21.15.165:6805/3469035609","state":["exists","up"]},{"osd":7,"uuid":"618b18e0-409a-453c-919f-b4e89cb43a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6817","nonce":3540151132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6819","nonce":3540151132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6827","nonce":3540151132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":3540151132},{"type":"v1","addr":"172.21.15.165:6823","nonce":3540151132}]},"public_addr":"172.21.15.165:6817/3540151132","cluster_addr":"172.21.15.165:6819/3540151132","heartbeat_back_addr":"172.21.15.165:6827/3540151132","heartbeat_front_addr":"172.21.15.165:6823/3540151132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.582069+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.281274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.457248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.362260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.248112+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.350592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.216047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T21:51:45.332841+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6837/1209499946":"2024-03-30T04:29:16.176848+0000","172.21.15.153:6834/1209499946":"2024-03-30T04:29:16.176848+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:29:26.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.862+0000 7feb6ec00640 1 -- 172.21.15.153:0/1636410301 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7feb4806b4d0 msgr2=0x7feb4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:26.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.862+0000 7feb6ec00640 1 --2- 172.21.15.153:0/1636410301 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7feb4806b4d0 0x7feb4806d990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7feb58000f60 tx=0x7feb580079b0 comp rx=0 tx=0).stop 2024-03-29T04:29:26.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.862+0000 7feb6ec00640 1 -- 172.21.15.153:0/1636410301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb6806dd30 msgr2=0x7feb6814fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:26.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.862+0000 7feb6ec00640 1 --2- 172.21.15.153:0/1636410301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb6806dd30 0x7feb6814fcb0 secure :-1 s=READY pgs=3381 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c4a0 tx=0x7feb5400c960 comp rx=0 tx=0).stop 2024-03-29T04:29:26.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.862+0000 7feb6ec00640 1 -- 172.21.15.153:0/1636410301 shutdown_connections 2024-03-29T04:29:26.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.862+0000 7feb6ec00640 1 --2- 172.21.15.153:0/1636410301 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7feb4806b4d0 0x7feb4806d990 secure :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7feb58000f60 tx=0x7feb580079b0 comp rx=0 tx=0).stop 2024-03-29T04:29:26.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.862+0000 7feb6ec00640 1 --2- 172.21.15.153:0/1636410301 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb68072130 0x7feb68159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:26.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.862+0000 7feb6ec00640 1 --2- 172.21.15.153:0/1636410301 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb68071cb0 0x7feb6809c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:26.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.862+0000 7feb6ec00640 1 --2- 172.21.15.153:0/1636410301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb6806dd30 0x7feb6814fcb0 unknown :-1 s=CLOSED pgs=3381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:26.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.862+0000 7feb6ec00640 1 -- 172.21.15.153:0/1636410301 >> 172.21.15.153:0/1636410301 conn(0x7feb680b1a30 msgr2=0x7feb680af900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:26.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.862+0000 7feb6ec00640 1 -- 172.21.15.153:0/1636410301 shutdown_connections 2024-03-29T04:29:26.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:26.863+0000 7feb6ec00640 1 -- 172.21.15.153:0/1636410301 wait complete. 2024-03-29T04:29:27.863 INFO:tasks.ceph:Scrubbing osd.0 2024-03-29T04:29:27.863 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:29:28.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.093+0000 7ff403400640 1 Processor -- start 2024-03-29T04:29:28.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.093+0000 7ff403400640 1 -- start start 2024-03-29T04:29:28.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.095+0000 7ff403400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff3fc15caa0 0x7ff3fc072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.095+0000 7ff403400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3fc15ce80 0x7ff3fc0cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.095+0000 7ff403400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3fc071b50 con 0x7ff3fc0cda60 2024-03-29T04:29:28.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.095+0000 7ff403400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff3fc0cded0 con 0x7ff3fc15caa0 2024-03-29T04:29:28.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.095+0000 7ff403400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff3fc072760 con 0x7ff3fc15ce80 2024-03-29T04:29:28.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.095+0000 7ff401400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff3fc0cda60 0x7ff3fc06d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:39010/0 (socket says 172.21.15.153:39010) 2024-03-29T04:29:28.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.095+0000 7ff401400640 1 -- 172.21.15.153:0/3600446645 learned_addr learned my addr 172.21.15.153:0/3600446645 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:28.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.095+0000 7ff400a00640 1 --2- 172.21.15.153:0/3600446645 >> v2:172.21.15.165:3300/0 conn(0x7ff3fc15caa0 0x7ff3fc072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.095+0000 7ff3fb400640 1 -- 172.21.15.153:0/3600446645 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3103553811 0 0) 0x7ff3fc071b50 con 0x7ff3fc0cda60 2024-03-29T04:29:28.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.095+0000 7ff3fbe00640 1 --2- 172.21.15.153:0/3600446645 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3fc15ce80 0x7ff3fc0cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 -- 172.21.15.153:0/3600446645 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3e4003520 con 0x7ff3fc0cda60 2024-03-29T04:29:28.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 -- 172.21.15.153:0/3600446645 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4149646754 0 0) 0x7ff3e4003520 con 0x7ff3fc0cda60 2024-03-29T04:29:28.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 -- 172.21.15.153:0/3600446645 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3fc15ce80 msgr2=0x7ff3fc0cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:28.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 --2- 172.21.15.153:0/3600446645 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3fc15ce80 0x7ff3fc0cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 -- 172.21.15.153:0/3600446645 >> v2:172.21.15.165:3300/0 conn(0x7ff3fc15caa0 msgr2=0x7ff3fc072bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:28.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 --2- 172.21.15.153:0/3600446645 >> v2:172.21.15.165:3300/0 conn(0x7ff3fc15caa0 0x7ff3fc072bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 -- 172.21.15.153:0/3600446645 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc071e30 con 0x7ff3fc0cda60 2024-03-29T04:29:28.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 -- 172.21.15.153:0/3600446645 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7ff3f40019f0 con 0x7ff3fc0cda60 2024-03-29T04:29:28.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 -- 172.21.15.153:0/3600446645 >> v1:172.21.15.153:6789/0 conn(0x7ff3fc0cda60 legacy=0x7ff3fc06d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 --2- 172.21.15.153:0/3600446645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3e40039b0 0x7ff3e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 --2- 172.21.15.153:0/3600446645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3e4004800 0x7ff3e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 --2- 172.21.15.153:0/3600446645 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3fc15ce80 0x7ff3e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 -- 172.21.15.153:0/3600446645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc0cded0 con 0x7ff3e4004800 2024-03-29T04:29:28.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 -- 172.21.15.153:0/3600446645 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc072760 con 0x7ff3e40039b0 2024-03-29T04:29:28.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fb400640 1 -- 172.21.15.153:0/3600446645 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e400b9c0 con 0x7ff3fc15ce80 2024-03-29T04:29:28.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.096+0000 7ff3fbe00640 1 --2- 172.21.15.153:0/3600446645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3e4004800 0x7ff3e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.097+0000 7ff400a00640 1 --2- 172.21.15.153:0/3600446645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3e40039b0 0x7ff3e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.097+0000 7ff401400640 1 --2- 172.21.15.153:0/3600446645 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3fc15ce80 0x7ff3e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.097+0000 7ff3fbe00640 1 -- 172.21.15.153:0/3600446645 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3fc15ce80 msgr2=0x7ff3e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:28.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.097+0000 7ff3fbe00640 1 --2- 172.21.15.153:0/3600446645 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3fc15ce80 0x7ff3e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.097+0000 7ff3fbe00640 1 -- 172.21.15.153:0/3600446645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3e40039b0 msgr2=0x7ff3e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:28.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.097+0000 7ff3fbe00640 1 --2- 172.21.15.153:0/3600446645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3e40039b0 0x7ff3e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.097+0000 7ff3fbe00640 1 -- 172.21.15.153:0/3600446645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e4003520 con 0x7ff3e4004800 2024-03-29T04:29:28.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.097+0000 7ff400a00640 1 --2- 172.21.15.153:0/3600446645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3e40039b0 0x7ff3e4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:29:28.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.098+0000 7ff3fbe00640 1 --2- 172.21.15.153:0/3600446645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3e4004800 0x7ff3e4004c80 secure :-1 s=READY pgs=3383 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009ac0 tx=0x7ff3e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0af2083505b4f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:28.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.099+0000 7ff3fb400640 1 -- 172.21.15.153:0/3600446645 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8039070 con 0x7ff3e4004800 2024-03-29T04:29:28.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.099+0000 7ff3fb400640 1 -- 172.21.15.153:0/3600446645 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e802c6b0 con 0x7ff3e4004800 2024-03-29T04:29:28.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.099+0000 7ff3fb400640 1 -- 172.21.15.153:0/3600446645 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8009690 con 0x7ff3e4004800 2024-03-29T04:29:28.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.099+0000 7ff403400640 1 -- 172.21.15.153:0/3600446645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3e4004800 msgr2=0x7ff3e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.099+0000 7ff403400640 1 --2- 172.21.15.153:0/3600446645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3e4004800 0x7ff3e4004c80 secure :-1 s=READY pgs=3383 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009ac0 tx=0x7ff3e4005830 comp rx=0 tx=0).stop 2024-03-29T04:29:28.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.099+0000 7ff401400640 1 -- 172.21.15.153:0/3600446645 reap_dead start 2024-03-29T04:29:28.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.100+0000 7ff403400640 1 -- 172.21.15.153:0/3600446645 shutdown_connections 2024-03-29T04:29:28.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.100+0000 7ff403400640 1 -- 172.21.15.153:0/3600446645 >> 172.21.15.153:0/3600446645 conn(0x7ff3fc06b170 msgr2=0x7ff3fc06b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:28.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.100+0000 7ff403400640 1 -- 172.21.15.153:0/3600446645 shutdown_connections 2024-03-29T04:29:28.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.100+0000 7ff403400640 1 -- 172.21.15.153:0/3600446645 wait complete. 2024-03-29T04:29:28.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.101+0000 7ff403400640 1 Processor -- start 2024-03-29T04:29:28.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.101+0000 7ff403400640 1 -- start start 2024-03-29T04:29:28.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.102+0000 7ff403400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3e4004800 0x7ff3fc156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.102+0000 7ff403400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc149730 0x7ff3fc0b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.102+0000 7ff403400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3fc1588c0 0x7ff3fc158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.102+0000 7ff403400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc0cf930 con 0x7ff3fc149730 2024-03-29T04:29:28.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.102+0000 7ff403400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc0723f0 con 0x7ff3fc1588c0 2024-03-29T04:29:28.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.102+0000 7ff403400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff3fc0cfab0 con 0x7ff3e4004800 2024-03-29T04:29:28.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.103+0000 7ff3fbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc149730 0x7ff3fc0b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.103+0000 7ff3fbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc149730 0x7ff3fc0b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47354/0 (socket says 172.21.15.153:47354) 2024-03-29T04:29:28.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.103+0000 7ff3fbe00640 1 -- 172.21.15.153:0/3667084928 learned_addr learned my addr 172.21.15.153:0/3667084928 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:28.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.103+0000 7ff400a00640 1 --2- 172.21.15.153:0/3667084928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3e4004800 0x7ff3fc156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.103+0000 7ff3fbe00640 1 -- 172.21.15.153:0/3667084928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3e4004800 msgr2=0x7ff3fc156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.103+0000 7ff401400640 1 --2- 172.21.15.153:0/3667084928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3fc1588c0 0x7ff3fc158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.103+0000 7ff3fbe00640 1 --2- 172.21.15.153:0/3667084928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3e4004800 0x7ff3fc156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.103+0000 7ff3fbe00640 1 -- 172.21.15.153:0/3667084928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3fc1588c0 msgr2=0x7ff3fc158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.103+0000 7ff3fbe00640 1 --2- 172.21.15.153:0/3667084928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3fc1588c0 0x7ff3fc158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.103+0000 7ff3fbe00640 1 -- 172.21.15.153:0/3667084928 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc1575f0 con 0x7ff3fc149730 2024-03-29T04:29:28.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.103+0000 7ff3fbe00640 1 --2- 172.21.15.153:0/3667084928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc149730 0x7ff3fc0b4870 secure :-1 s=READY pgs=3384 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8037040 tx=0x7ff3e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:28.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.104+0000 7ff3f8c00640 1 -- 172.21.15.153:0/3667084928 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8042020 con 0x7ff3fc149730 2024-03-29T04:29:28.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.104+0000 7ff3f8c00640 1 -- 172.21.15.153:0/3667084928 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e803a040 con 0x7ff3fc149730 2024-03-29T04:29:28.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.104+0000 7ff3f8c00640 1 -- 172.21.15.153:0/3667084928 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8039070 con 0x7ff3fc149730 2024-03-29T04:29:28.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.104+0000 7ff403400640 1 -- 172.21.15.153:0/3667084928 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3fc1578d0 con 0x7ff3fc149730 2024-03-29T04:29:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.104+0000 7ff403400640 1 -- 172.21.15.153:0/3667084928 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3fc157e90 con 0x7ff3fc149730 2024-03-29T04:29:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.104+0000 7ff403400640 1 -- 172.21.15.153:0/3667084928 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff3fc158690 con 0x7ff3fc149730 2024-03-29T04:29:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.106+0000 7ff3f8c00640 1 -- 172.21.15.153:0/3667084928 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff3e8045020 con 0x7ff3fc149730 2024-03-29T04:29:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.106+0000 7ff3f8c00640 1 --2- 172.21.15.153:0/3667084928 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff3dc06b4d0 0x7ff3dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.107+0000 7ff3f8c00640 1 -- 172.21.15.153:0/3667084928 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7ff3e80aaff0 con 0x7ff3fc149730 2024-03-29T04:29:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.107+0000 7ff400a00640 1 --2- 172.21.15.153:0/3667084928 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff3dc06b4d0 0x7ff3dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.107+0000 7ff3f8c00640 1 --2- 172.21.15.153:0/3667084928 >> [v2:172.21.15.153:6816/3758921042,v1:172.21.15.153:6817/3758921042] conn(0x7ff3dc071390 0x7ff3dc0737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.107+0000 7ff3f8c00640 1 -- 172.21.15.153:0/3667084928 --> [v2:172.21.15.153:6816/3758921042,v1:172.21.15.153:6817/3758921042] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff3e8001d30 con 0x7ff3dc071390 2024-03-29T04:29:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.107+0000 7ff3f8c00640 1 -- 172.21.15.153:0/3667084928 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff3e80ad610 con 0x7ff3fc149730 2024-03-29T04:29:28.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.107+0000 7ff401400640 1 --2- 172.21.15.153:0/3667084928 >> [v2:172.21.15.153:6816/3758921042,v1:172.21.15.153:6817/3758921042] conn(0x7ff3dc071390 0x7ff3dc0737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.107+0000 7ff400a00640 1 --2- 172.21.15.153:0/3667084928 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff3dc06b4d0 0x7ff3dc06d990 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009a30 tx=0x7ff3f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:28.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.108+0000 7ff401400640 1 --2- 172.21.15.153:0/3667084928 >> [v2:172.21.15.153:6816/3758921042,v1:172.21.15.153:6817/3758921042] conn(0x7ff3dc071390 0x7ff3dc0737b0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:28.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.108+0000 7ff3f8c00640 1 -- 172.21.15.153:0/3667084928 <== osd.0 v2:172.21.15.153:6816/3758921042 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff3e8001d30 con 0x7ff3dc071390 2024-03-29T04:29:28.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.122+0000 7ff403400640 1 -- 172.21.15.153:0/3667084928 --> [v2:172.21.15.153:6816/3758921042,v1:172.21.15.153:6817/3758921042] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff3fc0690d0 con 0x7ff3dc071390 2024-03-29T04:29:28.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.123+0000 7ff3f8c00640 1 -- 172.21.15.153:0/3667084928 <== osd.0 v2:172.21.15.153:6816/3758921042 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff3fc0690d0 con 0x7ff3dc071390 2024-03-29T04:29:28.098 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-29T04:29:28.099 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:29:28.099 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-29T04:29:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.123+0000 7ff403400640 1 -- 172.21.15.153:0/3667084928 >> [v2:172.21.15.153:6816/3758921042,v1:172.21.15.153:6817/3758921042] conn(0x7ff3dc071390 msgr2=0x7ff3dc0737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.123+0000 7ff403400640 1 --2- 172.21.15.153:0/3667084928 >> [v2:172.21.15.153:6816/3758921042,v1:172.21.15.153:6817/3758921042] conn(0x7ff3dc071390 0x7ff3dc0737b0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.124+0000 7ff403400640 1 -- 172.21.15.153:0/3667084928 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff3dc06b4d0 msgr2=0x7ff3dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.124+0000 7ff403400640 1 --2- 172.21.15.153:0/3667084928 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff3dc06b4d0 0x7ff3dc06d990 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009a30 tx=0x7ff3f0008040 comp rx=0 tx=0).stop 2024-03-29T04:29:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.124+0000 7ff403400640 1 -- 172.21.15.153:0/3667084928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc149730 msgr2=0x7ff3fc0b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.124+0000 7ff403400640 1 --2- 172.21.15.153:0/3667084928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc149730 0x7ff3fc0b4870 secure :-1 s=READY pgs=3384 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8037040 tx=0x7ff3e8004730 comp rx=0 tx=0).stop 2024-03-29T04:29:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.124+0000 7ff401400640 1 -- 172.21.15.153:0/3667084928 reap_dead start 2024-03-29T04:29:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.124+0000 7ff403400640 1 -- 172.21.15.153:0/3667084928 shutdown_connections 2024-03-29T04:29:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.124+0000 7ff403400640 1 -- 172.21.15.153:0/3667084928 >> 172.21.15.153:0/3667084928 conn(0x7ff3fc06b170 msgr2=0x7ff3fc06df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.124+0000 7ff403400640 1 -- 172.21.15.153:0/3667084928 shutdown_connections 2024-03-29T04:29:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.124+0000 7ff403400640 1 -- 172.21.15.153:0/3667084928 wait complete. 2024-03-29T04:29:28.115 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-29T04:29:28.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.331+0000 7fec20c00640 1 Processor -- start 2024-03-29T04:29:28.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.331+0000 7fec20c00640 1 -- start start 2024-03-29T04:29:28.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.332+0000 7fec20c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1c1445a0 0x7fec1c0b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.332+0000 7fec20c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c0b47f0 con 0x7fec1c072030 2024-03-29T04:29:28.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.332+0000 7fec20c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c0725f0 con 0x7fec1c15b970 2024-03-29T04:29:28.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.332+0000 7fec20c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec1c15b4e0 con 0x7fec1c1445a0 2024-03-29T04:29:28.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.332+0000 7fec1aa00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fec1c072030 0x7fec1c15e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:39012/0 (socket says 172.21.15.153:39012) 2024-03-29T04:29:28.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1aa00640 1 -- 172.21.15.153:0/2751193073 learned_addr learned my addr 172.21.15.153:0/2751193073 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:28.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 -- 172.21.15.153:0/2751193073 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2551063623 0 0) 0x7fec08001110 con 0x7fec1c072030 2024-03-29T04:29:28.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 -- 172.21.15.153:0/2751193073 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec00003520 con 0x7fec1c072030 2024-03-29T04:29:28.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1b400640 1 --2- 172.21.15.153:0/2751193073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1c1445a0 0x7fec1c0b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 -- 172.21.15.153:0/2751193073 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4185046121 0 0) 0x7fec00003520 con 0x7fec1c072030 2024-03-29T04:29:28.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 -- 172.21.15.153:0/2751193073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1c1445a0 msgr2=0x7fec1c0b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:28.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 --2- 172.21.15.153:0/2751193073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1c1445a0 0x7fec1c0b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 -- 172.21.15.153:0/2751193073 >> v1:172.21.15.165:6789/0 conn(0x7fec1c15b970 legacy=0x7fec1c0cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 -- 172.21.15.153:0/2751193073 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c0728d0 con 0x7fec1c072030 2024-03-29T04:29:28.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 -- 172.21.15.153:0/2751193073 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fec08001840 con 0x7fec1c072030 2024-03-29T04:29:28.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 -- 172.21.15.153:0/2751193073 >> v1:172.21.15.153:6789/0 conn(0x7fec1c072030 legacy=0x7fec1c15e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 --2- 172.21.15.153:0/2751193073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec000039e0 0x7fec00003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 --2- 172.21.15.153:0/2751193073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1c1445a0 0x7fec00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 --2- 172.21.15.153:0/2751193073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec00004d40 0x7fec000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 -- 172.21.15.153:0/2751193073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c15b4e0 con 0x7fec00004d40 2024-03-29T04:29:28.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 -- 172.21.15.153:0/2751193073 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec0000bc40 con 0x7fec000039e0 2024-03-29T04:29:28.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.333+0000 7fec1a000640 1 -- 172.21.15.153:0/2751193073 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec0000be40 con 0x7fec1c1445a0 2024-03-29T04:29:28.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.334+0000 7fec1be00640 1 --2- 172.21.15.153:0/2751193073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec00004d40 0x7fec000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.334+0000 7fec1b400640 1 --2- 172.21.15.153:0/2751193073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec000039e0 0x7fec00003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.334+0000 7fec1aa00640 1 --2- 172.21.15.153:0/2751193073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1c1445a0 0x7fec00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.334+0000 7fec1be00640 1 -- 172.21.15.153:0/2751193073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1c1445a0 msgr2=0x7fec00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:28.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.334+0000 7fec1be00640 1 --2- 172.21.15.153:0/2751193073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1c1445a0 0x7fec00004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.334+0000 7fec1be00640 1 -- 172.21.15.153:0/2751193073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec000039e0 msgr2=0x7fec00003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:28.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.334+0000 7fec1be00640 1 --2- 172.21.15.153:0/2751193073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec000039e0 0x7fec00003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.334+0000 7fec1be00640 1 -- 172.21.15.153:0/2751193073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec00003520 con 0x7fec00004d40 2024-03-29T04:29:28.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.334+0000 7fec1b400640 1 --2- 172.21.15.153:0/2751193073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec000039e0 0x7fec00003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:28.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.335+0000 7fec1be00640 1 --2- 172.21.15.153:0/2751193073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec00004d40 0x7fec000051c0 secure :-1 s=READY pgs=3386 cs=0 l=1 rev1=1 crypto rx=0x7fec14001e50 tx=0x7fec00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d874e6b4656ed7 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:28.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.335+0000 7fec1a000640 1 -- 172.21.15.153:0/2751193073 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14001a70 con 0x7fec00004d40 2024-03-29T04:29:28.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.335+0000 7fec1a000640 1 -- 172.21.15.153:0/2751193073 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec14003b70 con 0x7fec00004d40 2024-03-29T04:29:28.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.335+0000 7fec1a000640 1 -- 172.21.15.153:0/2751193073 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec140050d0 con 0x7fec00004d40 2024-03-29T04:29:28.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.336+0000 7fec20c00640 1 -- 172.21.15.153:0/2751193073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec00004d40 msgr2=0x7fec000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.336+0000 7fec20c00640 1 --2- 172.21.15.153:0/2751193073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec00004d40 0x7fec000051c0 secure :-1 s=READY pgs=3386 cs=0 l=1 rev1=1 crypto rx=0x7fec14001e50 tx=0x7fec00005830 comp rx=0 tx=0).stop 2024-03-29T04:29:28.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.336+0000 7fec1be00640 1 -- 172.21.15.153:0/2751193073 reap_dead start 2024-03-29T04:29:28.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.336+0000 7fec20c00640 1 -- 172.21.15.153:0/2751193073 shutdown_connections 2024-03-29T04:29:28.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.336+0000 7fec20c00640 1 -- 172.21.15.153:0/2751193073 >> 172.21.15.153:0/2751193073 conn(0x7fec1c06b350 msgr2=0x7fec1c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:28.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.336+0000 7fec20c00640 1 -- 172.21.15.153:0/2751193073 shutdown_connections 2024-03-29T04:29:28.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.336+0000 7fec20c00640 1 -- 172.21.15.153:0/2751193073 wait complete. 2024-03-29T04:29:28.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.338+0000 7fec20c00640 1 Processor -- start 2024-03-29T04:29:28.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.338+0000 7fec20c00640 1 -- start start 2024-03-29T04:29:28.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec20c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec00004d40 0x7fec1c1420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec20c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1c15a080 0x7fec1c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec20c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec1c13cfb0 0x7fec1c13d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec20c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c072e90 con 0x7fec1c13cfb0 2024-03-29T04:29:28.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec20c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c15f000 con 0x7fec00004d40 2024-03-29T04:29:28.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec20c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec1c144980 con 0x7fec1c15a080 2024-03-29T04:29:28.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec1be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec1c13cfb0 0x7fec1c13d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec1be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec1c13cfb0 0x7fec1c13d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47366/0 (socket says 172.21.15.153:47366) 2024-03-29T04:29:28.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec1be00640 1 -- 172.21.15.153:0/984664479 learned_addr learned my addr 172.21.15.153:0/984664479 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:28.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec1aa00640 1 --2- 172.21.15.153:0/984664479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1c15a080 0x7fec1c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec1be00640 1 -- 172.21.15.153:0/984664479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1c15a080 msgr2=0x7fec1c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec1be00640 1 --2- 172.21.15.153:0/984664479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1c15a080 0x7fec1c06d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec1be00640 1 -- 172.21.15.153:0/984664479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec00004d40 msgr2=0x7fec1c1420f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-29T04:29:28.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec1be00640 1 --2- 172.21.15.153:0/984664479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec00004d40 0x7fec1c1420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.339+0000 7fec1be00640 1 -- 172.21.15.153:0/984664479 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c13f080 con 0x7fec1c13cfb0 2024-03-29T04:29:28.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.340+0000 7fec1be00640 1 --2- 172.21.15.153:0/984664479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec1c13cfb0 0x7fec1c13d430 secure :-1 s=READY pgs=3387 cs=0 l=1 rev1=1 crypto rx=0x7fec14001f70 tx=0x7fec140014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:28.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.340+0000 7fec13400640 1 -- 172.21.15.153:0/984664479 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14047070 con 0x7fec1c13cfb0 2024-03-29T04:29:28.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.340+0000 7fec13400640 1 -- 172.21.15.153:0/984664479 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec14006b50 con 0x7fec1c13cfb0 2024-03-29T04:29:28.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.340+0000 7fec13400640 1 -- 172.21.15.153:0/984664479 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14001a70 con 0x7fec1c13cfb0 2024-03-29T04:29:28.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.340+0000 7fec20c00640 1 -- 172.21.15.153:0/984664479 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec1c140780 con 0x7fec1c13cfb0 2024-03-29T04:29:28.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.340+0000 7fec20c00640 1 -- 172.21.15.153:0/984664479 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec1c13ed10 con 0x7fec1c13cfb0 2024-03-29T04:29:28.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.341+0000 7fec20c00640 1 -- 172.21.15.153:0/984664479 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec1c140ca0 con 0x7fec1c13cfb0 2024-03-29T04:29:28.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.342+0000 7fec13400640 1 -- 172.21.15.153:0/984664479 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fec14007030 con 0x7fec1c13cfb0 2024-03-29T04:29:28.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.343+0000 7fec13400640 1 --2- 172.21.15.153:0/984664479 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7febfc06b500 0x7febfc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.343+0000 7fec13400640 1 -- 172.21.15.153:0/984664479 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fec140ab570 con 0x7fec1c13cfb0 2024-03-29T04:29:28.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.343+0000 7fec1b400640 1 --2- 172.21.15.153:0/984664479 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7febfc06b500 0x7febfc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.344+0000 7fec1b400640 1 --2- 172.21.15.153:0/984664479 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7febfc06b500 0x7febfc06d9c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fec1c06d530 tx=0x7fec0c009350 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:28.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.347+0000 7fec13400640 1 -- 172.21.15.153:0/984664479 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fec14033020 con 0x7fec1c13cfb0 2024-03-29T04:29:28.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.527+0000 7fec20c00640 1 -- 172.21.15.153:0/984664479 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fec1c04f4b0 con 0x7febfc06b500 2024-03-29T04:29:28.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.528+0000 7fec13400640 1 -- 172.21.15.153:0/984664479 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fec1c04f4b0 con 0x7febfc06b500 2024-03-29T04:29:28.504 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 0 to deep-scrub 2024-03-29T04:29:28.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.530+0000 7fec20c00640 1 -- 172.21.15.153:0/984664479 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7febfc06b500 msgr2=0x7febfc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.530+0000 7fec20c00640 1 --2- 172.21.15.153:0/984664479 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7febfc06b500 0x7febfc06d9c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fec1c06d530 tx=0x7fec0c009350 comp rx=0 tx=0).stop 2024-03-29T04:29:28.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.530+0000 7fec20c00640 1 -- 172.21.15.153:0/984664479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec1c13cfb0 msgr2=0x7fec1c13d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.530+0000 7fec20c00640 1 --2- 172.21.15.153:0/984664479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec1c13cfb0 0x7fec1c13d430 secure :-1 s=READY pgs=3387 cs=0 l=1 rev1=1 crypto rx=0x7fec14001f70 tx=0x7fec140014a0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.531+0000 7fec20c00640 1 -- 172.21.15.153:0/984664479 shutdown_connections 2024-03-29T04:29:28.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.531+0000 7fec20c00640 1 --2- 172.21.15.153:0/984664479 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7febfc06b500 0x7febfc06d9c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.531+0000 7fec20c00640 1 --2- 172.21.15.153:0/984664479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec1c13cfb0 0x7fec1c13d430 unknown :-1 s=CLOSED pgs=3387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.531+0000 7fec20c00640 1 --2- 172.21.15.153:0/984664479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1c15a080 0x7fec1c06d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.531+0000 7fec20c00640 1 --2- 172.21.15.153:0/984664479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec00004d40 0x7fec1c1420f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.531+0000 7fec20c00640 1 -- 172.21.15.153:0/984664479 >> 172.21.15.153:0/984664479 conn(0x7fec1c06b350 msgr2=0x7fec1c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:28.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.531+0000 7fec20c00640 1 -- 172.21.15.153:0/984664479 shutdown_connections 2024-03-29T04:29:28.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.531+0000 7fec20c00640 1 -- 172.21.15.153:0/984664479 wait complete. 2024-03-29T04:29:28.524 INFO:tasks.ceph:Scrubbing osd.1 2024-03-29T04:29:28.524 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:29:28.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.747+0000 7fb941600640 1 Processor -- start 2024-03-29T04:29:28.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.747+0000 7fb941600640 1 -- start start 2024-03-29T04:29:28.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.749+0000 7fb941600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb93c06b170 0x7fb93c06b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.749+0000 7fb941600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb93c145220 0x7fb93c06e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.749+0000 7fb941600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb93c06d910 0x7fb93c06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.749+0000 7fb941600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fb93c06ba90 con 0x7fb93c06d910 2024-03-29T04:29:28.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.749+0000 7fb941600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb93c145a70 con 0x7fb93c145220 2024-03-29T04:29:28.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.749+0000 7fb941600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb93c145790 con 0x7fb93c06b170 2024-03-29T04:29:28.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.750+0000 7fb940c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb93c06d910 0x7fb93c06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.750+0000 7fb940c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb93c06d910 0x7fb93c06dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47370/0 (socket says 172.21.15.153:47370) 2024-03-29T04:29:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.750+0000 7fb940c00640 1 -- 172.21.15.153:0/3721655993 learned_addr learned my addr 172.21.15.153:0/3721655993 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.750+0000 7fb93be00640 1 --2- 172.21.15.153:0/3721655993 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb93c06b170 0x7fb93c06b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.750+0000 7fb93b400640 1 --2- 172.21.15.153:0/3721655993 >> v2:172.21.15.165:3300/0 conn(0x7fb93c145220 0x7fb93c06e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.750+0000 7fb940c00640 1 -- 172.21.15.153:0/3721655993 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb93c06b170 msgr2=0x7fb93c06b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.750+0000 7fb940c00640 1 --2- 172.21.15.153:0/3721655993 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb93c06b170 0x7fb93c06b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.750+0000 7fb940c00640 1 -- 172.21.15.153:0/3721655993 >> v2:172.21.15.165:3300/0 conn(0x7fb93c145220 msgr2=0x7fb93c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.750+0000 7fb940c00640 1 --2- 172.21.15.153:0/3721655993 >> v2:172.21.15.165:3300/0 conn(0x7fb93c145220 0x7fb93c06e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.750+0000 7fb940c00640 1 -- 172.21.15.153:0/3721655993 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c06ce30 con 0x7fb93c06d910 2024-03-29T04:29:28.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.751+0000 7fb940c00640 1 --2- 172.21.15.153:0/3721655993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06d910 0x7fb93c06dda0 secure :-1 s=READY pgs=3388 cs=0 l=1 rev1=1 crypto rx=0x7fb934009e50 tx=0x7fb93402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9cf9f0e146b838b server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:28.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.752+0000 7fb93aa00640 1 -- 172.21.15.153:0/3721655993 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93402ca70 con 0x7fb93c06d910 2024-03-29T04:29:28.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.752+0000 7fb93aa00640 1 -- 172.21.15.153:0/3721655993 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb93402cc10 con 0x7fb93c06d910 2024-03-29T04:29:28.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.752+0000 7fb93aa00640 1 -- 172.21.15.153:0/3721655993 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9340343f0 con 0x7fb93c06d910 2024-03-29T04:29:28.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.752+0000 7fb941600640 1 -- 172.21.15.153:0/3721655993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06d910 msgr2=0x7fb93c06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.752+0000 7fb941600640 1 --2- 172.21.15.153:0/3721655993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06d910 0x7fb93c06dda0 secure :-1 s=READY pgs=3388 cs=0 l=1 rev1=1 crypto rx=0x7fb934009e50 tx=0x7fb93402bed0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.753+0000 7fb941600640 1 -- 172.21.15.153:0/3721655993 shutdown_connections 2024-03-29T04:29:28.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.753+0000 7fb941600640 1 --2- 172.21.15.153:0/3721655993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06d910 0x7fb93c06dda0 unknown :-1 s=CLOSED pgs=3388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.753+0000 7fb941600640 1 --2- 172.21.15.153:0/3721655993 >> v2:172.21.15.165:3300/0 conn(0x7fb93c145220 0x7fb93c06e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.753+0000 7fb941600640 1 --2- 172.21.15.153:0/3721655993 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb93c06b170 0x7fb93c06b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.753+0000 7fb941600640 1 -- 172.21.15.153:0/3721655993 >> 172.21.15.153:0/3721655993 conn(0x7fb93c0cfda0 msgr2=0x7fb93c0d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:28.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.753+0000 7fb941600640 1 -- 172.21.15.153:0/3721655993 shutdown_connections 2024-03-29T04:29:28.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.753+0000 7fb941600640 1 -- 172.21.15.153:0/3721655993 wait complete. 2024-03-29T04:29:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.755+0000 7fb941600640 1 Processor -- start 2024-03-29T04:29:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.755+0000 7fb941600640 1 -- start start 2024-03-29T04:29:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb941600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06b170 0x7fb93c15c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb941600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb93c06d910 0x7fb93c15edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb941600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb93c145220 0x7fb93c0b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb941600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c06ef10 con 0x7fb93c06b170 2024-03-29T04:29:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb941600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c06d3f0 con 0x7fb93c145220 2024-03-29T04:29:28.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb941600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb93c144ea0 con 0x7fb93c06d910 2024-03-29T04:29:28.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb93be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06b170 0x7fb93c15c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb93be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06b170 0x7fb93c15c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47374/0 (socket says 172.21.15.153:47374) 2024-03-29T04:29:28.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb93be00640 1 -- 172.21.15.153:0/2142211219 learned_addr learned my addr 172.21.15.153:0/2142211219 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:28.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb940c00640 1 --2- 172.21.15.153:0/2142211219 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb93c145220 0x7fb93c0b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb93be00640 1 -- 172.21.15.153:0/2142211219 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb93c06d910 msgr2=0x7fb93c15edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb93b400640 1 --2- 172.21.15.153:0/2142211219 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb93c06d910 0x7fb93c15edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb93be00640 1 --2- 172.21.15.153:0/2142211219 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb93c06d910 0x7fb93c15edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb93be00640 1 -- 172.21.15.153:0/2142211219 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb93c145220 msgr2=0x7fb93c0b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb93be00640 1 --2- 172.21.15.153:0/2142211219 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb93c145220 0x7fb93c0b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.756+0000 7fb93be00640 1 -- 172.21.15.153:0/2142211219 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c15f2f0 con 0x7fb93c06b170 2024-03-29T04:29:28.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.757+0000 7fb93be00640 1 --2- 172.21.15.153:0/2142211219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06b170 0x7fb93c15c5e0 secure :-1 s=READY pgs=3389 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00e8c0 tx=0x7fb92c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:28.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.757+0000 7fb933e00640 1 -- 172.21.15.153:0/2142211219 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c017070 con 0x7fb93c06b170 2024-03-29T04:29:28.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.757+0000 7fb933e00640 1 -- 172.21.15.153:0/2142211219 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb92c00c940 con 0x7fb93c06b170 2024-03-29T04:29:28.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.757+0000 7fb941600640 1 -- 172.21.15.153:0/2142211219 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93c1f7550 con 0x7fb93c06b170 2024-03-29T04:29:28.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.757+0000 7fb933e00640 1 -- 172.21.15.153:0/2142211219 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c00cd10 con 0x7fb93c06b170 2024-03-29T04:29:28.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.757+0000 7fb941600640 1 -- 172.21.15.153:0/2142211219 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb93c1f7d90 con 0x7fb93c06b170 2024-03-29T04:29:28.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.758+0000 7fb941600640 1 -- 172.21.15.153:0/2142211219 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb93c068ff0 con 0x7fb93c06b170 2024-03-29T04:29:28.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.759+0000 7fb933e00640 1 -- 172.21.15.153:0/2142211219 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb92c01a070 con 0x7fb93c06b170 2024-03-29T04:29:28.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.760+0000 7fb933e00640 1 --2- 172.21.15.153:0/2142211219 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb91c06b4d0 0x7fb91c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.760+0000 7fb933e00640 1 -- 172.21.15.153:0/2142211219 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fb92c089e70 con 0x7fb93c06b170 2024-03-29T04:29:28.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.760+0000 7fb93b400640 1 --2- 172.21.15.153:0/2142211219 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb91c06b4d0 0x7fb91c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.760+0000 7fb933e00640 1 --2- 172.21.15.153:0/2142211219 >> [v2:172.21.15.153:6808/2932352417,v1:172.21.15.153:6809/2932352417] conn(0x7fb91c071390 0x7fb91c0737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:28.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.760+0000 7fb933e00640 1 -- 172.21.15.153:0/2142211219 --> [v2:172.21.15.153:6808/2932352417,v1:172.21.15.153:6809/2932352417] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb91c073e60 con 0x7fb91c071390 2024-03-29T04:29:28.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.760+0000 7fb933e00640 1 -- 172.21.15.153:0/2142211219 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb92c08c570 con 0x7fb93c06b170 2024-03-29T04:29:28.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.761+0000 7fb940c00640 1 --2- 172.21.15.153:0/2142211219 >> [v2:172.21.15.153:6808/2932352417,v1:172.21.15.153:6809/2932352417] conn(0x7fb91c071390 0x7fb91c0737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:28.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.761+0000 7fb93b400640 1 --2- 172.21.15.153:0/2142211219 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb91c06b4d0 0x7fb91c06d990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb928006fd0 tx=0x7fb928008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:28.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.791+0000 7fb940c00640 1 --2- 172.21.15.153:0/2142211219 >> [v2:172.21.15.153:6808/2932352417,v1:172.21.15.153:6809/2932352417] conn(0x7fb91c071390 0x7fb91c0737b0 crc :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:28.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.792+0000 7fb933e00640 1 -- 172.21.15.153:0/2142211219 <== osd.1 v2:172.21.15.153:6808/2932352417 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb91c073e60 con 0x7fb91c071390 2024-03-29T04:29:28.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.807+0000 7fb941600640 1 -- 172.21.15.153:0/2142211219 --> [v2:172.21.15.153:6808/2932352417,v1:172.21.15.153:6809/2932352417] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb93c072750 con 0x7fb91c071390 2024-03-29T04:29:28.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.807+0000 7fb933e00640 1 -- 172.21.15.153:0/2142211219 <== osd.1 v2:172.21.15.153:6808/2932352417 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb93c072750 con 0x7fb91c071390 2024-03-29T04:29:28.784 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-29T04:29:28.784 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:29:28.784 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-29T04:29:28.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.808+0000 7fb941600640 1 -- 172.21.15.153:0/2142211219 >> [v2:172.21.15.153:6808/2932352417,v1:172.21.15.153:6809/2932352417] conn(0x7fb91c071390 msgr2=0x7fb91c0737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.808+0000 7fb941600640 1 --2- 172.21.15.153:0/2142211219 >> [v2:172.21.15.153:6808/2932352417,v1:172.21.15.153:6809/2932352417] conn(0x7fb91c071390 0x7fb91c0737b0 crc :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:28.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.808+0000 7fb941600640 1 -- 172.21.15.153:0/2142211219 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb91c06b4d0 msgr2=0x7fb91c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.808+0000 7fb941600640 1 --2- 172.21.15.153:0/2142211219 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fb91c06b4d0 0x7fb91c06d990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb928006fd0 tx=0x7fb928008040 comp rx=0 tx=0).stop 2024-03-29T04:29:28.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.808+0000 7fb941600640 1 -- 172.21.15.153:0/2142211219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06b170 msgr2=0x7fb93c15c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:28.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.808+0000 7fb941600640 1 --2- 172.21.15.153:0/2142211219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb93c06b170 0x7fb93c15c5e0 secure :-1 s=READY pgs=3389 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00e8c0 tx=0x7fb92c00ed80 comp rx=0 tx=0).stop 2024-03-29T04:29:28.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.808+0000 7fb940c00640 1 -- 172.21.15.153:0/2142211219 reap_dead start 2024-03-29T04:29:28.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.808+0000 7fb941600640 1 -- 172.21.15.153:0/2142211219 shutdown_connections 2024-03-29T04:29:28.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.808+0000 7fb941600640 1 -- 172.21.15.153:0/2142211219 >> 172.21.15.153:0/2142211219 conn(0x7fb93c0cfda0 msgr2=0x7fb93c13ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:28.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.808+0000 7fb941600640 1 -- 172.21.15.153:0/2142211219 shutdown_connections 2024-03-29T04:29:28.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:28.808+0000 7fb941600640 1 -- 172.21.15.153:0/2142211219 wait complete. 2024-03-29T04:29:28.804 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-29T04:29:29.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.037+0000 7fa04a000640 1 Processor -- start 2024-03-29T04:29:29.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.037+0000 7fa04a000640 1 -- start start 2024-03-29T04:29:29.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.039+0000 7fa04a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa044070d70 0x7fa044071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.039+0000 7fa04a000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa0440b3a70 0x7fa0440b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.039+0000 7fa04a000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa04406db60 con 0x7fa04406ede0 2024-03-29T04:29:29.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.039+0000 7fa04a000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa0440b35e0 con 0x7fa0440b3a70 2024-03-29T04:29:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.039+0000 7fa04a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa04406de40 con 0x7fa044070d70 2024-03-29T04:29:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.039+0000 7fa042a00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa04406ede0 0x7fa044071690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:39028/0 (socket says 172.21.15.153:39028) 2024-03-29T04:29:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.039+0000 7fa042a00640 1 -- 172.21.15.153:0/3898469324 learned_addr learned my addr 172.21.15.153:0/3898469324 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa043400640 1 --2- 172.21.15.153:0/3898469324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa044070d70 0x7fa044071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa043e00640 1 --2- 172.21.15.153:0/3898469324 >> v2:172.21.15.165:3300/0 conn(0x7fa0440b3a70 0x7fa0440b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 -- 172.21.15.153:0/3898469324 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3917631392 0 0) 0x7fa04406db60 con 0x7fa04406ede0 2024-03-29T04:29:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 -- 172.21.15.153:0/3898469324 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa028003520 con 0x7fa04406ede0 2024-03-29T04:29:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 -- 172.21.15.153:0/3898469324 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3746290778 0 0) 0x7fa028003520 con 0x7fa04406ede0 2024-03-29T04:29:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 -- 172.21.15.153:0/3898469324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa044070d70 msgr2=0x7fa044071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 --2- 172.21.15.153:0/3898469324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa044070d70 0x7fa044071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 -- 172.21.15.153:0/3898469324 >> v2:172.21.15.165:3300/0 conn(0x7fa0440b3a70 msgr2=0x7fa0440b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 --2- 172.21.15.153:0/3898469324 >> v2:172.21.15.165:3300/0 conn(0x7fa0440b3a70 0x7fa0440b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 -- 172.21.15.153:0/3898469324 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04406e120 con 0x7fa04406ede0 2024-03-29T04:29:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 -- 172.21.15.153:0/3898469324 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fa02c001670 con 0x7fa04406ede0 2024-03-29T04:29:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 -- 172.21.15.153:0/3898469324 >> v1:172.21.15.153:6789/0 conn(0x7fa04406ede0 legacy=0x7fa044071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 --2- 172.21.15.153:0/3898469324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0280039b0 0x7fa028003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 --2- 172.21.15.153:0/3898469324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa028004800 0x7fa028004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 --2- 172.21.15.153:0/3898469324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa044070d70 0x7fa0280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 -- 172.21.15.153:0/3898469324 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0440b35e0 con 0x7fa0280039b0 2024-03-29T04:29:29.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 -- 172.21.15.153:0/3898469324 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa04406de40 con 0x7fa028004800 2024-03-29T04:29:29.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.040+0000 7fa042000640 1 -- 172.21.15.153:0/3898469324 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa02800b9c0 con 0x7fa044070d70 2024-03-29T04:29:29.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.041+0000 7fa043400640 1 --2- 172.21.15.153:0/3898469324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0280039b0 0x7fa028003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.041+0000 7fa042a00640 1 --2- 172.21.15.153:0/3898469324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa028004800 0x7fa028004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.041+0000 7fa043e00640 1 --2- 172.21.15.153:0/3898469324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa044070d70 0x7fa0280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.041+0000 7fa043400640 1 -- 172.21.15.153:0/3898469324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa044070d70 msgr2=0x7fa0280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:29.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.041+0000 7fa043400640 1 --2- 172.21.15.153:0/3898469324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa044070d70 0x7fa0280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.041+0000 7fa043400640 1 -- 172.21.15.153:0/3898469324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa028004800 msgr2=0x7fa028004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:29.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.041+0000 7fa043400640 1 --2- 172.21.15.153:0/3898469324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa028004800 0x7fa028004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.041+0000 7fa043400640 1 -- 172.21.15.153:0/3898469324 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa028003520 con 0x7fa0280039b0 2024-03-29T04:29:29.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.042+0000 7fa043400640 1 --2- 172.21.15.153:0/3898469324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0280039b0 0x7fa028003dd0 secure :-1 s=READY pgs=3391 cs=0 l=1 rev1=1 crypto rx=0x7fa034009ac0 tx=0x7fa028005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7472cd0ae81da5df server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:29.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.042+0000 7fa042000640 1 -- 172.21.15.153:0/3898469324 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa034039070 con 0x7fa0280039b0 2024-03-29T04:29:29.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.043+0000 7fa042000640 1 -- 172.21.15.153:0/3898469324 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa03402c6b0 con 0x7fa0280039b0 2024-03-29T04:29:29.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.043+0000 7fa042000640 1 -- 172.21.15.153:0/3898469324 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa034009690 con 0x7fa0280039b0 2024-03-29T04:29:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.043+0000 7fa04a000640 1 -- 172.21.15.153:0/3898469324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0280039b0 msgr2=0x7fa028003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.043+0000 7fa04a000640 1 --2- 172.21.15.153:0/3898469324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0280039b0 0x7fa028003dd0 secure :-1 s=READY pgs=3391 cs=0 l=1 rev1=1 crypto rx=0x7fa034009ac0 tx=0x7fa028005830 comp rx=0 tx=0).stop 2024-03-29T04:29:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.043+0000 7fa043e00640 1 -- 172.21.15.153:0/3898469324 reap_dead start 2024-03-29T04:29:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.043+0000 7fa04a000640 1 -- 172.21.15.153:0/3898469324 shutdown_connections 2024-03-29T04:29:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.043+0000 7fa04a000640 1 -- 172.21.15.153:0/3898469324 >> 172.21.15.153:0/3898469324 conn(0x7fa0440cfc00 msgr2=0x7fa0440cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.043+0000 7fa04a000640 1 -- 172.21.15.153:0/3898469324 shutdown_connections 2024-03-29T04:29:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.043+0000 7fa04a000640 1 -- 172.21.15.153:0/3898469324 wait complete. 2024-03-29T04:29:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.045+0000 7fa04a000640 1 Processor -- start 2024-03-29T04:29:29.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.045+0000 7fa04a000640 1 -- start start 2024-03-29T04:29:29.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.046+0000 7fa04a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0280039b0 0x7fa044153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.046+0000 7fa04a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa04415d2a0 0x7fa044152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.046+0000 7fa04a000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa04415c630 0x7fa0441e9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.046+0000 7fa04a000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa04415e5b0 con 0x7fa04415c630 2024-03-29T04:29:29.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.046+0000 7fa04a000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa04415e430 con 0x7fa04415d2a0 2024-03-29T04:29:29.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.046+0000 7fa04a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa044071150 con 0x7fa0280039b0 2024-03-29T04:29:29.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.046+0000 7fa043e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa04415c630 0x7fa0441e9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.046+0000 7fa043e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa04415c630 0x7fa0441e9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47396/0 (socket says 172.21.15.153:47396) 2024-03-29T04:29:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.046+0000 7fa043e00640 1 -- 172.21.15.153:0/2875987695 learned_addr learned my addr 172.21.15.153:0/2875987695 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.047+0000 7fa042a00640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa04415d2a0 0x7fa044152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.047+0000 7fa043400640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0280039b0 0x7fa044153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.047+0000 7fa043e00640 1 -- 172.21.15.153:0/2875987695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0280039b0 msgr2=0x7fa044153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.047+0000 7fa043e00640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0280039b0 0x7fa044153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.047+0000 7fa043e00640 1 -- 172.21.15.153:0/2875987695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa04415d2a0 msgr2=0x7fa044152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.047+0000 7fa043e00640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa04415d2a0 0x7fa044152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.047+0000 7fa043e00640 1 -- 172.21.15.153:0/2875987695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04415d760 con 0x7fa04415c630 2024-03-29T04:29:29.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.047+0000 7fa042a00640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa04415d2a0 0x7fa044152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:29.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.047+0000 7fa043e00640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa04415c630 0x7fa0441e9d10 secure :-1 s=READY pgs=3392 cs=0 l=1 rev1=1 crypto rx=0x7fa0440709a0 tx=0x7fa03c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:29.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.047+0000 7fa03b400640 1 -- 172.21.15.153:0/2875987695 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c011e40 con 0x7fa04415c630 2024-03-29T04:29:29.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.047+0000 7fa03b400640 1 -- 172.21.15.153:0/2875987695 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa03c01b070 con 0x7fa04415c630 2024-03-29T04:29:29.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.047+0000 7fa03b400640 1 -- 172.21.15.153:0/2875987695 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c003990 con 0x7fa04415c630 2024-03-29T04:29:29.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.047+0000 7fa04a000640 1 -- 172.21.15.153:0/2875987695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa04415da40 con 0x7fa04415c630 2024-03-29T04:29:29.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.048+0000 7fa04a000640 1 -- 172.21.15.153:0/2875987695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0441536b0 con 0x7fa04415c630 2024-03-29T04:29:29.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.049+0000 7fa04a000640 1 -- 172.21.15.153:0/2875987695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa044068ff0 con 0x7fa04415c630 2024-03-29T04:29:29.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.050+0000 7fa03b400640 1 -- 172.21.15.153:0/2875987695 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa03c005d10 con 0x7fa04415c630 2024-03-29T04:29:29.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.051+0000 7fa03b400640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa02006b4d0 0x7fa02006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.051+0000 7fa03b400640 1 -- 172.21.15.153:0/2875987695 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fa03c08a490 con 0x7fa04415c630 2024-03-29T04:29:29.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.051+0000 7fa043400640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa02006b4d0 0x7fa02006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.052+0000 7fa043400640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa02006b4d0 0x7fa02006d990 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa034036000 tx=0x7fa034030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:29.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.055+0000 7fa03b400640 1 -- 172.21.15.153:0/2875987695 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa03c025020 con 0x7fa04415c630 2024-03-29T04:29:29.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.254+0000 7fa04a000640 1 -- 172.21.15.153:0/2875987695 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fa04406f700 con 0x7fa02006b4d0 2024-03-29T04:29:29.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.255+0000 7fa03b400640 1 -- 172.21.15.153:0/2875987695 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa04406f700 con 0x7fa02006b4d0 2024-03-29T04:29:29.231 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 1 to deep-scrub 2024-03-29T04:29:29.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.257+0000 7fa04a000640 1 -- 172.21.15.153:0/2875987695 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa02006b4d0 msgr2=0x7fa02006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.257+0000 7fa04a000640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa02006b4d0 0x7fa02006d990 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa034036000 tx=0x7fa034030000 comp rx=0 tx=0).stop 2024-03-29T04:29:29.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.257+0000 7fa04a000640 1 -- 172.21.15.153:0/2875987695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa04415c630 msgr2=0x7fa0441e9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.257+0000 7fa04a000640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa04415c630 0x7fa0441e9d10 secure :-1 s=READY pgs=3392 cs=0 l=1 rev1=1 crypto rx=0x7fa0440709a0 tx=0x7fa03c0115a0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.258+0000 7fa04a000640 1 -- 172.21.15.153:0/2875987695 shutdown_connections 2024-03-29T04:29:29.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.258+0000 7fa04a000640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa02006b4d0 0x7fa02006d990 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.258+0000 7fa04a000640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa04415c630 0x7fa0441e9d10 unknown :-1 s=CLOSED pgs=3392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.258+0000 7fa04a000640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa04415d2a0 0x7fa044152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.258+0000 7fa04a000640 1 --2- 172.21.15.153:0/2875987695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0280039b0 0x7fa044153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.258+0000 7fa04a000640 1 -- 172.21.15.153:0/2875987695 >> 172.21.15.153:0/2875987695 conn(0x7fa0440cfc00 msgr2=0x7fa044158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:29.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.258+0000 7fa04a000640 1 -- 172.21.15.153:0/2875987695 shutdown_connections 2024-03-29T04:29:29.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.258+0000 7fa04a000640 1 -- 172.21.15.153:0/2875987695 wait complete. 2024-03-29T04:29:29.253 INFO:tasks.ceph:Scrubbing osd.2 2024-03-29T04:29:29.254 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:29:29.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.495+0000 7fa47be00640 1 Processor -- start 2024-03-29T04:29:29.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.496+0000 7fa47be00640 1 -- start start 2024-03-29T04:29:29.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.497+0000 7fa47be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa47415e280 0x7fa47406b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.497+0000 7fa47be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa47406b6b0 0x7fa47406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.497+0000 7fa47be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa47406f9b0 0x7fa47406e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.497+0000 7fa47be00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa47406bb10 con 0x7fa47406b6b0 2024-03-29T04:29:29.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.497+0000 7fa47be00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa47415e660 con 0x7fa47406f9b0 2024-03-29T04:29:29.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.497+0000 7fa47be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4740701a0 con 0x7fa47415e280 2024-03-29T04:29:29.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.497+0000 7fa478a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa47406b6b0 0x7fa47406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.497+0000 7fa478a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa47406b6b0 0x7fa47406f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47402/0 (socket says 172.21.15.153:47402) 2024-03-29T04:29:29.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.497+0000 7fa478a00640 1 -- 172.21.15.153:0/4125113109 learned_addr learned my addr 172.21.15.153:0/4125113109 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:29.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.498+0000 7fa479e00640 1 --2- 172.21.15.153:0/4125113109 >> v2:172.21.15.165:3300/0 conn(0x7fa47406f9b0 0x7fa47406e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.498+0000 7fa479400640 1 --2- 172.21.15.153:0/4125113109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa47415e280 0x7fa47406b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.498+0000 7fa478a00640 1 -- 172.21.15.153:0/4125113109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa47415e280 msgr2=0x7fa47406b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:29.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.498+0000 7fa478a00640 1 --2- 172.21.15.153:0/4125113109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa47415e280 0x7fa47406b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.498+0000 7fa478a00640 1 -- 172.21.15.153:0/4125113109 >> v2:172.21.15.165:3300/0 conn(0x7fa47406f9b0 msgr2=0x7fa47406e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:29.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.498+0000 7fa478a00640 1 --2- 172.21.15.153:0/4125113109 >> v2:172.21.15.165:3300/0 conn(0x7fa47406f9b0 0x7fa47406e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.498+0000 7fa478a00640 1 -- 172.21.15.153:0/4125113109 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa474161e50 con 0x7fa47406b6b0 2024-03-29T04:29:29.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.498+0000 7fa479400640 1 --2- 172.21.15.153:0/4125113109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa47415e280 0x7fa47406b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:29.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.498+0000 7fa479e00640 1 --2- 172.21.15.153:0/4125113109 >> v2:172.21.15.165:3300/0 conn(0x7fa47406f9b0 0x7fa47406e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:29.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.499+0000 7fa478a00640 1 --2- 172.21.15.153:0/4125113109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa47406b6b0 0x7fa47406f470 secure :-1 s=READY pgs=3393 cs=0 l=1 rev1=1 crypto rx=0x7fa47406bdc0 tx=0x7fa46002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab81a436eaa8c42 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:29.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.499+0000 7fa473e00640 1 -- 172.21.15.153:0/4125113109 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa460035020 con 0x7fa47406b6b0 2024-03-29T04:29:29.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.499+0000 7fa473e00640 1 -- 172.21.15.153:0/4125113109 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa46002d040 con 0x7fa47406b6b0 2024-03-29T04:29:29.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.499+0000 7fa473e00640 1 -- 172.21.15.153:0/4125113109 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa460031a80 con 0x7fa47406b6b0 2024-03-29T04:29:29.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.500+0000 7fa47be00640 1 -- 172.21.15.153:0/4125113109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa47406b6b0 msgr2=0x7fa47406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.500+0000 7fa47be00640 1 --2- 172.21.15.153:0/4125113109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa47406b6b0 0x7fa47406f470 secure :-1 s=READY pgs=3393 cs=0 l=1 rev1=1 crypto rx=0x7fa47406bdc0 tx=0x7fa46002b900 comp rx=0 tx=0).stop 2024-03-29T04:29:29.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.500+0000 7fa47be00640 1 -- 172.21.15.153:0/4125113109 shutdown_connections 2024-03-29T04:29:29.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.500+0000 7fa47be00640 1 --2- 172.21.15.153:0/4125113109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa47406b6b0 0x7fa47406f470 unknown :-1 s=CLOSED pgs=3393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.500+0000 7fa47be00640 1 --2- 172.21.15.153:0/4125113109 >> v2:172.21.15.165:3300/0 conn(0x7fa47406f9b0 0x7fa47406e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.500+0000 7fa47be00640 1 --2- 172.21.15.153:0/4125113109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa47415e280 0x7fa47406b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.500+0000 7fa47be00640 1 -- 172.21.15.153:0/4125113109 >> 172.21.15.153:0/4125113109 conn(0x7fa4740b2be0 msgr2=0x7fa4740b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:29.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.500+0000 7fa47be00640 1 -- 172.21.15.153:0/4125113109 shutdown_connections 2024-03-29T04:29:29.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.500+0000 7fa47be00640 1 -- 172.21.15.153:0/4125113109 wait complete. 2024-03-29T04:29:29.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.502+0000 7fa47be00640 1 Processor -- start 2024-03-29T04:29:29.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.502+0000 7fa47be00640 1 -- start start 2024-03-29T04:29:29.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.503+0000 7fa47be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa47406b6b0 0x7fa47415cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.503+0000 7fa47be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa47406f9b0 0x7fa474152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.503+0000 7fa47be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa47415e280 0x7fa474148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.503+0000 7fa47be00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa4741626f0 con 0x7fa47415e280 2024-03-29T04:29:29.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.503+0000 7fa47be00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa474162410 con 0x7fa47406f9b0 2024-03-29T04:29:29.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.503+0000 7fa47be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa474162c10 con 0x7fa47406b6b0 2024-03-29T04:29:29.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.503+0000 7fa479e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa47415e280 0x7fa474148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.503+0000 7fa479e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa47415e280 0x7fa474148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47408/0 (socket says 172.21.15.153:47408) 2024-03-29T04:29:29.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.503+0000 7fa479e00640 1 -- 172.21.15.153:0/1706130514 learned_addr learned my addr 172.21.15.153:0/1706130514 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:29.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.504+0000 7fa479400640 1 --2- 172.21.15.153:0/1706130514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa47406b6b0 0x7fa47415cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.504+0000 7fa478a00640 1 --2- 172.21.15.153:0/1706130514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa47406f9b0 0x7fa474152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.504+0000 7fa479e00640 1 -- 172.21.15.153:0/1706130514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa47406b6b0 msgr2=0x7fa47415cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.504+0000 7fa479e00640 1 --2- 172.21.15.153:0/1706130514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa47406b6b0 0x7fa47415cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.504+0000 7fa479e00640 1 -- 172.21.15.153:0/1706130514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa47406f9b0 msgr2=0x7fa474152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.504+0000 7fa479e00640 1 --2- 172.21.15.153:0/1706130514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa47406f9b0 0x7fa474152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.504+0000 7fa479e00640 1 -- 172.21.15.153:0/1706130514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa474155530 con 0x7fa47415e280 2024-03-29T04:29:29.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.504+0000 7fa479e00640 1 --2- 172.21.15.153:0/1706130514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa47415e280 0x7fa474148660 secure :-1 s=READY pgs=3394 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00cef0 tx=0x7fa46c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:29.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.504+0000 7fa471600640 1 -- 172.21.15.153:0/1706130514 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c01a070 con 0x7fa47415e280 2024-03-29T04:29:29.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.504+0000 7fa471600640 1 -- 172.21.15.153:0/1706130514 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa46c00d840 con 0x7fa47415e280 2024-03-29T04:29:29.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.504+0000 7fa471600640 1 -- 172.21.15.153:0/1706130514 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c00dc30 con 0x7fa47415e280 2024-03-29T04:29:29.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.504+0000 7fa47be00640 1 -- 172.21.15.153:0/1706130514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa47415d0f0 con 0x7fa47415e280 2024-03-29T04:29:29.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.505+0000 7fa47be00640 1 -- 172.21.15.153:0/1706130514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa474155ab0 con 0x7fa47415e280 2024-03-29T04:29:29.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.506+0000 7fa47be00640 1 -- 172.21.15.153:0/1706130514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa4740690d0 con 0x7fa47415e280 2024-03-29T04:29:29.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.507+0000 7fa471600640 1 -- 172.21.15.153:0/1706130514 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa46c01d070 con 0x7fa47415e280 2024-03-29T04:29:29.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.508+0000 7fa471600640 1 --2- 172.21.15.153:0/1706130514 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa45406b4d0 0x7fa45406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.508+0000 7fa471600640 1 -- 172.21.15.153:0/1706130514 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fa46c08a7b0 con 0x7fa47415e280 2024-03-29T04:29:29.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.508+0000 7fa479400640 1 --2- 172.21.15.153:0/1706130514 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa45406b4d0 0x7fa45406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.508+0000 7fa471600640 1 --2- 172.21.15.153:0/1706130514 >> [v2:172.21.15.153:6800/328922913,v1:172.21.15.153:6801/328922913] conn(0x7fa454071390 0x7fa4540737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.508+0000 7fa471600640 1 -- 172.21.15.153:0/1706130514 --> [v2:172.21.15.153:6800/328922913,v1:172.21.15.153:6801/328922913] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa46c018e70 con 0x7fa454071390 2024-03-29T04:29:29.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.508+0000 7fa471600640 1 -- 172.21.15.153:0/1706130514 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa46c091050 con 0x7fa47415e280 2024-03-29T04:29:29.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.508+0000 7fa478a00640 1 --2- 172.21.15.153:0/1706130514 >> [v2:172.21.15.153:6800/328922913,v1:172.21.15.153:6801/328922913] conn(0x7fa454071390 0x7fa4540737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.509+0000 7fa479400640 1 --2- 172.21.15.153:0/1706130514 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa45406b4d0 0x7fa45406d990 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa46400b840 tx=0x7fa464008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:29.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.509+0000 7fa478a00640 1 --2- 172.21.15.153:0/1706130514 >> [v2:172.21.15.153:6800/328922913,v1:172.21.15.153:6801/328922913] conn(0x7fa454071390 0x7fa4540737b0 crc :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:29.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.510+0000 7fa471600640 1 -- 172.21.15.153:0/1706130514 <== osd.2 v2:172.21.15.153:6800/328922913 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa46c018e70 con 0x7fa454071390 2024-03-29T04:29:29.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.524+0000 7fa47be00640 1 -- 172.21.15.153:0/1706130514 --> [v2:172.21.15.153:6800/328922913,v1:172.21.15.153:6801/328922913] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa4740b5290 con 0x7fa454071390 2024-03-29T04:29:29.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.525+0000 7fa471600640 1 -- 172.21.15.153:0/1706130514 <== osd.2 v2:172.21.15.153:6800/328922913 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa4740b5290 con 0x7fa454071390 2024-03-29T04:29:29.502 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-29T04:29:29.502 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:29:29.502 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-29T04:29:29.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.525+0000 7fa47be00640 1 -- 172.21.15.153:0/1706130514 >> [v2:172.21.15.153:6800/328922913,v1:172.21.15.153:6801/328922913] conn(0x7fa454071390 msgr2=0x7fa4540737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.525+0000 7fa47be00640 1 --2- 172.21.15.153:0/1706130514 >> [v2:172.21.15.153:6800/328922913,v1:172.21.15.153:6801/328922913] conn(0x7fa454071390 0x7fa4540737b0 crc :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.526+0000 7fa47be00640 1 -- 172.21.15.153:0/1706130514 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa45406b4d0 msgr2=0x7fa45406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.526+0000 7fa47be00640 1 --2- 172.21.15.153:0/1706130514 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa45406b4d0 0x7fa45406d990 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa46400b840 tx=0x7fa464008040 comp rx=0 tx=0).stop 2024-03-29T04:29:29.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.526+0000 7fa47be00640 1 -- 172.21.15.153:0/1706130514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa47415e280 msgr2=0x7fa474148660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.526+0000 7fa47be00640 1 --2- 172.21.15.153:0/1706130514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa47415e280 0x7fa474148660 secure :-1 s=READY pgs=3394 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00cef0 tx=0x7fa46c00a710 comp rx=0 tx=0).stop 2024-03-29T04:29:29.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.526+0000 7fa479e00640 1 -- 172.21.15.153:0/1706130514 reap_dead start 2024-03-29T04:29:29.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.526+0000 7fa47be00640 1 -- 172.21.15.153:0/1706130514 shutdown_connections 2024-03-29T04:29:29.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.526+0000 7fa47be00640 1 -- 172.21.15.153:0/1706130514 >> 172.21.15.153:0/1706130514 conn(0x7fa4740b2be0 msgr2=0x7fa4740b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:29.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.526+0000 7fa47be00640 1 -- 172.21.15.153:0/1706130514 shutdown_connections 2024-03-29T04:29:29.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.526+0000 7fa47be00640 1 -- 172.21.15.153:0/1706130514 wait complete. 2024-03-29T04:29:29.520 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-29T04:29:29.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.749+0000 7fca17200640 1 Processor -- start 2024-03-29T04:29:29.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.750+0000 7fca17200640 1 -- start start 2024-03-29T04:29:29.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.751+0000 7fca17200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fca1815c110 0x7fca180cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.751+0000 7fca17200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca180b4680 con 0x7fca1806f770 2024-03-29T04:29:29.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.751+0000 7fca17200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca180d1060 con 0x7fca180cd8f0 2024-03-29T04:29:29.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.751+0000 7fca17200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fca180d1320 con 0x7fca1815c110 2024-03-29T04:29:29.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.752+0000 7fca15e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fca1815c110 0x7fca180cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.752+0000 7fca15400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fca1806f770 0x7fca180b3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:39038/0 (socket says 172.21.15.153:39038) 2024-03-29T04:29:29.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.752+0000 7fca15400640 1 -- 172.21.15.153:0/283758795 learned_addr learned my addr 172.21.15.153:0/283758795 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:29.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.752+0000 7fca14a00640 1 -- 172.21.15.153:0/283758795 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349111423 0 0) 0x7fca180b4680 con 0x7fca1806f770 2024-03-29T04:29:29.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.752+0000 7fca14a00640 1 -- 172.21.15.153:0/283758795 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9fc003520 con 0x7fca1806f770 2024-03-29T04:29:29.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.753+0000 7fca15e00640 1 -- 172.21.15.153:0/283758795 >> v1:172.21.15.165:6789/0 conn(0x7fca180cd8f0 legacy=0x7fca180b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.753+0000 7fca15e00640 1 -- 172.21.15.153:0/283758795 >> v1:172.21.15.153:6789/0 conn(0x7fca1806f770 legacy=0x7fca180b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.753+0000 7fca14a00640 1 -- 172.21.15.153:0/283758795 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2925457577 0 0) 0x7fc9fc003520 con 0x7fca1806f770 2024-03-29T04:29:29.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.753+0000 7fca15e00640 1 -- 172.21.15.153:0/283758795 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca180d1600 con 0x7fca1815c110 2024-03-29T04:29:29.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.754+0000 7fca15e00640 1 --2- 172.21.15.153:0/283758795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca1815c110 0x7fca180cfec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fca000097a0 tx=0x7fca0002b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4ce9d7fde570c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:29.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.755+0000 7fca14a00640 1 -- 172.21.15.153:0/283758795 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca00037070 con 0x7fca1815c110 2024-03-29T04:29:29.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.755+0000 7fca14a00640 1 -- 172.21.15.153:0/283758795 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca00030510 con 0x7fca1815c110 2024-03-29T04:29:29.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.755+0000 7fca14a00640 1 -- 172.21.15.153:0/283758795 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca080019f0 con 0x7fca1815c110 2024-03-29T04:29:29.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.755+0000 7fca17200640 1 -- 172.21.15.153:0/283758795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca1815c110 msgr2=0x7fca180cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.755+0000 7fca17200640 1 --2- 172.21.15.153:0/283758795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca1815c110 0x7fca180cfec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fca000097a0 tx=0x7fca0002b710 comp rx=0 tx=0).stop 2024-03-29T04:29:29.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.756+0000 7fca17200640 1 -- 172.21.15.153:0/283758795 shutdown_connections 2024-03-29T04:29:29.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.756+0000 7fca17200640 1 --2- 172.21.15.153:0/283758795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca1815c110 0x7fca180cfec0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.756+0000 7fca17200640 1 -- 172.21.15.153:0/283758795 >> 172.21.15.153:0/283758795 conn(0x7fca180d1c80 msgr2=0x7fca180d2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.756+0000 7fca17200640 1 -- 172.21.15.153:0/283758795 shutdown_connections 2024-03-29T04:29:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.756+0000 7fca17200640 1 -- 172.21.15.153:0/283758795 wait complete. 2024-03-29T04:29:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.757+0000 7fca17200640 1 Processor -- start 2024-03-29T04:29:29.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.758+0000 7fca17200640 1 -- start start 2024-03-29T04:29:29.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca17200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca1806f770 0x7fca180b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca17200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca180cd8f0 0x7fca180b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca17200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca18155130 0x7fca181555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca17200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fca180cbf00 con 0x7fca18155130 2024-03-29T04:29:29.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca17200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fca180ce470 con 0x7fca1806f770 2024-03-29T04:29:29.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca17200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fca180cc080 con 0x7fca180cd8f0 2024-03-29T04:29:29.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca16800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca18155130 0x7fca181555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca16800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca18155130 0x7fca181555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47424/0 (socket says 172.21.15.153:47424) 2024-03-29T04:29:29.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca16800640 1 -- 172.21.15.153:0/2454949348 learned_addr learned my addr 172.21.15.153:0/2454949348 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:29.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca15e00640 1 --2- 172.21.15.153:0/2454949348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca1806f770 0x7fca180b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca15400640 1 --2- 172.21.15.153:0/2454949348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca180cd8f0 0x7fca180b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca16800640 1 -- 172.21.15.153:0/2454949348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca180cd8f0 msgr2=0x7fca180b70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca16800640 1 --2- 172.21.15.153:0/2454949348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca180cd8f0 0x7fca180b70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca16800640 1 -- 172.21.15.153:0/2454949348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca1806f770 msgr2=0x7fca180b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca16800640 1 --2- 172.21.15.153:0/2454949348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca1806f770 0x7fca180b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.759+0000 7fca16800640 1 -- 172.21.15.153:0/2454949348 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca181577e0 con 0x7fca18155130 2024-03-29T04:29:29.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.760+0000 7fca16800640 1 --2- 172.21.15.153:0/2454949348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca18155130 0x7fca181555e0 secure :-1 s=READY pgs=3396 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c390 tx=0x7fca1000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:29.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.760+0000 7fca0e000640 1 -- 172.21.15.153:0/2454949348 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10017070 con 0x7fca18155130 2024-03-29T04:29:29.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.760+0000 7fca0e000640 1 -- 172.21.15.153:0/2454949348 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca100052d0 con 0x7fca18155130 2024-03-29T04:29:29.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.760+0000 7fca17200640 1 -- 172.21.15.153:0/2454949348 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca18157ac0 con 0x7fca18155130 2024-03-29T04:29:29.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.760+0000 7fca0e000640 1 -- 172.21.15.153:0/2454949348 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10003810 con 0x7fca18155130 2024-03-29T04:29:29.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.760+0000 7fca17200640 1 -- 172.21.15.153:0/2454949348 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca18158080 con 0x7fca18155130 2024-03-29T04:29:29.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.761+0000 7fca17200640 1 -- 172.21.15.153:0/2454949348 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca1804f4b0 con 0x7fca18155130 2024-03-29T04:29:29.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.763+0000 7fca0e000640 1 -- 172.21.15.153:0/2454949348 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fca1001a070 con 0x7fca18155130 2024-03-29T04:29:29.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.764+0000 7fca0e000640 1 --2- 172.21.15.153:0/2454949348 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc9f406b4d0 0x7fc9f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:29.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.764+0000 7fca0e000640 1 -- 172.21.15.153:0/2454949348 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fca100892a0 con 0x7fca18155130 2024-03-29T04:29:29.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.764+0000 7fca15e00640 1 --2- 172.21.15.153:0/2454949348 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc9f406b4d0 0x7fc9f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:29.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.765+0000 7fca15e00640 1 --2- 172.21.15.153:0/2454949348 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc9f406b4d0 0x7fc9f406d990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fca00034000 tx=0x7fca00008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:29.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.768+0000 7fca0e000640 1 -- 172.21.15.153:0/2454949348 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fca10058380 con 0x7fca18155130 2024-03-29T04:29:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.962+0000 7fca17200640 1 -- 172.21.15.153:0/2454949348 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fca180cf3e0 con 0x7fc9f406b4d0 2024-03-29T04:29:29.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.962+0000 7fca0e000640 1 -- 172.21.15.153:0/2454949348 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fca180cf3e0 con 0x7fc9f406b4d0 2024-03-29T04:29:29.939 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 2 to deep-scrub 2024-03-29T04:29:29.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.965+0000 7fca17200640 1 -- 172.21.15.153:0/2454949348 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc9f406b4d0 msgr2=0x7fc9f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.965+0000 7fca17200640 1 --2- 172.21.15.153:0/2454949348 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc9f406b4d0 0x7fc9f406d990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fca00034000 tx=0x7fca00008030 comp rx=0 tx=0).stop 2024-03-29T04:29:29.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.965+0000 7fca17200640 1 -- 172.21.15.153:0/2454949348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca18155130 msgr2=0x7fca181555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:29.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.965+0000 7fca17200640 1 --2- 172.21.15.153:0/2454949348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca18155130 0x7fca181555e0 secure :-1 s=READY pgs=3396 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c390 tx=0x7fca1000c850 comp rx=0 tx=0).stop 2024-03-29T04:29:29.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.965+0000 7fca17200640 1 -- 172.21.15.153:0/2454949348 shutdown_connections 2024-03-29T04:29:29.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.965+0000 7fca17200640 1 --2- 172.21.15.153:0/2454949348 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fc9f406b4d0 0x7fc9f406d990 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.965+0000 7fca17200640 1 --2- 172.21.15.153:0/2454949348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca18155130 0x7fca181555e0 unknown :-1 s=CLOSED pgs=3396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.965+0000 7fca17200640 1 --2- 172.21.15.153:0/2454949348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca180cd8f0 0x7fca180b70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.965+0000 7fca17200640 1 --2- 172.21.15.153:0/2454949348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca1806f770 0x7fca180b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:29.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.965+0000 7fca17200640 1 -- 172.21.15.153:0/2454949348 >> 172.21.15.153:0/2454949348 conn(0x7fca180d1c80 msgr2=0x7fca180ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:29.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.965+0000 7fca17200640 1 -- 172.21.15.153:0/2454949348 shutdown_connections 2024-03-29T04:29:29.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:29.965+0000 7fca17200640 1 -- 172.21.15.153:0/2454949348 wait complete. 2024-03-29T04:29:29.960 INFO:tasks.ceph:Scrubbing osd.3 2024-03-29T04:29:29.960 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:29:30.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.204+0000 7ffb08a00640 1 Processor -- start 2024-03-29T04:29:30.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.205+0000 7ffb08a00640 1 -- start start 2024-03-29T04:29:30.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.206+0000 7ffb08a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ffb04158820 0x7ffb0406b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.206+0000 7ffb08a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb04158c00 con 0x7ffb0406e130 2024-03-29T04:29:30.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.206+0000 7ffb08a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0415ead0 con 0x7ffb0406b6b0 2024-03-29T04:29:30.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.206+0000 7ffb08a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ffb0406bb10 con 0x7ffb04158820 2024-03-29T04:29:30.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.207+0000 7ffb03200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ffb0406e130 0x7ffb040715d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:39042/0 (socket says 172.21.15.153:39042) 2024-03-29T04:29:30.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.207+0000 7ffb03200640 1 -- 172.21.15.153:0/2894722687 learned_addr learned my addr 172.21.15.153:0/2894722687 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:30.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.207+0000 7ffb02800640 1 --2- 172.21.15.153:0/2894722687 >> v2:172.21.15.165:3300/0 conn(0x7ffb04158820 0x7ffb0406b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.207+0000 7ffb01400640 1 -- 172.21.15.153:0/2894722687 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1460760509 0 0) 0x7ffb04158c00 con 0x7ffb0406e130 2024-03-29T04:29:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.207+0000 7ffb01400640 1 -- 172.21.15.153:0/2894722687 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffae8005730 con 0x7ffb0406e130 2024-03-29T04:29:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.207+0000 7ffb01400640 1 -- 172.21.15.153:0/2894722687 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2067523847 0 0) 0x7ffae8005730 con 0x7ffb0406e130 2024-03-29T04:29:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.207+0000 7ffb01400640 1 -- 172.21.15.153:0/2894722687 >> v2:172.21.15.165:3300/0 conn(0x7ffb04158820 msgr2=0x7ffb0406b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.207+0000 7ffb01400640 1 --2- 172.21.15.153:0/2894722687 >> v2:172.21.15.165:3300/0 conn(0x7ffb04158820 0x7ffb0406b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.207+0000 7ffb01400640 1 -- 172.21.15.153:0/2894722687 >> v1:172.21.15.165:6789/0 conn(0x7ffb0406b6b0 legacy=0x7ffb0406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.207+0000 7ffb01400640 1 -- 172.21.15.153:0/2894722687 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0415edb0 con 0x7ffb0406e130 2024-03-29T04:29:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb01400640 1 -- 172.21.15.153:0/2894722687 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7ffafc0019f0 con 0x7ffb0406e130 2024-03-29T04:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb01400640 1 -- 172.21.15.153:0/2894722687 >> v1:172.21.15.153:6789/0 conn(0x7ffb0406e130 legacy=0x7ffb040715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb01400640 1 --2- 172.21.15.153:0/2894722687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffae8005bc0 0x7ffae8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb01400640 1 --2- 172.21.15.153:0/2894722687 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffae8006a10 0x7ffae8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb01400640 1 --2- 172.21.15.153:0/2894722687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffae80073d0 0x7ffae800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb01400640 1 -- 172.21.15.153:0/2894722687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffae800e240 con 0x7ffae8005bc0 2024-03-29T04:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb01400640 1 -- 172.21.15.153:0/2894722687 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffae800e3f0 con 0x7ffae80073d0 2024-03-29T04:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb01400640 1 -- 172.21.15.153:0/2894722687 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffae800e5f0 con 0x7ffae8006a10 2024-03-29T04:29:30.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb02800640 1 --2- 172.21.15.153:0/2894722687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffae8005bc0 0x7ffae8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb02800640 1 -- 172.21.15.153:0/2894722687 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffae8006a10 msgr2=0x7ffae8006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb02800640 1 --2- 172.21.15.153:0/2894722687 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffae8006a10 0x7ffae8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb02800640 1 -- 172.21.15.153:0/2894722687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffae80073d0 msgr2=0x7ffae800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb02800640 1 --2- 172.21.15.153:0/2894722687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffae80073d0 0x7ffae800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb02800640 1 -- 172.21.15.153:0/2894722687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae8005730 con 0x7ffae8005bc0 2024-03-29T04:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.208+0000 7ffb03200640 1 -- 172.21.15.153:0/2894722687 reap_dead start 2024-03-29T04:29:30.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.209+0000 7ffb02800640 1 --2- 172.21.15.153:0/2894722687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffae8005bc0 0x7ffae8005fe0 secure :-1 s=READY pgs=3398 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009ac0 tx=0x7ffae8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b3607a6e3afb16 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:30.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.210+0000 7ffb01400640 1 -- 172.21.15.153:0/2894722687 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4039070 con 0x7ffae8005bc0 2024-03-29T04:29:30.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.210+0000 7ffb01400640 1 -- 172.21.15.153:0/2894722687 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf402c710 con 0x7ffae8005bc0 2024-03-29T04:29:30.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.210+0000 7ffb01400640 1 -- 172.21.15.153:0/2894722687 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4009690 con 0x7ffae8005bc0 2024-03-29T04:29:30.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.210+0000 7ffb08a00640 1 -- 172.21.15.153:0/2894722687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffae8005bc0 msgr2=0x7ffae8005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.210+0000 7ffb08a00640 1 --2- 172.21.15.153:0/2894722687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffae8005bc0 0x7ffae8005fe0 secure :-1 s=READY pgs=3398 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009ac0 tx=0x7ffae8007a40 comp rx=0 tx=0).stop 2024-03-29T04:29:30.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.210+0000 7ffb08a00640 1 -- 172.21.15.153:0/2894722687 shutdown_connections 2024-03-29T04:29:30.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.210+0000 7ffb08a00640 1 --2- 172.21.15.153:0/2894722687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffae8005bc0 0x7ffae8005fe0 unknown :-1 s=CLOSED pgs=3398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.210+0000 7ffb08a00640 1 -- 172.21.15.153:0/2894722687 >> 172.21.15.153:0/2894722687 conn(0x7ffb040cfda0 msgr2=0x7ffb040d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:30.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.210+0000 7ffb08a00640 1 -- 172.21.15.153:0/2894722687 shutdown_connections 2024-03-29T04:29:30.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.210+0000 7ffb08a00640 1 -- 172.21.15.153:0/2894722687 wait complete. 2024-03-29T04:29:30.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.212+0000 7ffb08a00640 1 Processor -- start 2024-03-29T04:29:30.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.212+0000 7ffb08a00640 1 -- start start 2024-03-29T04:29:30.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.213+0000 7ffb08a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffae8005bc0 0x7ffb0414ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.213+0000 7ffb08a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb040b30e0 0x7ffb04157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.213+0000 7ffb08a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb04157dd0 0x7ffb04151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.213+0000 7ffb08a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0415f370 con 0x7ffae8005bc0 2024-03-29T04:29:30.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.213+0000 7ffb08a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0415e880 con 0x7ffb040b30e0 2024-03-29T04:29:30.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.213+0000 7ffb08a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0406b170 con 0x7ffb04157dd0 2024-03-29T04:29:30.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.214+0000 7ffb02800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffae8005bc0 0x7ffb0414ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.214+0000 7ffb02800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffae8005bc0 0x7ffb0414ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47436/0 (socket says 172.21.15.153:47436) 2024-03-29T04:29:30.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.214+0000 7ffb02800640 1 -- 172.21.15.153:0/2224391166 learned_addr learned my addr 172.21.15.153:0/2224391166 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:30.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.214+0000 7ffb02800640 1 -- 172.21.15.153:0/2224391166 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb04157dd0 msgr2=0x7ffb04151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.214+0000 7ffb02800640 1 --2- 172.21.15.153:0/2224391166 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb04157dd0 0x7ffb04151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.214+0000 7ffb02800640 1 -- 172.21.15.153:0/2224391166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb040b30e0 msgr2=0x7ffb04157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.214+0000 7ffb02800640 1 --2- 172.21.15.153:0/2224391166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb040b30e0 0x7ffb04157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.214+0000 7ffb02800640 1 -- 172.21.15.153:0/2224391166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0414fc10 con 0x7ffae8005bc0 2024-03-29T04:29:30.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.214+0000 7ffb02800640 1 --2- 172.21.15.153:0/2224391166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffae8005bc0 0x7ffb0414ae90 secure :-1 s=READY pgs=3399 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4000c00 tx=0x7ffaf4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:30.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.215+0000 7ffafaa00640 1 -- 172.21.15.153:0/2224391166 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4039050 con 0x7ffae8005bc0 2024-03-29T04:29:30.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.215+0000 7ffafaa00640 1 -- 172.21.15.153:0/2224391166 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf4045070 con 0x7ffae8005bc0 2024-03-29T04:29:30.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.215+0000 7ffafaa00640 1 -- 172.21.15.153:0/2224391166 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40044e0 con 0x7ffae8005bc0 2024-03-29T04:29:30.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.215+0000 7ffb08a00640 1 -- 172.21.15.153:0/2224391166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb0414fef0 con 0x7ffae8005bc0 2024-03-29T04:29:30.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.215+0000 7ffb08a00640 1 -- 172.21.15.153:0/2224391166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb041504b0 con 0x7ffae8005bc0 2024-03-29T04:29:30.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.216+0000 7ffb08a00640 1 -- 172.21.15.153:0/2224391166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb04068ff0 con 0x7ffae8005bc0 2024-03-29T04:29:30.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.217+0000 7ffafaa00640 1 -- 172.21.15.153:0/2224391166 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ffaf4003a50 con 0x7ffae8005bc0 2024-03-29T04:29:30.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.218+0000 7ffafaa00640 1 --2- 172.21.15.153:0/2224391166 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ffae406b4d0 0x7ffae406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.218+0000 7ffafaa00640 1 -- 172.21.15.153:0/2224391166 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7ffaf40abac0 con 0x7ffae8005bc0 2024-03-29T04:29:30.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.218+0000 7ffb01e00640 1 --2- 172.21.15.153:0/2224391166 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ffae406b4d0 0x7ffae406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.218+0000 7ffafaa00640 1 --2- 172.21.15.153:0/2224391166 >> [v2:172.21.15.153:6824/3058330116,v1:172.21.15.153:6825/3058330116] conn(0x7ffae4071390 0x7ffae40737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.218+0000 7ffafaa00640 1 -- 172.21.15.153:0/2224391166 --> [v2:172.21.15.153:6824/3058330116,v1:172.21.15.153:6825/3058330116] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffaf4036e90 con 0x7ffae4071390 2024-03-29T04:29:30.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.218+0000 7ffafaa00640 1 -- 172.21.15.153:0/2224391166 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ffaf40ade60 con 0x7ffae8005bc0 2024-03-29T04:29:30.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.219+0000 7ffb03200640 1 --2- 172.21.15.153:0/2224391166 >> [v2:172.21.15.153:6824/3058330116,v1:172.21.15.153:6825/3058330116] conn(0x7ffae4071390 0x7ffae40737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.219+0000 7ffb01e00640 1 --2- 172.21.15.153:0/2224391166 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ffae406b4d0 0x7ffae406d990 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ffb040b14b0 tx=0x7ffaf0007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:30.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.219+0000 7ffb03200640 1 --2- 172.21.15.153:0/2224391166 >> [v2:172.21.15.153:6824/3058330116,v1:172.21.15.153:6825/3058330116] conn(0x7ffae4071390 0x7ffae40737b0 crc :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:30.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.220+0000 7ffafaa00640 1 -- 172.21.15.153:0/2224391166 <== osd.3 v2:172.21.15.153:6824/3058330116 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffaf4036e90 con 0x7ffae4071390 2024-03-29T04:29:30.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.235+0000 7ffb08a00640 1 -- 172.21.15.153:0/2224391166 --> [v2:172.21.15.153:6824/3058330116,v1:172.21.15.153:6825/3058330116] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffb04158c00 con 0x7ffae4071390 2024-03-29T04:29:30.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.235+0000 7ffafaa00640 1 -- 172.21.15.153:0/2224391166 <== osd.3 v2:172.21.15.153:6824/3058330116 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffb04158c00 con 0x7ffae4071390 2024-03-29T04:29:30.212 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-29T04:29:30.212 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:29:30.213 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-29T04:29:30.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.235+0000 7ffb08a00640 1 -- 172.21.15.153:0/2224391166 >> [v2:172.21.15.153:6824/3058330116,v1:172.21.15.153:6825/3058330116] conn(0x7ffae4071390 msgr2=0x7ffae40737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.235+0000 7ffb08a00640 1 --2- 172.21.15.153:0/2224391166 >> [v2:172.21.15.153:6824/3058330116,v1:172.21.15.153:6825/3058330116] conn(0x7ffae4071390 0x7ffae40737b0 crc :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.236+0000 7ffb08a00640 1 -- 172.21.15.153:0/2224391166 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ffae406b4d0 msgr2=0x7ffae406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.236+0000 7ffb08a00640 1 --2- 172.21.15.153:0/2224391166 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ffae406b4d0 0x7ffae406d990 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ffb040b14b0 tx=0x7ffaf0007990 comp rx=0 tx=0).stop 2024-03-29T04:29:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.236+0000 7ffb08a00640 1 -- 172.21.15.153:0/2224391166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffae8005bc0 msgr2=0x7ffb0414ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.236+0000 7ffb08a00640 1 --2- 172.21.15.153:0/2224391166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffae8005bc0 0x7ffb0414ae90 secure :-1 s=READY pgs=3399 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4000c00 tx=0x7ffaf4004730 comp rx=0 tx=0).stop 2024-03-29T04:29:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.236+0000 7ffb03200640 1 -- 172.21.15.153:0/2224391166 reap_dead start 2024-03-29T04:29:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.236+0000 7ffb08a00640 1 -- 172.21.15.153:0/2224391166 shutdown_connections 2024-03-29T04:29:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.236+0000 7ffb08a00640 1 -- 172.21.15.153:0/2224391166 >> 172.21.15.153:0/2224391166 conn(0x7ffb040cfda0 msgr2=0x7ffb04158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:30.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.236+0000 7ffb08a00640 1 -- 172.21.15.153:0/2224391166 shutdown_connections 2024-03-29T04:29:30.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.236+0000 7ffb08a00640 1 -- 172.21.15.153:0/2224391166 wait complete. 2024-03-29T04:29:30.231 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-29T04:29:30.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.464+0000 7efd23e00640 1 Processor -- start 2024-03-29T04:29:30.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.465+0000 7efd23e00640 1 -- start start 2024-03-29T04:29:30.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.466+0000 7efd23e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efd2415e180 0x7efd240d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.466+0000 7efd23e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240d4680 0x7efd240d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.466+0000 7efd23e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd240d4b80 con 0x7efd2415e560 2024-03-29T04:29:30.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.466+0000 7efd23e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7efd240d4e60 con 0x7efd2415e180 2024-03-29T04:29:30.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.466+0000 7efd23e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efd240b34e0 con 0x7efd240d4680 2024-03-29T04:29:30.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.466+0000 7efd22a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efd2415e180 0x7efd240d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.466+0000 7efd22a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efd2415e180 0x7efd240d2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47450/0 (socket says 172.21.15.153:47450) 2024-03-29T04:29:30.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.467+0000 7efd22a00640 1 -- 172.21.15.153:0/2896857433 learned_addr learned my addr 172.21.15.153:0/2896857433 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:30.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.467+0000 7efd22a00640 1 -- 172.21.15.153:0/2896857433 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240d4680 msgr2=0x7efd240d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:30.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.467+0000 7efd22a00640 1 --2- 172.21.15.153:0/2896857433 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240d4680 0x7efd240d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.467+0000 7efd22a00640 1 -- 172.21.15.153:0/2896857433 >> v1:172.21.15.165:6789/0 conn(0x7efd2415e560 legacy=0x7efd240cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:30.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.467+0000 7efd22a00640 1 -- 172.21.15.153:0/2896857433 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd240b37c0 con 0x7efd2415e180 2024-03-29T04:29:30.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.468+0000 7efd22a00640 1 --2- 172.21.15.153:0/2896857433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415e180 0x7efd240d2c30 secure :-1 s=READY pgs=3400 cs=0 l=1 rev1=1 crypto rx=0x7efd14009870 tx=0x7efd1402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dea484228b35b79 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:30.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.469+0000 7efd22000640 1 -- 172.21.15.153:0/2896857433 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd140317c0 con 0x7efd2415e180 2024-03-29T04:29:30.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.469+0000 7efd22000640 1 -- 172.21.15.153:0/2896857433 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd14037070 con 0x7efd2415e180 2024-03-29T04:29:30.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.469+0000 7efd22000640 1 -- 172.21.15.153:0/2896857433 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14031b80 con 0x7efd2415e180 2024-03-29T04:29:30.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.469+0000 7efd23e00640 1 -- 172.21.15.153:0/2896857433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415e180 msgr2=0x7efd240d2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.469+0000 7efd23e00640 1 --2- 172.21.15.153:0/2896857433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415e180 0x7efd240d2c30 secure :-1 s=READY pgs=3400 cs=0 l=1 rev1=1 crypto rx=0x7efd14009870 tx=0x7efd1402b860 comp rx=0 tx=0).stop 2024-03-29T04:29:30.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.470+0000 7efd23e00640 1 -- 172.21.15.153:0/2896857433 shutdown_connections 2024-03-29T04:29:30.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.470+0000 7efd23e00640 1 --2- 172.21.15.153:0/2896857433 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240d4680 0x7efd240d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.470+0000 7efd23e00640 1 --2- 172.21.15.153:0/2896857433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415e180 0x7efd240d2c30 unknown :-1 s=CLOSED pgs=3400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.470+0000 7efd23e00640 1 -- 172.21.15.153:0/2896857433 >> 172.21.15.153:0/2896857433 conn(0x7efd2409d1e0 msgr2=0x7efd240d3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:30.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.470+0000 7efd23e00640 1 -- 172.21.15.153:0/2896857433 shutdown_connections 2024-03-29T04:29:30.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.470+0000 7efd23e00640 1 -- 172.21.15.153:0/2896857433 wait complete. 2024-03-29T04:29:30.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.472+0000 7efd23e00640 1 Processor -- start 2024-03-29T04:29:30.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.472+0000 7efd23e00640 1 -- start start 2024-03-29T04:29:30.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.473+0000 7efd23e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240d4680 0x7efd241f8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.473+0000 7efd23e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2415e180 0x7efd240cf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.473+0000 7efd23e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415e560 0x7efd240c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.473+0000 7efd23e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd240d1e70 con 0x7efd2415e560 2024-03-29T04:29:30.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.473+0000 7efd23e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efd240d1cf0 con 0x7efd2415e180 2024-03-29T04:29:30.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.473+0000 7efd23e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efd240b4fd0 con 0x7efd240d4680 2024-03-29T04:29:30.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.473+0000 7efd23400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415e560 0x7efd240c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.473+0000 7efd23400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415e560 0x7efd240c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47456/0 (socket says 172.21.15.153:47456) 2024-03-29T04:29:30.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.473+0000 7efd23400640 1 -- 172.21.15.153:0/1510504217 learned_addr learned my addr 172.21.15.153:0/1510504217 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:30.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.474+0000 7efd22a00640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240d4680 0x7efd241f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.474+0000 7efd1a000640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2415e180 0x7efd240cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.474+0000 7efd23400640 1 -- 172.21.15.153:0/1510504217 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240d4680 msgr2=0x7efd241f8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.474+0000 7efd23400640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240d4680 0x7efd241f8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.474+0000 7efd23400640 1 -- 172.21.15.153:0/1510504217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2415e180 msgr2=0x7efd240cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.474+0000 7efd23400640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2415e180 0x7efd240cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.474+0000 7efd23400640 1 -- 172.21.15.153:0/1510504217 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd24152a80 con 0x7efd2415e560 2024-03-29T04:29:30.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.474+0000 7efd1a000640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2415e180 0x7efd240cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:30.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.474+0000 7efd23400640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415e560 0x7efd240c8a30 secure :-1 s=READY pgs=3401 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00b9e0 tx=0x7efd1c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:30.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.475+0000 7efd1b400640 1 -- 172.21.15.153:0/1510504217 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c019070 con 0x7efd2415e560 2024-03-29T04:29:30.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.475+0000 7efd1b400640 1 -- 172.21.15.153:0/1510504217 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c00ca40 con 0x7efd2415e560 2024-03-29T04:29:30.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.475+0000 7efd23e00640 1 -- 172.21.15.153:0/1510504217 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd24151b90 con 0x7efd2415e560 2024-03-29T04:29:30.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.475+0000 7efd1b400640 1 -- 172.21.15.153:0/1510504217 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c014440 con 0x7efd2415e560 2024-03-29T04:29:30.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.475+0000 7efd23e00640 1 -- 172.21.15.153:0/1510504217 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd24152150 con 0x7efd2415e560 2024-03-29T04:29:30.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.476+0000 7efd23e00640 1 -- 172.21.15.153:0/1510504217 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd2404f4b0 con 0x7efd2415e560 2024-03-29T04:29:30.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.477+0000 7efd1b400640 1 -- 172.21.15.153:0/1510504217 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7efd1c01c070 con 0x7efd2415e560 2024-03-29T04:29:30.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.478+0000 7efd1b400640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0006b4d0 0x7efd0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.478+0000 7efd1b400640 1 -- 172.21.15.153:0/1510504217 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7efd1c089b00 con 0x7efd2415e560 2024-03-29T04:29:30.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.478+0000 7efd22a00640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0006b4d0 0x7efd0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.479+0000 7efd22a00640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0006b4d0 0x7efd0006d990 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7efd14036000 tx=0x7efd1403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:30.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.482+0000 7efd1b400640 1 -- 172.21.15.153:0/1510504217 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7efd1c058c80 con 0x7efd2415e560 2024-03-29T04:29:30.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.678+0000 7efd23e00640 1 -- 172.21.15.153:0/1510504217 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7efd240d0530 con 0x7efd0006b4d0 2024-03-29T04:29:30.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.679+0000 7efd1b400640 1 -- 172.21.15.153:0/1510504217 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efd240d0530 con 0x7efd0006b4d0 2024-03-29T04:29:30.655 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 3 to deep-scrub 2024-03-29T04:29:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.682+0000 7efd23e00640 1 -- 172.21.15.153:0/1510504217 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0006b4d0 msgr2=0x7efd0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.682+0000 7efd23e00640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0006b4d0 0x7efd0006d990 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7efd14036000 tx=0x7efd1403d040 comp rx=0 tx=0).stop 2024-03-29T04:29:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.682+0000 7efd23e00640 1 -- 172.21.15.153:0/1510504217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415e560 msgr2=0x7efd240c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.682+0000 7efd23e00640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415e560 0x7efd240c8a30 secure :-1 s=READY pgs=3401 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00b9e0 tx=0x7efd1c00bea0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.682+0000 7efd23e00640 1 -- 172.21.15.153:0/1510504217 shutdown_connections 2024-03-29T04:29:30.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.682+0000 7efd23e00640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7efd0006b4d0 0x7efd0006d990 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.682+0000 7efd23e00640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2415e560 0x7efd240c8a30 unknown :-1 s=CLOSED pgs=3401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.682+0000 7efd23e00640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2415e180 0x7efd240cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.682+0000 7efd23e00640 1 --2- 172.21.15.153:0/1510504217 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240d4680 0x7efd241f8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.682+0000 7efd23e00640 1 -- 172.21.15.153:0/1510504217 >> 172.21.15.153:0/1510504217 conn(0x7efd2409d1e0 msgr2=0x7efd240cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:30.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.682+0000 7efd23e00640 1 -- 172.21.15.153:0/1510504217 shutdown_connections 2024-03-29T04:29:30.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.682+0000 7efd23e00640 1 -- 172.21.15.153:0/1510504217 wait complete. 2024-03-29T04:29:30.678 INFO:tasks.ceph:Scrubbing osd.4 2024-03-29T04:29:30.681 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:29:30.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.917+0000 7fafd8000640 1 Processor -- start 2024-03-29T04:29:30.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.917+0000 7fafd8000640 1 -- start start 2024-03-29T04:29:30.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.919+0000 7fafd8000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd006b170 0x7fafd006eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.919+0000 7fafd8000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fafd015c540 0x7fafd015c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.919+0000 7fafd8000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd006e1e0 con 0x7fafd006b550 2024-03-29T04:29:30.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.919+0000 7fafd8000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fafd00ced70 con 0x7fafd015c540 2024-03-29T04:29:30.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.919+0000 7fafd8000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fafd00cf050 con 0x7fafd006b170 2024-03-29T04:29:30.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.919+0000 7fafd6000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fafd015c540 0x7fafd015c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.919+0000 7fafd6000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fafd015c540 0x7fafd015c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47468/0 (socket says 172.21.15.153:47468) 2024-03-29T04:29:30.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.919+0000 7fafd6000640 1 -- 172.21.15.153:0/3762101308 learned_addr learned my addr 172.21.15.153:0/3762101308 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:30.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.920+0000 7fafd6000640 1 -- 172.21.15.153:0/3762101308 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd006b170 msgr2=0x7fafd006eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.920+0000 7fafd5600640 1 --2- 172.21.15.153:0/3762101308 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd006b170 0x7fafd006eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.920+0000 7fafd6000640 1 --2- 172.21.15.153:0/3762101308 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd006b170 0x7fafd006eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.920+0000 7fafd6000640 1 -- 172.21.15.153:0/3762101308 >> v1:172.21.15.165:6789/0 conn(0x7fafd006b550 legacy=0x7fafd00ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.920+0000 7fafd6000640 1 -- 172.21.15.153:0/3762101308 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd006e4a0 con 0x7fafd015c540 2024-03-29T04:29:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.921+0000 7fafd6000640 1 --2- 172.21.15.153:0/3762101308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafd015c540 0x7fafd015c990 secure :-1 s=READY pgs=3402 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009870 tx=0x7fafc802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd64c2b1eedbd50 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.921+0000 7fafcfe00640 1 -- 172.21.15.153:0/3762101308 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc8035020 con 0x7fafd015c540 2024-03-29T04:29:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.921+0000 7fafcfe00640 1 -- 172.21.15.153:0/3762101308 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc8031640 con 0x7fafd015c540 2024-03-29T04:29:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.921+0000 7fafcfe00640 1 -- 172.21.15.153:0/3762101308 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc802d040 con 0x7fafd015c540 2024-03-29T04:29:30.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.922+0000 7fafd8000640 1 -- 172.21.15.153:0/3762101308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafd015c540 msgr2=0x7fafd015c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.922+0000 7fafd8000640 1 --2- 172.21.15.153:0/3762101308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafd015c540 0x7fafd015c990 secure :-1 s=READY pgs=3402 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009870 tx=0x7fafc802b8f0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.922+0000 7fafd8000640 1 -- 172.21.15.153:0/3762101308 shutdown_connections 2024-03-29T04:29:30.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.922+0000 7fafd8000640 1 --2- 172.21.15.153:0/3762101308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafd015c540 0x7fafd015c990 unknown :-1 s=CLOSED pgs=3402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.922+0000 7fafd8000640 1 --2- 172.21.15.153:0/3762101308 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd006b170 0x7fafd006eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.922+0000 7fafd8000640 1 -- 172.21.15.153:0/3762101308 >> 172.21.15.153:0/3762101308 conn(0x7fafd00b2be0 msgr2=0x7fafd00b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:30.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.922+0000 7fafd8000640 1 -- 172.21.15.153:0/3762101308 shutdown_connections 2024-03-29T04:29:30.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.922+0000 7fafd8000640 1 -- 172.21.15.153:0/3762101308 wait complete. 2024-03-29T04:29:30.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.924+0000 7fafd8000640 1 Processor -- start 2024-03-29T04:29:30.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.924+0000 7fafd8000640 1 -- start start 2024-03-29T04:29:30.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.925+0000 7fafd8000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd006b170 0x7fafd01f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.925+0000 7fafd8000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafd006b550 0x7fafd015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.925+0000 7fafd8000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafd015c540 0x7fafd015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.925+0000 7fafd8000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fafd006b9b0 con 0x7fafd006b550 2024-03-29T04:29:30.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.925+0000 7fafd8000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fafd00d09b0 con 0x7fafd015c540 2024-03-29T04:29:30.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.925+0000 7fafd8000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fafd00ce9e0 con 0x7fafd006b170 2024-03-29T04:29:30.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.925+0000 7fafd4c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafd006b550 0x7fafd015b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.925+0000 7fafd4c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafd006b550 0x7fafd015b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47480/0 (socket says 172.21.15.153:47480) 2024-03-29T04:29:30.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.925+0000 7fafd4c00640 1 -- 172.21.15.153:0/1395944669 learned_addr learned my addr 172.21.15.153:0/1395944669 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:30.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.926+0000 7fafd5600640 1 --2- 172.21.15.153:0/1395944669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd006b170 0x7fafd01f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.926+0000 7fafd4c00640 1 -- 172.21.15.153:0/1395944669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd006b170 msgr2=0x7fafd01f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.926+0000 7fafd4c00640 1 --2- 172.21.15.153:0/1395944669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd006b170 0x7fafd01f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.926+0000 7fafd4c00640 1 -- 172.21.15.153:0/1395944669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafd015c540 msgr2=0x7fafd015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.926+0000 7fafd6000640 1 --2- 172.21.15.153:0/1395944669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafd015c540 0x7fafd015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.926+0000 7fafd4c00640 1 --2- 172.21.15.153:0/1395944669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafd015c540 0x7fafd015d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.926+0000 7fafd4c00640 1 -- 172.21.15.153:0/1395944669 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd015bc10 con 0x7fafd006b550 2024-03-29T04:29:30.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.926+0000 7fafd4c00640 1 --2- 172.21.15.153:0/1395944669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafd006b550 0x7fafd015b6d0 secure :-1 s=READY pgs=3403 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00c430 tx=0x7fafbc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:30.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.926+0000 7fafcd600640 1 -- 172.21.15.153:0/1395944669 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafbc011790 con 0x7fafd006b550 2024-03-29T04:29:30.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.927+0000 7fafcd600640 1 -- 172.21.15.153:0/1395944669 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafbc017070 con 0x7fafd006b550 2024-03-29T04:29:30.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.927+0000 7fafcd600640 1 -- 172.21.15.153:0/1395944669 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafbc011bb0 con 0x7fafd006b550 2024-03-29T04:29:30.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.927+0000 7fafd8000640 1 -- 172.21.15.153:0/1395944669 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd01e5a80 con 0x7fafd006b550 2024-03-29T04:29:30.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.927+0000 7fafd8000640 1 -- 172.21.15.153:0/1395944669 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd013b830 con 0x7fafd006b550 2024-03-29T04:29:30.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.928+0000 7fafd8000640 1 -- 172.21.15.153:0/1395944669 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fafd013b640 con 0x7fafd006b550 2024-03-29T04:29:30.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.929+0000 7fafcd600640 1 -- 172.21.15.153:0/1395944669 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fafbc01c460 con 0x7fafd006b550 2024-03-29T04:29:30.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.930+0000 7fafcd600640 1 --2- 172.21.15.153:0/1395944669 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fafb006b4d0 0x7fafb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.930+0000 7fafcd600640 1 -- 172.21.15.153:0/1395944669 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fafbc089d10 con 0x7fafd006b550 2024-03-29T04:29:30.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.930+0000 7fafcd600640 1 --2- 172.21.15.153:0/1395944669 >> [v2:172.21.15.165:6808/2527321544,v1:172.21.15.165:6809/2527321544] conn(0x7fafb0071390 0x7fafb00737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:30.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.930+0000 7fafd5600640 1 --2- 172.21.15.153:0/1395944669 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fafb006b4d0 0x7fafb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.930+0000 7fafcd600640 1 -- 172.21.15.153:0/1395944669 --> [v2:172.21.15.165:6808/2527321544,v1:172.21.15.165:6809/2527321544] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafbc00bf30 con 0x7fafb0071390 2024-03-29T04:29:30.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.930+0000 7fafcd600640 1 -- 172.21.15.153:0/1395944669 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fafbc08c3b0 con 0x7fafd006b550 2024-03-29T04:29:30.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.931+0000 7fafd5600640 1 --2- 172.21.15.153:0/1395944669 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fafb006b4d0 0x7fafb006d990 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fafc40070b0 tx=0x7fafc4007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:30.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.931+0000 7fafd6000640 1 --2- 172.21.15.153:0/1395944669 >> [v2:172.21.15.165:6808/2527321544,v1:172.21.15.165:6809/2527321544] conn(0x7fafb0071390 0x7fafb00737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:30.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.931+0000 7fafd6000640 1 --2- 172.21.15.153:0/1395944669 >> [v2:172.21.15.165:6808/2527321544,v1:172.21.15.165:6809/2527321544] conn(0x7fafb0071390 0x7fafb00737b0 crc :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:30.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.934+0000 7fafcd600640 1 -- 172.21.15.153:0/1395944669 <== osd.4 v2:172.21.15.165:6808/2527321544 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fafbc00bf30 con 0x7fafb0071390 2024-03-29T04:29:30.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.948+0000 7fafd8000640 1 -- 172.21.15.153:0/1395944669 --> [v2:172.21.15.165:6808/2527321544,v1:172.21.15.165:6809/2527321544] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fafd00690d0 con 0x7fafb0071390 2024-03-29T04:29:30.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.949+0000 7fafcd600640 1 -- 172.21.15.153:0/1395944669 <== osd.4 v2:172.21.15.165:6808/2527321544 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fafd00690d0 con 0x7fafb0071390 2024-03-29T04:29:30.925 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-29T04:29:30.925 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:29:30.925 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-29T04:29:30.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.950+0000 7fafd8000640 1 -- 172.21.15.153:0/1395944669 >> [v2:172.21.15.165:6808/2527321544,v1:172.21.15.165:6809/2527321544] conn(0x7fafb0071390 msgr2=0x7fafb00737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.950+0000 7fafd8000640 1 --2- 172.21.15.153:0/1395944669 >> [v2:172.21.15.165:6808/2527321544,v1:172.21.15.165:6809/2527321544] conn(0x7fafb0071390 0x7fafb00737b0 crc :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.950+0000 7fafd8000640 1 -- 172.21.15.153:0/1395944669 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fafb006b4d0 msgr2=0x7fafb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.950+0000 7fafd8000640 1 --2- 172.21.15.153:0/1395944669 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fafb006b4d0 0x7fafb006d990 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fafc40070b0 tx=0x7fafc4007040 comp rx=0 tx=0).stop 2024-03-29T04:29:30.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.950+0000 7fafd8000640 1 -- 172.21.15.153:0/1395944669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafd006b550 msgr2=0x7fafd015b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:30.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.950+0000 7fafd8000640 1 --2- 172.21.15.153:0/1395944669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafd006b550 0x7fafd015b6d0 secure :-1 s=READY pgs=3403 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00c430 tx=0x7fafbc00c8f0 comp rx=0 tx=0).stop 2024-03-29T04:29:30.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.950+0000 7fafd6000640 1 -- 172.21.15.153:0/1395944669 reap_dead start 2024-03-29T04:29:30.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.950+0000 7fafd8000640 1 -- 172.21.15.153:0/1395944669 shutdown_connections 2024-03-29T04:29:30.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.950+0000 7fafd8000640 1 -- 172.21.15.153:0/1395944669 >> 172.21.15.153:0/1395944669 conn(0x7fafd00b2be0 msgr2=0x7fafd0142cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:30.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.950+0000 7fafd8000640 1 -- 172.21.15.153:0/1395944669 shutdown_connections 2024-03-29T04:29:30.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:30.950+0000 7fafd8000640 1 -- 172.21.15.153:0/1395944669 wait complete. 2024-03-29T04:29:30.944 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-29T04:29:31.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.182+0000 7fa4a2e00640 1 Processor -- start 2024-03-29T04:29:31.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.182+0000 7fa4a2e00640 1 -- start start 2024-03-29T04:29:31.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.184+0000 7fa4a2e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa49c070d70 0x7fa49c071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.184+0000 7fa4a2e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa49c0b3a70 0x7fa49c0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.184+0000 7fa4a2e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa49c06db60 con 0x7fa49c06ede0 2024-03-29T04:29:31.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.184+0000 7fa4a2e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fa49c0b35e0 con 0x7fa49c0b3a70 2024-03-29T04:29:31.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.184+0000 7fa4a2e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa49c06de40 con 0x7fa49c070d70 2024-03-29T04:29:31.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.184+0000 7fa4a0e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa49c0b3a70 0x7fa49c0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.185+0000 7fa4a0e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa49c0b3a70 0x7fa49c0b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47488/0 (socket says 172.21.15.153:47488) 2024-03-29T04:29:31.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.185+0000 7fa4a0e00640 1 -- 172.21.15.153:0/2346891652 learned_addr learned my addr 172.21.15.153:0/2346891652 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:31.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.185+0000 7fa49be00640 1 --2- 172.21.15.153:0/2346891652 >> v2:172.21.15.165:3300/0 conn(0x7fa49c070d70 0x7fa49c071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.185+0000 7fa4a0e00640 1 -- 172.21.15.153:0/2346891652 >> v2:172.21.15.165:3300/0 conn(0x7fa49c070d70 msgr2=0x7fa49c071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:31.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.185+0000 7fa4a0e00640 1 --2- 172.21.15.153:0/2346891652 >> v2:172.21.15.165:3300/0 conn(0x7fa49c070d70 0x7fa49c071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.185+0000 7fa4a0e00640 1 -- 172.21.15.153:0/2346891652 >> v1:172.21.15.165:6789/0 conn(0x7fa49c06ede0 legacy=0x7fa49c071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:31.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.185+0000 7fa4a0e00640 1 -- 172.21.15.153:0/2346891652 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c06e120 con 0x7fa49c0b3a70 2024-03-29T04:29:31.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.186+0000 7fa4a0e00640 1 --2- 172.21.15.153:0/2346891652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c0b3a70 0x7fa49c0b3f20 secure :-1 s=READY pgs=3404 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0d0880 tx=0x7fa49402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb46aed74e12e78 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:31.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.186+0000 7fa49b400640 1 -- 172.21.15.153:0/2346891652 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49402ca80 con 0x7fa49c0b3a70 2024-03-29T04:29:31.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.186+0000 7fa49b400640 1 -- 172.21.15.153:0/2346891652 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49402cc20 con 0x7fa49c0b3a70 2024-03-29T04:29:31.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.186+0000 7fa49b400640 1 -- 172.21.15.153:0/2346891652 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4940343f0 con 0x7fa49c0b3a70 2024-03-29T04:29:31.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.187+0000 7fa4a2e00640 1 -- 172.21.15.153:0/2346891652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c0b3a70 msgr2=0x7fa49c0b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.187+0000 7fa4a2e00640 1 --2- 172.21.15.153:0/2346891652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c0b3a70 0x7fa49c0b3f20 secure :-1 s=READY pgs=3404 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0d0880 tx=0x7fa49402bee0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.187+0000 7fa4a2e00640 1 -- 172.21.15.153:0/2346891652 shutdown_connections 2024-03-29T04:29:31.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.187+0000 7fa4a2e00640 1 --2- 172.21.15.153:0/2346891652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c0b3a70 0x7fa49c0b3f20 unknown :-1 s=CLOSED pgs=3404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.187+0000 7fa4a2e00640 1 --2- 172.21.15.153:0/2346891652 >> v2:172.21.15.165:3300/0 conn(0x7fa49c070d70 0x7fa49c071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.187+0000 7fa4a2e00640 1 -- 172.21.15.153:0/2346891652 >> 172.21.15.153:0/2346891652 conn(0x7fa49c0cfc00 msgr2=0x7fa49c0cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:31.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.187+0000 7fa4a2e00640 1 -- 172.21.15.153:0/2346891652 shutdown_connections 2024-03-29T04:29:31.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.187+0000 7fa4a2e00640 1 -- 172.21.15.153:0/2346891652 wait complete. 2024-03-29T04:29:31.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.189+0000 7fa4a2e00640 1 Processor -- start 2024-03-29T04:29:31.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.189+0000 7fa4a2e00640 1 -- start start 2024-03-29T04:29:31.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.190+0000 7fa4a2e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c06ede0 0x7fa49c1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.190+0000 7fa4a2e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa49c070d70 0x7fa49c1e8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.190+0000 7fa4a2e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa49c0b3a70 0x7fa49c1e9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.190+0000 7fa4a2e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c15e5b0 con 0x7fa49c06ede0 2024-03-29T04:29:31.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.190+0000 7fa4a2e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c15e430 con 0x7fa49c0b3a70 2024-03-29T04:29:31.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.190+0000 7fa4a2e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c0b4460 con 0x7fa49c070d70 2024-03-29T04:29:31.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.191+0000 7fa49be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c06ede0 0x7fa49c1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.191+0000 7fa49be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c06ede0 0x7fa49c1508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47494/0 (socket says 172.21.15.153:47494) 2024-03-29T04:29:31.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.191+0000 7fa49be00640 1 -- 172.21.15.153:0/3466145238 learned_addr learned my addr 172.21.15.153:0/3466145238 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:31.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.191+0000 7fa49be00640 1 -- 172.21.15.153:0/3466145238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa49c070d70 msgr2=0x7fa49c1e8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.191+0000 7fa49be00640 1 --2- 172.21.15.153:0/3466145238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa49c070d70 0x7fa49c1e8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.191+0000 7fa49be00640 1 -- 172.21.15.153:0/3466145238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa49c0b3a70 msgr2=0x7fa49c1e9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.191+0000 7fa49be00640 1 --2- 172.21.15.153:0/3466145238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa49c0b3a70 0x7fa49c1e9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.191+0000 7fa49be00640 1 -- 172.21.15.153:0/3466145238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c15fb30 con 0x7fa49c06ede0 2024-03-29T04:29:31.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.191+0000 7fa49be00640 1 --2- 172.21.15.153:0/3466145238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c06ede0 0x7fa49c1508e0 secure :-1 s=READY pgs=3405 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00d800 tx=0x7fa48c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:31.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.191+0000 7fa498c00640 1 -- 172.21.15.153:0/3466145238 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c00b6c0 con 0x7fa49c06ede0 2024-03-29T04:29:31.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.192+0000 7fa498c00640 1 -- 172.21.15.153:0/3466145238 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c019070 con 0x7fa49c06ede0 2024-03-29T04:29:31.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.192+0000 7fa4a2e00640 1 -- 172.21.15.153:0/3466145238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49c15fdd0 con 0x7fa49c06ede0 2024-03-29T04:29:31.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.192+0000 7fa498c00640 1 -- 172.21.15.153:0/3466145238 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c00ba80 con 0x7fa49c06ede0 2024-03-29T04:29:31.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.192+0000 7fa4a2e00640 1 -- 172.21.15.153:0/3466145238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49c151360 con 0x7fa49c06ede0 2024-03-29T04:29:31.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.193+0000 7fa4a2e00640 1 -- 172.21.15.153:0/3466145238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49c068ff0 con 0x7fa49c06ede0 2024-03-29T04:29:31.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.194+0000 7fa498c00640 1 -- 172.21.15.153:0/3466145238 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa48c00bc20 con 0x7fa49c06ede0 2024-03-29T04:29:31.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.194+0000 7fa498c00640 1 --2- 172.21.15.153:0/3466145238 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa47806b500 0x7fa47806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.195+0000 7fa498c00640 1 -- 172.21.15.153:0/3466145238 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fa48c08a3c0 con 0x7fa49c06ede0 2024-03-29T04:29:31.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.195+0000 7fa493400640 1 --2- 172.21.15.153:0/3466145238 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa47806b500 0x7fa47806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.196+0000 7fa493400640 1 --2- 172.21.15.153:0/3466145238 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa47806b500 0x7fa47806d9c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa49c152660 tx=0x7fa4840079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:31.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.199+0000 7fa498c00640 1 -- 172.21.15.153:0/3466145238 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa48c059530 con 0x7fa49c06ede0 2024-03-29T04:29:31.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.398+0000 7fa4a2e00640 1 -- 172.21.15.153:0/3466145238 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fa49c0b2eb0 con 0x7fa47806b500 2024-03-29T04:29:31.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.399+0000 7fa498c00640 1 -- 172.21.15.153:0/3466145238 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa49c0b2eb0 con 0x7fa47806b500 2024-03-29T04:29:31.374 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 4 to deep-scrub 2024-03-29T04:29:31.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.401+0000 7fa4a2e00640 1 -- 172.21.15.153:0/3466145238 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa47806b500 msgr2=0x7fa47806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.401+0000 7fa4a2e00640 1 --2- 172.21.15.153:0/3466145238 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa47806b500 0x7fa47806d9c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa49c152660 tx=0x7fa4840079b0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.401+0000 7fa4a2e00640 1 -- 172.21.15.153:0/3466145238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c06ede0 msgr2=0x7fa49c1508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.401+0000 7fa4a2e00640 1 --2- 172.21.15.153:0/3466145238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c06ede0 0x7fa49c1508e0 secure :-1 s=READY pgs=3405 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00d800 tx=0x7fa48c00dcc0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.402+0000 7fa4a2e00640 1 -- 172.21.15.153:0/3466145238 shutdown_connections 2024-03-29T04:29:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.402+0000 7fa4a2e00640 1 --2- 172.21.15.153:0/3466145238 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fa47806b500 0x7fa47806d9c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.402+0000 7fa4a2e00640 1 --2- 172.21.15.153:0/3466145238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa49c0b3a70 0x7fa49c1e9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.402+0000 7fa4a2e00640 1 --2- 172.21.15.153:0/3466145238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa49c070d70 0x7fa49c1e8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.402+0000 7fa4a2e00640 1 --2- 172.21.15.153:0/3466145238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49c06ede0 0x7fa49c1508e0 unknown :-1 s=CLOSED pgs=3405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.402+0000 7fa4a2e00640 1 -- 172.21.15.153:0/3466145238 >> 172.21.15.153:0/3466145238 conn(0x7fa49c0cfc00 msgr2=0x7fa49c0afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:31.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.402+0000 7fa4a2e00640 1 -- 172.21.15.153:0/3466145238 shutdown_connections 2024-03-29T04:29:31.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.402+0000 7fa4a2e00640 1 -- 172.21.15.153:0/3466145238 wait complete. 2024-03-29T04:29:31.397 INFO:tasks.ceph:Scrubbing osd.5 2024-03-29T04:29:31.397 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:29:31.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.636+0000 7f37a9000640 1 Processor -- start 2024-03-29T04:29:31.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.636+0000 7f37a9000640 1 -- start start 2024-03-29T04:29:31.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.638+0000 7f37a9000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f37a4147930 0x7f37a40aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.638+0000 7f37a9000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37a40b4ae0 0x7f37a4072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.638+0000 7f37a9000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37a40b3040 con 0x7f37a40ae590 2024-03-29T04:29:31.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.638+0000 7f37a9000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f37a40b2df0 con 0x7f37a40b4ae0 2024-03-29T04:29:31.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.638+0000 7f37a9000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f37a40b3320 con 0x7f37a4147930 2024-03-29T04:29:31.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.638+0000 7f37a2800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37a40b4ae0 0x7f37a4072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.638+0000 7f37a2800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37a40b4ae0 0x7f37a4072260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47508/0 (socket says 172.21.15.153:47508) 2024-03-29T04:29:31.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.638+0000 7f37a1400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f37a40ae590 0x7f37a40b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:39056/0 (socket says 172.21.15.153:39056) 2024-03-29T04:29:31.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.638+0000 7f37a2800640 1 -- 172.21.15.153:0/3962124633 learned_addr learned my addr 172.21.15.153:0/3962124633 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:31.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.639+0000 7f37a1e00640 1 --2- 172.21.15.153:0/3962124633 >> v2:172.21.15.165:3300/0 conn(0x7f37a4147930 0x7f37a40aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.639+0000 7f37a2800640 1 -- 172.21.15.153:0/3962124633 >> v2:172.21.15.165:3300/0 conn(0x7f37a4147930 msgr2=0x7f37a40aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:31.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.639+0000 7f37a2800640 1 --2- 172.21.15.153:0/3962124633 >> v2:172.21.15.165:3300/0 conn(0x7f37a4147930 0x7f37a40aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.639+0000 7f37a2800640 1 -- 172.21.15.153:0/3962124633 >> v1:172.21.15.153:6789/0 conn(0x7f37a40ae590 legacy=0x7f37a40b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.639+0000 7f37a2800640 1 -- 172.21.15.153:0/3962124633 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a40b3600 con 0x7f37a40b4ae0 2024-03-29T04:29:31.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.640+0000 7f37a2800640 1 --2- 172.21.15.153:0/3962124633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a40b4ae0 0x7f37a4072260 secure :-1 s=READY pgs=3407 cs=0 l=1 rev1=1 crypto rx=0x7f37a406f1c0 tx=0x7f379c02b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d01e1ead926ee56 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:31.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.640+0000 7f37a0a00640 1 -- 172.21.15.153:0/3962124633 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c034070 con 0x7f37a40b4ae0 2024-03-29T04:29:31.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.640+0000 7f37a0a00640 1 -- 172.21.15.153:0/3962124633 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f379c030870 con 0x7f37a40b4ae0 2024-03-29T04:29:31.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.640+0000 7f37a0a00640 1 -- 172.21.15.153:0/3962124633 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c030c40 con 0x7f37a40b4ae0 2024-03-29T04:29:31.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.641+0000 7f37a9000640 1 -- 172.21.15.153:0/3962124633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a40b4ae0 msgr2=0x7f37a4072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.641+0000 7f37a9000640 1 --2- 172.21.15.153:0/3962124633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a40b4ae0 0x7f37a4072260 secure :-1 s=READY pgs=3407 cs=0 l=1 rev1=1 crypto rx=0x7f37a406f1c0 tx=0x7f379c02b9b0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.641+0000 7f37a9000640 1 -- 172.21.15.153:0/3962124633 shutdown_connections 2024-03-29T04:29:31.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.641+0000 7f37a9000640 1 --2- 172.21.15.153:0/3962124633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a40b4ae0 0x7f37a4072260 unknown :-1 s=CLOSED pgs=3407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.641+0000 7f37a9000640 1 --2- 172.21.15.153:0/3962124633 >> v2:172.21.15.165:3300/0 conn(0x7f37a4147930 0x7f37a40aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.641+0000 7f37a9000640 1 -- 172.21.15.153:0/3962124633 >> 172.21.15.153:0/3962124633 conn(0x7f37a406b170 msgr2=0x7f37a406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:31.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.641+0000 7f37a9000640 1 -- 172.21.15.153:0/3962124633 shutdown_connections 2024-03-29T04:29:31.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.641+0000 7f37a9000640 1 -- 172.21.15.153:0/3962124633 wait complete. 2024-03-29T04:29:31.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.643+0000 7f37a9000640 1 Processor -- start 2024-03-29T04:29:31.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.643+0000 7f37a9000640 1 -- start start 2024-03-29T04:29:31.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.644+0000 7f37a9000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37a40ae590 0x7f37a4144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.644+0000 7f37a9000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a40b4ae0 0x7f37a41623f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.644+0000 7f37a9000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37a4147930 0x7f37a415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.644+0000 7f37a9000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37a4147d10 con 0x7f37a40b4ae0 2024-03-29T04:29:31.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.644+0000 7f37a9000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f37a40b3bc0 con 0x7f37a4147930 2024-03-29T04:29:31.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.644+0000 7f37a9000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f37a40af0d0 con 0x7f37a40ae590 2024-03-29T04:29:31.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.644+0000 7f37a1400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a40b4ae0 0x7f37a41623f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.644+0000 7f37a1400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a40b4ae0 0x7f37a41623f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47518/0 (socket says 172.21.15.153:47518) 2024-03-29T04:29:31.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.644+0000 7f37a1400640 1 -- 172.21.15.153:0/1175475695 learned_addr learned my addr 172.21.15.153:0/1175475695 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:31.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.644+0000 7f37a1400640 1 -- 172.21.15.153:0/1175475695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37a40ae590 msgr2=0x7f37a4144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.644+0000 7f37a1400640 1 --2- 172.21.15.153:0/1175475695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37a40ae590 0x7f37a4144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.644+0000 7f37a1400640 1 -- 172.21.15.153:0/1175475695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37a4147930 msgr2=0x7f37a415b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.644+0000 7f37a1400640 1 --2- 172.21.15.153:0/1175475695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37a4147930 0x7f37a415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.644+0000 7f37a1400640 1 -- 172.21.15.153:0/1175475695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a41f7110 con 0x7f37a40b4ae0 2024-03-29T04:29:31.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.645+0000 7f37a1400640 1 --2- 172.21.15.153:0/1175475695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a40b4ae0 0x7f37a41623f0 secure :-1 s=READY pgs=3408 cs=0 l=1 rev1=1 crypto rx=0x7f379400c790 tx=0x7f379400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:31.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.645+0000 7f379a000640 1 -- 172.21.15.153:0/1175475695 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3794017070 con 0x7f37a40b4ae0 2024-03-29T04:29:31.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.645+0000 7f379a000640 1 -- 172.21.15.153:0/1175475695 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f379400a640 con 0x7f37a40b4ae0 2024-03-29T04:29:31.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.645+0000 7f379a000640 1 -- 172.21.15.153:0/1175475695 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379400a9f0 con 0x7f37a40b4ae0 2024-03-29T04:29:31.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.645+0000 7f37a9000640 1 -- 172.21.15.153:0/1175475695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a4144be0 con 0x7f37a40b4ae0 2024-03-29T04:29:31.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.645+0000 7f37a9000640 1 -- 172.21.15.153:0/1175475695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a41f7690 con 0x7f37a40b4ae0 2024-03-29T04:29:31.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.646+0000 7f37a9000640 1 -- 172.21.15.153:0/1175475695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37a4144990 con 0x7f37a40b4ae0 2024-03-29T04:29:31.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.647+0000 7f379a000640 1 -- 172.21.15.153:0/1175475695 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f379401a070 con 0x7f37a40b4ae0 2024-03-29T04:29:31.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.648+0000 7f379a000640 1 --2- 172.21.15.153:0/1175475695 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f378006b4d0 0x7f378006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.648+0000 7f379a000640 1 -- 172.21.15.153:0/1175475695 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f3794089460 con 0x7f37a40b4ae0 2024-03-29T04:29:31.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.648+0000 7f37a1e00640 1 --2- 172.21.15.153:0/1175475695 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f378006b4d0 0x7f378006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.648+0000 7f379a000640 1 --2- 172.21.15.153:0/1175475695 >> [v2:172.21.15.165:6820/3492880445,v1:172.21.15.165:6822/3492880445] conn(0x7f3780071390 0x7f37800737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.648+0000 7f379a000640 1 -- 172.21.15.153:0/1175475695 --> [v2:172.21.15.165:6820/3492880445,v1:172.21.15.165:6822/3492880445] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3780073e60 con 0x7f3780071390 2024-03-29T04:29:31.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.648+0000 7f379a000640 1 -- 172.21.15.153:0/1175475695 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3794090050 con 0x7f37a40b4ae0 2024-03-29T04:29:31.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.649+0000 7f37a2800640 1 --2- 172.21.15.153:0/1175475695 >> [v2:172.21.15.165:6820/3492880445,v1:172.21.15.165:6822/3492880445] conn(0x7f3780071390 0x7f37800737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.649+0000 7f37a1e00640 1 --2- 172.21.15.153:0/1175475695 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f378006b4d0 0x7f378006d990 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f378c006fd0 tx=0x7f378c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:31.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.650+0000 7f37a2800640 1 --2- 172.21.15.153:0/1175475695 >> [v2:172.21.15.165:6820/3492880445,v1:172.21.15.165:6822/3492880445] conn(0x7f3780071390 0x7f37800737b0 crc :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:31.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.652+0000 7f379a000640 1 -- 172.21.15.153:0/1175475695 <== osd.5 v2:172.21.15.165:6820/3492880445 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3780073e60 con 0x7f3780071390 2024-03-29T04:29:31.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.667+0000 7f37a9000640 1 -- 172.21.15.153:0/1175475695 --> [v2:172.21.15.165:6820/3492880445,v1:172.21.15.165:6822/3492880445] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f37a41f7b90 con 0x7f3780071390 2024-03-29T04:29:31.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.668+0000 7f379a000640 1 -- 172.21.15.153:0/1175475695 <== osd.5 v2:172.21.15.165:6820/3492880445 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f379c004040 con 0x7f3780071390 2024-03-29T04:29:31.643 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-29T04:29:31.644 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:29:31.644 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-29T04:29:31.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.668+0000 7f37a9000640 1 -- 172.21.15.153:0/1175475695 >> [v2:172.21.15.165:6820/3492880445,v1:172.21.15.165:6822/3492880445] conn(0x7f3780071390 msgr2=0x7f37800737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.668+0000 7f37a9000640 1 --2- 172.21.15.153:0/1175475695 >> [v2:172.21.15.165:6820/3492880445,v1:172.21.15.165:6822/3492880445] conn(0x7f3780071390 0x7f37800737b0 crc :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.669+0000 7f37a9000640 1 -- 172.21.15.153:0/1175475695 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f378006b4d0 msgr2=0x7f378006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.669+0000 7f37a9000640 1 --2- 172.21.15.153:0/1175475695 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f378006b4d0 0x7f378006d990 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f378c006fd0 tx=0x7f378c008040 comp rx=0 tx=0).stop 2024-03-29T04:29:31.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.669+0000 7f37a9000640 1 -- 172.21.15.153:0/1175475695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a40b4ae0 msgr2=0x7f37a41623f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.669+0000 7f37a9000640 1 --2- 172.21.15.153:0/1175475695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a40b4ae0 0x7f37a41623f0 secure :-1 s=READY pgs=3408 cs=0 l=1 rev1=1 crypto rx=0x7f379400c790 tx=0x7f379400cc50 comp rx=0 tx=0).stop 2024-03-29T04:29:31.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.669+0000 7f37a2800640 1 -- 172.21.15.153:0/1175475695 reap_dead start 2024-03-29T04:29:31.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.669+0000 7f37a9000640 1 -- 172.21.15.153:0/1175475695 shutdown_connections 2024-03-29T04:29:31.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.669+0000 7f37a9000640 1 -- 172.21.15.153:0/1175475695 >> 172.21.15.153:0/1175475695 conn(0x7f37a406b170 msgr2=0x7f37a4072d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:31.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.669+0000 7f37a9000640 1 -- 172.21.15.153:0/1175475695 shutdown_connections 2024-03-29T04:29:31.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.669+0000 7f37a9000640 1 -- 172.21.15.153:0/1175475695 wait complete. 2024-03-29T04:29:31.663 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-29T04:29:31.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.897+0000 7fe787e00640 1 Processor -- start 2024-03-29T04:29:31.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.898+0000 7fe787e00640 1 -- start start 2024-03-29T04:29:31.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.899+0000 7fe787e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe780161990 0x7fe7800d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.899+0000 7fe787e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe7800d2ad0 0x7fe7800cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.899+0000 7fe787e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7800ceca0 con 0x7fe7800b3a60 2024-03-29T04:29:31.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.899+0000 7fe787e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fe7800d1a20 con 0x7fe780161990 2024-03-29T04:29:31.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.899+0000 7fe787e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe7800d4810 con 0x7fe7800d2ad0 2024-03-29T04:29:31.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.900+0000 7fe785400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe780161990 0x7fe7800d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.900+0000 7fe785400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe780161990 0x7fe7800d14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47530/0 (socket says 172.21.15.153:47530) 2024-03-29T04:29:31.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.900+0000 7fe785400640 1 -- 172.21.15.153:0/2698267355 learned_addr learned my addr 172.21.15.153:0/2698267355 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:31.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.900+0000 7fe785e00640 1 --2- 172.21.15.153:0/2698267355 >> v2:172.21.15.165:3300/0 conn(0x7fe7800d2ad0 0x7fe7800cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.900+0000 7fe785400640 1 -- 172.21.15.153:0/2698267355 >> v2:172.21.15.165:3300/0 conn(0x7fe7800d2ad0 msgr2=0x7fe7800cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:31.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.900+0000 7fe785400640 1 --2- 172.21.15.153:0/2698267355 >> v2:172.21.15.165:3300/0 conn(0x7fe7800d2ad0 0x7fe7800cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.900+0000 7fe785400640 1 -- 172.21.15.153:0/2698267355 >> v1:172.21.15.153:6789/0 conn(0x7fe7800b3a60 legacy=0x7fe7800d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.900+0000 7fe785400640 1 -- 172.21.15.153:0/2698267355 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7800d4af0 con 0x7fe780161990 2024-03-29T04:29:31.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.900+0000 7fe785e00640 1 --2- 172.21.15.153:0/2698267355 >> v2:172.21.15.165:3300/0 conn(0x7fe7800d2ad0 0x7fe7800cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:31.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.901+0000 7fe785400640 1 --2- 172.21.15.153:0/2698267355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe780161990 0x7fe7800d14e0 secure :-1 s=READY pgs=3410 cs=0 l=1 rev1=1 crypto rx=0x7fe78008e0c0 tx=0x7fe77402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ea2b13bdbe1727 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:31.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.901+0000 7fe77fe00640 1 -- 172.21.15.153:0/2698267355 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774034070 con 0x7fe780161990 2024-03-29T04:29:31.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.901+0000 7fe77fe00640 1 -- 172.21.15.153:0/2698267355 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe774030860 con 0x7fe780161990 2024-03-29T04:29:31.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.901+0000 7fe77fe00640 1 -- 172.21.15.153:0/2698267355 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774030c30 con 0x7fe780161990 2024-03-29T04:29:31.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.902+0000 7fe787e00640 1 -- 172.21.15.153:0/2698267355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe780161990 msgr2=0x7fe7800d14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.902+0000 7fe787e00640 1 --2- 172.21.15.153:0/2698267355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe780161990 0x7fe7800d14e0 secure :-1 s=READY pgs=3410 cs=0 l=1 rev1=1 crypto rx=0x7fe78008e0c0 tx=0x7fe77402b9a0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.902+0000 7fe787e00640 1 -- 172.21.15.153:0/2698267355 shutdown_connections 2024-03-29T04:29:31.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.902+0000 7fe787e00640 1 --2- 172.21.15.153:0/2698267355 >> v2:172.21.15.165:3300/0 conn(0x7fe7800d2ad0 0x7fe7800cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.902+0000 7fe787e00640 1 --2- 172.21.15.153:0/2698267355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe780161990 0x7fe7800d14e0 unknown :-1 s=CLOSED pgs=3410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.902+0000 7fe787e00640 1 -- 172.21.15.153:0/2698267355 >> 172.21.15.153:0/2698267355 conn(0x7fe78009d430 msgr2=0x7fe7800d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:31.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.902+0000 7fe787e00640 1 -- 172.21.15.153:0/2698267355 shutdown_connections 2024-03-29T04:29:31.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.902+0000 7fe787e00640 1 -- 172.21.15.153:0/2698267355 wait complete. 2024-03-29T04:29:31.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.904+0000 7fe787e00640 1 Processor -- start 2024-03-29T04:29:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.904+0000 7fe787e00640 1 -- start start 2024-03-29T04:29:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.905+0000 7fe787e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7800b3a60 0x7fe7800cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.905+0000 7fe787e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7800d2ad0 0x7fe7801f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.905+0000 7fe787e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe780161990 0x7fe7800b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.905+0000 7fe787e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe7800cf200 con 0x7fe7800b3a60 2024-03-29T04:29:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.905+0000 7fe787e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe7800cef20 con 0x7fe7800d2ad0 2024-03-29T04:29:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.905+0000 7fe787e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe7800b3ec0 con 0x7fe780161990 2024-03-29T04:29:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.905+0000 7fe785400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7800b3a60 0x7fe7800cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.905+0000 7fe785400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7800b3a60 0x7fe7800cbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47540/0 (socket says 172.21.15.153:47540) 2024-03-29T04:29:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.905+0000 7fe785400640 1 -- 172.21.15.153:0/981950676 learned_addr learned my addr 172.21.15.153:0/981950676 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.906+0000 7fe785e00640 1 --2- 172.21.15.153:0/981950676 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe780161990 0x7fe7800b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.906+0000 7fe784a00640 1 --2- 172.21.15.153:0/981950676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7800d2ad0 0x7fe7801f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.906+0000 7fe785400640 1 -- 172.21.15.153:0/981950676 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe780161990 msgr2=0x7fe7800b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.906+0000 7fe785400640 1 --2- 172.21.15.153:0/981950676 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe780161990 0x7fe7800b5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.906+0000 7fe785400640 1 -- 172.21.15.153:0/981950676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7800d2ad0 msgr2=0x7fe7801f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.906+0000 7fe785400640 1 --2- 172.21.15.153:0/981950676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7800d2ad0 0x7fe7801f42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.906+0000 7fe785400640 1 -- 172.21.15.153:0/981950676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7800cdbf0 con 0x7fe7800b3a60 2024-03-29T04:29:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.906+0000 7fe785400640 1 --2- 172.21.15.153:0/981950676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7800b3a60 0x7fe7800cbbe0 secure :-1 s=READY pgs=3411 cs=0 l=1 rev1=1 crypto rx=0x7fe77402b9e0 tx=0x7fe7740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.907+0000 7fe77d600640 1 -- 172.21.15.153:0/981950676 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774034040 con 0x7fe7800b3a60 2024-03-29T04:29:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.907+0000 7fe77d600640 1 -- 172.21.15.153:0/981950676 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7740433f0 con 0x7fe7800b3a60 2024-03-29T04:29:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.907+0000 7fe787e00640 1 -- 172.21.15.153:0/981950676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7800ccfa0 con 0x7fe7800b3a60 2024-03-29T04:29:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.907+0000 7fe77d600640 1 -- 172.21.15.153:0/981950676 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7740437e0 con 0x7fe7800b3a60 2024-03-29T04:29:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.907+0000 7fe787e00640 1 -- 172.21.15.153:0/981950676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7800cc120 con 0x7fe7800b3a60 2024-03-29T04:29:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.908+0000 7fe787e00640 1 -- 172.21.15.153:0/981950676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7800caf20 con 0x7fe7800b3a60 2024-03-29T04:29:31.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.909+0000 7fe77d600640 1 -- 172.21.15.153:0/981950676 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe77404a060 con 0x7fe7800b3a60 2024-03-29T04:29:31.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.910+0000 7fe77d600640 1 --2- 172.21.15.153:0/981950676 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe76006b4d0 0x7fe76006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:31.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.910+0000 7fe77d600640 1 -- 172.21.15.153:0/981950676 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fe7740ac0b0 con 0x7fe7800b3a60 2024-03-29T04:29:31.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.910+0000 7fe784a00640 1 --2- 172.21.15.153:0/981950676 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe76006b4d0 0x7fe76006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:31.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.910+0000 7fe784a00640 1 --2- 172.21.15.153:0/981950676 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe76006b4d0 0x7fe76006d990 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe76c007fd0 tx=0x7fe76c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:31.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:31.914+0000 7fe77d600640 1 -- 172.21.15.153:0/981950676 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe7800caf20 con 0x7fe7800b3a60 2024-03-29T04:29:32.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.112+0000 7fe787e00640 1 -- 172.21.15.153:0/981950676 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fe780068ff0 con 0x7fe76006b4d0 2024-03-29T04:29:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.113+0000 7fe77d600640 1 -- 172.21.15.153:0/981950676 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe780068ff0 con 0x7fe76006b4d0 2024-03-29T04:29:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 5 to deep-scrub 2024-03-29T04:29:32.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.116+0000 7fe787e00640 1 -- 172.21.15.153:0/981950676 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe76006b4d0 msgr2=0x7fe76006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:32.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.116+0000 7fe787e00640 1 --2- 172.21.15.153:0/981950676 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe76006b4d0 0x7fe76006d990 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe76c007fd0 tx=0x7fe76c009040 comp rx=0 tx=0).stop 2024-03-29T04:29:32.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.116+0000 7fe787e00640 1 -- 172.21.15.153:0/981950676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7800b3a60 msgr2=0x7fe7800cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:32.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.116+0000 7fe787e00640 1 --2- 172.21.15.153:0/981950676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7800b3a60 0x7fe7800cbbe0 secure :-1 s=READY pgs=3411 cs=0 l=1 rev1=1 crypto rx=0x7fe77402b9e0 tx=0x7fe7740046c0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.116+0000 7fe787e00640 1 -- 172.21.15.153:0/981950676 shutdown_connections 2024-03-29T04:29:32.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.116+0000 7fe787e00640 1 --2- 172.21.15.153:0/981950676 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe76006b4d0 0x7fe76006d990 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.116+0000 7fe787e00640 1 --2- 172.21.15.153:0/981950676 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe780161990 0x7fe7800b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.116+0000 7fe787e00640 1 --2- 172.21.15.153:0/981950676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7800d2ad0 0x7fe7801f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.116+0000 7fe787e00640 1 --2- 172.21.15.153:0/981950676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7800b3a60 0x7fe7800cbbe0 unknown :-1 s=CLOSED pgs=3411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.116+0000 7fe787e00640 1 -- 172.21.15.153:0/981950676 >> 172.21.15.153:0/981950676 conn(0x7fe78009d430 msgr2=0x7fe780162710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.116+0000 7fe787e00640 1 -- 172.21.15.153:0/981950676 shutdown_connections 2024-03-29T04:29:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.116+0000 7fe787e00640 1 -- 172.21.15.153:0/981950676 wait complete. 2024-03-29T04:29:32.111 INFO:tasks.ceph:Scrubbing osd.6 2024-03-29T04:29:32.112 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:29:32.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.354+0000 7fda8f000640 1 Processor -- start 2024-03-29T04:29:32.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.354+0000 7fda8f000640 1 -- start start 2024-03-29T04:29:32.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.355+0000 7fda8f000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fda881616b0 0x7fda880d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.355+0000 7fda8f000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda880c7b00 con 0x7fda88161a90 2024-03-29T04:29:32.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.355+0000 7fda8f000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda880d2630 con 0x7fda880c9010 2024-03-29T04:29:32.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.355+0000 7fda8f000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fda880d2910 con 0x7fda881616b0 2024-03-29T04:29:32.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.356+0000 7fda8d200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fda88161a90 0x7fda880d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:39072/0 (socket says 172.21.15.153:39072) 2024-03-29T04:29:32.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.356+0000 7fda8d200640 1 -- 172.21.15.153:0/4081612785 learned_addr learned my addr 172.21.15.153:0/4081612785 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:32.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.356+0000 7fda8dc00640 1 --2- 172.21.15.153:0/4081612785 >> v2:172.21.15.165:3300/0 conn(0x7fda881616b0 0x7fda880d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:32.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.356+0000 7fda87e00640 1 -- 172.21.15.153:0/4081612785 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2086363903 0 0) 0x7fda880c7b00 con 0x7fda88161a90 2024-03-29T04:29:32.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.356+0000 7fda87e00640 1 -- 172.21.15.153:0/4081612785 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda70003520 con 0x7fda88161a90 2024-03-29T04:29:32.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda87e00640 1 -- 172.21.15.153:0/4081612785 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 721165983 0 0) 0x7fda70003520 con 0x7fda88161a90 2024-03-29T04:29:32.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda87e00640 1 -- 172.21.15.153:0/4081612785 >> v2:172.21.15.165:3300/0 conn(0x7fda881616b0 msgr2=0x7fda880d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:32.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda87e00640 1 --2- 172.21.15.153:0/4081612785 >> v2:172.21.15.165:3300/0 conn(0x7fda881616b0 0x7fda880d08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda87e00640 1 -- 172.21.15.153:0/4081612785 >> v1:172.21.15.165:6789/0 conn(0x7fda880c9010 legacy=0x7fda880cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:32.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda87e00640 1 -- 172.21.15.153:0/4081612785 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda880d2bf0 con 0x7fda88161a90 2024-03-29T04:29:32.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda87e00640 1 -- 172.21.15.153:0/4081612785 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fda74001670 con 0x7fda88161a90 2024-03-29T04:29:32.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda87e00640 1 -- 172.21.15.153:0/4081612785 >> v1:172.21.15.153:6789/0 conn(0x7fda88161a90 legacy=0x7fda880d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:32.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda87e00640 1 --2- 172.21.15.153:0/4081612785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda700039b0 0x7fda70003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda87e00640 1 --2- 172.21.15.153:0/4081612785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda70004800 0x7fda70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda87e00640 1 --2- 172.21.15.153:0/4081612785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda700051c0 0x7fda7000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda87e00640 1 -- 172.21.15.153:0/4081612785 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda880d2910 con 0x7fda70004800 2024-03-29T04:29:32.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda87e00640 1 -- 172.21.15.153:0/4081612785 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fda7000c040 con 0x7fda700051c0 2024-03-29T04:29:32.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda87e00640 1 -- 172.21.15.153:0/4081612785 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fda7000c240 con 0x7fda700039b0 2024-03-29T04:29:32.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda8d200640 1 --2- 172.21.15.153:0/4081612785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda70004800 0x7fda70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:32.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda8e600640 1 --2- 172.21.15.153:0/4081612785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda700051c0 0x7fda7000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:32.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.357+0000 7fda8dc00640 1 --2- 172.21.15.153:0/4081612785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda700039b0 0x7fda70003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:32.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.358+0000 7fda8d200640 1 -- 172.21.15.153:0/4081612785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda700039b0 msgr2=0x7fda70003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:32.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.358+0000 7fda8d200640 1 --2- 172.21.15.153:0/4081612785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda700039b0 0x7fda70003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.358+0000 7fda8d200640 1 -- 172.21.15.153:0/4081612785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda700051c0 msgr2=0x7fda7000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:32.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.358+0000 7fda8d200640 1 --2- 172.21.15.153:0/4081612785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda700051c0 0x7fda7000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.358+0000 7fda8e600640 1 -- 172.21.15.153:0/4081612785 reap_dead start 2024-03-29T04:29:32.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.358+0000 7fda8d200640 1 -- 172.21.15.153:0/4081612785 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda70003520 con 0x7fda70004800 2024-03-29T04:29:32.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.359+0000 7fda8d200640 1 --2- 172.21.15.153:0/4081612785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda70004800 0x7fda70004c80 secure :-1 s=READY pgs=3413 cs=0 l=1 rev1=1 crypto rx=0x7fda7400c240 tx=0x7fda70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f207a1edde156332 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:32.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.359+0000 7fda87e00640 1 -- 172.21.15.153:0/4081612785 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda74007d10 con 0x7fda70004800 2024-03-29T04:29:32.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.359+0000 7fda87e00640 1 -- 172.21.15.153:0/4081612785 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda74030070 con 0x7fda70004800 2024-03-29T04:29:32.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.359+0000 7fda87e00640 1 -- 172.21.15.153:0/4081612785 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda74005d70 con 0x7fda70004800 2024-03-29T04:29:32.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.360+0000 7fda8f000640 1 -- 172.21.15.153:0/4081612785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda70004800 msgr2=0x7fda70004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:32.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.360+0000 7fda8f000640 1 --2- 172.21.15.153:0/4081612785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda70004800 0x7fda70004c80 secure :-1 s=READY pgs=3413 cs=0 l=1 rev1=1 crypto rx=0x7fda7400c240 tx=0x7fda70005830 comp rx=0 tx=0).stop 2024-03-29T04:29:32.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.360+0000 7fda8f000640 1 -- 172.21.15.153:0/4081612785 shutdown_connections 2024-03-29T04:29:32.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.360+0000 7fda8f000640 1 --2- 172.21.15.153:0/4081612785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda70004800 0x7fda70004c80 unknown :-1 s=CLOSED pgs=3413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.360+0000 7fda8f000640 1 -- 172.21.15.153:0/4081612785 >> 172.21.15.153:0/4081612785 conn(0x7fda880d3fb0 msgr2=0x7fda880d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:32.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.360+0000 7fda8f000640 1 -- 172.21.15.153:0/4081612785 shutdown_connections 2024-03-29T04:29:32.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.360+0000 7fda8f000640 1 -- 172.21.15.153:0/4081612785 wait complete. 2024-03-29T04:29:32.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.362+0000 7fda8f000640 1 Processor -- start 2024-03-29T04:29:32.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.362+0000 7fda8f000640 1 -- start start 2024-03-29T04:29:32.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.363+0000 7fda8f000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda70004800 0x7fda881524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.363+0000 7fda8f000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda8806c800 0x7fda8806cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.363+0000 7fda8f000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda880ccff0 0x7fda880cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.363+0000 7fda8f000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda880d4ed0 con 0x7fda70004800 2024-03-29T04:29:32.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.363+0000 7fda8f000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fda880d4d50 con 0x7fda880ccff0 2024-03-29T04:29:32.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.363+0000 7fda8f000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fda880d08f0 con 0x7fda8806c800 2024-03-29T04:29:32.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.363+0000 7fda8dc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda70004800 0x7fda881524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:32.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.363+0000 7fda8dc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda70004800 0x7fda881524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47572/0 (socket says 172.21.15.153:47572) 2024-03-29T04:29:32.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.363+0000 7fda8dc00640 1 -- 172.21.15.153:0/372874759 learned_addr learned my addr 172.21.15.153:0/372874759 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:32.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.364+0000 7fda8dc00640 1 -- 172.21.15.153:0/372874759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda8806c800 msgr2=0x7fda8806cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:32.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.364+0000 7fda8dc00640 1 --2- 172.21.15.153:0/372874759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda8806c800 0x7fda8806cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.364+0000 7fda8dc00640 1 -- 172.21.15.153:0/372874759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda880ccff0 msgr2=0x7fda880cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:32.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.364+0000 7fda8e600640 1 --2- 172.21.15.153:0/372874759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda880ccff0 0x7fda880cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:32.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.364+0000 7fda8dc00640 1 --2- 172.21.15.153:0/372874759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda880ccff0 0x7fda880cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.364+0000 7fda8dc00640 1 -- 172.21.15.153:0/372874759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda88152be0 con 0x7fda70004800 2024-03-29T04:29:32.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.364+0000 7fda8dc00640 1 --2- 172.21.15.153:0/372874759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda70004800 0x7fda881524c0 secure :-1 s=READY pgs=3414 cs=0 l=1 rev1=1 crypto rx=0x7fda7c007f30 tx=0x7fda7c011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:32.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.364+0000 7fda85600640 1 -- 172.21.15.153:0/372874759 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c01a020 con 0x7fda70004800 2024-03-29T04:29:32.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.364+0000 7fda85600640 1 -- 172.21.15.153:0/372874759 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda7c016470 con 0x7fda70004800 2024-03-29T04:29:32.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.364+0000 7fda85600640 1 -- 172.21.15.153:0/372874759 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c016860 con 0x7fda70004800 2024-03-29T04:29:32.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.364+0000 7fda8f000640 1 -- 172.21.15.153:0/372874759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda88152ec0 con 0x7fda70004800 2024-03-29T04:29:32.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.365+0000 7fda8f000640 1 -- 172.21.15.153:0/372874759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda88153480 con 0x7fda70004800 2024-03-29T04:29:32.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.365+0000 7fda8f000640 1 -- 172.21.15.153:0/372874759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fda88152a00 con 0x7fda70004800 2024-03-29T04:29:32.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.367+0000 7fda85600640 1 -- 172.21.15.153:0/372874759 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fda7c005d10 con 0x7fda70004800 2024-03-29T04:29:32.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.367+0000 7fda85600640 1 --2- 172.21.15.153:0/372874759 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fda6806b500 0x7fda6806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.368+0000 7fda85600640 1 -- 172.21.15.153:0/372874759 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fda7c08ae90 con 0x7fda70004800 2024-03-29T04:29:32.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.368+0000 7fda8d200640 1 --2- 172.21.15.153:0/372874759 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fda6806b500 0x7fda6806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:32.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.368+0000 7fda85600640 1 --2- 172.21.15.153:0/372874759 >> [v2:172.21.15.165:6800/3469035609,v1:172.21.15.165:6801/3469035609] conn(0x7fda680713c0 0x7fda680737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.368+0000 7fda85600640 1 -- 172.21.15.153:0/372874759 --> [v2:172.21.15.165:6800/3469035609,v1:172.21.15.165:6801/3469035609] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda68073e90 con 0x7fda680713c0 2024-03-29T04:29:32.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.368+0000 7fda85600640 1 -- 172.21.15.153:0/372874759 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fda7c08d4b0 con 0x7fda70004800 2024-03-29T04:29:32.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.369+0000 7fda8d200640 1 --2- 172.21.15.153:0/372874759 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fda6806b500 0x7fda6806d9c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fda74034000 tx=0x7fda7402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:32.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.369+0000 7fda8e600640 1 --2- 172.21.15.153:0/372874759 >> [v2:172.21.15.165:6800/3469035609,v1:172.21.15.165:6801/3469035609] conn(0x7fda680713c0 0x7fda680737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:32.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.370+0000 7fda8e600640 1 --2- 172.21.15.153:0/372874759 >> [v2:172.21.15.165:6800/3469035609,v1:172.21.15.165:6801/3469035609] conn(0x7fda680713c0 0x7fda680737e0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:32.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.371+0000 7fda85600640 1 -- 172.21.15.153:0/372874759 <== osd.6 v2:172.21.15.165:6800/3469035609 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fda68073e90 con 0x7fda680713c0 2024-03-29T04:29:32.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.386+0000 7fda8f000640 1 -- 172.21.15.153:0/372874759 --> [v2:172.21.15.165:6800/3469035609,v1:172.21.15.165:6801/3469035609] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fda881538a0 con 0x7fda680713c0 2024-03-29T04:29:32.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.387+0000 7fda85600640 1 -- 172.21.15.153:0/372874759 <== osd.6 v2:172.21.15.165:6800/3469035609 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fda881538a0 con 0x7fda680713c0 2024-03-29T04:29:32.362 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-29T04:29:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:29:32.363 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-29T04:29:32.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.387+0000 7fda8f000640 1 -- 172.21.15.153:0/372874759 >> [v2:172.21.15.165:6800/3469035609,v1:172.21.15.165:6801/3469035609] conn(0x7fda680713c0 msgr2=0x7fda680737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:32.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.387+0000 7fda8f000640 1 --2- 172.21.15.153:0/372874759 >> [v2:172.21.15.165:6800/3469035609,v1:172.21.15.165:6801/3469035609] conn(0x7fda680713c0 0x7fda680737e0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.387+0000 7fda8f000640 1 -- 172.21.15.153:0/372874759 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fda6806b500 msgr2=0x7fda6806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:32.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.387+0000 7fda8f000640 1 --2- 172.21.15.153:0/372874759 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fda6806b500 0x7fda6806d9c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fda74034000 tx=0x7fda7402e000 comp rx=0 tx=0).stop 2024-03-29T04:29:32.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.387+0000 7fda8f000640 1 -- 172.21.15.153:0/372874759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda70004800 msgr2=0x7fda881524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:32.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.387+0000 7fda8f000640 1 --2- 172.21.15.153:0/372874759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda70004800 0x7fda881524c0 secure :-1 s=READY pgs=3414 cs=0 l=1 rev1=1 crypto rx=0x7fda7c007f30 tx=0x7fda7c011660 comp rx=0 tx=0).stop 2024-03-29T04:29:32.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.388+0000 7fda8e600640 1 -- 172.21.15.153:0/372874759 reap_dead start 2024-03-29T04:29:32.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.388+0000 7fda8f000640 1 -- 172.21.15.153:0/372874759 shutdown_connections 2024-03-29T04:29:32.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.388+0000 7fda8f000640 1 -- 172.21.15.153:0/372874759 >> 172.21.15.153:0/372874759 conn(0x7fda880d3fb0 msgr2=0x7fda881566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:32.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.388+0000 7fda8f000640 1 -- 172.21.15.153:0/372874759 shutdown_connections 2024-03-29T04:29:32.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.388+0000 7fda8f000640 1 -- 172.21.15.153:0/372874759 wait complete. 2024-03-29T04:29:32.382 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-29T04:29:32.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.609+0000 7ff77f000640 1 Processor -- start 2024-03-29T04:29:32.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.609+0000 7ff77f000640 1 -- start start 2024-03-29T04:29:32.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.611+0000 7ff77f000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff778145a10 0x7ff77806e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.611+0000 7ff77f000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff778160260 0x7ff778070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.611+0000 7ff77f000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7780cec20 con 0x7ff7780ce360 2024-03-29T04:29:32.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.611+0000 7ff77f000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7ff7780cf830 con 0x7ff778160260 2024-03-29T04:29:32.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.611+0000 7ff77f000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff7780cef00 con 0x7ff778145a10 2024-03-29T04:29:32.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.611+0000 7ff77d000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff778160260 0x7ff778070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:32.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.611+0000 7ff77d000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff778160260 0x7ff778070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47588/0 (socket says 172.21.15.153:47588) 2024-03-29T04:29:32.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.611+0000 7ff77d000640 1 -- 172.21.15.153:0/1887105785 learned_addr learned my addr 172.21.15.153:0/1887105785 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:32.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.612+0000 7ff777e00640 1 --2- 172.21.15.153:0/1887105785 >> v2:172.21.15.165:3300/0 conn(0x7ff778145a10 0x7ff77806e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:32.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.612+0000 7ff77d000640 1 -- 172.21.15.153:0/1887105785 >> v2:172.21.15.165:3300/0 conn(0x7ff778145a10 msgr2=0x7ff77806e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:32.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.612+0000 7ff77d000640 1 --2- 172.21.15.153:0/1887105785 >> v2:172.21.15.165:3300/0 conn(0x7ff778145a10 0x7ff77806e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.612+0000 7ff77d000640 1 -- 172.21.15.153:0/1887105785 >> v1:172.21.15.165:6789/0 conn(0x7ff7780ce360 legacy=0x7ff77815fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:32.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.612+0000 7ff77d000640 1 -- 172.21.15.153:0/1887105785 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7780cf1e0 con 0x7ff778160260 2024-03-29T04:29:32.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.613+0000 7ff77d000640 1 --2- 172.21.15.153:0/1887105785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff778160260 0x7ff778070e70 secure :-1 s=READY pgs=3415 cs=0 l=1 rev1=1 crypto rx=0x7ff7780cf9b0 tx=0x7ff77002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31eef77737b623ea server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:32.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.613+0000 7ff776a00640 1 -- 172.21.15.153:0/1887105785 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77002ca70 con 0x7ff778160260 2024-03-29T04:29:32.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.614+0000 7ff776a00640 1 -- 172.21.15.153:0/1887105785 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff77002cc10 con 0x7ff778160260 2024-03-29T04:29:32.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.614+0000 7ff776a00640 1 -- 172.21.15.153:0/1887105785 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7700343f0 con 0x7ff778160260 2024-03-29T04:29:32.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.614+0000 7ff77f000640 1 -- 172.21.15.153:0/1887105785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff778160260 msgr2=0x7ff778070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:32.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.614+0000 7ff77f000640 1 --2- 172.21.15.153:0/1887105785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff778160260 0x7ff778070e70 secure :-1 s=READY pgs=3415 cs=0 l=1 rev1=1 crypto rx=0x7ff7780cf9b0 tx=0x7ff77002bed0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.615+0000 7ff77f000640 1 -- 172.21.15.153:0/1887105785 shutdown_connections 2024-03-29T04:29:32.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.615+0000 7ff77f000640 1 --2- 172.21.15.153:0/1887105785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff778160260 0x7ff778070e70 unknown :-1 s=CLOSED pgs=3415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.615+0000 7ff77f000640 1 --2- 172.21.15.153:0/1887105785 >> v2:172.21.15.165:3300/0 conn(0x7ff778145a10 0x7ff77806e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.615+0000 7ff77f000640 1 -- 172.21.15.153:0/1887105785 >> 172.21.15.153:0/1887105785 conn(0x7ff7780cfc00 msgr2=0x7ff7780cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:32.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.615+0000 7ff77f000640 1 -- 172.21.15.153:0/1887105785 shutdown_connections 2024-03-29T04:29:32.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.615+0000 7ff77f000640 1 -- 172.21.15.153:0/1887105785 wait complete. 2024-03-29T04:29:32.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.616+0000 7ff77f000640 1 Processor -- start 2024-03-29T04:29:32.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.616+0000 7ff77f000640 1 -- start start 2024-03-29T04:29:32.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.617+0000 7ff77f000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7780ce360 0x7ff7780caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.617+0000 7ff77f000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff778145a10 0x7ff7780cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.617+0000 7ff77f000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff778160260 0x7ff7781f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.617+0000 7ff77f000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff7780ce970 con 0x7ff7780ce360 2024-03-29T04:29:32.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.617+0000 7ff77f000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff7780ce7f0 con 0x7ff778145a10 2024-03-29T04:29:32.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.617+0000 7ff77f000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff7780713b0 con 0x7ff778160260 2024-03-29T04:29:32.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.618+0000 7ff777e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7780ce360 0x7ff7780caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:32.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.618+0000 7ff777e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7780ce360 0x7ff7780caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47598/0 (socket says 172.21.15.153:47598) 2024-03-29T04:29:32.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.618+0000 7ff777e00640 1 -- 172.21.15.153:0/386172241 learned_addr learned my addr 172.21.15.153:0/386172241 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:32.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.618+0000 7ff777400640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff778145a10 0x7ff7780cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:32.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.618+0000 7ff77d000640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff778160260 0x7ff7781f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:32.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.618+0000 7ff777e00640 1 -- 172.21.15.153:0/386172241 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff778160260 msgr2=0x7ff7781f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:32.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.618+0000 7ff777e00640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff778160260 0x7ff7781f4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.618+0000 7ff777e00640 1 -- 172.21.15.153:0/386172241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff778145a10 msgr2=0x7ff7780cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:32.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.618+0000 7ff777e00640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff778145a10 0x7ff7780cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.618+0000 7ff777e00640 1 -- 172.21.15.153:0/386172241 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7780cb9b0 con 0x7ff7780ce360 2024-03-29T04:29:32.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.618+0000 7ff777400640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff778145a10 0x7ff7780cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:32.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.618+0000 7ff777e00640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7780ce360 0x7ff7780caaa0 secure :-1 s=READY pgs=3416 cs=0 l=1 rev1=1 crypto rx=0x7ff76800d800 tx=0x7ff76800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:32.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.619+0000 7ff76fe00640 1 -- 172.21.15.153:0/386172241 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76800b6c0 con 0x7ff7780ce360 2024-03-29T04:29:32.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.619+0000 7ff76fe00640 1 -- 172.21.15.153:0/386172241 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff768019070 con 0x7ff7780ce360 2024-03-29T04:29:32.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.619+0000 7ff76fe00640 1 -- 172.21.15.153:0/386172241 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76800ba80 con 0x7ff7780ce360 2024-03-29T04:29:32.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.619+0000 7ff77f000640 1 -- 172.21.15.153:0/386172241 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7780cb6d0 con 0x7ff7780ce360 2024-03-29T04:29:32.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.619+0000 7ff77f000640 1 -- 172.21.15.153:0/386172241 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7781f56b0 con 0x7ff7780ce360 2024-03-29T04:29:32.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.620+0000 7ff77f000640 1 -- 172.21.15.153:0/386172241 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff778068ff0 con 0x7ff7780ce360 2024-03-29T04:29:32.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.621+0000 7ff76fe00640 1 -- 172.21.15.153:0/386172241 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff76800bc20 con 0x7ff7780ce360 2024-03-29T04:29:32.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.622+0000 7ff76fe00640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff75806b4d0 0x7ff75806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:32.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.622+0000 7ff76fe00640 1 -- 172.21.15.153:0/386172241 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7ff76808a3b0 con 0x7ff7780ce360 2024-03-29T04:29:32.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.622+0000 7ff777400640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff75806b4d0 0x7ff75806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:32.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.623+0000 7ff777400640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff75806b4d0 0x7ff75806d990 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff7781e6c40 tx=0x7ff764009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:32.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.627+0000 7ff76fe00640 1 -- 172.21.15.153:0/386172241 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff768059530 con 0x7ff7780ce360 2024-03-29T04:29:32.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.821+0000 7ff77f000640 1 -- 172.21.15.153:0/386172241 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7ff778072c60 con 0x7ff75806b4d0 2024-03-29T04:29:32.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.822+0000 7ff76fe00640 1 -- 172.21.15.153:0/386172241 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff778072c60 con 0x7ff75806b4d0 2024-03-29T04:29:32.798 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 6 to deep-scrub 2024-03-29T04:29:32.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.825+0000 7ff77f000640 1 -- 172.21.15.153:0/386172241 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff75806b4d0 msgr2=0x7ff75806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:32.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.825+0000 7ff77f000640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff75806b4d0 0x7ff75806d990 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff7781e6c40 tx=0x7ff764009040 comp rx=0 tx=0).stop 2024-03-29T04:29:32.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.825+0000 7ff77f000640 1 -- 172.21.15.153:0/386172241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7780ce360 msgr2=0x7ff7780caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:32.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.825+0000 7ff77f000640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7780ce360 0x7ff7780caaa0 secure :-1 s=READY pgs=3416 cs=0 l=1 rev1=1 crypto rx=0x7ff76800d800 tx=0x7ff76800dcc0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.825+0000 7ff77f000640 1 -- 172.21.15.153:0/386172241 shutdown_connections 2024-03-29T04:29:32.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.825+0000 7ff77f000640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7ff75806b4d0 0x7ff75806d990 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.825+0000 7ff77f000640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff778160260 0x7ff7781f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.825+0000 7ff77f000640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff778145a10 0x7ff7780cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.825+0000 7ff77f000640 1 --2- 172.21.15.153:0/386172241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7780ce360 0x7ff7780caaa0 unknown :-1 s=CLOSED pgs=3416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:32.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.825+0000 7ff77f000640 1 -- 172.21.15.153:0/386172241 >> 172.21.15.153:0/386172241 conn(0x7ff7780cfc00 msgr2=0x7ff77806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:32.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.825+0000 7ff77f000640 1 -- 172.21.15.153:0/386172241 shutdown_connections 2024-03-29T04:29:32.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:32.825+0000 7ff77f000640 1 -- 172.21.15.153:0/386172241 wait complete. 2024-03-29T04:29:32.821 INFO:tasks.ceph:Scrubbing osd.7 2024-03-29T04:29:32.821 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:29:33.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.060+0000 7fcafac00640 1 Processor -- start 2024-03-29T04:29:33.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.060+0000 7fcafac00640 1 -- start start 2024-03-29T04:29:33.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.063+0000 7fcafac00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcaf4140c30 0x7fcaf40cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.063+0000 7fcafac00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf40ce700 con 0x7fcaf4141130 2024-03-29T04:29:33.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.063+0000 7fcafac00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf40ce9e0 con 0x7fcaf413dd20 2024-03-29T04:29:33.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.063+0000 7fcafac00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf40cf310 con 0x7fcaf4140c30 2024-03-29T04:29:33.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.063+0000 7fcaf8c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcaf4140c30 0x7fcaf40cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.064+0000 7fcaf8c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcaf4140c30 0x7fcaf40cf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58300/0 (socket says 172.21.15.153:58300) 2024-03-29T04:29:33.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.064+0000 7fcaebe00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcaf4141130 0x7fcaf4140520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33894/0 (socket says 172.21.15.153:33894) 2024-03-29T04:29:33.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.064+0000 7fcaf8c00640 1 -- 172.21.15.153:0/1396751509 learned_addr learned my addr 172.21.15.153:0/1396751509 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:33.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.064+0000 7fcaf8c00640 1 -- 172.21.15.153:0/1396751509 >> v1:172.21.15.165:6789/0 conn(0x7fcaf413dd20 legacy=0x7fcaf40cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:33.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.064+0000 7fcaf8c00640 1 -- 172.21.15.153:0/1396751509 >> v1:172.21.15.153:6789/0 conn(0x7fcaf4141130 legacy=0x7fcaf4140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.064+0000 7fcaf8c00640 1 -- 172.21.15.153:0/1396751509 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf40cecc0 con 0x7fcaf4140c30 2024-03-29T04:29:33.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.065+0000 7fcaf8c00640 1 --2- 172.21.15.153:0/1396751509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf4140c30 0x7fcaf40cf7a0 secure :-1 s=READY pgs=3418 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40cf490 tx=0x7fcaec02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa163410874c702 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:33.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.065+0000 7fcaf3400640 1 -- 172.21.15.153:0/1396751509 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec02caf0 con 0x7fcaf4140c30 2024-03-29T04:29:33.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.065+0000 7fcaf3400640 1 -- 172.21.15.153:0/1396751509 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaec02cc90 con 0x7fcaf4140c30 2024-03-29T04:29:33.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.065+0000 7fcaf3400640 1 -- 172.21.15.153:0/1396751509 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec034610 con 0x7fcaf4140c30 2024-03-29T04:29:33.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.066+0000 7fcafac00640 1 -- 172.21.15.153:0/1396751509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf4140c30 msgr2=0x7fcaf40cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.066+0000 7fcafac00640 1 --2- 172.21.15.153:0/1396751509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf4140c30 0x7fcaf40cf7a0 secure :-1 s=READY pgs=3418 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40cf490 tx=0x7fcaec02bf50 comp rx=0 tx=0).stop 2024-03-29T04:29:33.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.066+0000 7fcafac00640 1 -- 172.21.15.153:0/1396751509 shutdown_connections 2024-03-29T04:29:33.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.066+0000 7fcafac00640 1 --2- 172.21.15.153:0/1396751509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf4140c30 0x7fcaf40cf7a0 unknown :-1 s=CLOSED pgs=3418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.066+0000 7fcafac00640 1 -- 172.21.15.153:0/1396751509 >> 172.21.15.153:0/1396751509 conn(0x7fcaf406b170 msgr2=0x7fcaf406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:33.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.066+0000 7fcafac00640 1 -- 172.21.15.153:0/1396751509 shutdown_connections 2024-03-29T04:29:33.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.066+0000 7fcafac00640 1 -- 172.21.15.153:0/1396751509 wait complete. 2024-03-29T04:29:33.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.068+0000 7fcafac00640 1 Processor -- start 2024-03-29T04:29:33.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.068+0000 7fcafac00640 1 -- start start 2024-03-29T04:29:33.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.069+0000 7fcafac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcaf413dd20 0x7fcaf40aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.069+0000 7fcafac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf4140c30 0x7fcaf41f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.069+0000 7fcafac00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaf4141130 0x7fcaf4157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.069+0000 7fcafac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf40cd000 con 0x7fcaf4140c30 2024-03-29T04:29:33.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.069+0000 7fcafac00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf413e100 con 0x7fcaf4141130 2024-03-29T04:29:33.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.069+0000 7fcafac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf40b2df0 con 0x7fcaf413dd20 2024-03-29T04:29:33.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.069+0000 7fcaebe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf4140c30 0x7fcaf41f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.070+0000 7fcaebe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf4140c30 0x7fcaf41f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58304/0 (socket says 172.21.15.153:58304) 2024-03-29T04:29:33.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.070+0000 7fcaebe00640 1 -- 172.21.15.153:0/3115380138 learned_addr learned my addr 172.21.15.153:0/3115380138 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:33.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.070+0000 7fcaf3e00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcaf413dd20 0x7fcaf40aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.070+0000 7fcaebe00640 1 -- 172.21.15.153:0/3115380138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcaf413dd20 msgr2=0x7fcaf40aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.070+0000 7fcaf8c00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaf4141130 0x7fcaf4157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.070+0000 7fcaebe00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcaf413dd20 0x7fcaf40aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.070+0000 7fcaebe00640 1 -- 172.21.15.153:0/3115380138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaf4141130 msgr2=0x7fcaf4157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.070+0000 7fcaebe00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaf4141130 0x7fcaf4157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.070+0000 7fcaebe00640 1 -- 172.21.15.153:0/3115380138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf41f6140 con 0x7fcaf4140c30 2024-03-29T04:29:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.070+0000 7fcaf3e00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcaf413dd20 0x7fcaf40aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.070+0000 7fcaebe00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf4140c30 0x7fcaf41f59d0 secure :-1 s=READY pgs=3419 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00c400 tx=0x7fcadc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.070+0000 7fcaf0c00640 1 -- 172.21.15.153:0/3115380138 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc0074e0 con 0x7fcaf4140c30 2024-03-29T04:29:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.071+0000 7fcaf0c00640 1 -- 172.21.15.153:0/3115380138 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcadc007680 con 0x7fcaf4140c30 2024-03-29T04:29:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.071+0000 7fcaf0c00640 1 -- 172.21.15.153:0/3115380138 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc004a00 con 0x7fcaf4140c30 2024-03-29T04:29:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.071+0000 7fcafac00640 1 -- 172.21.15.153:0/3115380138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf41f6420 con 0x7fcaf4140c30 2024-03-29T04:29:33.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.071+0000 7fcafac00640 1 -- 172.21.15.153:0/3115380138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf4142700 con 0x7fcaf4140c30 2024-03-29T04:29:33.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.072+0000 7fcafac00640 1 -- 172.21.15.153:0/3115380138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcaf41f6940 con 0x7fcaf4140c30 2024-03-29T04:29:33.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.073+0000 7fcaf0c00640 1 -- 172.21.15.153:0/3115380138 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fcadc01a020 con 0x7fcaf4140c30 2024-03-29T04:29:33.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.074+0000 7fcaf0c00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcad006b4d0 0x7fcad006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.074+0000 7fcaf0c00640 1 -- 172.21.15.153:0/3115380138 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fcadc089730 con 0x7fcaf4140c30 2024-03-29T04:29:33.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.074+0000 7fcaf0c00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.165:6816/3540151132,v1:172.21.15.165:6817/3540151132] conn(0x7fcad0071390 0x7fcad00737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.074+0000 7fcaf3e00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcad006b4d0 0x7fcad006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.074+0000 7fcaf0c00640 1 -- 172.21.15.153:0/3115380138 --> [v2:172.21.15.165:6816/3540151132,v1:172.21.15.165:6817/3540151132] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcadc011e50 con 0x7fcad0071390 2024-03-29T04:29:33.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.074+0000 7fcaf0c00640 1 -- 172.21.15.153:0/3115380138 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fcadc090050 con 0x7fcaf4140c30 2024-03-29T04:29:33.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.074+0000 7fcaf3e00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcad006b4d0 0x7fcad006d990 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcaf415a670 tx=0x7fcae4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:33.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.075+0000 7fcaf8c00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.165:6816/3540151132,v1:172.21.15.165:6817/3540151132] conn(0x7fcad0071390 0x7fcad00737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.076+0000 7fcaf8c00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.165:6816/3540151132,v1:172.21.15.165:6817/3540151132] conn(0x7fcad0071390 0x7fcad00737b0 crc :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:33.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.078+0000 7fcaf0c00640 1 -- 172.21.15.153:0/3115380138 <== osd.7 v2:172.21.15.165:6816/3540151132 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcadc011e50 con 0x7fcad0071390 2024-03-29T04:29:33.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.092+0000 7fcafac00640 1 -- 172.21.15.153:0/3115380138 --> [v2:172.21.15.165:6816/3540151132,v1:172.21.15.165:6817/3540151132] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcaf4158220 con 0x7fcad0071390 2024-03-29T04:29:33.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.093+0000 7fcaf0c00640 1 -- 172.21.15.153:0/3115380138 <== osd.7 v2:172.21.15.165:6816/3540151132 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcaf4158220 con 0x7fcad0071390 2024-03-29T04:29:33.068 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-29T04:29:33.069 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:29:33.069 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-29T04:29:33.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.093+0000 7fcafac00640 1 -- 172.21.15.153:0/3115380138 >> [v2:172.21.15.165:6816/3540151132,v1:172.21.15.165:6817/3540151132] conn(0x7fcad0071390 msgr2=0x7fcad00737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.093+0000 7fcafac00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.165:6816/3540151132,v1:172.21.15.165:6817/3540151132] conn(0x7fcad0071390 0x7fcad00737b0 crc :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.093+0000 7fcafac00640 1 -- 172.21.15.153:0/3115380138 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcad006b4d0 msgr2=0x7fcad006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.093+0000 7fcafac00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fcad006b4d0 0x7fcad006d990 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcaf415a670 tx=0x7fcae4008040 comp rx=0 tx=0).stop 2024-03-29T04:29:33.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.093+0000 7fcafac00640 1 -- 172.21.15.153:0/3115380138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf4140c30 msgr2=0x7fcaf41f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.093+0000 7fcafac00640 1 --2- 172.21.15.153:0/3115380138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf4140c30 0x7fcaf41f59d0 secure :-1 s=READY pgs=3419 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00c400 tx=0x7fcadc00c8c0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.093+0000 7fcaf8c00640 1 -- 172.21.15.153:0/3115380138 reap_dead start 2024-03-29T04:29:33.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.093+0000 7fcafac00640 1 -- 172.21.15.153:0/3115380138 shutdown_connections 2024-03-29T04:29:33.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.093+0000 7fcafac00640 1 -- 172.21.15.153:0/3115380138 >> 172.21.15.153:0/3115380138 conn(0x7fcaf406b170 msgr2=0x7fcaf4140290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:33.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.093+0000 7fcafac00640 1 -- 172.21.15.153:0/3115380138 shutdown_connections 2024-03-29T04:29:33.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.093+0000 7fcafac00640 1 -- 172.21.15.153:0/3115380138 wait complete. 2024-03-29T04:29:33.085 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-29T04:29:33.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.298+0000 7f83eb200640 1 Processor -- start 2024-03-29T04:29:33.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.298+0000 7f83eb200640 1 -- start start 2024-03-29T04:29:33.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.299+0000 7f83eb200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f83e415b970 0x7f83e415bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.299+0000 7f83eb200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83e415c2d0 con 0x7f83e41445a0 2024-03-29T04:29:33.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.299+0000 7f83eb200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83e40725f0 con 0x7f83e4072030 2024-03-29T04:29:33.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.299+0000 7f83eb200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f83e415b4e0 con 0x7f83e415b970 2024-03-29T04:29:33.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.300+0000 7f83e9e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f83e41445a0 0x7f83e40b42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33902/0 (socket says 172.21.15.153:33902) 2024-03-29T04:29:33.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.300+0000 7f83e9e00640 1 -- 172.21.15.153:0/875568141 learned_addr learned my addr 172.21.15.153:0/875568141 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:33.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.300+0000 7f83ea800640 1 --2- 172.21.15.153:0/875568141 >> v2:172.21.15.153:3300/0 conn(0x7f83e415b970 0x7f83e415bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.300+0000 7f83e8a00640 1 -- 172.21.15.153:0/875568141 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 172386677 0 0) 0x7f83e415c2d0 con 0x7f83e41445a0 2024-03-29T04:29:33.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.300+0000 7f83e8a00640 1 -- 172.21.15.153:0/875568141 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83cc003520 con 0x7f83e41445a0 2024-03-29T04:29:33.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.300+0000 7f83ea800640 1 -- 172.21.15.153:0/875568141 >> v1:172.21.15.165:6789/0 conn(0x7f83e4072030 legacy=0x7f83e415e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:33.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.300+0000 7f83ea800640 1 -- 172.21.15.153:0/875568141 >> v1:172.21.15.153:6789/0 conn(0x7f83e41445a0 legacy=0x7f83e40b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.300+0000 7f83ea800640 1 -- 172.21.15.153:0/875568141 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e40728d0 con 0x7f83e415b970 2024-03-29T04:29:33.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.302+0000 7f83ea800640 1 --2- 172.21.15.153:0/875568141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e415b970 0x7f83e415bd90 secure :-1 s=READY pgs=3421 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009d90 tx=0x7f83e002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b98825224c651b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:33.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.302+0000 7f83e8a00640 1 -- 172.21.15.153:0/875568141 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0039070 con 0x7f83e415b970 2024-03-29T04:29:33.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.302+0000 7f83e8a00640 1 -- 172.21.15.153:0/875568141 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e002cc60 con 0x7f83e415b970 2024-03-29T04:29:33.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.302+0000 7f83e8a00640 1 -- 172.21.15.153:0/875568141 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0034640 con 0x7f83e415b970 2024-03-29T04:29:33.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.302+0000 7f83eb200640 1 -- 172.21.15.153:0/875568141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e415b970 msgr2=0x7f83e415bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.302+0000 7f83eb200640 1 --2- 172.21.15.153:0/875568141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e415b970 0x7f83e415bd90 secure :-1 s=READY pgs=3421 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009d90 tx=0x7f83e002beb0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.302+0000 7f83eb200640 1 -- 172.21.15.153:0/875568141 shutdown_connections 2024-03-29T04:29:33.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.302+0000 7f83eb200640 1 --2- 172.21.15.153:0/875568141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e415b970 0x7f83e415bd90 unknown :-1 s=CLOSED pgs=3421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.302+0000 7f83eb200640 1 -- 172.21.15.153:0/875568141 >> 172.21.15.153:0/875568141 conn(0x7f83e406b350 msgr2=0x7f83e406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:33.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.303+0000 7f83eb200640 1 -- 172.21.15.153:0/875568141 shutdown_connections 2024-03-29T04:29:33.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.303+0000 7f83eb200640 1 -- 172.21.15.153:0/875568141 wait complete. 2024-03-29T04:29:33.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.304+0000 7f83eb200640 1 Processor -- start 2024-03-29T04:29:33.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.304+0000 7f83eb200640 1 -- start start 2024-03-29T04:29:33.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.305+0000 7f83eb200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4072030 0x7f83e41f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.305+0000 7f83eb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e41445a0 0x7f83e40cec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.305+0000 7f83eb200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83e415b970 0x7f83e40cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.305+0000 7f83eb200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f83e4072e90 con 0x7f83e4072030 2024-03-29T04:29:33.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.305+0000 7f83eb200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f83e415f000 con 0x7f83e415b970 2024-03-29T04:29:33.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.305+0000 7f83eb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f83e4144980 con 0x7f83e41445a0 2024-03-29T04:29:33.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.305+0000 7f83e9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4072030 0x7f83e41f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.306+0000 7f83e9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4072030 0x7f83e41f35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58322/0 (socket says 172.21.15.153:58322) 2024-03-29T04:29:33.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.306+0000 7f83e9e00640 1 -- 172.21.15.153:0/1659576739 learned_addr learned my addr 172.21.15.153:0/1659576739 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:33.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.306+0000 7f83e9e00640 1 -- 172.21.15.153:0/1659576739 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e41445a0 msgr2=0x7f83e40cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.306+0000 7f83e9e00640 1 --2- 172.21.15.153:0/1659576739 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e41445a0 0x7f83e40cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.306+0000 7f83e9e00640 1 -- 172.21.15.153:0/1659576739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83e415b970 msgr2=0x7f83e40cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.306+0000 7f83e9e00640 1 --2- 172.21.15.153:0/1659576739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83e415b970 0x7f83e40cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.306+0000 7f83e9e00640 1 -- 172.21.15.153:0/1659576739 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e40af4d0 con 0x7f83e4072030 2024-03-29T04:29:33.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.306+0000 7f83e9e00640 1 --2- 172.21.15.153:0/1659576739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4072030 0x7f83e41f35b0 secure :-1 s=READY pgs=3422 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c500 tx=0x7f83d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:33.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.306+0000 7f83de000640 1 -- 172.21.15.153:0/1659576739 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d8017070 con 0x7f83e4072030 2024-03-29T04:29:33.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.306+0000 7f83de000640 1 -- 172.21.15.153:0/1659576739 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d8005ce0 con 0x7f83e4072030 2024-03-29T04:29:33.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.306+0000 7f83eb200640 1 -- 172.21.15.153:0/1659576739 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e40ad9f0 con 0x7f83e4072030 2024-03-29T04:29:33.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.307+0000 7f83de000640 1 -- 172.21.15.153:0/1659576739 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d8007330 con 0x7f83e4072030 2024-03-29T04:29:33.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.307+0000 7f83eb200640 1 -- 172.21.15.153:0/1659576739 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e40af1f0 con 0x7f83e4072030 2024-03-29T04:29:33.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.308+0000 7f83eb200640 1 -- 172.21.15.153:0/1659576739 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e404f4b0 con 0x7f83e4072030 2024-03-29T04:29:33.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.309+0000 7f83de000640 1 -- 172.21.15.153:0/1659576739 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f83d801a070 con 0x7f83e4072030 2024-03-29T04:29:33.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.310+0000 7f83de000640 1 --2- 172.21.15.153:0/1659576739 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f83c806b4d0 0x7f83c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.310+0000 7f83de000640 1 -- 172.21.15.153:0/1659576739 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f83d80893f0 con 0x7f83e4072030 2024-03-29T04:29:33.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.310+0000 7f83e9400640 1 --2- 172.21.15.153:0/1659576739 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f83c806b4d0 0x7f83c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.310+0000 7f83e9400640 1 --2- 172.21.15.153:0/1659576739 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f83c806b4d0 0x7f83c806d990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f83d4000f60 tx=0x7f83d40079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:33.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.314+0000 7f83de000640 1 -- 172.21.15.153:0/1659576739 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f83d8058620 con 0x7f83e4072030 2024-03-29T04:29:33.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.512+0000 7f83eb200640 1 -- 172.21.15.153:0/1659576739 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f83e40b41a0 con 0x7f83c806b4d0 2024-03-29T04:29:33.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.512+0000 7f83de000640 1 -- 172.21.15.153:0/1659576739 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f83e40b41a0 con 0x7f83c806b4d0 2024-03-29T04:29:33.488 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 7 to deep-scrub 2024-03-29T04:29:33.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.515+0000 7f83eb200640 1 -- 172.21.15.153:0/1659576739 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f83c806b4d0 msgr2=0x7f83c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.515+0000 7f83eb200640 1 --2- 172.21.15.153:0/1659576739 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f83c806b4d0 0x7f83c806d990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f83d4000f60 tx=0x7f83d40079d0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.515+0000 7f83eb200640 1 -- 172.21.15.153:0/1659576739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4072030 msgr2=0x7f83e41f35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.515+0000 7f83eb200640 1 --2- 172.21.15.153:0/1659576739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4072030 0x7f83e41f35b0 secure :-1 s=READY pgs=3422 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c500 tx=0x7f83d800c9c0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.515+0000 7f83eb200640 1 -- 172.21.15.153:0/1659576739 shutdown_connections 2024-03-29T04:29:33.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.515+0000 7f83eb200640 1 --2- 172.21.15.153:0/1659576739 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f83c806b4d0 0x7f83c806d990 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.515+0000 7f83eb200640 1 --2- 172.21.15.153:0/1659576739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83e415b970 0x7f83e40cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.515+0000 7f83eb200640 1 --2- 172.21.15.153:0/1659576739 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e41445a0 0x7f83e40cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.515+0000 7f83eb200640 1 --2- 172.21.15.153:0/1659576739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83e4072030 0x7f83e41f35b0 unknown :-1 s=CLOSED pgs=3422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.515+0000 7f83eb200640 1 -- 172.21.15.153:0/1659576739 >> 172.21.15.153:0/1659576739 conn(0x7f83e406b350 msgr2=0x7f83e415a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:33.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.515+0000 7f83eb200640 1 -- 172.21.15.153:0/1659576739 shutdown_connections 2024-03-29T04:29:33.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.515+0000 7f83eb200640 1 -- 172.21.15.153:0/1659576739 wait complete. 2024-03-29T04:29:33.510 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:29:33.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.738+0000 7f0f04e00640 1 Processor -- start 2024-03-29T04:29:33.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.738+0000 7f0f04e00640 1 -- start start 2024-03-29T04:29:33.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.739+0000 7f0f04e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f00142720 0x7f0f0006e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.739+0000 7f0f04e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0f0006ee20 0x7f0f00072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.739+0000 7f0f04e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f0006db60 con 0x7f0f00072640 2024-03-29T04:29:33.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.740+0000 7f0f04e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f0f00071d60 con 0x7f0f0006ee20 2024-03-29T04:29:33.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.740+0000 7f0f04e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f00142b00 con 0x7f0f00142720 2024-03-29T04:29:33.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.740+0000 7f0efea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0f0006ee20 0x7f0f00072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.740+0000 7f0efea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0f0006ee20 0x7f0f00072100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58336/0 (socket says 172.21.15.153:58336) 2024-03-29T04:29:33.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.740+0000 7f0efea00640 1 -- 172.21.15.153:0/3657995100 learned_addr learned my addr 172.21.15.153:0/3657995100 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:33.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.740+0000 7f0effe00640 1 --1- 172.21.15.153:0/3657995100 >> v1:172.21.15.153:6789/0 conn(0x7f0f00072640 0x7f0f000cd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33904/0 (socket says 172.21.15.153:33904) 2024-03-29T04:29:33.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.740+0000 7f0eff400640 1 --2- 172.21.15.153:0/3657995100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f00142720 0x7f0f0006e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.740+0000 7f0efea00640 1 -- 172.21.15.153:0/3657995100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f00142720 msgr2=0x7f0f0006e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:33.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.740+0000 7f0efea00640 1 --2- 172.21.15.153:0/3657995100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f00142720 0x7f0f0006e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.740+0000 7f0efea00640 1 -- 172.21.15.153:0/3657995100 >> v1:172.21.15.153:6789/0 conn(0x7f0f00072640 legacy=0x7f0f000cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.740+0000 7f0efea00640 1 -- 172.21.15.153:0/3657995100 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f00071a80 con 0x7f0f0006ee20 2024-03-29T04:29:33.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.740+0000 7f0efe000640 1 -- 172.21.15.153:0/3657995100 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2469347316 0 0) 0x7f0f0006db60 con 0x7f0f00072640 2024-03-29T04:29:33.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.742+0000 7f0efea00640 1 --2- 172.21.15.153:0/3657995100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f0006ee20 0x7f0f00072100 secure :-1 s=READY pgs=3424 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009870 tx=0x7f0eec02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55a53ee85130bd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:33.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.742+0000 7f0efe000640 1 -- 172.21.15.153:0/3657995100 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec035020 con 0x7f0f0006ee20 2024-03-29T04:29:33.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.742+0000 7f0efe000640 1 -- 172.21.15.153:0/3657995100 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eec031640 con 0x7f0f0006ee20 2024-03-29T04:29:33.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.742+0000 7f0efe000640 1 -- 172.21.15.153:0/3657995100 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec02d040 con 0x7f0f0006ee20 2024-03-29T04:29:33.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.742+0000 7f0f04e00640 1 -- 172.21.15.153:0/3657995100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f0006ee20 msgr2=0x7f0f00072100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.742+0000 7f0f04e00640 1 --2- 172.21.15.153:0/3657995100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f0006ee20 0x7f0f00072100 secure :-1 s=READY pgs=3424 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009870 tx=0x7f0eec02b8f0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.743+0000 7f0f04e00640 1 -- 172.21.15.153:0/3657995100 shutdown_connections 2024-03-29T04:29:33.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.743+0000 7f0f04e00640 1 --2- 172.21.15.153:0/3657995100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f0006ee20 0x7f0f00072100 unknown :-1 s=CLOSED pgs=3424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.743+0000 7f0f04e00640 1 --2- 172.21.15.153:0/3657995100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f00142720 0x7f0f0006e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.743+0000 7f0f04e00640 1 -- 172.21.15.153:0/3657995100 >> 172.21.15.153:0/3657995100 conn(0x7f0f000b1890 msgr2=0x7f0f000b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:33.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.743+0000 7f0f04e00640 1 -- 172.21.15.153:0/3657995100 shutdown_connections 2024-03-29T04:29:33.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.743+0000 7f0f04e00640 1 -- 172.21.15.153:0/3657995100 wait complete. 2024-03-29T04:29:33.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.744+0000 7f0f04e00640 1 Processor -- start 2024-03-29T04:29:33.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.744+0000 7f0f04e00640 1 -- start start 2024-03-29T04:29:33.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.745+0000 7f0f04e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f00072640 0x7f0f001f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.745+0000 7f0f04e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f00142720 0x7f0f0013d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.745+0000 7f0f04e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f0013d720 0x7f0f001f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.745+0000 7f0f04e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0006e3c0 con 0x7f0f00142720 2024-03-29T04:29:33.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.745+0000 7f0f04e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0006e0e0 con 0x7f0f00072640 2024-03-29T04:29:33.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.745+0000 7f0f04e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f000cde20 con 0x7f0f0013d720 2024-03-29T04:29:33.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.746+0000 7f0efea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f00142720 0x7f0f0013d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.746+0000 7f0efea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f00142720 0x7f0f0013d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58346/0 (socket says 172.21.15.153:58346) 2024-03-29T04:29:33.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.746+0000 7f0efea00640 1 -- 172.21.15.153:0/871432412 learned_addr learned my addr 172.21.15.153:0/871432412 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:33.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.746+0000 7f0eff400640 1 --2- 172.21.15.153:0/871432412 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f00072640 0x7f0f001f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.746+0000 7f0effe00640 1 --2- 172.21.15.153:0/871432412 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f0013d720 0x7f0f001f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.746+0000 7f0efea00640 1 -- 172.21.15.153:0/871432412 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f0013d720 msgr2=0x7f0f001f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.746+0000 7f0efea00640 1 --2- 172.21.15.153:0/871432412 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f0013d720 0x7f0f001f21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.746+0000 7f0efea00640 1 -- 172.21.15.153:0/871432412 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f00072640 msgr2=0x7f0f001f4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.746+0000 7f0efea00640 1 --2- 172.21.15.153:0/871432412 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f00072640 0x7f0f001f4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.746+0000 7f0efea00640 1 -- 172.21.15.153:0/871432412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0015d110 con 0x7f0f00142720 2024-03-29T04:29:33.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.746+0000 7f0efea00640 1 --2- 172.21.15.153:0/871432412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f00142720 0x7f0f0013d1e0 secure :-1 s=READY pgs=3425 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0090b0 tx=0x7f0eec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:33.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.747+0000 7f0ef7400640 1 -- 172.21.15.153:0/871432412 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec040070 con 0x7f0f00142720 2024-03-29T04:29:33.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.747+0000 7f0ef7400640 1 -- 172.21.15.153:0/871432412 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eec0399f0 con 0x7f0f00142720 2024-03-29T04:29:33.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.747+0000 7f0ef7400640 1 -- 172.21.15.153:0/871432412 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec035040 con 0x7f0f00142720 2024-03-29T04:29:33.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.747+0000 7f0f04e00640 1 -- 172.21.15.153:0/871432412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0015d3f0 con 0x7f0f00142720 2024-03-29T04:29:33.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.747+0000 7f0f04e00640 1 -- 172.21.15.153:0/871432412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f0015d9b0 con 0x7f0f00142720 2024-03-29T04:29:33.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.748+0000 7f0f04e00640 1 -- 172.21.15.153:0/871432412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f0013db30 con 0x7f0f00142720 2024-03-29T04:29:33.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.749+0000 7f0ef7400640 1 -- 172.21.15.153:0/871432412 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0eec038020 con 0x7f0f00142720 2024-03-29T04:29:33.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.750+0000 7f0ef7400640 1 --2- 172.21.15.153:0/871432412 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0ee006b500 0x7f0ee006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:33.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.750+0000 7f0ef7400640 1 -- 172.21.15.153:0/871432412 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f0eec0ab980 con 0x7f0f00142720 2024-03-29T04:29:33.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.750+0000 7f0eff400640 1 --2- 172.21.15.153:0/871432412 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0ee006b500 0x7f0ee006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:33.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.751+0000 7f0eff400640 1 --2- 172.21.15.153:0/871432412 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0ee006b500 0x7f0ee006d9c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009e90 tx=0x7f0ef000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:33.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.754+0000 7f0ef7400640 1 -- 172.21.15.153:0/871432412 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0f0013db30 con 0x7f0f00142720 2024-03-29T04:29:33.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.948+0000 7f0f04e00640 1 -- 172.21.15.153:0/871432412 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f0015cec0 con 0x7f0ee006b500 2024-03-29T04:29:33.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.950+0000 7f0ef7400640 1 -- 172.21.15.153:0/871432412 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13584 (secure 0 0 0) 0x7f0f0015cec0 con 0x7f0ee006b500 2024-03-29T04:29:33.926 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:33.929 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-03-29T04:29:33.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.952+0000 7f0f04e00640 1 -- 172.21.15.153:0/871432412 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0ee006b500 msgr2=0x7f0ee006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.952+0000 7f0f04e00640 1 --2- 172.21.15.153:0/871432412 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0ee006b500 0x7f0ee006d9c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009e90 tx=0x7f0ef000b040 comp rx=0 tx=0).stop 2024-03-29T04:29:33.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.952+0000 7f0f04e00640 1 -- 172.21.15.153:0/871432412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f00142720 msgr2=0x7f0f0013d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:33.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.952+0000 7f0f04e00640 1 --2- 172.21.15.153:0/871432412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f00142720 0x7f0f0013d1e0 secure :-1 s=READY pgs=3425 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0090b0 tx=0x7f0eec0046c0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.953+0000 7f0f04e00640 1 -- 172.21.15.153:0/871432412 shutdown_connections 2024-03-29T04:29:33.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.953+0000 7f0f04e00640 1 --2- 172.21.15.153:0/871432412 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f0ee006b500 0x7f0ee006d9c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.953+0000 7f0f04e00640 1 --2- 172.21.15.153:0/871432412 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f0013d720 0x7f0f001f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.953+0000 7f0f04e00640 1 --2- 172.21.15.153:0/871432412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f00142720 0x7f0f0013d1e0 unknown :-1 s=CLOSED pgs=3425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.953+0000 7f0f04e00640 1 --2- 172.21.15.153:0/871432412 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f00072640 0x7f0f001f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:33.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.953+0000 7f0f04e00640 1 -- 172.21.15.153:0/871432412 >> 172.21.15.153:0/871432412 conn(0x7f0f000b1890 msgr2=0x7f0f000cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:33.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.953+0000 7f0f04e00640 1 -- 172.21.15.153:0/871432412 shutdown_connections 2024-03-29T04:29:33.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:33.953+0000 7f0f04e00640 1 -- 172.21.15.153:0/871432412 wait complete. 2024-03-29T04:29:33.946 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":11959,"stamp":"2024-03-29T04:29:31.960149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":11308264,"kb_used_data":4584,"kb_used_omap":55746,"kb_used_meta":11247869,"kb_avail":743666456,"statfs":{"total":773094113280,"available":761514450944,"internally_reserved":0,"allocated":4694016,"data_stored":2558056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57084633,"internal_metadata":11517818151},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":308,"apply_latency_ms":308,"commit_latency_ns":308000000,"apply_latency_ns":308000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004990"},"pg_stats":[{"pgid":"1.0","version":"35'161","reported_seq":451,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-03-29T04:29:19.766409+0000","last_change":"2024-03-28T21:51:51.547812+0000","last_active":"2024-03-29T04:29:19.766409+0000","last_peered":"2024-03-29T04:29:19.766409+0000","last_clean":"2024-03-29T04:29:19.766409+0000","last_became_active":"2024-03-28T21:51:51.545783+0000","last_became_peered":"2024-03-28T21:51:51.545783+0000","last_unstale":"2024-03-29T04:29:19.766409+0000","last_undegraded":"2024-03-29T04:29:19.766409+0000","last_fullsized":"2024-03-29T04:29:19.766409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T21:51:50.185942+0000","last_clean_scrub_stamp":"2024-03-28T21:51:50.185942+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:08:34.531035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129546911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1622840,"kb_used_data":1008,"kb_used_omap":5372,"kb_used_meta":1616451,"kb_avail":92749000,"statfs":{"total":96636764160,"available":94974976000,"internally_reserved":0,"allocated":1032192,"data_stored":762533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5501459,"internal_metadata":1655246317},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":81,"apply_latency_ms":81,"commit_latency_ns":81000000,"apply_latency_ns":81000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129546918,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1501620,"kb_used_data":428,"kb_used_omap":4531,"kb_used_meta":1496652,"kb_avail":92870220,"statfs":{"total":96636764160,"available":95099105280,"internally_reserved":0,"allocated":438272,"data_stored":172165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4640277,"internal_metadata":1532572139},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129546913,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1197172,"kb_used_data":428,"kb_used_omap":7010,"kb_used_meta":1189725,"kb_avail":93174668,"statfs":{"total":96636764160,"available":95410860032,"internally_reserved":0,"allocated":438272,"data_stored":172165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7178678,"internal_metadata":1218278986},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129546910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1296180,"kb_used_data":428,"kb_used_omap":9219,"kb_used_meta":1286524,"kb_avail":93075660,"statfs":{"total":96636764160,"available":95309475840,"internally_reserved":0,"allocated":438272,"data_stored":172165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9441271,"internal_metadata":1317400585},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":70,"apply_latency_ms":70,"commit_latency_ns":70000000,"apply_latency_ns":70000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129546866,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1314676,"kb_used_data":428,"kb_used_omap":11564,"kb_used_meta":1302675,"kb_avail":93057164,"statfs":{"total":96636764160,"available":95290535936,"internally_reserved":0,"allocated":438272,"data_stored":172165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11842450,"internal_metadata":1333939310},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129546890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1668340,"kb_used_data":428,"kb_used_omap":3626,"kb_used_meta":1664277,"kb_avail":92703500,"statfs":{"total":96636764160,"available":94928384000,"internally_reserved":0,"allocated":438272,"data_stored":172165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3713583,"internal_metadata":1704220113},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129546879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1379828,"kb_used_data":428,"kb_used_omap":9461,"kb_used_meta":1369930,"kb_avail":92992012,"statfs":{"total":96636764160,"available":95223820288,"internally_reserved":0,"allocated":438272,"data_stored":172165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9688902,"internal_metadata":1402808506},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129546903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1327608,"kb_used_data":1008,"kb_used_omap":4958,"kb_used_meta":1321633,"kb_avail":93044232,"statfs":{"total":96636764160,"available":95277293568,"internally_reserved":0,"allocated":1032192,"data_stored":762533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5078013,"internal_metadata":1353352195},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:29:33.949 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-28T21:51:50.185942+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=21, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=4, tm_min=29, tm_sec=26, tm_wday=4, tm_yday=89, tm_isdst=0) 2024-03-29T04:29:33.950 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-29T04:29:53.951 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:29:54.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.197+0000 7f6cf7200640 1 Processor -- start 2024-03-29T04:29:54.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.197+0000 7f6cf7200640 1 -- start start 2024-03-29T04:29:54.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.198+0000 7f6cf7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf0159a10 0x7f6cf015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:54.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.198+0000 7f6cf7200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6cf00ad830 0x7f6cf006dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:54.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.199+0000 7f6cf7200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf00b2e60 con 0x7f6cf006e270 2024-03-29T04:29:54.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.199+0000 7f6cf7200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6cf00adc70 con 0x7f6cf00ad830 2024-03-29T04:29:54.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.199+0000 7f6cf7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf0159df0 con 0x7f6cf0159a10 2024-03-29T04:29:54.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.199+0000 7f6cefe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf0159a10 0x7f6cf015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:54.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.199+0000 7f6cef400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6cf00ad830 0x7f6cf006dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:54.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.199+0000 7f6cef400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6cf00ad830 0x7f6cf006dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.153:59080/0 (socket says 172.21.15.153:59080) 2024-03-29T04:29:54.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.199+0000 7f6cef400640 1 -- 172.21.15.153:0/3490191670 learned_addr learned my addr 172.21.15.153:0/3490191670 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:54.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.199+0000 7f6cefe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf0159a10 0x7f6cf015cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.153:57184/0 (socket says 172.21.15.153:57184) 2024-03-29T04:29:54.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.200+0000 7f6cef400640 1 -- 172.21.15.153:0/3490191670 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf0159a10 msgr2=0x7f6cf015cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:54.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.200+0000 7f6cef400640 1 --2- 172.21.15.153:0/3490191670 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf0159a10 0x7f6cf015cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.200+0000 7f6cef400640 1 -- 172.21.15.153:0/3490191670 >> v1:172.21.15.165:6789/0 conn(0x7f6cf006e270 legacy=0x7f6cf015fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:54.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.200+0000 7f6cef400640 1 -- 172.21.15.153:0/3490191670 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf00adf10 con 0x7f6cf00ad830 2024-03-29T04:29:54.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.200+0000 7f6cefe00640 1 --2- 172.21.15.153:0/3490191670 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf0159a10 0x7f6cf015cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:29:54.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.202+0000 7f6cef400640 1 --2- 172.21.15.153:0/3490191670 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf00ad830 0x7f6cf006dd30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009870 tx=0x7f6cdc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c7816616e2b1e02 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:54.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.202+0000 7f6ceea00640 1 -- 172.21.15.153:0/3490191670 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc035020 con 0x7f6cf00ad830 2024-03-29T04:29:54.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.202+0000 7f6ceea00640 1 -- 172.21.15.153:0/3490191670 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cdc031640 con 0x7f6cf00ad830 2024-03-29T04:29:54.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.202+0000 7f6ceea00640 1 -- 172.21.15.153:0/3490191670 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc02d040 con 0x7f6cf00ad830 2024-03-29T04:29:54.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.203+0000 7f6cf7200640 1 -- 172.21.15.153:0/3490191670 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf00ad830 msgr2=0x7f6cf006dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:54.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.203+0000 7f6cf7200640 1 --2- 172.21.15.153:0/3490191670 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf00ad830 0x7f6cf006dd30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009870 tx=0x7f6cdc02b8f0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.203+0000 7f6cf7200640 1 -- 172.21.15.153:0/3490191670 shutdown_connections 2024-03-29T04:29:54.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.203+0000 7f6cf7200640 1 --2- 172.21.15.153:0/3490191670 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf00ad830 0x7f6cf006dd30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.203+0000 7f6cf7200640 1 --2- 172.21.15.153:0/3490191670 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf0159a10 0x7f6cf015cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.203+0000 7f6cf7200640 1 -- 172.21.15.153:0/3490191670 >> 172.21.15.153:0/3490191670 conn(0x7f6cf00b1a30 msgr2=0x7f6cf00b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:54.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.203+0000 7f6cf7200640 1 -- 172.21.15.153:0/3490191670 shutdown_connections 2024-03-29T04:29:54.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.203+0000 7f6cf7200640 1 -- 172.21.15.153:0/3490191670 wait complete. 2024-03-29T04:29:54.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.205+0000 7f6cf7200640 1 Processor -- start 2024-03-29T04:29:54.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.205+0000 7f6cf7200640 1 -- start start 2024-03-29T04:29:54.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.206+0000 7f6cf7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf006e270 0x7f6cf0155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:54.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.206+0000 7f6cf7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf00ad830 0x7f6cf00cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:54.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.206+0000 7f6cf7200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cf0159a10 0x7f6cf00cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:54.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.206+0000 7f6cf7200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf00ae4d0 con 0x7f6cf0159a10 2024-03-29T04:29:54.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.206+0000 7f6cf7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf00b3100 con 0x7f6cf00ad830 2024-03-29T04:29:54.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.206+0000 7f6cf7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf00b4630 con 0x7f6cf006e270 2024-03-29T04:29:54.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.206+0000 7f6cf5200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cf0159a10 0x7f6cf00cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:54.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.206+0000 7f6cf5200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cf0159a10 0x7f6cf00cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42792/0 (socket says 172.21.15.153:42792) 2024-03-29T04:29:54.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.206+0000 7f6cf5200640 1 -- 172.21.15.153:0/45338842 learned_addr learned my addr 172.21.15.153:0/45338842 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:54.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.206+0000 7f6cefe00640 1 --2- 172.21.15.153:0/45338842 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf006e270 0x7f6cf0155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:54.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.206+0000 7f6cef400640 1 --2- 172.21.15.153:0/45338842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf00ad830 0x7f6cf00cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:54.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.207+0000 7f6cf5200640 1 -- 172.21.15.153:0/45338842 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf006e270 msgr2=0x7f6cf0155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:54.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.207+0000 7f6cf5200640 1 --2- 172.21.15.153:0/45338842 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf006e270 0x7f6cf0155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.207+0000 7f6cf5200640 1 -- 172.21.15.153:0/45338842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf00ad830 msgr2=0x7f6cf00cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:54.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.207+0000 7f6cf5200640 1 --2- 172.21.15.153:0/45338842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf00ad830 0x7f6cf00cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.207+0000 7f6cf5200640 1 -- 172.21.15.153:0/45338842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf0156140 con 0x7f6cf0159a10 2024-03-29T04:29:54.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.207+0000 7f6cf5200640 1 --2- 172.21.15.153:0/45338842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cf0159a10 0x7f6cf00cb860 secure :-1 s=READY pgs=3426 cs=0 l=1 rev1=1 crypto rx=0x7f6ce800c7a0 tx=0x7f6ce800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.207+0000 7f6ce7e00640 1 -- 172.21.15.153:0/45338842 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8003b70 con 0x7f6cf0159a10 2024-03-29T04:29:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.207+0000 7f6ce7e00640 1 -- 172.21.15.153:0/45338842 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce8003d30 con 0x7f6cf0159a10 2024-03-29T04:29:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.207+0000 7f6ce7e00640 1 -- 172.21.15.153:0/45338842 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce800aa90 con 0x7f6cf0159a10 2024-03-29T04:29:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.207+0000 7f6cf7200640 1 -- 172.21.15.153:0/45338842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf00cd430 con 0x7f6cf0159a10 2024-03-29T04:29:54.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.207+0000 7f6cf7200640 1 -- 172.21.15.153:0/45338842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf00cd9b0 con 0x7f6cf0159a10 2024-03-29T04:29:54.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.209+0000 7f6cf7200640 1 -- 172.21.15.153:0/45338842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf0068ff0 con 0x7f6cf0159a10 2024-03-29T04:29:54.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.209+0000 7f6ce7e00640 1 -- 172.21.15.153:0/45338842 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f6ce800ac30 con 0x7f6cf0159a10 2024-03-29T04:29:54.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.210+0000 7f6ce7e00640 1 --2- 172.21.15.153:0/45338842 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6cd006b4d0 0x7f6cd006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:54.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.210+0000 7f6ce7e00640 1 -- 172.21.15.153:0/45338842 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f6ce8089ef0 con 0x7f6cf0159a10 2024-03-29T04:29:54.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.211+0000 7f6cefe00640 1 --2- 172.21.15.153:0/45338842 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6cd006b4d0 0x7f6cd006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:54.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.211+0000 7f6cefe00640 1 --2- 172.21.15.153:0/45338842 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6cd006b4d0 0x7f6cd006d990 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00cf130 tx=0x7f6ce0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:54.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.215+0000 7f6ce7e00640 1 -- 172.21.15.153:0/45338842 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6cf0156140 con 0x7f6cf0159a10 2024-03-29T04:29:54.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.408+0000 7f6cf7200640 1 -- 172.21.15.153:0/45338842 --> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6cf0156dc0 con 0x7f6cd006b4d0 2024-03-29T04:29:54.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.410+0000 7f6ce7e00640 1 -- 172.21.15.153:0/45338842 <== mgr.4103 v2:172.21.15.153:6832/1496390417 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13473 (secure 0 0 0) 0x7f6cf0156dc0 con 0x7f6cd006b4d0 2024-03-29T04:29:54.387 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:54.387 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-03-29T04:29:54.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.413+0000 7f6cf7200640 1 -- 172.21.15.153:0/45338842 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6cd006b4d0 msgr2=0x7f6cd006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:54.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.413+0000 7f6cf7200640 1 --2- 172.21.15.153:0/45338842 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6cd006b4d0 0x7f6cd006d990 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00cf130 tx=0x7f6ce0008040 comp rx=0 tx=0).stop 2024-03-29T04:29:54.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.413+0000 7f6cf7200640 1 -- 172.21.15.153:0/45338842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cf0159a10 msgr2=0x7f6cf00cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:54.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.413+0000 7f6cf7200640 1 --2- 172.21.15.153:0/45338842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cf0159a10 0x7f6cf00cb860 secure :-1 s=READY pgs=3426 cs=0 l=1 rev1=1 crypto rx=0x7f6ce800c7a0 tx=0x7f6ce800cc60 comp rx=0 tx=0).stop 2024-03-29T04:29:54.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.413+0000 7f6cf7200640 1 -- 172.21.15.153:0/45338842 shutdown_connections 2024-03-29T04:29:54.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.413+0000 7f6cf7200640 1 --2- 172.21.15.153:0/45338842 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6cd006b4d0 0x7f6cd006d990 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.413+0000 7f6cf7200640 1 --2- 172.21.15.153:0/45338842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cf0159a10 0x7f6cf00cb860 unknown :-1 s=CLOSED pgs=3426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.413+0000 7f6cf7200640 1 --2- 172.21.15.153:0/45338842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf00ad830 0x7f6cf00cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.413+0000 7f6cf7200640 1 --2- 172.21.15.153:0/45338842 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf006e270 0x7f6cf0155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.413+0000 7f6cf7200640 1 -- 172.21.15.153:0/45338842 >> 172.21.15.153:0/45338842 conn(0x7f6cf00b1a30 msgr2=0x7f6cf006d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:54.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.413+0000 7f6cf7200640 1 -- 172.21.15.153:0/45338842 shutdown_connections 2024-03-29T04:29:54.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.413+0000 7f6cf7200640 1 -- 172.21.15.153:0/45338842 wait complete. 2024-03-29T04:29:54.409 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":11970,"stamp":"2024-03-29T04:29:53.966187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":11308264,"kb_used_data":4584,"kb_used_omap":55746,"kb_used_meta":11247869,"kb_avail":743666456,"statfs":{"total":773094113280,"available":761514450944,"internally_reserved":0,"allocated":4694016,"data_stored":2558056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57084633,"internal_metadata":11517818151},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003285"},"pg_stats":[{"pgid":"1.0","version":"38'163","reported_seq":463,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-03-29T04:29:34.406504+0000","last_change":"2024-03-29T04:29:34.406504+0000","last_active":"2024-03-29T04:29:34.406504+0000","last_peered":"2024-03-29T04:29:34.406504+0000","last_clean":"2024-03-29T04:29:34.406504+0000","last_became_active":"2024-03-28T21:51:51.545783+0000","last_became_peered":"2024-03-28T21:51:51.545783+0000","last_unstale":"2024-03-29T04:29:34.406504+0000","last_undegraded":"2024-03-29T04:29:34.406504+0000","last_fullsized":"2024-03-29T04:29:34.406504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'163","last_scrub_stamp":"2024-03-29T04:29:34.406370+0000","last_deep_scrub":"38'163","last_deep_scrub_stamp":"2024-03-29T04:29:34.406370+0000","last_clean_scrub_stamp":"2024-03-29T04:29:34.406370+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:48:33.586559+0000","scrub_duration":262,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129546915,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1622840,"kb_used_data":1008,"kb_used_omap":5372,"kb_used_meta":1616451,"kb_avail":92749000,"statfs":{"total":96636764160,"available":94974976000,"internally_reserved":0,"allocated":1032192,"data_stored":762533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5501459,"internal_metadata":1655246317},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129546923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1501620,"kb_used_data":428,"kb_used_omap":4531,"kb_used_meta":1496652,"kb_avail":92870220,"statfs":{"total":96636764160,"available":95099105280,"internally_reserved":0,"allocated":438272,"data_stored":172165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4640277,"internal_metadata":1532572139},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129546917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1197172,"kb_used_data":428,"kb_used_omap":7010,"kb_used_meta":1189725,"kb_avail":93174668,"statfs":{"total":96636764160,"available":95410860032,"internally_reserved":0,"allocated":438272,"data_stored":172165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7178678,"internal_metadata":1218278986},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129546914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1296180,"kb_used_data":428,"kb_used_omap":9219,"kb_used_meta":1286524,"kb_avail":93075660,"statfs":{"total":96636764160,"available":95309475840,"internally_reserved":0,"allocated":438272,"data_stored":172165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9441271,"internal_metadata":1317400585},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129546870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1314676,"kb_used_data":428,"kb_used_omap":11564,"kb_used_meta":1302675,"kb_avail":93057164,"statfs":{"total":96636764160,"available":95290535936,"internally_reserved":0,"allocated":438272,"data_stored":172165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11842450,"internal_metadata":1333939310},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129546894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1668340,"kb_used_data":428,"kb_used_omap":3626,"kb_used_meta":1664277,"kb_avail":92703500,"statfs":{"total":96636764160,"available":94928384000,"internally_reserved":0,"allocated":438272,"data_stored":172165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3713583,"internal_metadata":1704220113},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129546883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1379828,"kb_used_data":428,"kb_used_omap":9461,"kb_used_meta":1369930,"kb_avail":92992012,"statfs":{"total":96636764160,"available":95223820288,"internally_reserved":0,"allocated":438272,"data_stored":172165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9688902,"internal_metadata":1402808506},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129546907,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1327608,"kb_used_data":1008,"kb_used_omap":4958,"kb_used_meta":1321633,"kb_avail":93044232,"statfs":{"total":96636764160,"available":95277293568,"internally_reserved":0,"allocated":1032192,"data_stored":762533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5078013,"internal_metadata":1353352195},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:29:54.410 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-29T04:29:54.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.620+0000 7fe8e7200640 1 Processor -- start 2024-03-29T04:29:54.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.620+0000 7fe8e7200640 1 -- start start 2024-03-29T04:29:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.622+0000 7fe8e7200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe8e0141db0 0x7fe8e00ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.622+0000 7fe8e7200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e0070df0 con 0x7fe8e00ce7e0 2024-03-29T04:29:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.622+0000 7fe8e7200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e013f2f0 con 0x7fe8e013ef10 2024-03-29T04:29:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.622+0000 7fe8e7200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe8e00cf060 con 0x7fe8e0141db0 2024-03-29T04:29:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.622+0000 7fe8e6800640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe8e00ce7e0 0x7fe8e00712a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38988/0 (socket says 172.21.15.153:38988) 2024-03-29T04:29:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.622+0000 7fe8e6800640 1 -- 172.21.15.153:0/949872036 learned_addr learned my addr 172.21.15.153:0/949872036 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-29T04:29:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.623+0000 7fe8e5400640 1 --2- 172.21.15.153:0/949872036 >> v2:172.21.15.165:3300/0 conn(0x7fe8e0141db0 0x7fe8e00ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:54.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.623+0000 7fe8e4a00640 1 -- 172.21.15.153:0/949872036 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484749375 0 0) 0x7fe8e0070df0 con 0x7fe8e00ce7e0 2024-03-29T04:29:54.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.623+0000 7fe8e4a00640 1 -- 172.21.15.153:0/949872036 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8c8003520 con 0x7fe8e00ce7e0 2024-03-29T04:29:54.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.623+0000 7fe8e4a00640 1 -- 172.21.15.153:0/949872036 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2911224691 0 0) 0x7fe8c8003520 con 0x7fe8e00ce7e0 2024-03-29T04:29:54.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.623+0000 7fe8e4a00640 1 -- 172.21.15.153:0/949872036 >> v2:172.21.15.165:3300/0 conn(0x7fe8e0141db0 msgr2=0x7fe8e00ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:54.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.623+0000 7fe8e4a00640 1 --2- 172.21.15.153:0/949872036 >> v2:172.21.15.165:3300/0 conn(0x7fe8e0141db0 0x7fe8e00ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.623+0000 7fe8e4a00640 1 -- 172.21.15.153:0/949872036 >> v1:172.21.15.165:6789/0 conn(0x7fe8e013ef10 legacy=0x7fe8e01416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:54.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.623+0000 7fe8e4a00640 1 -- 172.21.15.153:0/949872036 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e00cf340 con 0x7fe8e00ce7e0 2024-03-29T04:29:54.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.623+0000 7fe8e4a00640 1 -- 172.21.15.153:0/949872036 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2282412344 0 0) 0x7fe8dc0019f0 con 0x7fe8e00ce7e0 2024-03-29T04:29:54.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.623+0000 7fe8e4a00640 1 -- 172.21.15.153:0/949872036 >> v1:172.21.15.153:6789/0 conn(0x7fe8e00ce7e0 legacy=0x7fe8e00712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:54.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.623+0000 7fe8e4a00640 1 --2- 172.21.15.153:0/949872036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8c8003a00 0x7fe8c8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:54.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.623+0000 7fe8e4a00640 1 --2- 172.21.15.153:0/949872036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8c8004800 0x7fe8c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:54.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.624+0000 7fe8e4a00640 1 --2- 172.21.15.153:0/949872036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8c80051c0 0x7fe8c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:54.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.624+0000 7fe8e4a00640 1 -- 172.21.15.153:0/949872036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e00cf060 con 0x7fe8c8004800 2024-03-29T04:29:54.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.624+0000 7fe8e4a00640 1 -- 172.21.15.153:0/949872036 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c800c0c0 con 0x7fe8c8003a00 2024-03-29T04:29:54.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.624+0000 7fe8e4a00640 1 -- 172.21.15.153:0/949872036 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c800c2c0 con 0x7fe8c80051c0 2024-03-29T04:29:54.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.624+0000 7fe8e5400640 1 --2- 172.21.15.153:0/949872036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8c8004800 0x7fe8c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:54.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.624+0000 7fe8e5e00640 1 --2- 172.21.15.153:0/949872036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8c8003a00 0x7fe8c8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:54.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.624+0000 7fe8e5400640 1 -- 172.21.15.153:0/949872036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8c80051c0 msgr2=0x7fe8c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:54.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.624+0000 7fe8e5400640 1 --2- 172.21.15.153:0/949872036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8c80051c0 0x7fe8c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.624+0000 7fe8e5400640 1 -- 172.21.15.153:0/949872036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8c8003a00 msgr2=0x7fe8c8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:54.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.624+0000 7fe8e5400640 1 --2- 172.21.15.153:0/949872036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8c8003a00 0x7fe8c8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.624+0000 7fe8e5400640 1 -- 172.21.15.153:0/949872036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c8003520 con 0x7fe8c8004800 2024-03-29T04:29:54.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.624+0000 7fe8e5e00640 1 --2- 172.21.15.153:0/949872036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8c8003a00 0x7fe8c8003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:29:54.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.624+0000 7fe8e6800640 1 -- 172.21.15.153:0/949872036 reap_dead start 2024-03-29T04:29:54.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.625+0000 7fe8e5400640 1 --2- 172.21.15.153:0/949872036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8c8004800 0x7fe8c8004c80 secure :-1 s=READY pgs=3428 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009ac0 tx=0x7fe8c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532dd24a7ddc44f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:54.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.626+0000 7fe8e4a00640 1 -- 172.21.15.153:0/949872036 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0039070 con 0x7fe8c8004800 2024-03-29T04:29:54.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.626+0000 7fe8e4a00640 1 -- 172.21.15.153:0/949872036 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d002c6b0 con 0x7fe8c8004800 2024-03-29T04:29:54.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.626+0000 7fe8e4a00640 1 -- 172.21.15.153:0/949872036 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0009690 con 0x7fe8c8004800 2024-03-29T04:29:54.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.626+0000 7fe8e7200640 1 -- 172.21.15.153:0/949872036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8c8004800 msgr2=0x7fe8c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:54.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.626+0000 7fe8e7200640 1 --2- 172.21.15.153:0/949872036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8c8004800 0x7fe8c8004c80 secure :-1 s=READY pgs=3428 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009ac0 tx=0x7fe8c8005830 comp rx=0 tx=0).stop 2024-03-29T04:29:54.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.626+0000 7fe8e7200640 1 -- 172.21.15.153:0/949872036 shutdown_connections 2024-03-29T04:29:54.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.626+0000 7fe8e7200640 1 --2- 172.21.15.153:0/949872036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8c8004800 0x7fe8c8004c80 unknown :-1 s=CLOSED pgs=3428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.626+0000 7fe8e7200640 1 -- 172.21.15.153:0/949872036 >> 172.21.15.153:0/949872036 conn(0x7fe8e00b1820 msgr2=0x7fe8e00b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:54.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.626+0000 7fe8e7200640 1 -- 172.21.15.153:0/949872036 shutdown_connections 2024-03-29T04:29:54.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.626+0000 7fe8e7200640 1 -- 172.21.15.153:0/949872036 wait complete. 2024-03-29T04:29:54.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.628+0000 7fe8e7200640 1 Processor -- start 2024-03-29T04:29:54.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.628+0000 7fe8e7200640 1 -- start start 2024-03-29T04:29:54.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.629+0000 7fe8e7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8c8004800 0x7fe8e015b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:54.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.629+0000 7fe8e7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8e00af260 0x7fe8e00ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:54.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.629+0000 7fe8e7200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e01f3c60 0x7fe8e006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:54.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.629+0000 7fe8e7200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e00cebf0 con 0x7fe8e01f3c60 2024-03-29T04:29:54.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.629+0000 7fe8e7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e00cf900 con 0x7fe8e00af260 2024-03-29T04:29:54.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.629+0000 7fe8e7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e00ced70 con 0x7fe8c8004800 2024-03-29T04:29:54.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.629+0000 7fe8e6800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e01f3c60 0x7fe8e006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:54.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.629+0000 7fe8e6800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e01f3c60 0x7fe8e006dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42814/0 (socket says 172.21.15.153:42814) 2024-03-29T04:29:54.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.629+0000 7fe8e6800640 1 -- 172.21.15.153:0/2732029272 learned_addr learned my addr 172.21.15.153:0/2732029272 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:54.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.630+0000 7fe8e6800640 1 -- 172.21.15.153:0/2732029272 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8c8004800 msgr2=0x7fe8e015b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:54.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.630+0000 7fe8e6800640 1 --2- 172.21.15.153:0/2732029272 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8c8004800 0x7fe8e015b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.630+0000 7fe8e6800640 1 -- 172.21.15.153:0/2732029272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8e00af260 msgr2=0x7fe8e00ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:54.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.630+0000 7fe8e6800640 1 --2- 172.21.15.153:0/2732029272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8e00af260 0x7fe8e00ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.630+0000 7fe8e6800640 1 -- 172.21.15.153:0/2732029272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e01f46b0 con 0x7fe8e01f3c60 2024-03-29T04:29:54.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.630+0000 7fe8e6800640 1 --2- 172.21.15.153:0/2732029272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e01f3c60 0x7fe8e006dd50 secure :-1 s=READY pgs=3429 cs=0 l=1 rev1=1 crypto rx=0x7fe8e006ca90 tx=0x7fe8dc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:54.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.630+0000 7fe8da000640 1 -- 172.21.15.153:0/2732029272 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc004d60 con 0x7fe8e01f3c60 2024-03-29T04:29:54.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.630+0000 7fe8da000640 1 -- 172.21.15.153:0/2732029272 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8dc00a5b0 con 0x7fe8e01f3c60 2024-03-29T04:29:54.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.630+0000 7fe8da000640 1 -- 172.21.15.153:0/2732029272 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc00a9a0 con 0x7fe8e01f3c60 2024-03-29T04:29:54.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.630+0000 7fe8e7200640 1 -- 172.21.15.153:0/2732029272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e01f4990 con 0x7fe8e01f3c60 2024-03-29T04:29:54.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.630+0000 7fe8e7200640 1 -- 172.21.15.153:0/2732029272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e00add40 con 0x7fe8e01f3c60 2024-03-29T04:29:54.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.631+0000 7fe8e7200640 1 -- 172.21.15.153:0/2732029272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e0068ff0 con 0x7fe8e01f3c60 2024-03-29T04:29:54.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.632+0000 7fe8da000640 1 -- 172.21.15.153:0/2732029272 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe8dc011070 con 0x7fe8e01f3c60 2024-03-29T04:29:54.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.633+0000 7fe8da000640 1 --2- 172.21.15.153:0/2732029272 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe8c406b500 0x7fe8c406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:54.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.633+0000 7fe8da000640 1 -- 172.21.15.153:0/2732029272 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fe8dc089770 con 0x7fe8e01f3c60 2024-03-29T04:29:54.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.633+0000 7fe8e5e00640 1 --2- 172.21.15.153:0/2732029272 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe8c406b500 0x7fe8c406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:54.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.634+0000 7fe8e5e00640 1 --2- 172.21.15.153:0/2732029272 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe8c406b500 0x7fe8c406d9c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe8e01f71b0 tx=0x7fe8d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:54.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.638+0000 7fe8da000640 1 -- 172.21.15.153:0/2732029272 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe8dc058850 con 0x7fe8e01f3c60 2024-03-29T04:29:54.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.837+0000 7fe8e7200640 1 -- 172.21.15.153:0/2732029272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fe8e0072c10 con 0x7fe8e01f3c60 2024-03-29T04:29:54.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.844+0000 7fe8da000640 1 -- 172.21.15.153:0/2732029272 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fe8dc058150 con 0x7fe8e01f3c60 2024-03-29T04:29:54.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.844+0000 7fe8da000640 1 -- 172.21.15.153:0/2732029272 <== mon.0 v2:172.21.15.153:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe8dc05c2a0 con 0x7fe8e01f3c60 2024-03-29T04:29:54.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.847+0000 7fe8e7200640 1 -- 172.21.15.153:0/2732029272 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe8c406b500 msgr2=0x7fe8c406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:54.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.847+0000 7fe8e7200640 1 --2- 172.21.15.153:0/2732029272 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe8c406b500 0x7fe8c406d9c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe8e01f71b0 tx=0x7fe8d4009040 comp rx=0 tx=0).stop 2024-03-29T04:29:54.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.847+0000 7fe8e7200640 1 -- 172.21.15.153:0/2732029272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e01f3c60 msgr2=0x7fe8e006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:54.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.847+0000 7fe8e7200640 1 --2- 172.21.15.153:0/2732029272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e01f3c60 0x7fe8e006dd50 secure :-1 s=READY pgs=3429 cs=0 l=1 rev1=1 crypto rx=0x7fe8e006ca90 tx=0x7fe8dc00cb90 comp rx=0 tx=0).stop 2024-03-29T04:29:54.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.848+0000 7fe8e7200640 1 -- 172.21.15.153:0/2732029272 shutdown_connections 2024-03-29T04:29:54.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.848+0000 7fe8e7200640 1 --2- 172.21.15.153:0/2732029272 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7fe8c406b500 0x7fe8c406d9c0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.848+0000 7fe8e7200640 1 --2- 172.21.15.153:0/2732029272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e01f3c60 0x7fe8e006dd50 unknown :-1 s=CLOSED pgs=3429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.848+0000 7fe8e7200640 1 --2- 172.21.15.153:0/2732029272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8e00af260 0x7fe8e00ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.848+0000 7fe8e7200640 1 --2- 172.21.15.153:0/2732029272 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8c8004800 0x7fe8e015b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:54.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.848+0000 7fe8e7200640 1 -- 172.21.15.153:0/2732029272 >> 172.21.15.153:0/2732029272 conn(0x7fe8e00b1820 msgr2=0x7fe8e015d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:54.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.848+0000 7fe8e7200640 1 -- 172.21.15.153:0/2732029272 shutdown_connections 2024-03-29T04:29:54.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:54.848+0000 7fe8e7200640 1 -- 172.21.15.153:0/2732029272 wait complete. 2024-03-29T04:29:54.846 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-29T04:29:54.846 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:29:55.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.077+0000 7f6fa3200640 1 Processor -- start 2024-03-29T04:29:55.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.077+0000 7f6fa3200640 1 -- start start 2024-03-29T04:29:55.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.078+0000 7f6fa3200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6fa4161730 0x7f6fa406c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.079+0000 7f6fa3200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6fa4066f30 0x7f6fa406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.079+0000 7f6fa3200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fa40673f0 con 0x7f6fa4161b10 2024-03-29T04:29:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.079+0000 7f6fa3200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 -- 0x7f6fa40b4910 con 0x7f6fa4066f30 2024-03-29T04:29:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.079+0000 7f6fa3200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6fa40b42c0 con 0x7f6fa4161730 2024-03-29T04:29:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.079+0000 7f6fa1400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6fa4066f30 0x7f6fa406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.079+0000 7f6fa1400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6fa4066f30 0x7f6fa406c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42816/0 (socket says 172.21.15.153:42816) 2024-03-29T04:29:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.079+0000 7f6fa1400640 1 -- 172.21.15.153:0/4130855956 learned_addr learned my addr 172.21.15.153:0/4130855956 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.079+0000 7f6fa2800640 1 --1- 172.21.15.153:0/4130855956 >> v1:172.21.15.153:6789/0 conn(0x7f6fa4161b10 0x7f6fa40ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38992/0 (socket says 172.21.15.153:38992) 2024-03-29T04:29:55.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.079+0000 7f6fa1e00640 1 --2- 172.21.15.153:0/4130855956 >> v2:172.21.15.165:3300/0 conn(0x7f6fa4161730 0x7f6fa406c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:55.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.079+0000 7f6fa1400640 1 -- 172.21.15.153:0/4130855956 >> v2:172.21.15.165:3300/0 conn(0x7f6fa4161730 msgr2=0x7f6fa406c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:29:55.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.079+0000 7f6fa1400640 1 --2- 172.21.15.153:0/4130855956 >> v2:172.21.15.165:3300/0 conn(0x7f6fa4161730 0x7f6fa406c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:55.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.079+0000 7f6fa1400640 1 -- 172.21.15.153:0/4130855956 >> v1:172.21.15.153:6789/0 conn(0x7f6fa4161b10 legacy=0x7f6fa40ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:55.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.079+0000 7f6fa1400640 1 -- 172.21.15.153:0/4130855956 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa40b45a0 con 0x7f6fa4066f30 2024-03-29T04:29:55.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.081+0000 7f6fa1400640 1 --2- 172.21.15.153:0/4130855956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa4066f30 0x7f6fa406c6c0 secure :-1 s=READY pgs=3431 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4071170 tx=0x7f6f9002b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e721a7a108865bc server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:55.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.081+0000 7f6fa0a00640 1 -- 172.21.15.153:0/4130855956 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90034070 con 0x7f6fa4066f30 2024-03-29T04:29:55.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.081+0000 7f6fa0a00640 1 -- 172.21.15.153:0/4130855956 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6f90030870 con 0x7f6fa4066f30 2024-03-29T04:29:55.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.081+0000 7f6fa0a00640 1 -- 172.21.15.153:0/4130855956 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90030c60 con 0x7f6fa4066f30 2024-03-29T04:29:55.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.082+0000 7f6fa3200640 1 -- 172.21.15.153:0/4130855956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa4066f30 msgr2=0x7f6fa406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:55.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.082+0000 7f6fa3200640 1 --2- 172.21.15.153:0/4130855956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa4066f30 0x7f6fa406c6c0 secure :-1 s=READY pgs=3431 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4071170 tx=0x7f6f9002b9b0 comp rx=0 tx=0).stop 2024-03-29T04:29:55.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.082+0000 7f6fa3200640 1 -- 172.21.15.153:0/4130855956 shutdown_connections 2024-03-29T04:29:55.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.082+0000 7f6fa3200640 1 --2- 172.21.15.153:0/4130855956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa4066f30 0x7f6fa406c6c0 unknown :-1 s=CLOSED pgs=3431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:55.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.082+0000 7f6fa3200640 1 --2- 172.21.15.153:0/4130855956 >> v2:172.21.15.165:3300/0 conn(0x7f6fa4161730 0x7f6fa406c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:55.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.082+0000 7f6fa3200640 1 -- 172.21.15.153:0/4130855956 >> 172.21.15.153:0/4130855956 conn(0x7f6fa40715e0 msgr2=0x7f6fa40719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:55.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.082+0000 7f6fa3200640 1 -- 172.21.15.153:0/4130855956 shutdown_connections 2024-03-29T04:29:55.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.082+0000 7f6fa3200640 1 -- 172.21.15.153:0/4130855956 wait complete. 2024-03-29T04:29:55.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.083+0000 7f6fa3200640 1 Processor -- start 2024-03-29T04:29:55.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.084+0000 7f6fa3200640 1 -- start start 2024-03-29T04:29:55.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.085+0000 7f6fa3200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa4066f30 0x7f6fa4154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:55.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.085+0000 7f6fa3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fa4161730 0x7f6fa415d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:55.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.085+0000 7f6fa3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6fa4161b10 0x7f6fa40b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:55.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.085+0000 7f6fa3200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa40cf6f0 con 0x7f6fa4066f30 2024-03-29T04:29:55.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.085+0000 7f6fa3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa40cf570 con 0x7f6fa4161730 2024-03-29T04:29:55.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.085+0000 7f6fa3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa406e750 con 0x7f6fa4161b10 2024-03-29T04:29:55.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.085+0000 7f6fa1e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa4066f30 0x7f6fa4154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:55.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.085+0000 7f6fa1e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa4066f30 0x7f6fa4154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42822/0 (socket says 172.21.15.153:42822) 2024-03-29T04:29:55.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.085+0000 7f6fa1e00640 1 -- 172.21.15.153:0/647357774 learned_addr learned my addr 172.21.15.153:0/647357774 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-29T04:29:55.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.085+0000 7f6fa1e00640 1 -- 172.21.15.153:0/647357774 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6fa4161b10 msgr2=0x7f6fa40b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:55.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.085+0000 7f6fa1e00640 1 --2- 172.21.15.153:0/647357774 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6fa4161b10 0x7f6fa40b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:55.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.085+0000 7f6fa1e00640 1 -- 172.21.15.153:0/647357774 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fa4161730 msgr2=0x7f6fa415d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:55.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.085+0000 7f6fa1e00640 1 --2- 172.21.15.153:0/647357774 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fa4161730 0x7f6fa415d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:55.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.085+0000 7f6fa1e00640 1 -- 172.21.15.153:0/647357774 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa415d890 con 0x7f6fa4066f30 2024-03-29T04:29:55.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.086+0000 7f6fa1e00640 1 --2- 172.21.15.153:0/647357774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa4066f30 0x7f6fa4154080 secure :-1 s=READY pgs=3432 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400c7f0 tx=0x7f6f9400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:55.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.086+0000 7f6f9a000640 1 -- 172.21.15.153:0/647357774 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94015070 con 0x7f6fa4066f30 2024-03-29T04:29:55.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.086+0000 7f6f9a000640 1 -- 172.21.15.153:0/647357774 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6f94004240 con 0x7f6fa4066f30 2024-03-29T04:29:55.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.086+0000 7f6f9a000640 1 -- 172.21.15.153:0/647357774 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94007620 con 0x7f6fa4066f30 2024-03-29T04:29:55.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.086+0000 7f6fa3200640 1 -- 172.21.15.153:0/647357774 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa41f4830 con 0x7f6fa4066f30 2024-03-29T04:29:55.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.086+0000 7f6fa3200640 1 -- 172.21.15.153:0/647357774 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa415c870 con 0x7f6fa4066f30 2024-03-29T04:29:55.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.087+0000 7f6fa3200640 1 -- 172.21.15.153:0/647357774 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa404f520 con 0x7f6fa4066f30 2024-03-29T04:29:55.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.088+0000 7f6f9a000640 1 -- 172.21.15.153:0/647357774 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f6f940079f0 con 0x7f6fa4066f30 2024-03-29T04:29:55.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.089+0000 7f6f9a000640 1 --2- 172.21.15.153:0/647357774 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6f8406b4d0 0x7f6f8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:29:55.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.089+0000 7f6f9a000640 1 -- 172.21.15.153:0/647357774 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f6f9408a3f0 con 0x7f6fa4066f30 2024-03-29T04:29:55.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.089+0000 7f6fa1400640 1 --2- 172.21.15.153:0/647357774 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6f8406b4d0 0x7f6f8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:29:55.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.090+0000 7f6fa1400640 1 --2- 172.21.15.153:0/647357774 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6f8406b4d0 0x7f6f8406d990 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6f90036000 tx=0x7f6f9003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:29:55.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.093+0000 7f6f9a000640 1 -- 172.21.15.153:0/647357774 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6f940594d0 con 0x7f6fa4066f30 2024-03-29T04:29:55.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.329+0000 7f6fa3200640 1 -- 172.21.15.153:0/647357774 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fa40af7d0 con 0x7f6fa4066f30 2024-03-29T04:29:55.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.330+0000 7f6f9a000640 1 -- 172.21.15.153:0/647357774 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3879 (secure 0 0 0) 0x7f6f94058dd0 con 0x7f6fa4066f30 2024-03-29T04:29:55.307 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-29T04:29:55.307 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3849778471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3849778471},{"type":"v1","addr":"172.21.15.165:6835","nonce":3849778471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/2718440878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2718440878},{"type":"v1","addr":"172.21.15.165:6833","nonce":2718440878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6836/974086107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6835","nonce":974086107},{"type":"v1","addr":"172.21.15.153:6836","nonce":974086107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":14052,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3576609615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3576609615},{"type":"v1","addr":"172.21.15.153:6837","nonce":3576609615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-03-29T04:29:55.307 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 19 2024-03-29T04:29:55.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.333+0000 7f6fa3200640 1 -- 172.21.15.153:0/647357774 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6f8406b4d0 msgr2=0x7f6f8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:55.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.333+0000 7f6fa3200640 1 --2- 172.21.15.153:0/647357774 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6f8406b4d0 0x7f6f8406d990 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6f90036000 tx=0x7f6f9003b040 comp rx=0 tx=0).stop 2024-03-29T04:29:55.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.333+0000 7f6fa3200640 1 -- 172.21.15.153:0/647357774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa4066f30 msgr2=0x7f6fa4154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:29:55.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.333+0000 7f6fa3200640 1 --2- 172.21.15.153:0/647357774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa4066f30 0x7f6fa4154080 secure :-1 s=READY pgs=3432 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400c7f0 tx=0x7f6f9400ccb0 comp rx=0 tx=0).stop 2024-03-29T04:29:55.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.333+0000 7f6fa3200640 1 -- 172.21.15.153:0/647357774 shutdown_connections 2024-03-29T04:29:55.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.333+0000 7f6fa3200640 1 --2- 172.21.15.153:0/647357774 >> [v2:172.21.15.153:6832/1496390417,v1:172.21.15.153:6833/1496390417] conn(0x7f6f8406b4d0 0x7f6f8406d990 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:55.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.333+0000 7f6fa3200640 1 --2- 172.21.15.153:0/647357774 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6fa4161b10 0x7f6fa40b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:55.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.333+0000 7f6fa3200640 1 --2- 172.21.15.153:0/647357774 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fa4161730 0x7f6fa415d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:55.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.333+0000 7f6fa3200640 1 --2- 172.21.15.153:0/647357774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa4066f30 0x7f6fa4154080 unknown :-1 s=CLOSED pgs=3432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:29:55.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.333+0000 7f6fa3200640 1 -- 172.21.15.153:0/647357774 >> 172.21.15.153:0/647357774 conn(0x7f6fa40715e0 msgr2=0x7f6fa40ae0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:29:55.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.333+0000 7f6fa3200640 1 -- 172.21.15.153:0/647357774 shutdown_connections 2024-03-29T04:29:55.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-29T04:29:55.333+0000 7f6fa3200640 1 -- 172.21.15.153:0/647357774 wait complete. 2024-03-29T04:29:55.328 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-29T04:29:55.328 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-29T04:29:55.328 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-29T04:29:55.329 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:29:55.348 INFO:tasks.ceph.mds.a:Stopped 2024-03-29T04:29:55.349 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-29T04:29:55.349 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:29:55.412 INFO:tasks.ceph.mds.c:Stopped 2024-03-29T04:29:55.413 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-29T04:29:55.413 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:29:55.443 INFO:tasks.ceph.mds.b:Stopped 2024-03-29T04:29:55.444 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-29T04:29:55.444 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:29:55.514 INFO:tasks.ceph.mds.d:Stopped 2024-03-29T04:29:55.514 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-29T04:29:55.514 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-29T04:29:55.514 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:30:00.867 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-03-29T04:30:01.616 INFO:tasks.ceph.osd.0:Stopped 2024-03-29T04:30:01.617 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-29T04:30:01.617 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:30:06.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-03-29T04:30:06.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-03-29T04:30:07.719 INFO:tasks.ceph.osd.1:Stopped 2024-03-29T04:30:07.719 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-29T04:30:07.719 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:30:12.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-29T04:30:12.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-03-29T04:30:13.821 INFO:tasks.ceph.osd.2:Stopped 2024-03-29T04:30:13.821 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-29T04:30:13.821 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:30:18.895 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-29T04:30:18.895 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-03-29T04:30:19.923 INFO:tasks.ceph.osd.3:Stopped 2024-03-29T04:30:19.923 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-29T04:30:19.923 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:30:24.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-03-29T04:30:24.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-29T04:30:26.025 INFO:tasks.ceph.osd.4:Stopped 2024-03-29T04:30:26.026 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-29T04:30:26.026 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:30:30.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-29T04:30:30.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-03-29T04:30:32.128 INFO:tasks.ceph.osd.5:Stopped 2024-03-29T04:30:32.128 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-29T04:30:32.128 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:30:36.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-03-29T04:30:36.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-03-29T04:30:38.230 INFO:tasks.ceph.osd.6:Stopped 2024-03-29T04:30:38.230 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-29T04:30:38.230 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:30:41.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-29T04:30:41.523 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-03-29T04:30:44.332 INFO:tasks.ceph.osd.7:Stopped 2024-03-29T04:30:44.333 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-29T04:30:44.333 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-29T04:30:44.333 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:30:46.926 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-03-29T04:30:46.926 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-29T04:30:50.435 INFO:tasks.ceph.mgr.y:Stopped 2024-03-29T04:30:50.436 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-29T04:30:50.436 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:30:50.519 INFO:tasks.ceph.mgr.x:Stopped 2024-03-29T04:30:50.519 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-29T04:30:50.519 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-29T04:30:50.519 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:30:52.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-03-29T04:30:52.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-03-29T04:30:56.621 INFO:tasks.ceph.mon.a:Stopped 2024-03-29T04:30:56.621 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-29T04:30:56.621 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:30:56.689 INFO:tasks.ceph.mon.b:Stopped 2024-03-29T04:30:56.689 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-29T04:30:56.689 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:30:56.749 INFO:tasks.ceph.mon.c:Stopped 2024-03-29T04:30:56.749 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-29T04:30:56.750 DEBUG:teuthology.orchestra.run.smithi153:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-29T04:30:56.938 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-29T04:30:56.939 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-29T04:30:57.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-03-29T04:30:57.198 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-29T04:30:57.198 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-29T04:30:57.494 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-29T04:30:57.494 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-29T04:30:57.762 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-29T04:30:57.762 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-29T04:30:58.060 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi165.front.sepia.ceph.com 2024-03-29T04:30:58.060 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-29T04:30:58.617 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi165.front.sepia.ceph.com 2024-03-29T04:30:58.617 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-29T04:30:58.907 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi165.front.sepia.ceph.com 2024-03-29T04:30:58.907 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-29T04:30:59.168 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi165.front.sepia.ceph.com 2024-03-29T04:30:59.168 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-29T04:30:59.461 INFO:tasks.ceph:Archiving mon data... 2024-03-29T04:30:59.462 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059/data/mon.a.tgz 2024-03-29T04:30:59.463 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-03-29T04:30:59.523 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.z0LzQK6Ax4 2024-03-29T04:30:59.523 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.z0LzQK6Ax4 2024-03-29T04:30:59.761 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.z0LzQK6Ax4 2024-03-29T04:30:59.928 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.z0LzQK6Ax4 is 638KB 2024-03-29T04:31:00.053 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.z0LzQK6Ax4 2024-03-29T04:31:00.111 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059/data/mon.b.tgz 2024-03-29T04:31:00.112 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2024-03-29T04:31:00.168 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.Zu90xIqvG8 2024-03-29T04:31:00.169 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Zu90xIqvG8 2024-03-29T04:31:00.385 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.Zu90xIqvG8 2024-03-29T04:31:00.578 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.Zu90xIqvG8 is 642KB 2024-03-29T04:31:00.695 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.Zu90xIqvG8 2024-03-29T04:31:00.752 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059/data/mon.c.tgz 2024-03-29T04:31:00.752 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2024-03-29T04:31:00.803 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.3zDDJB54iq 2024-03-29T04:31:00.803 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3zDDJB54iq 2024-03-29T04:31:01.006 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.3zDDJB54iq 2024-03-29T04:31:01.157 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.3zDDJB54iq is 642KB 2024-03-29T04:31:01.269 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.3zDDJB54iq 2024-03-29T04:31:01.325 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-29T04:31:01.325 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-29T04:31:01.334 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-29T04:31:01.592 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-29T04:31:01.650 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-29T04:31:01.650 INFO:tasks.ceph:Archiving crash dumps... 2024-03-29T04:31:01.652 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059/remote/smithi153/crash 2024-03-29T04:31:01.653 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-29T04:31:01.751 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059/remote/smithi165/crash 2024-03-29T04:31:01.752 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-29T04:31:01.846 INFO:tasks.ceph:Shutting down logrotate 2024-03-29T04:31:01.847 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi153 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-29T04:31:01.875 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-29T04:31:01.886 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph_55f5138942aa4866e49329c9103468889cec3f73/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi153 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-29T04:31:01.890 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-29T04:31:01.890 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-29T04:31:01.907 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-29T04:31:02.046 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-29T04:31:02.056 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-29T04:31:02.056 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-29T04:31:02.064 DEBUG:teuthology.orchestra.run.smithi165:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-29T04:31:02.110 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-03-29T04:31:02.119 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-03-29T04:31:02.135 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-29T04:31:02.135 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-03-29T04:31:02.135 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 40 +85us[ +85us] +/- 76ms 2024-03-29T04:31:02.135 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv02.front.sepia.ceph.com 3 6 377 48 -1349us[-1343us] +/- 59ms 2024-03-29T04:31:02.135 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 47 +1751us[+1751us] +/- 84ms 2024-03-29T04:31:02.135 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-03-29T04:31:02.140 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-29T04:31:02.140 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-03-29T04:31:02.140 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 234 +77us[ +99us] +/- 74ms 2024-03-29T04:31:02.140 INFO:teuthology.orchestra.run.smithi165.stdout:^* hv02.front.sepia.ceph.com 3 7 377 30 -1354us[-1345us] +/- 59ms 2024-03-29T04:31:02.141 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 37 +1736us[+1746us] +/- 84ms 2024-03-29T04:31:02.141 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-03-29T04:31:02.142 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-29T04:31:02.151 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-29T04:31:02.151 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-29T04:31:02.160 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-29T04:31:02.488 DEBUG:teuthology.orchestra.run.smithi165:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-29T04:31:02.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-29T04:31:02.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:31:02.819 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-29T04:31:02.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:31:02.925 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-29T04:31:02.935 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-29T04:31:02.955 INFO:teuthology.task.internal:Duration was 24522.352402 seconds 2024-03-29T04:31:02.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-29T04:31:02.964 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-29T04:31:02.964 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-29T04:31:02.972 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-29T04:31:03.155 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-29T04:31:03.180 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-29T04:31:03.613 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-29T04:31:03.614 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-03-29T04:31:03.614 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-29T04:31:03.680 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi165.front.sepia.ceph.com 2024-03-29T04:31:03.680 DEBUG:teuthology.orchestra.run.smithi165:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-29T04:31:03.758 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-29T04:31:03.759 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-29T04:31:03.766 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-29T04:31:03.868 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-29T04:31:03.868 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-29T04:31:03.873 DEBUG:teuthology.orchestra.run.smithi165:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-29T04:31:04.384 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-29T04:31:04.395 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-29T04:31:04.395 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-29T04:31:04.488 DEBUG:teuthology.orchestra.run.smithi165:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-29T04:31:04.607 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-29T04:31:04.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-29T04:31:04.626 DEBUG:teuthology.orchestra.run.smithi165:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-29T04:31:04.737 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-03-29T04:31:04.754 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = core 2024-03-29T04:31:04.821 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-29T04:31:04.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:31:04.875 DEBUG:teuthology.orchestra.run.smithi165:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-29T04:31:04.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:31:04.929 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-29T04:31:04.939 INFO:teuthology.task.internal:Transferring archived files... 2024-03-29T04:31:04.940 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059/remote/smithi153 2024-03-29T04:31:04.940 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-29T04:31:05.054 DEBUG:teuthology.misc:Transferring archived files from smithi165:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059/remote/smithi165 2024-03-29T04:31:05.054 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-29T04:31:05.159 INFO:teuthology.task.internal:Removing archive directory... 2024-03-29T04:31:05.159 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-29T04:31:05.168 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-29T04:31:05.223 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-29T04:31:05.236 INFO:teuthology.task.internal:Not uploading archives. 2024-03-29T04:31:05.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-29T04:31:05.247 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-29T04:31:05.247 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-29T04:31:05.255 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-29T04:31:05.304 INFO:teuthology.orchestra.run.smithi153.stdout: 393809 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 29 04:31 /home/ubuntu/cephtest 2024-03-29T04:31:05.310 INFO:teuthology.orchestra.run.smithi165.stdout: 395133 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 29 04:31 /home/ubuntu/cephtest 2024-03-29T04:31:05.313 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-29T04:31:05.324 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-29T04:31:05.372 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi153 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-03-29T04:31:05.373 INFO:teuthology.nuke:Checking targets against current locks 2024-03-29T04:31:05.401 DEBUG:teuthology.nuke:shortname: smithi153 2024-03-29T04:31:05.401 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-29T04:31:05.422 DEBUG:teuthology.nuke:shortname: smithi165 2024-03-29T04:31:05.422 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-29T04:31:05.428 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-28 21:32:12.138608', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNyOn+XjEEeviiRfh8n2NmY+aed5azVsvfvaq3kTllg3aA9QgGG2vUXMxHMAGJOgP1qq2fzaLhDYXpFLDGi22ZE='} 2024-03-29T04:31:05.443 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi165.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-27_21:24:03-fs-squid-distro-default-smithi/7627059', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-28 21:32:12.137257', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPK0PWKqju/yAHgFV04dllBlqvQvg+g5UAX7WuVR1JQ61iINE4wq0MbSs4qy2l8xIk/fXIda2zvHNEWJxHU/dWQ='} 2024-03-29T04:31:05.474 INFO:teuthology.orchestra.console.smithi153:Power off 2024-03-29T04:31:05.474 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-29T04:31:05.490 INFO:teuthology.orchestra.console.smithi165:Power off 2024-03-29T04:31:05.490 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-29T04:31:05.499 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2024-03-29T04:31:05.500 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T04:31:05.513 DEBUG:teuthology.orchestra.console.smithi165:power off output: Chassis Power Control: Down/Off 2024-03-29T04:31:05.513 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T04:31:05.523 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-03-29T04:31:05.538 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on 2024-03-29T04:31:09.524 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T04:31:09.538 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T04:31:09.636 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-03-29T04:31:09.649 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on 2024-03-29T04:31:13.638 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T04:31:13.650 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T04:31:13.750 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-03-29T04:31:13.761 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off 2024-03-29T04:31:13.851 INFO:teuthology.orchestra.console.smithi153:Power off completed 2024-03-29T04:31:13.862 INFO:teuthology.orchestra.console.smithi165:Power off completed 2024-03-29T04:31:13.968 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 client.1-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} duration: 24522.3524017334 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ad327ec86d4545df8fb5dad6611ad84b status: fail success: false 2024-03-29T04:31:13.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T04:31:14.059 INFO:teuthology.run:FAIL